2024-09-19T06:27:16.273 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T06:27:16.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:27:16.390 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911751' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ/GzFe1n0myQT95ewVotnu45HLfAj2MHVVeL6xjS7aMsuOTAk4VRqCDOsF69g5owf1GQjkC9KFytQ3OolONfg4= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSdLYUlpb0quUzk5niyeQx3iHKAYjN0U0pKCGyPczDVZeQVXFDSw6QkZwAtKDGRlJru8s795PAMDDfDN3O/lUQ= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK6TMTvRYvXyz6BcvpWrtDSLBY5w3hATVJoSvHJRsziTpvTrqJOMxoTymmma9hPimdZdmkKpWNlZ5uQs2b6lMgo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T06:27:16.391 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T06:27:16.391 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T06:27:16.391 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T06:27:16.393 INFO:teuthology.task.internal:Checking packages... 2024-09-19T06:27:16.416 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T06:27:16.416 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:27:16.416 INFO:teuthology.packaging:ref: None 2024-09-19T06:27:16.416 INFO:teuthology.packaging:tag: None 2024-09-19T06:27:16.416 INFO:teuthology.packaging:branch: squid 2024-09-19T06:27:16.416 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:27:16.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T06:27:16.658 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T06:27:16.660 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T06:27:16.666 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T06:27:16.667 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T06:27:16.672 INFO:teuthology.task.internal:Saving configuration 2024-09-19T06:27:16.692 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T06:27:16.699 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T06:27:16.725 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:22:03.222230', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ/GzFe1n0myQT95ewVotnu45HLfAj2MHVVeL6xjS7aMsuOTAk4VRqCDOsF69g5owf1GQjkC9KFytQ3OolONfg4='} 2024-09-19T06:27:16.749 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:22:03.220230', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSdLYUlpb0quUzk5niyeQx3iHKAYjN0U0pKCGyPczDVZeQVXFDSw6QkZwAtKDGRlJru8s795PAMDDfDN3O/lUQ='} 2024-09-19T06:27:16.773 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:22:03.223949', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK6TMTvRYvXyz6BcvpWrtDSLBY5w3hATVJoSvHJRsziTpvTrqJOMxoTymmma9hPimdZdmkKpWNlZ5uQs2b6lMgo='} 2024-09-19T06:27:16.773 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T06:27:16.812 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T06:27:16.812 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T06:27:16.812 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T06:27:16.812 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T06:27:16.894 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff773503be0>, signals=[15]) 2024-09-19T06:27:16.894 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T06:27:16.899 INFO:teuthology.task.internal:Opening connections... 2024-09-19T06:27:16.900 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T06:27:16.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:27:16.979 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-19T06:27:16.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:27:17.057 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-09-19T06:27:17.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:27:17.135 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T06:27:17.141 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-09-19T06:27:17.159 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-09-19T06:27:17.160 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:27:17.218 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:27:17.219 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:27:17.219 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:27:17.219 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-09-19T06:27:17.241 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-19T06:27:17.261 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-19T06:27:17.261 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-19T06:27:17.319 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-09-19T06:27:17.319 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-09-19T06:27:17.319 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:27:17.320 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:27:17.321 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-19T06:27:17.342 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-09-19T06:27:17.361 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-09-19T06:27:17.361 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-09-19T06:27:17.420 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-09-19T06:27:17.420 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-09-19T06:27:17.420 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-09-19T06:27:17.420 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:27:17.420 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-09-19T06:27:17.420 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:27:17.420 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:27:17.420 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-09-19T06:27:17.420 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:27:17.421 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:27:17.421 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:27:17.421 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:27:17.421 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:27:17.421 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:27:17.421 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-09-19T06:27:17.441 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T06:27:17.450 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T06:27:17.456 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T06:27:17.456 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:27:17.459 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:27:17.462 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:27:17.481 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T06:27:17.488 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T06:27:17.488 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:27:17.517 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:27:17.519 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:27:17.628 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T06:27:17.693 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T06:27:17.708 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T06:27:17.708 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T06:27:17.708 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T06:27:17.708 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:27:17.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:27:17.726 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-09-19T06:27:17.784 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-503.el9.x86_64 2024-09-19T06:27:17.784 INFO:teuthology.task.kernel:Running kernel on smithi159: 5.14.0-503.el9.x86_64 2024-09-19T06:27:17.784 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum install -y kernel 2024-09-19T06:27:21.209 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.3 MB 00:01 2024-09-19T06:27:22.952 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T06:27:28.386 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-19T06:27:30.037 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-19T06:27:31.032 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T06:27:36.472 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-19T06:27:38.336 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T06:27:38.336 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T06:27:38.415 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-19T06:27:38.420 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-19T06:27:38.421 INFO:teuthology.orchestra.run.smithi159.stdout:Install 4 Packages 2024-09-19T06:27:38.422 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:27:38.422 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 79 M 2024-09-19T06:27:38.422 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 126 M 2024-09-19T06:27:38.422 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-19T06:27:38.598 INFO:teuthology.orchestra.run.smithi159.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 460 kB/s | 36 kB 00:00 2024-09-19T06:27:39.140 INFO:teuthology.orchestra.run.smithi159.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-19T06:27:39.690 INFO:teuthology.orchestra.run.smithi159.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-19T06:27:40.024 INFO:teuthology.orchestra.run.smithi159.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-19T06:27:40.024 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:27:40.024 INFO:teuthology.orchestra.run.smithi159.stdout:Total 49 MB/s | 79 MB 00:01 2024-09-19T06:27:40.703 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-19T06:27:41.045 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-19T06:27:41.045 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-19T06:27:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-19T06:27:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-19T06:27:44.416 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-19T06:27:45.132 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:27:45.224 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:27:47.986 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:27:48.112 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:27:52.951 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:27:52.987 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:27:57.833 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:35.716 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:35.754 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:28:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:28:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:28:36.857 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:28:36.857 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:28:36.857 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-19T06:28:36.857 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T06:28:36.857 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T06:28:36.857 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T06:28:36.857 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T06:28:36.857 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:28:36.857 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-19T06:28:37.180 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:28:37.315 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:28:37.316 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:28:37.316 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T06:28:37.316 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T06:28:37.316 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T06:28:37.316 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T06:28:37.316 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T06:28:37.316 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:28:37.374 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:28:37.375 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:28:37.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.06 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 82.el9 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:Group : Unspecified 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 8274670 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2024-09-19T06:28:37.414 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : builder@centos.org 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T06:28:37.415 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2024-09-19T06:28:37.416 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:28:37.416 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T06:28:37.416 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T06:28:37.417 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 5.14.0-508.el9.x86_64 2024-09-19T06:28:37.417 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T06:28:38.055 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2024-09-19T06:28:39.402 INFO:teuthology.orchestra.run.smithi159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T06:28:39.428 INFO:teuthology.orchestra.run.smithi159.stderr:done 2024-09-19T06:28:39.430 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-09-19T06:28:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.GUi0JGgEDo 2024-09-19T06:28:39.446 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GUi0JGgEDo 2024-09-19T06:28:39.513 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.GUi0JGgEDo 2024-09-19T06:28:39.652 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.GUi0JGgEDo is 6KB 2024-09-19T06:28:39.701 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.GUi0JGgEDo 2024-09-19T06:28:39.716 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T06:28:39.779 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T06:28:39.779 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T06:28:39.779 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T06:28:39.779 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T06:28:39.780 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T06:28:39.938 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2024-09-19T06:29:09.941 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T06:29:09.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-19T06:29:09.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:29:28.509 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-19T06:29:37.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-19T06:29:37.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:29:40.577 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-19T06:29:52.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-19T06:29:52.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:30:11.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-19T06:30:26.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-19T06:30:26.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:30:26.408 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-19T06:30:26.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-19T06:30:26.783 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T06:30:26.783 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-09-19T06:30:26.798 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-508.el9.x86_64 2024-09-19T06:30:26.798 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T06:30:26.798 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T06:30:26.798 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T06:30:27.799 DEBUG:teuthology.parallel:result is None 2024-09-19T06:30:27.799 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T06:30:27.807 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T06:30:27.807 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:30:27.809 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:30:27.812 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:30:27.831 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T06:30:27.838 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T06:30:27.847 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T06:30:27.847 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:30:27.869 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:30:27.871 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:30:28.035 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T06:30:28.042 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T06:30:28.042 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:30:28.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:30:28.060 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:30:28.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:30:28.078 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:30:28.080 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:30:28.102 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:30:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:28.164 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:28.190 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:30:28.195 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T06:30:28.202 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T06:30:28.203 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:30:28.205 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:30:28.207 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:30:28.234 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T06:30:28.244 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T06:30:28.244 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:30:28.275 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:30:28.277 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:30:28.293 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:28.373 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:28.426 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:28.512 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:28.558 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:30:28.558 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:30:28.638 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:28.685 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:28.739 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:28.824 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:28.869 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:30:28.869 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:30:28.937 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:28.984 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:30:29.034 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:29.119 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:30:29.162 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:30:29.162 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:30:29.229 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-09-19T06:30:29.232 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-19T06:30:29.234 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-09-19T06:30:29.270 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:30:29.275 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:30:29.314 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:30:29.753 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T06:30:29.766 INFO:teuthology.task.internal:Starting timer... 2024-09-19T06:30:29.766 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T06:30:29.795 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T06:30:29.819 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T06:30:29.819 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2024-09-19T06:30:29.899 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2024-09-19T06:30:29.901 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-09-19T06:30:29.973 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-09-19T06:30:29.975 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-09-19T06:30:30.029 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-09-19T06:30:30.030 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T06:30:30.031 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2024-09-19T06:30:30.055 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2024-09-19T06:30:30.055 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-09-19T06:30:30.083 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-09-19T06:30:30.083 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-09-19T06:30:30.110 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-09-19T06:30:30.110 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi159.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-09-19T06:30:30.110 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:30:30.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:30:30.136 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:30:30.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:30:30.165 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:30:30.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:30:30.194 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T06:30:30.194 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:30:30.236 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:30:30.277 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:30:30.308 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T06:30:30.318 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T06:30:30.329 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T06:30:30.330 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi159.front.sepia.ceph.com,smithi189.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T06:34:47.155 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi159.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-09-19T06:34:47.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-19T06:34:47.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:34:47.239 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-19T06:34:47.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-19T06:34:47.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-19T06:34:47.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:34:47.390 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-19T06:34:47.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-19T06:34:47.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-19T06:34:47.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:34:47.548 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-19T06:34:47.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-19T06:34:47.634 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T06:34:47.646 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T06:34:47.647 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:34:47.647 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:34:47.649 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:34:47.650 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:34:47.652 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:34:47.652 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:34:47.679 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:34:47.680 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:34:47.694 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:34:47.697 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:34:47.703 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:34:47.717 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-09-19T06:34:47.718 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:34:47.723 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2024-09-19T06:34:47.728 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-09-19T06:34:47.735 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2024-09-19T06:34:47.742 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:34:47.744 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-09-19T06:34:47.750 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:34:47.754 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-09-19T06:34:47.756 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:34:47.765 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:34:47.769 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:34:47.783 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:34:47.815 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:34:47.819 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:34:47.819 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-19T06:34:47.819 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.819 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.819 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.819 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.828 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:34:47.831 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:34:47.831 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-19T06:34:47.831 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.831 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.832 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.832 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.840 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:34:47.843 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:34:47.844 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-19T06:34:47.844 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.844 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.844 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.844 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:34:47.845 INFO:teuthology.run_tasks:Running task install... 2024-09-19T06:34:47.853 DEBUG:teuthology.task.install:project ceph 2024-09-19T06:34:47.853 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T06:34:47.853 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T06:34:47.854 INFO:teuthology.task.install:Using flavor: default 2024-09-19T06:34:47.861 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T06:34:47.861 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T06:34:47.862 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:34:47.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:34:47.865 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:34:47.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:34:47.866 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:34:47.866 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:34:48.015 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:34:48.015 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:34:48.029 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:34:48.029 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:34:48.033 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:34:48.033 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:34:48.125 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:34:48.125 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:34:48.126 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:34:48.137 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:34:48.137 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:34:48.137 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:34:48.145 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:34:48.145 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:34:48.145 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:34:48.152 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:34:48.152 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:34:48.163 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:34:48.163 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:34:48.171 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:34:48.172 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:34:48.218 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:34:48.230 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:34:48.238 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:34:48.293 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:34:48.305 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:34:48.313 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:34:48.358 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2024-09-19T06:34:48.359 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2024-09-19T06:34:48.369 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-09-19T06:34:48.371 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-09-19T06:34:48.377 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-09-19T06:34:48.378 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-09-19T06:34:48.600 INFO:teuthology.orchestra.run.smithi189.stdout:45 files removed 2024-09-19T06:34:48.600 INFO:teuthology.orchestra.run.smithi159.stdout:45 files removed 2024-09-19T06:34:48.604 INFO:teuthology.orchestra.run.smithi203.stdout:45 files removed 2024-09-19T06:34:48.627 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:34:48.628 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:34:48.632 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:34:49.173 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-19T06:34:49.178 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-19T06:34:49.182 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-19T06:34:49.587 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 32 kB/s | 12 kB 00:00 2024-09-19T06:34:49.607 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-09-19T06:34:49.633 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-09-19T06:34:50.071 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2024-09-19T06:34:50.082 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-09-19T06:34:50.117 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-09-19T06:34:51.208 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 8.3 MB 00:01 2024-09-19T06:34:52.910 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-19T06:34:53.066 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-19T06:34:53.229 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.3 MB 00:03 2024-09-19T06:34:57.685 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 6.6 MB/s | 6.5 MB 00:00 2024-09-19T06:34:59.178 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-19T06:35:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-19T06:35:02.200 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-19T06:35:02.271 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-19T06:35:05.421 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T06:35:06.551 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-19T06:35:06.763 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-19T06:35:07.617 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:35:07.618 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:35:07.631 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:35:07.632 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:35:07.633 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:35:07.634 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:35:07.636 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:35:07.641 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:35:07.641 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:35:07.703 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:35:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:35:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:35:07.724 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:35:07.725 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:35:07.726 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:35:07.727 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:35:07.727 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:35:07.727 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:35:07.727 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:35:07.727 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:35:07.727 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:35:07.728 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:35:07.728 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:35:07.728 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:35:07.728 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:35:07.728 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:35:07.729 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:35:07.729 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:35:07.729 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:35:07.729 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:35:07.729 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:35:07.730 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:35:07.730 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:35:07.730 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:35:07.730 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:35:07.730 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:35:07.730 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:35:07.731 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:35:07.731 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:35:07.731 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:35:07.731 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:35:07.731 INFO:teuthology.orchestra.run.smithi159.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:35:07.732 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:35:07.732 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:35:07.732 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:35:07.732 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:35:07.732 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:35:07.733 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:35:07.733 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:35:07.733 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:35:07.733 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:35:07.733 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:35:07.733 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:35:07.733 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:35:07.734 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:35:07.735 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:35:07.736 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:35:07.737 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:35:07.738 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:35:07.738 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:35:07.738 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:35:07.738 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:35:07.738 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:35:07.738 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:35:07.738 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:35:07.739 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:35:07.739 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:35:07.739 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:35:07.739 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:35:07.739 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:35:07.740 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:35:07.740 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:35:07.740 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:35:07.740 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:35:07.740 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:35:07.741 INFO:teuthology.orchestra.run.smithi159.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:35:07.741 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:35:07.741 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:35:07.741 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2024-09-19T06:35:07.742 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:35:07.742 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:35:07.742 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-19T06:35:07.742 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-19T06:35:07.742 INFO:teuthology.orchestra.run.smithi159.stdout:Install 148 Packages 2024-09-19T06:35:07.742 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 8 Packages 2024-09-19T06:35:07.743 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:35:07.743 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 226 M 2024-09-19T06:35:07.744 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-19T06:35:07.976 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-19T06:35:08.406 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-19T06:35:08.456 INFO:teuthology.orchestra.run.smithi159.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-09-19T06:35:08.773 INFO:teuthology.orchestra.run.smithi159.stdout:(2/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T06:35:08.806 INFO:teuthology.orchestra.run.smithi159.stdout:(3/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.5 MB/s | 896 kB 00:00 2024-09-19T06:35:08.831 INFO:teuthology.orchestra.run.smithi159.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 2.4 MB/s | 145 kB 00:00 2024-09-19T06:35:08.864 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T06:35:08.924 INFO:teuthology.orchestra.run.smithi159.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-19T06:35:09.199 INFO:teuthology.orchestra.run.smithi159.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-19T06:35:09.257 INFO:teuthology.orchestra.run.smithi159.stdout:(7/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 5.3 MB/s | 2.4 MB 00:00 2024-09-19T06:35:09.508 INFO:teuthology.orchestra.run.smithi159.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T06:35:09.541 INFO:teuthology.orchestra.run.smithi159.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 758 kB/s | 25 kB 00:00 2024-09-19T06:35:09.585 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-19T06:35:10.208 INFO:teuthology.orchestra.run.smithi159.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 17 MB/s | 17 MB 00:01 2024-09-19T06:35:10.342 INFO:teuthology.orchestra.run.smithi159.stdout:(11/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 9.8 MB/s | 11 MB 00:01 2024-09-19T06:35:10.367 INFO:teuthology.orchestra.run.smithi159.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.4 MB/s | 228 kB 00:00 2024-09-19T06:35:10.392 INFO:teuthology.orchestra.run.smithi159.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 542 kB/s | 27 kB 00:00 2024-09-19T06:35:10.417 INFO:teuthology.orchestra.run.smithi159.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 631 kB/s | 32 kB 00:00 2024-09-19T06:35:10.468 INFO:teuthology.orchestra.run.smithi159.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T06:35:10.493 INFO:teuthology.orchestra.run.smithi159.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 7.3 MB/s | 751 kB 00:00 2024-09-19T06:35:10.527 INFO:teuthology.orchestra.run.smithi159.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T06:35:10.552 INFO:teuthology.orchestra.run.smithi159.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 8.4 MB/s | 506 kB 00:00 2024-09-19T06:35:10.619 INFO:teuthology.orchestra.run.smithi159.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 677 kB/s | 45 kB 00:00 2024-09-19T06:35:10.686 INFO:teuthology.orchestra.run.smithi159.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T06:35:10.761 INFO:teuthology.orchestra.run.smithi159.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T06:35:10.845 INFO:teuthology.orchestra.run.smithi159.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-19T06:35:10.870 INFO:teuthology.orchestra.run.smithi159.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.9 MB/s | 320 kB 00:00 2024-09-19T06:35:10.895 INFO:teuthology.orchestra.run.smithi159.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.9 MB/s | 300 kB 00:00 2024-09-19T06:35:10.921 INFO:teuthology.orchestra.run.smithi159.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T06:35:10.946 INFO:teuthology.orchestra.run.smithi159.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:35:10.997 INFO:teuthology.orchestra.run.smithi159.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.4 MB/s | 171 kB 00:00 2024-09-19T06:35:11.063 INFO:teuthology.orchestra.run.smithi159.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 477 kB/s | 32 kB 00:00 2024-09-19T06:35:11.122 INFO:teuthology.orchestra.run.smithi159.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-19T06:35:11.147 INFO:teuthology.orchestra.run.smithi159.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T06:35:11.397 INFO:teuthology.orchestra.run.smithi159.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 13 MB/s | 3.6 MB 00:00 2024-09-19T06:35:11.464 INFO:teuthology.orchestra.run.smithi159.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.7 MB/s | 249 kB 00:00 2024-09-19T06:35:11.898 INFO:teuthology.orchestra.run.smithi159.stdout:(33/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 21 MB/s | 49 MB 00:02 2024-09-19T06:35:11.923 INFO:teuthology.orchestra.run.smithi159.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 107 kB/s | 49 kB 00:00 2024-09-19T06:35:11.948 INFO:teuthology.orchestra.run.smithi159.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 330 kB/s | 16 kB 00:00 2024-09-19T06:35:11.974 INFO:teuthology.orchestra.run.smithi159.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T06:35:12.066 INFO:teuthology.orchestra.run.smithi159.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 8.1 MB/s | 7.4 MB 00:00 2024-09-19T06:35:12.091 INFO:teuthology.orchestra.run.smithi159.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 156 kB/s | 18 kB 00:00 2024-09-19T06:35:12.125 INFO:teuthology.orchestra.run.smithi159.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.3 MB/s | 765 kB 00:00 2024-09-19T06:35:12.725 INFO:teuthology.orchestra.run.smithi159.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 121 kB/s | 80 kB 00:00 2024-09-19T06:35:12.892 INFO:teuthology.orchestra.run.smithi159.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 249 kB/s | 191 kB 00:00 2024-09-19T06:35:13.509 INFO:teuthology.orchestra.run.smithi159.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 565 kB/s | 801 kB 00:01 2024-09-19T06:35:13.671 INFO:teuthology.orchestra.run.smithi159.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 268 kB/s | 253 kB 00:00 2024-09-19T06:35:14.167 INFO:teuthology.orchestra.run.smithi159.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 985 kB/s | 1.2 MB 00:01 2024-09-19T06:35:14.276 INFO:teuthology.orchestra.run.smithi159.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 139 kB/s | 106 kB 00:00 2024-09-19T06:35:14.295 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T06:35:14.376 INFO:teuthology.orchestra.run.smithi159.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 192 kB/s | 135 kB 00:00 2024-09-19T06:35:14.877 INFO:teuthology.orchestra.run.smithi159.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 176 kB/s | 125 kB 00:00 2024-09-19T06:35:14.999 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-19T06:35:15.068 INFO:teuthology.orchestra.run.smithi159.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 996 kB/s | 689 kB 00:00 2024-09-19T06:35:15.194 INFO:teuthology.orchestra.run.smithi159.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 855 kB/s | 107 kB 00:00 2024-09-19T06:35:15.227 INFO:teuthology.orchestra.run.smithi159.stdout:(50/156): python3-urllib3-1.26.5-6.el9.noarch.r 226 kB/s | 215 kB 00:00 2024-09-19T06:35:15.261 INFO:teuthology.orchestra.run.smithi159.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 323 kB/s | 22 kB 00:00 2024-09-19T06:35:15.336 INFO:teuthology.orchestra.run.smithi159.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 437 kB/s | 33 kB 00:00 2024-09-19T06:35:15.611 INFO:teuthology.orchestra.run.smithi159.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-19T06:35:15.679 INFO:teuthology.orchestra.run.smithi159.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-19T06:35:15.704 INFO:teuthology.orchestra.run.smithi159.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 658 kB/s | 313 kB 00:00 2024-09-19T06:35:15.747 INFO:teuthology.orchestra.run.smithi159.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-19T06:35:15.821 INFO:teuthology.orchestra.run.smithi159.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-09-19T06:35:15.846 INFO:teuthology.orchestra.run.smithi159.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-19T06:35:16.121 INFO:teuthology.orchestra.run.smithi159.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-19T06:35:16.155 INFO:teuthology.orchestra.run.smithi159.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 1.8 MB/s | 581 kB 00:00 2024-09-19T06:35:16.189 INFO:teuthology.orchestra.run.smithi159.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-19T06:35:16.231 INFO:teuthology.orchestra.run.smithi159.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-19T06:35:16.347 INFO:teuthology.orchestra.run.smithi159.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-19T06:35:16.364 INFO:teuthology.orchestra.run.smithi159.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-19T06:35:16.415 INFO:teuthology.orchestra.run.smithi159.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 576 kB/s | 38 kB 00:00 2024-09-19T06:35:16.451 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:35:16.452 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:35:16.465 INFO:teuthology.orchestra.run.smithi203.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:35:16.466 INFO:teuthology.orchestra.run.smithi203.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:35:16.467 INFO:teuthology.orchestra.run.smithi203.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:35:16.468 INFO:teuthology.orchestra.run.smithi203.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:35:16.470 INFO:teuthology.orchestra.run.smithi203.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:35:16.473 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:35:16.474 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:35:16.538 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-19T06:35:16.548 INFO:teuthology.orchestra.run.smithi159.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-09-19T06:35:16.558 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-09-19T06:35:16.558 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-19T06:35:16.558 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-09-19T06:35:16.558 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:35:16.559 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:35:16.560 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:35:16.560 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:35:16.560 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:35:16.560 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:35:16.560 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:35:16.560 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:35:16.560 INFO:teuthology.orchestra.run.smithi203.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:35:16.560 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:35:16.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:35:16.562 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:35:16.562 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:35:16.562 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:35:16.562 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:35:16.562 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-09-19T06:35:16.562 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:35:16.562 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:35:16.563 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:35:16.563 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:35:16.563 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:35:16.563 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:35:16.563 INFO:teuthology.orchestra.run.smithi203.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:35:16.563 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:35:16.563 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-19T06:35:16.563 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:35:16.563 INFO:teuthology.orchestra.run.smithi203.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:35:16.564 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:35:16.565 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:35:16.566 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:35:16.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:35:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:35:16.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:35:16.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:35:16.571 INFO:teuthology.orchestra.run.smithi203.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:35:16.572 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:35:16.572 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:35:16.572 INFO:teuthology.orchestra.run.smithi203.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:35:16.572 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:35:16.572 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:35:16.572 INFO:teuthology.orchestra.run.smithi203.stdout:Installing weak dependencies: 2024-09-19T06:35:16.572 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:35:16.572 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:35:16.572 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-19T06:35:16.573 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-09-19T06:35:16.573 INFO:teuthology.orchestra.run.smithi203.stdout:Install 148 Packages 2024-09-19T06:35:16.573 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 8 Packages 2024-09-19T06:35:16.573 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:35:16.573 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 226 M 2024-09-19T06:35:16.573 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-19T06:35:17.057 INFO:teuthology.orchestra.run.smithi159.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-09-19T06:35:17.156 INFO:teuthology.orchestra.run.smithi203.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-19T06:35:17.169 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:35:17.170 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:35:17.183 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:35:17.184 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:35:17.185 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:35:17.186 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:35:17.188 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:35:17.191 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:35:17.192 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:35:17.255 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-19T06:35:17.290 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-19T06:35:17.290 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-09-19T06:35:17.290 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:35:17.291 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:35:17.292 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:35:17.293 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:35:17.294 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:35:17.295 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:35:17.296 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:35:17.297 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:35:17.298 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:35:17.299 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:35:17.300 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:35:17.301 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:35:17.302 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:35:17.303 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-19T06:35:17.303 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-19T06:35:17.303 INFO:teuthology.orchestra.run.smithi189.stdout:Install 148 Packages 2024-09-19T06:35:17.303 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 8 Packages 2024-09-19T06:35:17.303 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:35:17.303 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 226 M 2024-09-19T06:35:17.303 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-19T06:35:17.382 INFO:teuthology.orchestra.run.smithi159.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 2.7 MB/s | 910 kB 00:00 2024-09-19T06:35:17.389 INFO:teuthology.orchestra.run.smithi203.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.8 MB/s | 896 kB 00:00 2024-09-19T06:35:17.457 INFO:teuthology.orchestra.run.smithi159.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-19T06:35:17.506 INFO:teuthology.orchestra.run.smithi203.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T06:35:17.531 INFO:teuthology.orchestra.run.smithi203.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.0 MB/s | 145 kB 00:00 2024-09-19T06:35:17.607 INFO:teuthology.orchestra.run.smithi203.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 24 MB/s | 2.4 MB 00:00 2024-09-19T06:35:17.840 INFO:teuthology.orchestra.run.smithi203.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.9 MB/s | 1.5 MB 00:00 2024-09-19T06:35:17.932 INFO:teuthology.orchestra.run.smithi203.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-19T06:35:17.941 INFO:teuthology.orchestra.run.smithi189.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-19T06:35:18.058 INFO:teuthology.orchestra.run.smithi159.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.9 MB/s | 4.9 MB 00:01 2024-09-19T06:35:18.158 INFO:teuthology.orchestra.run.smithi203.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 19 MB/s | 21 MB 00:01 2024-09-19T06:35:18.200 INFO:teuthology.orchestra.run.smithi203.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 606 kB/s | 25 kB 00:00 2024-09-19T06:35:18.392 INFO:teuthology.orchestra.run.smithi189.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.9 MB/s | 896 kB 00:00 2024-09-19T06:35:18.401 INFO:teuthology.orchestra.run.smithi159.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.0 MB/s | 1.0 MB 00:00 2024-09-19T06:35:18.516 INFO:teuthology.orchestra.run.smithi159.stdout:(72/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.1 MB/s | 4.4 MB 00:02 2024-09-19T06:35:18.517 INFO:teuthology.orchestra.run.smithi189.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.1 MB/s | 145 kB 00:00 2024-09-19T06:35:18.541 INFO:teuthology.orchestra.run.smithi159.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 617 kB/s | 87 kB 00:00 2024-09-19T06:35:18.558 INFO:teuthology.orchestra.run.smithi203.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 17 MB/s | 11 MB 00:00 2024-09-19T06:35:18.617 INFO:teuthology.orchestra.run.smithi203.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T06:35:18.683 INFO:teuthology.orchestra.run.smithi159.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 432 kB/s | 61 kB 00:00 2024-09-19T06:35:18.701 INFO:teuthology.orchestra.run.smithi203.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 324 kB/s | 27 kB 00:00 2024-09-19T06:35:18.709 INFO:teuthology.orchestra.run.smithi189.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 6.0 MB/s | 5.4 MB 00:00 2024-09-19T06:35:18.759 INFO:teuthology.orchestra.run.smithi203.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 546 kB/s | 32 kB 00:00 2024-09-19T06:35:18.792 INFO:teuthology.orchestra.run.smithi159.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-19T06:35:18.851 INFO:teuthology.orchestra.run.smithi203.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T06:35:18.909 INFO:teuthology.orchestra.run.smithi159.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-19T06:35:18.935 INFO:teuthology.orchestra.run.smithi203.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.9 MB/s | 163 kB 00:00 2024-09-19T06:35:18.959 INFO:teuthology.orchestra.run.smithi189.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.1 MB/s | 1.5 MB 00:00 2024-09-19T06:35:19.001 INFO:teuthology.orchestra.run.smithi159.stdout:(77/156): postgresql-server-13.16-1.el9.x86_64. 3.7 MB/s | 5.8 MB 00:01 2024-09-19T06:35:19.010 INFO:teuthology.orchestra.run.smithi203.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.7 MB/s | 127 kB 00:00 2024-09-19T06:35:19.026 INFO:teuthology.orchestra.run.smithi159.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-19T06:35:19.068 INFO:teuthology.orchestra.run.smithi159.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-09-19T06:35:19.102 INFO:teuthology.orchestra.run.smithi203.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.4 MB/s | 506 kB 00:00 2024-09-19T06:35:19.119 INFO:teuthology.orchestra.run.smithi159.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-19T06:35:19.144 INFO:teuthology.orchestra.run.smithi159.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-09-19T06:35:19.272 INFO:teuthology.orchestra.run.smithi159.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 250 kB 00:00 2024-09-19T06:35:19.343 INFO:teuthology.orchestra.run.smithi189.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 2.4 MB 00:00 2024-09-19T06:35:19.386 INFO:teuthology.orchestra.run.smithi159.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-19T06:35:19.445 INFO:teuthology.orchestra.run.smithi159.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T06:35:19.511 INFO:teuthology.orchestra.run.smithi203.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-19T06:35:19.512 INFO:teuthology.orchestra.run.smithi159.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 634 kB/s | 42 kB 00:00 2024-09-19T06:35:19.578 INFO:teuthology.orchestra.run.smithi203.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 678 kB/s | 45 kB 00:00 2024-09-19T06:35:19.601 INFO:teuthology.orchestra.run.smithi189.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 7.3 MB/s | 4.7 MB 00:00 2024-09-19T06:35:19.620 INFO:teuthology.orchestra.run.smithi159.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-19T06:35:19.636 INFO:teuthology.orchestra.run.smithi203.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.3 MB/s | 136 kB 00:00 2024-09-19T06:35:19.713 INFO:teuthology.orchestra.run.smithi203.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T06:35:19.737 INFO:teuthology.orchestra.run.smithi159.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-19T06:35:19.796 INFO:teuthology.orchestra.run.smithi203.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.8 MB/s | 320 kB 00:00 2024-09-19T06:35:19.846 INFO:teuthology.orchestra.run.smithi159.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-19T06:35:19.879 INFO:teuthology.orchestra.run.smithi203.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.5 MB/s | 300 kB 00:00 2024-09-19T06:35:19.955 INFO:teuthology.orchestra.run.smithi159.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-19T06:35:20.063 INFO:teuthology.orchestra.run.smithi159.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-19T06:35:20.353 INFO:teuthology.orchestra.run.smithi203.stdout:(24/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 23 MB/s | 49 MB 00:02 2024-09-19T06:35:20.387 INFO:teuthology.orchestra.run.smithi203.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 196 kB/s | 99 kB 00:00 2024-09-19T06:35:20.388 INFO:teuthology.orchestra.run.smithi159.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-09-19T06:35:20.412 INFO:teuthology.orchestra.run.smithi203.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T06:35:20.455 INFO:teuthology.orchestra.run.smithi159.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-09-19T06:35:20.555 INFO:teuthology.orchestra.run.smithi159.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-09-19T06:35:20.569 INFO:teuthology.orchestra.run.smithi189.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 11 MB/s | 11 MB 00:00 2024-09-19T06:35:20.602 INFO:teuthology.orchestra.run.smithi189.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 763 kB/s | 25 kB 00:00 2024-09-19T06:35:20.672 INFO:teuthology.orchestra.run.smithi159.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-19T06:35:20.748 INFO:teuthology.orchestra.run.smithi159.stdout:(95/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.7 MB/s | 6.0 MB 00:02 2024-09-19T06:35:20.773 INFO:teuthology.orchestra.run.smithi159.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 358 kB/s | 36 kB 00:00 2024-09-19T06:35:20.815 INFO:teuthology.orchestra.run.smithi159.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-19T06:35:20.827 INFO:teuthology.orchestra.run.smithi189.stdout:(10/156): ceph-common-19.1.1-361.g2f599a46.el9. 7.0 MB/s | 21 MB 00:03 2024-09-19T06:35:20.829 INFO:teuthology.orchestra.run.smithi203.stdout:(27/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 5.6 MB/s | 17 MB 00:02 2024-09-19T06:35:20.854 INFO:teuthology.orchestra.run.smithi203.stdout:(28/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 386 kB/s | 171 kB 00:00 2024-09-19T06:35:20.880 INFO:teuthology.orchestra.run.smithi203.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 636 kB/s | 32 kB 00:00 2024-09-19T06:35:20.890 INFO:teuthology.orchestra.run.smithi159.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-19T06:35:20.905 INFO:teuthology.orchestra.run.smithi203.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T06:35:20.924 INFO:teuthology.orchestra.run.smithi159.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-09-19T06:35:20.972 INFO:teuthology.orchestra.run.smithi203.stdout:(31/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 5.3 MB/s | 3.1 MB 00:00 2024-09-19T06:35:20.982 INFO:teuthology.orchestra.run.smithi159.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-19T06:35:20.995 INFO:teuthology.orchestra.run.smithi189.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 17 MB 00:01 2024-09-19T06:35:21.019 INFO:teuthology.orchestra.run.smithi189.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.2 MB/s | 228 kB 00:00 2024-09-19T06:35:21.022 INFO:teuthology.orchestra.run.smithi203.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T06:35:21.049 INFO:teuthology.orchestra.run.smithi159.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 509 kB/s | 64 kB 00:00 2024-09-19T06:35:21.053 INFO:teuthology.orchestra.run.smithi189.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 464 kB/s | 27 kB 00:00 2024-09-19T06:35:21.070 INFO:teuthology.orchestra.run.smithi189.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 633 kB/s | 32 kB 00:00 2024-09-19T06:35:21.074 INFO:teuthology.orchestra.run.smithi159.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 488 kB/s | 45 kB 00:00 2024-09-19T06:35:21.089 INFO:teuthology.orchestra.run.smithi203.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 740 kB/s | 49 kB 00:00 2024-09-19T06:35:21.162 INFO:teuthology.orchestra.run.smithi189.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.7 MB/s | 163 kB 00:00 2024-09-19T06:35:21.164 INFO:teuthology.orchestra.run.smithi203.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 220 kB/s | 16 kB 00:00 2024-09-19T06:35:21.166 INFO:teuthology.orchestra.run.smithi159.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-19T06:35:21.187 INFO:teuthology.orchestra.run.smithi189.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 5.5 MB/s | 751 kB 00:00 2024-09-19T06:35:21.212 INFO:teuthology.orchestra.run.smithi189.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T06:35:21.225 INFO:teuthology.orchestra.run.smithi159.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T06:35:21.254 INFO:teuthology.orchestra.run.smithi189.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T06:35:21.259 INFO:teuthology.orchestra.run.smithi159.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T06:35:21.284 INFO:teuthology.orchestra.run.smithi159.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-19T06:35:21.298 INFO:teuthology.orchestra.run.smithi203.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 19 MB/s | 7.4 MB 00:00 2024-09-19T06:35:21.318 INFO:teuthology.orchestra.run.smithi159.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-19T06:35:21.321 INFO:teuthology.orchestra.run.smithi189.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 679 kB/s | 45 kB 00:00 2024-09-19T06:35:21.323 INFO:teuthology.orchestra.run.smithi203.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 1.8 MB/s | 285 kB 00:00 2024-09-19T06:35:21.390 INFO:teuthology.orchestra.run.smithi159.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 361 kB/s | 26 kB 00:00 2024-09-19T06:35:21.390 INFO:teuthology.orchestra.run.smithi203.stdout:(37/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.0 MB/s | 3.6 MB 00:00 2024-09-19T06:35:21.397 INFO:teuthology.orchestra.run.smithi189.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T06:35:21.407 INFO:teuthology.orchestra.run.smithi203.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 218 kB/s | 18 kB 00:00 2024-09-19T06:35:21.427 INFO:teuthology.orchestra.run.smithi159.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.3 MB/s | 49 kB 00:00 2024-09-19T06:35:21.449 INFO:teuthology.orchestra.run.smithi203.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-19T06:35:21.452 INFO:teuthology.orchestra.run.smithi159.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T06:35:21.469 INFO:teuthology.orchestra.run.smithi159.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 8.9 MB/s | 151 kB 00:00 2024-09-19T06:35:21.472 INFO:teuthology.orchestra.run.smithi189.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 21 MB/s | 5.3 MB 00:00 2024-09-19T06:35:21.497 INFO:teuthology.orchestra.run.smithi189.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.6 MB/s | 161 kB 00:00 2024-09-19T06:35:21.511 INFO:teuthology.orchestra.run.smithi159.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-19T06:35:21.523 INFO:teuthology.orchestra.run.smithi189.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T06:35:21.556 INFO:teuthology.orchestra.run.smithi189.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T06:35:21.568 INFO:teuthology.orchestra.run.smithi203.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 454 kB/s | 80 kB 00:00 2024-09-19T06:35:21.578 INFO:teuthology.orchestra.run.smithi159.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-19T06:35:21.581 INFO:teuthology.orchestra.run.smithi189.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T06:35:21.595 INFO:teuthology.orchestra.run.smithi159.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-19T06:35:21.612 INFO:teuthology.orchestra.run.smithi159.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T06:35:21.614 INFO:teuthology.orchestra.run.smithi189.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T06:35:21.629 INFO:teuthology.orchestra.run.smithi159.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 849 kB/s | 14 kB 00:00 2024-09-19T06:35:21.654 INFO:teuthology.orchestra.run.smithi159.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-19T06:35:21.679 INFO:teuthology.orchestra.run.smithi159.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-19T06:35:21.681 INFO:teuthology.orchestra.run.smithi189.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-19T06:35:21.683 INFO:teuthology.orchestra.run.smithi203.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-19T06:35:21.709 INFO:teuthology.orchestra.run.smithi203.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 738 kB/s | 191 kB 00:00 2024-09-19T06:35:21.713 INFO:teuthology.orchestra.run.smithi159.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T06:35:21.734 INFO:teuthology.orchestra.run.smithi203.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-19T06:35:21.747 INFO:teuthology.orchestra.run.smithi159.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-19T06:35:21.748 INFO:teuthology.orchestra.run.smithi189.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-19T06:35:21.772 INFO:teuthology.orchestra.run.smithi159.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T06:35:21.774 INFO:teuthology.orchestra.run.smithi189.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 347 kB/s | 32 kB 00:00 2024-09-19T06:35:21.776 INFO:teuthology.orchestra.run.smithi203.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-19T06:35:21.799 INFO:teuthology.orchestra.run.smithi189.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T06:35:21.933 INFO:teuthology.orchestra.run.smithi203.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-19T06:35:21.933 INFO:teuthology.orchestra.run.smithi203.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T06:35:21.933 INFO:teuthology.orchestra.run.smithi203.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-19T06:35:21.933 INFO:teuthology.orchestra.run.smithi159.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T06:35:21.933 INFO:teuthology.orchestra.run.smithi159.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-19T06:35:21.933 INFO:teuthology.orchestra.run.smithi159.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-19T06:35:21.933 INFO:teuthology.orchestra.run.smithi159.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-19T06:35:21.934 INFO:teuthology.orchestra.run.smithi159.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-19T06:35:21.938 INFO:teuthology.orchestra.run.smithi159.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-19T06:35:21.986 INFO:teuthology.orchestra.run.smithi159.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-19T06:35:22.008 INFO:teuthology.orchestra.run.smithi159.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:35:22.011 INFO:teuthology.orchestra.run.smithi203.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-19T06:35:22.032 INFO:teuthology.orchestra.run.smithi189.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 14 MB/s | 3.6 MB 00:00 2024-09-19T06:35:22.033 INFO:teuthology.orchestra.run.smithi159.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T06:35:22.058 INFO:teuthology.orchestra.run.smithi203.stdout:(49/156): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-09-19T06:35:22.075 INFO:teuthology.orchestra.run.smithi159.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T06:35:22.082 INFO:teuthology.orchestra.run.smithi203.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-19T06:35:22.100 INFO:teuthology.orchestra.run.smithi159.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 864 kB/s | 58 kB 00:00 2024-09-19T06:35:22.121 INFO:teuthology.orchestra.run.smithi203.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-19T06:35:22.125 INFO:teuthology.orchestra.run.smithi189.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 23 MB/s | 7.4 MB 00:00 2024-09-19T06:35:22.125 INFO:teuthology.orchestra.run.smithi159.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-19T06:35:22.146 INFO:teuthology.orchestra.run.smithi203.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 235 kB/s | 22 kB 00:00 2024-09-19T06:35:22.150 INFO:teuthology.orchestra.run.smithi189.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.1 MB/s | 249 kB 00:00 2024-09-19T06:35:22.150 INFO:teuthology.orchestra.run.smithi159.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-19T06:35:22.171 INFO:teuthology.orchestra.run.smithi203.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-19T06:35:22.175 INFO:teuthology.orchestra.run.smithi189.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 986 kB/s | 49 kB 00:00 2024-09-19T06:35:22.176 INFO:teuthology.orchestra.run.smithi159.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T06:35:22.196 INFO:teuthology.orchestra.run.smithi203.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T06:35:22.201 INFO:teuthology.orchestra.run.smithi189.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 329 kB/s | 16 kB 00:00 2024-09-19T06:35:22.201 INFO:teuthology.orchestra.run.smithi159.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-19T06:35:22.221 INFO:teuthology.orchestra.run.smithi203.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-19T06:35:22.225 INFO:teuthology.orchestra.run.smithi189.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T06:35:22.226 INFO:teuthology.orchestra.run.smithi159.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T06:35:22.247 INFO:teuthology.orchestra.run.smithi203.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-19T06:35:22.251 INFO:teuthology.orchestra.run.smithi159.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T06:35:22.259 INFO:teuthology.orchestra.run.smithi189.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T06:35:22.272 INFO:teuthology.orchestra.run.smithi203.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T06:35:22.276 INFO:teuthology.orchestra.run.smithi189.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 364 kB/s | 18 kB 00:00 2024-09-19T06:35:22.277 INFO:teuthology.orchestra.run.smithi159.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T06:35:22.297 INFO:teuthology.orchestra.run.smithi203.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-09-19T06:35:22.302 INFO:teuthology.orchestra.run.smithi159.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-19T06:35:22.340 INFO:teuthology.orchestra.run.smithi203.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-19T06:35:22.344 INFO:teuthology.orchestra.run.smithi159.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-19T06:35:22.378 INFO:teuthology.orchestra.run.smithi159.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-19T06:35:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-19T06:35:22.403 INFO:teuthology.orchestra.run.smithi159.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T06:35:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-19T06:35:22.428 INFO:teuthology.orchestra.run.smithi159.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-19T06:35:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-19T06:35:22.454 INFO:teuthology.orchestra.run.smithi159.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T06:35:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T06:35:22.479 INFO:teuthology.orchestra.run.smithi159.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-19T06:35:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T06:35:22.508 INFO:teuthology.orchestra.run.smithi203.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-19T06:35:22.529 INFO:teuthology.orchestra.run.smithi159.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-19T06:35:22.558 INFO:teuthology.orchestra.run.smithi203.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.2 MB/s | 3.0 MB 00:00 2024-09-19T06:35:22.650 INFO:teuthology.orchestra.run.smithi203.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-19T06:35:22.651 INFO:teuthology.orchestra.run.smithi189.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 204 kB/s | 80 kB 00:00 2024-09-19T06:35:22.692 INFO:teuthology.orchestra.run.smithi203.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-19T06:35:22.755 INFO:teuthology.orchestra.run.smithi159.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T06:35:22.759 INFO:teuthology.orchestra.run.smithi203.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T06:35:22.785 INFO:teuthology.orchestra.run.smithi203.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T06:35:22.827 INFO:teuthology.orchestra.run.smithi203.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-19T06:35:22.830 INFO:teuthology.orchestra.run.smithi159.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-19T06:35:22.852 INFO:teuthology.orchestra.run.smithi189.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 957 kB/s | 191 kB 00:00 2024-09-19T06:35:22.877 INFO:teuthology.orchestra.run.smithi203.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-19T06:35:22.902 INFO:teuthology.orchestra.run.smithi203.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-19T06:35:22.936 INFO:teuthology.orchestra.run.smithi203.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-19T06:35:23.019 INFO:teuthology.orchestra.run.smithi203.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-19T06:35:23.045 INFO:teuthology.orchestra.run.smithi203.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-19T06:35:23.052 INFO:teuthology.orchestra.run.smithi189.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-19T06:35:23.070 INFO:teuthology.orchestra.run.smithi203.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T06:35:23.087 INFO:teuthology.orchestra.run.smithi203.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 613 kB/s | 26 kB 00:00 2024-09-19T06:35:23.102 INFO:teuthology.orchestra.run.smithi189.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 970 kB/s | 801 kB 00:00 2024-09-19T06:35:23.104 INFO:teuthology.orchestra.run.smithi203.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 572 kB/s | 19 kB 00:00 2024-09-19T06:35:23.129 INFO:teuthology.orchestra.run.smithi203.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-19T06:35:23.146 INFO:teuthology.orchestra.run.smithi203.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 832 kB/s | 35 kB 00:00 2024-09-19T06:35:23.219 INFO:teuthology.orchestra.run.smithi189.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 914 kB/s | 106 kB 00:00 2024-09-19T06:35:23.230 INFO:teuthology.orchestra.run.smithi203.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-19T06:35:23.264 INFO:teuthology.orchestra.run.smithi203.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-19T06:35:23.289 INFO:teuthology.orchestra.run.smithi203.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T06:35:23.314 INFO:teuthology.orchestra.run.smithi203.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T06:35:23.336 INFO:teuthology.orchestra.run.smithi189.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-19T06:35:23.340 INFO:teuthology.orchestra.run.smithi203.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-19T06:35:23.365 INFO:teuthology.orchestra.run.smithi203.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-19T06:35:23.399 INFO:teuthology.orchestra.run.smithi203.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-19T06:35:23.424 INFO:teuthology.orchestra.run.smithi203.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-19T06:35:23.449 INFO:teuthology.orchestra.run.smithi203.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T06:35:23.475 INFO:teuthology.orchestra.run.smithi203.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T06:35:23.558 INFO:teuthology.orchestra.run.smithi203.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T06:35:23.583 INFO:teuthology.orchestra.run.smithi203.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-19T06:35:23.609 INFO:teuthology.orchestra.run.smithi203.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-19T06:35:23.634 INFO:teuthology.orchestra.run.smithi203.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T06:35:23.660 INFO:teuthology.orchestra.run.smithi203.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-19T06:35:23.685 INFO:teuthology.orchestra.run.smithi203.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-19T06:35:23.710 INFO:teuthology.orchestra.run.smithi203.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T06:35:23.735 INFO:teuthology.orchestra.run.smithi203.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T06:35:23.761 INFO:teuthology.orchestra.run.smithi203.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T06:35:23.762 INFO:teuthology.orchestra.run.smithi189.stdout:(45/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 15 MB/s | 49 MB 00:03 2024-09-19T06:35:23.763 INFO:teuthology.orchestra.run.smithi159.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:01 2024-09-19T06:35:23.786 INFO:teuthology.orchestra.run.smithi203.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T06:35:23.787 INFO:teuthology.orchestra.run.smithi189.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 277 kB/s | 125 kB 00:00 2024-09-19T06:35:23.805 INFO:teuthology.orchestra.run.smithi159.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.9 MB/s | 1.8 MB 00:00 2024-09-19T06:35:23.811 INFO:teuthology.orchestra.run.smithi203.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-19T06:35:23.829 INFO:teuthology.orchestra.run.smithi189.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 1.6 MB/s | 1.2 MB 00:00 2024-09-19T06:35:23.887 INFO:teuthology.orchestra.run.smithi203.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-19T06:35:24.054 INFO:teuthology.orchestra.run.smithi189.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-19T06:35:24.105 INFO:teuthology.orchestra.run.smithi189.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-19T06:35:24.113 INFO:teuthology.orchestra.run.smithi203.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-19T06:35:24.138 INFO:teuthology.orchestra.run.smithi189.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-19T06:35:24.164 INFO:teuthology.orchestra.run.smithi189.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-19T06:35:24.171 INFO:teuthology.orchestra.run.smithi203.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.9 MB/s | 548 kB 00:00 2024-09-19T06:35:24.197 INFO:teuthology.orchestra.run.smithi203.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-19T06:35:24.213 INFO:teuthology.orchestra.run.smithi203.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 464 kB/s | 19 kB 00:00 2024-09-19T06:35:24.214 INFO:teuthology.orchestra.run.smithi189.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-09-19T06:35:24.238 INFO:teuthology.orchestra.run.smithi203.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-19T06:35:24.239 INFO:teuthology.orchestra.run.smithi189.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-19T06:35:24.264 INFO:teuthology.orchestra.run.smithi203.stdout:(109/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.0 MB/s | 308 kB 00:00 2024-09-19T06:35:24.281 INFO:teuthology.orchestra.run.smithi203.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-19T06:35:24.289 INFO:teuthology.orchestra.run.smithi189.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-19T06:35:24.306 INFO:teuthology.orchestra.run.smithi203.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-19T06:35:24.331 INFO:teuthology.orchestra.run.smithi159.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 72 kB/s | 41 kB 00:00 2024-09-19T06:35:24.331 INFO:teuthology.orchestra.run.smithi203.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T06:35:24.340 INFO:teuthology.orchestra.run.smithi189.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-19T06:35:24.390 INFO:teuthology.orchestra.run.smithi189.stdout:(56/156): python3-urllib3-1.26.5-6.el9.noarch.r 342 kB/s | 215 kB 00:00 2024-09-19T06:35:24.407 INFO:teuthology.orchestra.run.smithi203.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-19T06:35:24.432 INFO:teuthology.orchestra.run.smithi189.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-19T06:35:24.432 INFO:teuthology.orchestra.run.smithi203.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-19T06:35:24.458 INFO:teuthology.orchestra.run.smithi203.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 865 kB/s | 43 kB 00:00 2024-09-19T06:35:24.483 INFO:teuthology.orchestra.run.smithi203.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-09-19T06:35:24.508 INFO:teuthology.orchestra.run.smithi203.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-19T06:35:24.515 INFO:teuthology.orchestra.run.smithi189.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-09-19T06:35:24.534 INFO:teuthology.orchestra.run.smithi203.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T06:35:24.567 INFO:teuthology.orchestra.run.smithi203.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T06:35:24.581 INFO:teuthology.orchestra.run.smithi159.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 321 kB/s | 249 kB 00:00 2024-09-19T06:35:24.599 INFO:teuthology.orchestra.run.smithi189.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-19T06:35:24.609 INFO:teuthology.orchestra.run.smithi203.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-19T06:35:24.643 INFO:teuthology.orchestra.run.smithi203.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-19T06:35:24.649 INFO:teuthology.orchestra.run.smithi189.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-19T06:35:24.677 INFO:teuthology.orchestra.run.smithi203.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T06:35:24.702 INFO:teuthology.orchestra.run.smithi203.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-19T06:35:24.708 INFO:teuthology.orchestra.run.smithi189.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-09-19T06:35:24.727 INFO:teuthology.orchestra.run.smithi203.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-19T06:35:24.733 INFO:teuthology.orchestra.run.smithi189.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-09-19T06:35:24.761 INFO:teuthology.orchestra.run.smithi203.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 695 kB/s | 23 kB 00:00 2024-09-19T06:35:24.786 INFO:teuthology.orchestra.run.smithi203.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-19T06:35:24.808 INFO:teuthology.orchestra.run.smithi189.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.0 MB/s | 3.0 MB 00:00 2024-09-19T06:35:24.811 INFO:teuthology.orchestra.run.smithi203.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-19T06:35:24.833 INFO:teuthology.orchestra.run.smithi189.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-19T06:35:24.853 INFO:teuthology.orchestra.run.smithi203.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-19T06:35:24.859 INFO:teuthology.orchestra.run.smithi189.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-19T06:35:24.884 INFO:teuthology.orchestra.run.smithi189.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-19T06:35:24.887 INFO:teuthology.orchestra.run.smithi203.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T06:35:24.921 INFO:teuthology.orchestra.run.smithi203.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T06:35:24.988 INFO:teuthology.orchestra.run.smithi203.stdout:(131/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-09-19T06:35:25.013 INFO:teuthology.orchestra.run.smithi203.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 627 kB/s | 58 kB 00:00 2024-09-19T06:35:25.039 INFO:teuthology.orchestra.run.smithi203.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-19T06:35:25.064 INFO:teuthology.orchestra.run.smithi203.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T06:35:25.098 INFO:teuthology.orchestra.run.smithi203.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-19T06:35:25.115 INFO:teuthology.orchestra.run.smithi203.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-19T06:35:25.132 INFO:teuthology.orchestra.run.smithi203.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 915 kB/s | 31 kB 00:00 2024-09-19T06:35:25.166 INFO:teuthology.orchestra.run.smithi203.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 2.9 MB/s | 1.0 MB 00:00 2024-09-19T06:35:25.168 INFO:teuthology.orchestra.run.smithi189.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-09-19T06:35:25.181 INFO:teuthology.orchestra.run.smithi159.stdout:(154/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-09-19T06:35:25.191 INFO:teuthology.orchestra.run.smithi203.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-19T06:35:25.216 INFO:teuthology.orchestra.run.smithi203.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-19T06:35:25.241 INFO:teuthology.orchestra.run.smithi203.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T06:35:25.267 INFO:teuthology.orchestra.run.smithi203.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-19T06:35:25.292 INFO:teuthology.orchestra.run.smithi203.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T06:35:25.317 INFO:teuthology.orchestra.run.smithi203.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T06:35:25.334 INFO:teuthology.orchestra.run.smithi189.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-19T06:35:25.343 INFO:teuthology.orchestra.run.smithi203.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-19T06:35:25.368 INFO:teuthology.orchestra.run.smithi203.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T06:35:25.402 INFO:teuthology.orchestra.run.smithi203.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-19T06:35:25.418 INFO:teuthology.orchestra.run.smithi189.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-19T06:35:25.452 INFO:teuthology.orchestra.run.smithi203.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T06:35:25.506 INFO:teuthology.orchestra.run.smithi159.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.2 MB/s | 1.4 MB 00:01 2024-09-19T06:35:25.611 INFO:teuthology.orchestra.run.smithi203.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-19T06:35:25.735 INFO:teuthology.orchestra.run.smithi189.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.5 MB/s | 4.9 MB 00:00 2024-09-19T06:35:25.794 INFO:teuthology.orchestra.run.smithi203.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.1 MB/s | 3.2 MB 00:00 2024-09-19T06:35:25.798 INFO:teuthology.orchestra.run.smithi159.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-19T06:35:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:35:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:Total 13 MB/s | 226 MB 00:18 2024-09-19T06:35:25.902 INFO:teuthology.orchestra.run.smithi189.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-09-19T06:35:25.961 INFO:teuthology.orchestra.run.smithi203.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.2 MB/s | 1.8 MB 00:00 2024-09-19T06:35:25.987 INFO:teuthology.orchestra.run.smithi203.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 213 kB/s | 41 kB 00:00 2024-09-19T06:35:25.994 INFO:teuthology.orchestra.run.smithi189.stdout:(72/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-09-19T06:35:26.019 INFO:teuthology.orchestra.run.smithi189.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 747 kB/s | 87 kB 00:00 2024-09-19T06:35:26.095 INFO:teuthology.orchestra.run.smithi189.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 816 kB/s | 61 kB 00:00 2024-09-19T06:35:26.130 INFO:teuthology.orchestra.run.smithi203.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.4 MB/s | 249 kB 00:00 2024-09-19T06:35:26.178 INFO:teuthology.orchestra.run.smithi189.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T06:35:26.262 INFO:teuthology.orchestra.run.smithi189.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-19T06:35:26.270 INFO:teuthology.orchestra.run.smithi203.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 1.4 MB 00:00 2024-09-19T06:35:26.304 INFO:teuthology.orchestra.run.smithi189.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 618 kB/s | 26 kB 00:00 2024-09-19T06:35:26.345 INFO:teuthology.orchestra.run.smithi189.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-19T06:35:26.429 INFO:teuthology.orchestra.run.smithi203.stdout:(155/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.4 MB/s | 2.3 MB 00:00 2024-09-19T06:35:26.446 INFO:teuthology.orchestra.run.smithi189.stdout:(79/156): postgresql-server-13.16-1.el9.x86_64. 5.6 MB/s | 5.8 MB 00:01 2024-09-19T06:35:26.471 INFO:teuthology.orchestra.run.smithi189.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-19T06:35:26.488 INFO:teuthology.orchestra.run.smithi189.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 830 kB/s | 35 kB 00:00 2024-09-19T06:35:26.572 INFO:teuthology.orchestra.run.smithi189.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-19T06:35:26.655 INFO:teuthology.orchestra.run.smithi189.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T06:35:26.706 INFO:teuthology.orchestra.run.smithi189.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T06:35:26.748 INFO:teuthology.orchestra.run.smithi189.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T06:35:26.831 INFO:teuthology.orchestra.run.smithi189.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-19T06:35:26.892 INFO:teuthology.orchestra.run.smithi189.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-19T06:35:26.974 INFO:teuthology.orchestra.run.smithi189.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-19T06:35:27.007 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-19T06:35:27.024 INFO:teuthology.orchestra.run.smithi189.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T06:35:27.074 INFO:teuthology.orchestra.run.smithi189.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T06:35:27.160 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-19T06:35:27.160 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-19T06:35:27.274 INFO:teuthology.orchestra.run.smithi189.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.3 MB/s | 5.1 MB 00:00 2024-09-19T06:35:27.324 INFO:teuthology.orchestra.run.smithi189.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 836 kB/s | 42 kB 00:00 2024-09-19T06:35:27.371 INFO:teuthology.orchestra.run.smithi203.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-09-19T06:35:27.377 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:35:27.377 INFO:teuthology.orchestra.run.smithi203.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-19T06:35:27.383 INFO:teuthology.orchestra.run.smithi189.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 758 kB/s | 44 kB 00:00 2024-09-19T06:35:27.442 INFO:teuthology.orchestra.run.smithi189.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T06:35:27.509 INFO:teuthology.orchestra.run.smithi189.stdout:(95/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2024-09-19T06:35:27.534 INFO:teuthology.orchestra.run.smithi189.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-09-19T06:35:27.559 INFO:teuthology.orchestra.run.smithi189.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-19T06:35:27.609 INFO:teuthology.orchestra.run.smithi189.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T06:35:27.643 INFO:teuthology.orchestra.run.smithi189.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-19T06:35:27.668 INFO:teuthology.orchestra.run.smithi189.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T06:35:27.693 INFO:teuthology.orchestra.run.smithi189.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T06:35:27.719 INFO:teuthology.orchestra.run.smithi189.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-19T06:35:27.786 INFO:teuthology.orchestra.run.smithi189.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-19T06:35:27.853 INFO:teuthology.orchestra.run.smithi189.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-19T06:35:27.895 INFO:teuthology.orchestra.run.smithi189.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-19T06:35:27.937 INFO:teuthology.orchestra.run.smithi189.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.6 MB/s | 308 kB 00:00 2024-09-19T06:35:27.971 INFO:teuthology.orchestra.run.smithi189.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-09-19T06:35:27.996 INFO:teuthology.orchestra.run.smithi189.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T06:35:28.021 INFO:teuthology.orchestra.run.smithi189.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T06:35:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T06:35:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-19T06:35:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 839 kB 00:00 2024-09-19T06:35:28.247 INFO:teuthology.orchestra.run.smithi189.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-19T06:35:28.272 INFO:teuthology.orchestra.run.smithi189.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:35:28.298 INFO:teuthology.orchestra.run.smithi189.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-19T06:35:28.314 INFO:teuthology.orchestra.run.smithi189.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 768 kB/s | 32 kB 00:00 2024-09-19T06:35:28.340 INFO:teuthology.orchestra.run.smithi189.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 338 kB/s | 14 kB 00:00 2024-09-19T06:35:28.365 INFO:teuthology.orchestra.run.smithi189.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T06:35:28.399 INFO:teuthology.orchestra.run.smithi189.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T06:35:28.424 INFO:teuthology.orchestra.run.smithi189.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T06:35:28.449 INFO:teuthology.orchestra.run.smithi189.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T06:35:28.483 INFO:teuthology.orchestra.run.smithi189.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T06:35:28.508 INFO:teuthology.orchestra.run.smithi189.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-19T06:35:28.534 INFO:teuthology.orchestra.run.smithi189.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-19T06:35:28.559 INFO:teuthology.orchestra.run.smithi189.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 937 kB/s | 23 kB 00:00 2024-09-19T06:35:28.584 INFO:teuthology.orchestra.run.smithi189.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-19T06:35:28.601 INFO:teuthology.orchestra.run.smithi189.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T06:35:28.605 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-19T06:35:28.660 INFO:teuthology.orchestra.run.smithi189.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-19T06:35:28.685 INFO:teuthology.orchestra.run.smithi189.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:35:28.710 INFO:teuthology.orchestra.run.smithi189.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T06:35:28.744 INFO:teuthology.orchestra.run.smithi189.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T06:35:28.755 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-19T06:35:28.755 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-19T06:35:28.769 INFO:teuthology.orchestra.run.smithi189.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 981 kB/s | 58 kB 00:00 2024-09-19T06:35:28.795 INFO:teuthology.orchestra.run.smithi189.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-19T06:35:28.820 INFO:teuthology.orchestra.run.smithi189.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T06:35:28.853 INFO:teuthology.orchestra.run.smithi189.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-19T06:35:28.879 INFO:teuthology.orchestra.run.smithi189.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-19T06:35:28.904 INFO:teuthology.orchestra.run.smithi189.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T06:35:28.929 INFO:teuthology.orchestra.run.smithi189.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T06:35:28.955 INFO:teuthology.orchestra.run.smithi189.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T06:35:28.980 INFO:teuthology.orchestra.run.smithi189.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T06:35:29.005 INFO:teuthology.orchestra.run.smithi189.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T06:35:29.031 INFO:teuthology.orchestra.run.smithi189.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T06:35:29.056 INFO:teuthology.orchestra.run.smithi189.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T06:35:29.081 INFO:teuthology.orchestra.run.smithi189.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-19T06:35:29.131 INFO:teuthology.orchestra.run.smithi189.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-09-19T06:35:29.157 INFO:teuthology.orchestra.run.smithi189.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-19T06:35:29.207 INFO:teuthology.orchestra.run.smithi189.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-19T06:35:29.388 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-19T06:35:29.388 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-19T06:35:29.424 INFO:teuthology.orchestra.run.smithi189.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-19T06:35:29.513 INFO:teuthology.orchestra.run.smithi189.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T06:35:29.758 INFO:teuthology.orchestra.run.smithi189.stdout:(150/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.1 MB/s | 16 MB 00:02 2024-09-19T06:35:30.133 INFO:teuthology.orchestra.run.smithi189.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 109 kB/s | 41 kB 00:00 2024-09-19T06:35:30.525 INFO:teuthology.orchestra.run.smithi189.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2024-09-19T06:35:30.555 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-19T06:35:30.555 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-19T06:35:30.633 INFO:teuthology.orchestra.run.smithi189.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 497 kB/s | 249 kB 00:00 2024-09-19T06:35:30.676 INFO:teuthology.orchestra.run.smithi189.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.6 MB/s | 1.8 MB 00:01 2024-09-19T06:35:30.717 INFO:teuthology.orchestra.run.smithi189.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 1.4 MB 00:00 2024-09-19T06:35:31.242 INFO:teuthology.orchestra.run.smithi189.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.9 MB/s | 2.4 MB 00:00 2024-09-19T06:35:31.248 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:35:31.248 INFO:teuthology.orchestra.run.smithi189.stdout:Total 16 MB/s | 226 MB 00:13 2024-09-19T06:35:32.481 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-19T06:35:32.633 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-19T06:35:32.633 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-19T06:35:34.444 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-19T06:35:34.444 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-19T06:35:35.898 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-19T06:35:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:35:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:35:36.225 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:35:36.413 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:35:36.463 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:35:36.530 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:35:36.825 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-19T06:35:36.862 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:35:36.958 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:35:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:36.996 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:35:37.058 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:35:37.092 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:35:37.093 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:37.118 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:35:37.123 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:37.169 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:35:37.215 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:37.244 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:35:37.418 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:35:37.476 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:35:37.501 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:35:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:37.608 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:37.637 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:37.722 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:37.731 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:37.747 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:37.769 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:37.924 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:37.942 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:37.971 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:38.063 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:38.092 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:35:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:38.211 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:35:38.242 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:35:38.297 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:35:38.320 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:38.325 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:38.379 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:38.428 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:38.452 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:38.514 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:38.536 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:38.563 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:38.603 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:35:38.755 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:35:38.835 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:35:38.869 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:35:38.884 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:38.932 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:35:38.986 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:35:39.019 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:35:39.027 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:35:39.062 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:35:39.095 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:35:39.123 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:35:39.134 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:39.190 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:35:39.220 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:39.270 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:35:39.457 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:39.492 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:35:39.575 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:35:39.645 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:35:39.676 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:35:39.705 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:35:39.729 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:35:39.739 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:35:39.764 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:35:39.804 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:35:39.807 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:35:39.835 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:35:39.849 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:35:39.881 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:35:39.905 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:35:39.933 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:35:39.950 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:35:39.982 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:35:40.010 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:35:40.023 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:35:40.079 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:35:40.133 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:35:40.156 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:35:40.163 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:35:40.199 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:35:40.203 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:35:40.275 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:35:40.318 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:35:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:35:40.390 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:35:40.460 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:35:40.505 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:35:40.580 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:35:40.713 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:35:40.716 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-19T06:35:40.717 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:35:40.766 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:35:40.806 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:35:40.813 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:35:40.836 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:35:40.859 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:35:40.879 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:35:40.917 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:35:40.921 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:35:40.955 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:35:40.962 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:35:40.981 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:35:41.024 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:35:41.140 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:35:41.203 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:35:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:35:41.301 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:35:41.338 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:35:41.371 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:35:41.378 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:35:41.407 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:35:41.417 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:35:41.432 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:35:41.462 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:35:41.476 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:35:41.498 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:35:41.522 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:35:41.541 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:35:41.548 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:41.564 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:35:41.583 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:35:41.670 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:35:41.699 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:41.717 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:35:41.736 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:35:41.752 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:35:41.790 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:35:41.793 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:35:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:35:41.820 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:35:41.847 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:35:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:35:41.920 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:35:41.927 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:35:41.953 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:35:41.971 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:35:41.978 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:35:41.997 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:35:42.009 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:35:42.034 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:35:42.034 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:35:42.052 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:35:42.061 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:42.097 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:35:42.133 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:35:42.139 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:35:42.149 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:35:42.171 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:42.182 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:35:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:35:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:42.260 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:35:42.262 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:35:42.291 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:35:42.318 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:35:42.322 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:35:42.357 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:35:42.368 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:35:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:35:42.409 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:35:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:35:42.456 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:35:42.492 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:35:42.520 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:35:42.525 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:35:42.558 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:35:42.559 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:35:42.594 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:35:42.599 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:35:42.611 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:35:42.625 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:35:42.650 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:35:42.678 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:35:42.720 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:35:42.723 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:35:42.724 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:35:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:42.852 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:35:42.857 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:35:42.883 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:35:42.896 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:42.911 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:35:42.914 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:35:42.945 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:35:42.993 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:35:43.123 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:35:43.209 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:35:43.239 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:35:43.258 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:35:43.273 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:35:43.307 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:35:43.349 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:35:43.360 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:35:43.383 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:35:43.396 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:35:43.439 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:35:43.471 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:35:43.513 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:35:43.521 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:35:43.553 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:35:43.574 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:35:43.613 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:35:43.637 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:35:43.656 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:35:43.658 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:35:43.686 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:35:43.689 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:35:43.704 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:35:43.717 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:35:43.720 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:35:43.787 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:35:43.817 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:35:43.849 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:35:43.858 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:35:43.887 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:35:43.903 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:35:43.931 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:35:43.989 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:35:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:35:44.023 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:35:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:35:44.085 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:35:44.122 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:35:44.192 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:35:44.207 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:35:44.237 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:35:44.254 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:35:44.319 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:35:44.331 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:35:44.427 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:35:44.461 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:35:44.477 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:35:44.514 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:35:44.518 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:35:44.646 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:35:44.699 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:35:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:35:44.831 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:35:44.863 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:35:44.990 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:35:45.048 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:35:45.049 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:35:45.078 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:35:45.135 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:35:45.156 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:35:45.163 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:35:45.210 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:35:45.214 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:35:45.252 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:35:45.293 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:35:45.447 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:35:45.522 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:35:45.585 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:35:45.658 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:35:45.706 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:35:45.742 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:35:45.789 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:35:45.806 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:35:45.824 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:35:45.868 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:35:45.910 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:35:45.927 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:35:46.055 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:35:46.095 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:35:46.137 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:35:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:35:46.270 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:35:46.310 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:35:46.335 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:35:46.360 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:35:46.436 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:35:46.472 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:35:46.559 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:35:46.563 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:35:46.587 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:35:46.613 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:35:46.752 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:35:46.788 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:35:46.822 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:35:46.861 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:35:46.901 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:35:46.922 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:35:46.930 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:35:46.965 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:35:46.966 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:47.007 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:35:47.057 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:35:47.057 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:47.088 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:35:47.091 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:35:47.125 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:35:47.165 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:35:47.179 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:35:47.221 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:35:47.243 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:35:47.252 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:35:47.271 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:35:47.304 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:35:47.364 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:35:47.420 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:35:47.605 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:35:47.614 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:35:47.636 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:47.659 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:47.707 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:35:47.758 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:47.789 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:35:47.825 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:35:48.151 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:35:48.200 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:35:48.234 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:35:48.307 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:35:48.332 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:35:48.337 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:48.400 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:48.407 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:35:48.423 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:35:48.461 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:35:48.549 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:35:48.588 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:35:48.777 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:35:48.811 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:35:48.890 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:35:49.540 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:35:49.652 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:35:50.048 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:50.076 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:50.654 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:50.747 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:50.747 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:35:50.747 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:35:50.748 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:35:50.798 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:35:50.881 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:50.899 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:35:50.920 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:50.989 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:35:51.017 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:35:51.050 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:35:51.362 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:35:51.405 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:51.469 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:51.513 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:35:51.515 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:51.543 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:35:51.579 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:35:51.599 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:51.599 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:35:51.599 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:35:51.599 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:35:51.633 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:35:52.066 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:35:52.091 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:52.171 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:35:52.201 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:35:54.512 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:54.547 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:55.094 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:35:55.134 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:35:55.228 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:35:55.228 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:35:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:35:55.260 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:36:02.561 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:36:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2024-09-19T06:36:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2024-09-19T06:36:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2024-09-19T06:36:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2024-09-19T06:36:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2024-09-19T06:36:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2024-09-19T06:36:02.562 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2024-09-19T06:36:02.562 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:02.736 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:36:02.752 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:36:02.752 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:02.752 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:36:02.752 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:03.417 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:36:03.417 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-09-19T06:36:03.417 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-09-19T06:36:03.417 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-09-19T06:36:03.417 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-09-19T06:36:03.417 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-09-19T06:36:03.418 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-09-19T06:36:03.418 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-09-19T06:36:03.418 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:03.591 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:36:03.611 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:36:03.611 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:03.611 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:36:03.611 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:36:04.274 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:36:04.275 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:04.275 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:36:04.275 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:36:04.275 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:36:04.275 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:04.498 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:36:04.522 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:36:04.522 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:04.522 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:36:04.522 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:36:04.522 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:36:04.522 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:04.957 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:36:04.981 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:36:04.981 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:04.981 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:36:04.981 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:36:04.981 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:36:04.981 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:05.087 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:36:05.103 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:36:05.130 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:36:05.130 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:05.130 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:36:05.131 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:36:05.131 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:36:05.131 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:05.135 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:36:05.190 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:36:05.362 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:36:05.382 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:36:05.386 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:36:05.386 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:05.386 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:36:05.386 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:36:05.386 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:36:05.386 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:05.424 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:36:05.501 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:36:05.591 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:36:05.730 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:36:05.786 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:36:05.821 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:36:05.823 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:36:05.845 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:36:05.845 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:05.845 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:36:05.845 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:36:05.845 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:36:05.845 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:05.851 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:36:05.951 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:36:06.008 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:36:06.064 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:36:06.250 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:36:06.298 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:36:06.305 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:36:06.341 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:36:06.373 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:36:06.376 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:36:06.435 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:36:06.464 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:36:06.465 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:36:06.605 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:36:06.657 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:36:06.689 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:36:06.717 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:36:07.121 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:36:07.121 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-09-19T06:36:07.121 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-09-19T06:36:07.122 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-09-19T06:36:07.122 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-09-19T06:36:07.122 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-09-19T06:36:07.122 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-09-19T06:36:07.122 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-09-19T06:36:07.122 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:07.129 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:36:07.158 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:36:07.189 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:36:07.260 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:36:07.294 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:36:07.297 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:36:07.310 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:36:07.310 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:07.310 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:36:07.310 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:07.516 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:36:07.566 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:36:08.351 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:36:08.391 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:36:08.538 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:36:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:36:08.669 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:36:08.804 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:36:08.832 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:36:08.833 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:08.838 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:36:08.860 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:36:08.885 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:36:08.885 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:08.885 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:36:08.885 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:36:08.885 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:36:08.885 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:08.936 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:36:08.948 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:36:09.046 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:36:09.089 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:36:09.100 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:36:09.113 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:36:09.113 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:09.113 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:36:09.113 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:36:09.113 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:36:09.113 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:09.359 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:36:09.392 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:36:09.495 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:36:09.574 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:36:09.598 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:36:09.598 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:09.598 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:36:09.598 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:36:09.598 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:36:09.599 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:09.662 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:36:09.694 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:36:09.713 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:36:09.718 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:36:09.718 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:09.719 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:36:09.719 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:36:09.719 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:36:09.719 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:09.770 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:36:09.770 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:36:09.782 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:36:09.825 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:36:09.887 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:36:09.935 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:36:10.012 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:36:10.027 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:36:10.056 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:36:10.058 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:36:10.079 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:36:10.079 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:10.079 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:36:10.080 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:36:10.080 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:36:10.080 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:10.123 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:36:10.136 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:36:10.145 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:36:10.146 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:10.146 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:36:10.146 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:10.190 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:36:10.213 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:36:10.213 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:10.213 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:36:10.213 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:36:10.214 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:36:10.214 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:10.225 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:36:10.365 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:36:10.417 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:36:10.449 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:36:10.493 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:36:10.516 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:36:10.539 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:36:10.539 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:10.539 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:36:10.539 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:36:10.540 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:36:10.540 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:10.863 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:36:10.898 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:36:10.922 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:36:10.923 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:10.923 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:36:10.923 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:36:10.923 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:36:10.923 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:10.954 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:36:10.965 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:36:10.988 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:36:10.988 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:10.988 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:36:10.989 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:10.991 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:36:11.023 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:36:11.041 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:36:11.064 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:36:11.064 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:11.065 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:36:11.065 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:36:11.065 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:36:11.065 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:11.085 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:36:11.114 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:36:11.375 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:36:11.399 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:36:11.399 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:11.399 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:36:11.399 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:36:11.399 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:36:11.399 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:12.168 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:36:12.199 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:36:13.170 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:36:13.191 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:36:13.294 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:36:13.462 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:36:13.493 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:36:13.518 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:36:13.518 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:13.518 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:36:13.518 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:36:13.518 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:36:13.518 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:13.569 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:36:13.582 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:36:13.680 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:36:13.726 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:36:14.653 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:36:14.680 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:36:14.704 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:36:14.704 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:14.705 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:36:14.705 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:36:14.705 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:36:14.705 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:14.747 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:36:14.770 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:36:14.770 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:14.771 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:36:14.771 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:14.831 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:36:14.854 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:36:14.855 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:14.855 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:36:14.855 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:36:14.855 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:36:14.855 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:15.157 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:36:15.180 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:36:15.180 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:36:15.180 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:36:15.180 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:36:15.181 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:36:15.181 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:15.453 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:36:15.494 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:36:15.535 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:36:15.567 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:36:15.595 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:36:15.782 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:36:15.832 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:36:15.863 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:36:15.892 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:36:15.938 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:36:15.947 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:36:15.979 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:36:16.028 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:36:16.069 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:36:16.096 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:36:16.277 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:36:16.327 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:36:16.357 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:36:16.387 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:36:16.442 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:36:16.535 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:36:16.578 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:36:16.598 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:36:17.106 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:36:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:36:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:36:17.424 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:36:17.508 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:36:17.557 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:36:17.643 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:36:17.678 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:36:17.704 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:36:17.729 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:36:17.730 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:36:17.821 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:36:17.822 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:36:17.905 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:36:17.931 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:36:17.936 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:36:17.936 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:36:18.004 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:36:18.097 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:36:18.116 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:36:18.116 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:36:18.137 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:36:18.209 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:36:18.221 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:36:18.250 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:36:18.276 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:36:18.282 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:18.302 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:36:18.302 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:36:18.386 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:36:18.386 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:36:18.462 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:36:18.487 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:36:18.493 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:36:18.493 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:36:18.673 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:36:18.673 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:36:18.748 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:36:18.811 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:19.768 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:36:19.809 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:36:19.850 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:36:19.882 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:36:19.909 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:36:20.092 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:36:20.148 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:36:20.178 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:36:20.207 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:36:20.253 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:36:20.829 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:36:20.868 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:36:20.889 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:36:21.745 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:36:21.830 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:36:21.871 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:36:21.961 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:36:21.991 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:36:22.017 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:36:22.043 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:36:22.043 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:36:22.135 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:36:22.135 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:36:22.219 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:36:22.244 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:36:22.250 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:36:22.250 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:36:22.429 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:36:22.429 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:36:22.513 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:36:22.577 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:36:24.020 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:36:24.020 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:36:24.020 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:36:24.020 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:36:24.020 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:36:24.020 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:36:24.698 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:36:24.699 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:36:24.700 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:36:24.701 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:36:24.701 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:36:24.701 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:36:24.701 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:36:24.701 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:36:24.701 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:36:24.701 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:36:24.701 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:36:24.701 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:36:24.702 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:36:24.703 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:36:24.704 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:36:24.705 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:36:24.706 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:36:24.707 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:36:24.708 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:36:24.709 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:36:24.710 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:36:24.711 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:36:26.735 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:26.736 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.737 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.738 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:36:26.739 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.740 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:36:26.741 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:36:26.743 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:36:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:36:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:36:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:36:26.747 INFO:teuthology.orchestra.run.smithi159.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:36:26.748 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:36:26.748 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:36:26.748 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:36:26.748 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:36:26.748 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-19T06:36:27.217 DEBUG:teuthology.parallel:result is None 2024-09-19T06:36:27.418 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:27.418 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:27.418 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-09-19T06:36:27.418 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:27.419 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:27.419 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:27.419 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:27.419 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.419 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.419 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:27.420 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:27.420 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-19T06:36:27.420 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:36:27.420 INFO:teuthology.orchestra.run.smithi203.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:36:27.420 INFO:teuthology.orchestra.run.smithi203.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:36:27.420 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:36:27.421 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.421 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.421 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.421 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.421 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.422 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.422 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.422 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.422 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.422 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.422 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.423 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.423 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.423 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.423 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.423 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.423 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.424 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.424 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.424 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.424 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.424 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.425 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.425 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:27.425 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:36:27.425 INFO:teuthology.orchestra.run.smithi203.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:36:27.425 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:36:27.425 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:36:27.426 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:36:27.427 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:36:27.428 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:36:27.429 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:36:27.430 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:36:27.431 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.432 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:36:27.433 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:36:27.434 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:36:27.435 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:36:27.435 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:36:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-19T06:36:27.865 DEBUG:teuthology.parallel:result is None 2024-09-19T06:36:28.133 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:28.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:36:28.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:36:28.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:36:28.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:36:28.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:36:28.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:36:28.133 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:36:28.134 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:36:28.135 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:36:28.136 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:36:28.137 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:36:28.138 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:36:28.139 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:36:28.140 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:36:28.141 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:36:28.142 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:36:28.143 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:36:28.144 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:36:28.145 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:36:30.959 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:36:30.959 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:30.959 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-09-19T06:36:30.959 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:30.959 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:30.959 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:36:30.960 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.961 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.962 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:36:30.963 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.964 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:36:30.965 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:36:30.966 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:36:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:36:30.968 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:36:30.969 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.970 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:36:30.971 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:36:30.972 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:36:30.973 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:36:30.973 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:36:30.973 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:36:30.973 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:36:30.973 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:36:30.973 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-19T06:36:31.403 DEBUG:teuthology.parallel:result is None 2024-09-19T06:36:31.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:36:31.561 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:36:31.587 INFO:teuthology.orchestra.run.smithi159.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:36:31.588 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:36:31.588 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:36:31.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:36:31.732 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:36:31.756 INFO:teuthology.orchestra.run.smithi189.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:36:31.756 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:36:31.756 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:36:31.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:36:31.901 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:36:31.928 INFO:teuthology.orchestra.run.smithi203.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:36:31.929 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:36:31.929 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:36:31.930 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T06:36:31.931 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:36:31.931 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:36:31.964 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:36:31.964 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:36:31.994 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:36:31.995 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:36:32.026 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T06:36:32.026 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:36:32.027 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:36:32.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:36:32.124 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:36:32.124 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:36:32.151 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:36:32.219 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:36:32.220 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:36:32.249 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:36:32.319 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T06:36:32.319 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:36:32.319 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:36:32.348 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:36:32.415 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:36:32.415 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:36:32.442 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:36:32.508 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:36:32.508 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:36:32.538 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:36:32.608 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T06:36:32.608 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:36:32.608 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:36:32.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:36:32.702 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:36:32.702 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:36:32.729 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:36:32.796 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:36:32.796 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:36:32.826 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:36:32.895 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T06:36:33.029 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T06:36:33.029 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:36:33.029 INFO:tasks.cephadm:Cluster fsid is 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:36:33.030 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T06:36:33.030 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.159', 'mon.b': '172.21.15.189', 'mon.c': '172.21.15.203'} 2024-09-19T06:36:33.030 INFO:tasks.cephadm:First mon is mon.a on smithi159 2024-09-19T06:36:33.030 INFO:tasks.cephadm:First mgr is x 2024-09-19T06:36:33.030 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T06:36:33.030 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname $(hostname -s) 2024-09-19T06:36:33.060 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-09-19T06:36:33.088 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname $(hostname -s) 2024-09-19T06:36:33.119 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T06:36:33.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:36:33.268 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T06:36:33.412 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:36:33.414 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:36:33.414 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:36:33.414 DEBUG:teuthology.orchestra.run.smithi159:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:36:33.806 INFO:teuthology.orchestra.run.smithi159.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:36 /home/ubuntu/cephtest/cephadm 2024-09-19T06:36:33.806 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:36:34.201 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:36 /home/ubuntu/cephtest/cephadm 2024-09-19T06:36:34.201 DEBUG:teuthology.orchestra.run.smithi203:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:36:34.586 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:36 /home/ubuntu/cephtest/cephadm 2024-09-19T06:36:34.587 DEBUG:teuthology.orchestra.run.smithi159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:36:34.606 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:36:34.626 DEBUG:teuthology.orchestra.run.smithi203:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:36:34.662 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T06:36:34.662 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:36:34.665 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:36:34.669 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:36:36.236 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:36:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:36:36.359 INFO:teuthology.orchestra.run.smithi203.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:37:07.100 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-19T06:37:07.100 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:37:07.100 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:37:07.101 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-09-19T06:37:07.101 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:37:07.101 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-09-19T06:37:07.101 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-19T06:37:25.062 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:37:25.063 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:37:25.063 INFO:teuthology.orchestra.run.smithi159.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:37:25.063 INFO:teuthology.orchestra.run.smithi159.stdout: "repo_digests": [ 2024-09-19T06:37:25.063 INFO:teuthology.orchestra.run.smithi159.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:37:25.063 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:37:25.063 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:37:29.274 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T06:37:29.274 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:37:29.274 INFO:teuthology.orchestra.run.smithi203.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:37:29.274 INFO:teuthology.orchestra.run.smithi203.stdout: "repo_digests": [ 2024-09-19T06:37:29.274 INFO:teuthology.orchestra.run.smithi203.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:37:29.274 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-19T06:37:29.274 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T06:37:29.299 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph 2024-09-19T06:37:29.334 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-09-19T06:37:29.369 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph 2024-09-19T06:37:29.397 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /etc/ceph 2024-09-19T06:37:29.425 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-09-19T06:37:29.454 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /etc/ceph 2024-09-19T06:37:29.478 INFO:tasks.cephadm:Writing seed config... 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T06:37:29.480 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T06:37:29.481 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T06:37:29.482 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T06:37:29.482 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T06:37:29.482 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T06:37:29.482 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T06:37:29.482 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T06:37:29.482 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T06:37:29.482 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T06:37:29.482 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T06:37:29.483 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T06:37:29.484 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T06:37:29.484 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:37:29.484 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T06:37:29.502 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 82c73dba-7651-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T06:37:29.502 DEBUG:teuthology.orchestra.run.smithi159:mon.a> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T06:37:29.545 DEBUG:teuthology.orchestra.run.smithi159:mgr.x> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T06:37:29.588 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T06:37:29.589 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 82c73dba-7651-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.159 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:37:29.790 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:37:29.790 INFO:teuthology.orchestra.run.smithi159.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '82c73dba-7651-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.159', '--skip-admin-label'] 2024-09-19T06:37:29.790 INFO:teuthology.orchestra.run.smithi159.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T06:37:29.791 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying podman|docker is present... 2024-09-19T06:37:29.814 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:37:29.814 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying lvm2 is present... 2024-09-19T06:37:29.814 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying time synchronization is in place... 2024-09-19T06:37:29.822 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:37:29.822 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:37:29.828 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:37:29.828 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-09-19T06:37:29.835 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout enabled 2024-09-19T06:37:29.841 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout active 2024-09-19T06:37:29.842 INFO:teuthology.orchestra.run.smithi159.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:37:29.842 INFO:teuthology.orchestra.run.smithi159.stdout:Repeating the final host check... 2024-09-19T06:37:29.865 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:37:29.865 INFO:teuthology.orchestra.run.smithi159.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T06:37:29.865 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl is present 2024-09-19T06:37:29.865 INFO:teuthology.orchestra.run.smithi159.stdout:lvcreate is present 2024-09-19T06:37:29.871 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:37:29.872 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:37:29.878 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:37:29.878 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-09-19T06:37:29.884 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout enabled 2024-09-19T06:37:29.891 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout active 2024-09-19T06:37:29.891 INFO:teuthology.orchestra.run.smithi159.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:37:29.891 INFO:teuthology.orchestra.run.smithi159.stdout:Host looks OK 2024-09-19T06:37:29.891 INFO:teuthology.orchestra.run.smithi159.stdout:Cluster fsid: 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:29.891 INFO:teuthology.orchestra.run.smithi159.stdout:Acquiring lock 140120537805824 on /run/cephadm/82c73dba-7651-11ef-bceb-c7b262605968.lock 2024-09-19T06:37:29.891 INFO:teuthology.orchestra.run.smithi159.stdout:Lock 140120537805824 acquired on /run/cephadm/82c73dba-7651-11ef-bceb-c7b262605968.lock 2024-09-19T06:37:29.891 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying IP 172.21.15.159 port 3300 ... 2024-09-19T06:37:29.892 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying IP 172.21.15.159 port 6789 ... 2024-09-19T06:37:29.892 INFO:teuthology.orchestra.run.smithi159.stdout:Base mon IP(s) is [172.21.15.159:3300, 172.21.15.159:6789], mon addrv is [v2:172.21.15.159:3300,v1:172.21.15.159:6789] 2024-09-19T06:37:29.895 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.159 metric 100 2024-09-19T06:37:29.895 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.159 metric 100 2024-09-19T06:37:29.898 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T06:37:29.898 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T06:37:29.898 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T06:37:29.900 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T06:37:29.900 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T06:37:29.900 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:37:29.901 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T06:37:29.901 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:724f/64 scope link noprefixroute 2024-09-19T06:37:29.901 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:37:29.901 INFO:teuthology.orchestra.run.smithi159.stdout:Mon IP `172.21.15.159` is in CIDR network `172.21.0.0/20` 2024-09-19T06:37:29.901 INFO:teuthology.orchestra.run.smithi159.stdout:Mon IP `172.21.15.159` is in CIDR network `172.21.0.0/20` 2024-09-19T06:37:29.902 INFO:teuthology.orchestra.run.smithi159.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T06:37:29.902 INFO:teuthology.orchestra.run.smithi159.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T06:37:29.902 INFO:teuthology.orchestra.run.smithi159.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:37:30.324 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:37:30.324 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:37:30.324 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T06:37:30.324 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T06:37:30.324 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T06:37:30.324 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:37:30.325 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi159.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:37:31.220 INFO:teuthology.orchestra.run.smithi159.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:37:31.220 INFO:teuthology.orchestra.run.smithi159.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T06:37:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:stat: stdout 167 167 2024-09-19T06:37:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:Creating initial keys... 2024-09-19T06:37:33.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph-authtool: stdout AQCsxutmoq1LHRAAfr+J3NAps4gX5RWn31i+Eg== 2024-09-19T06:37:34.171 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph-authtool: stdout AQCtxutm2PAfIRAAorUNlimyp2AR2TqEHPh6xA== 2024-09-19T06:37:35.135 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph-authtool: stdout AQCuxutmjr39HhAAbaInyZrk8QpQt+2YwiwBXQ== 2024-09-19T06:37:35.136 INFO:teuthology.orchestra.run.smithi159.stdout:Creating initial monmap... 2024-09-19T06:37:36.134 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:37:36.134 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T06:37:36.134 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:36.134 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:37:36.134 INFO:teuthology.orchestra.run.smithi159.stdout:monmaptool for a [v2:172.21.15.159:3300,v1:172.21.15.159:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:37:36.134 INFO:teuthology.orchestra.run.smithi159.stdout:setting min_mon_release = quincy 2024-09-19T06:37:36.134 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: set fsid to 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:36.134 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:37:36.134 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:37:36.135 INFO:teuthology.orchestra.run.smithi159.stdout:Creating mon... 2024-09-19T06:37:37.081 INFO:teuthology.orchestra.run.smithi159.stdout:create mon.a on 2024-09-19T06:37:37.300 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T06:37:37.461 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T06:37:37.640 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-82c73dba-7651-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-82c73dba-7651-11ef-bceb-c7b262605968.target. 2024-09-19T06:37:37.641 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-82c73dba-7651-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-82c73dba-7651-11ef-bceb-c7b262605968.target. 2024-09-19T06:37:37.903 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:37:37.903 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Failed to reset failed state of unit ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T06:37:38.086 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-82c73dba-7651-11ef-bceb-c7b262605968.target.wants/ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-82c73dba-7651-11ef-bceb-c7b262605968@.service. 2024-09-19T06:37:38.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:38 smithi159 podman[30548]: 2024-09-19 06:37:38.223717355 +0000 UTC m=+0.016600665 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:37:38.605 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:37:38.606 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout disabled 2024-09-19T06:37:38.613 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:37:38.613 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-09-19T06:37:38.613 INFO:teuthology.orchestra.run.smithi159.stdout:firewalld.service is not enabled 2024-09-19T06:37:38.613 INFO:teuthology.orchestra.run.smithi159.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:37:38.613 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mon to start... 2024-09-19T06:37:38.613 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mon... 2024-09-19T06:37:38.687 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:38 smithi159 podman[30548]: 2024-09-19 06:37:38.515985224 +0000 UTC m=+0.308868551 container init 2a4b5999f47d5dd49806bedb6e2887f32ed3696bce114c64d93c248a70b8dd6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T06:37:38.688 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:38 smithi159 podman[30548]: 2024-09-19 06:37:38.51926251 +0000 UTC m=+0.312145822 container start 2a4b5999f47d5dd49806bedb6e2887f32ed3696bce114c64d93c248a70b8dd6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T06:37:38.688 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:38 smithi159 ceph-mon[30567]: mkfs 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:38.688 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:38 smithi159 ceph-mon[30567]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:37:38.688 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:38 smithi159 bash[30548]: 2a4b5999f47d5dd49806bedb6e2887f32ed3696bce114c64d93c248a70b8dd6a 2024-09-19T06:37:38.688 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:38 smithi159 systemd[1]: Started Ceph mon.a for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:37:39.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:37:39.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: monmap epoch 1 2024-09-19T06:37:39.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:39.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: last_changed 2024-09-19T06:37:35.440913+0000 2024-09-19T06:37:39.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:37:39.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: min_mon_release 19 (squid) 2024-09-19T06:37:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: election_strategy: 1 2024-09-19T06:37:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:37:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: fsmap 2024-09-19T06:37:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:37:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: mgrmap e1: no daemons active 2024-09-19T06:37:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:39 smithi159 ceph-mon[30567]: from='client.? 172.21.15.159:0/3767414273' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T06:37:41.489 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T06:37:41.489 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout id: 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:41.489 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T06:37:41.489 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:37:41.489 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout services: 2024-09-19T06:37:41.489 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.602764s) 2024-09-19T06:37:41.489 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T06:37:41.489 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout data: 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.087+0000 7f2e917e3640 1 Processor -- start 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.087+0000 7f2e917e3640 1 -- start start 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.088+0000 7f2e917e3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.088+0000 7f2e917e3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c106ee0 con 0x7f2e8c106510 2024-09-19T06:37:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.088+0000 7f2e8affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.088+0000 7f2e8affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49868/0 (socket says 172.21.15.159:49868) 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.088+0000 7f2e8affd640 1 -- 172.21.15.159:0/1602545183 learned_addr learned my addr 172.21.15.159:0/1602545183 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.088+0000 7f2e8affd640 1 -- 172.21.15.159:0/1602545183 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c1076c0 con 0x7f2e8c106510 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.090+0000 7f2e8affd640 1 --2- 172.21.15.159:0/1602545183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c106910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009e80 tx=0x7f2e7c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a179052e1aa4bc1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.090+0000 7f2e89ffb640 1 -- 172.21.15.159:0/1602545183 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e7c036070 con 0x7f2e8c106510 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.090+0000 7f2e89ffb640 1 -- 172.21.15.159:0/1602545183 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c031400 con 0x7f2e8c106510 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.090+0000 7f2e89ffb640 1 -- 172.21.15.159:0/1602545183 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e7c031700 con 0x7f2e8c106510 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.091+0000 7f2e917e3640 1 -- 172.21.15.159:0/1602545183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 msgr2=0x7f2e8c106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.091+0000 7f2e917e3640 1 --2- 172.21.15.159:0/1602545183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c106910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009e80 tx=0x7f2e7c02a7a0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.091+0000 7f2e917e3640 1 -- 172.21.15.159:0/1602545183 shutdown_connections 2024-09-19T06:37:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.091+0000 7f2e917e3640 1 --2- 172.21.15.159:0/1602545183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c106910 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.091+0000 7f2e917e3640 1 -- 172.21.15.159:0/1602545183 >> 172.21.15.159:0/1602545183 conn(0x7f2e8c101ca0 msgr2=0x7f2e8c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.091+0000 7f2e917e3640 1 -- 172.21.15.159:0/1602545183 shutdown_connections 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.091+0000 7f2e917e3640 1 -- 172.21.15.159:0/1602545183 wait complete. 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.091+0000 7f2e917e3640 1 Processor -- start 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.092+0000 7f2e917e3640 1 -- start start 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.092+0000 7f2e917e3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c18f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.092+0000 7f2e917e3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c107c60 con 0x7f2e8c106510 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.092+0000 7f2e8affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c18f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.092+0000 7f2e8affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c18f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49882/0 (socket says 172.21.15.159:49882) 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.092+0000 7f2e8affd640 1 -- 172.21.15.159:0/3767414273 learned_addr learned my addr 172.21.15.159:0/3767414273 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.092+0000 7f2e8affd640 1 -- 172.21.15.159:0/3767414273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c18f5c0 con 0x7f2e8c106510 2024-09-19T06:37:41.492 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.092+0000 7f2e8affd640 1 --2- 172.21.15.159:0/3767414273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c18f080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c034040 tx=0x7f2e7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.093+0000 7f2e73fff640 1 -- 172.21.15.159:0/3767414273 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e7c041070 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.093+0000 7f2e73fff640 1 -- 172.21.15.159:0/3767414273 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c03c650 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.093+0000 7f2e73fff640 1 -- 172.21.15.159:0/3767414273 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e7c036040 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.093+0000 7f2e917e3640 1 -- 172.21.15.159:0/3767414273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c18d7b0 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.093+0000 7f2e917e3640 1 -- 172.21.15.159:0/3767414273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c18dcf0 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.093+0000 7f2e73fff640 1 -- 172.21.15.159:0/3767414273 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e7c044070 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.093+0000 7f2e73fff640 1 -- 172.21.15.159:0/3767414273 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2e7c046c10 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.094+0000 7f2e917e3640 1 -- 172.21.15.159:0/3767414273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8c1082b0 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.096+0000 7f2e73fff640 1 -- 172.21.15.159:0/3767414273 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2e7c03c950 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.156+0000 7f2e917e3640 1 -- 172.21.15.159:0/3767414273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f2e8c18e3f0 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.157+0000 7f2e73fff640 1 -- 172.21.15.159:0/3767414273 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f2e7c03cb30 con 0x7f2e8c106510 2024-09-19T06:37:41.493 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.158+0000 7f2e917e3640 1 -- 172.21.15.159:0/3767414273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 msgr2=0x7f2e8c18f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:41.494 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.158+0000 7f2e917e3640 1 --2- 172.21.15.159:0/3767414273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c18f080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c034040 tx=0x7f2e7c004a40 comp rx=0 tx=0).stop 2024-09-19T06:37:41.494 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.158+0000 7f2e917e3640 1 -- 172.21.15.159:0/3767414273 shutdown_connections 2024-09-19T06:37:41.494 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.158+0000 7f2e917e3640 1 --2- 172.21.15.159:0/3767414273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e8c106510 0x7f2e8c18f080 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:41.494 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.158+0000 7f2e917e3640 1 -- 172.21.15.159:0/3767414273 >> 172.21.15.159:0/3767414273 conn(0x7f2e8c101ca0 msgr2=0x7f2e8c07b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:41.494 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.158+0000 7f2e917e3640 1 -- 172.21.15.159:0/3767414273 shutdown_connections 2024-09-19T06:37:41.494 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:39.158+0000 7f2e917e3640 1 -- 172.21.15.159:0/3767414273 wait complete. 2024-09-19T06:37:41.494 INFO:teuthology.orchestra.run.smithi159.stdout:mon is available 2024-09-19T06:37:41.494 INFO:teuthology.orchestra.run.smithi159.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T06:37:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:44 smithi159 ceph-mon[30567]: from='client.? 172.21.15.159:0/627564502' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:37:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:44 smithi159 ceph-mon[30567]: from='client.? 172.21.15.159:0/627564502' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T06:37:50.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:37:50.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:37:50.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout fsid = 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:50.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.159:3300,v1:172.21.15.159:6789] 2024-09-19T06:37:50.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:37:50.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.660+0000 7f2153f5b640 1 Processor -- start 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.660+0000 7f2153f5b640 1 -- start start 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.660+0000 7f2153f5b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.660+0000 7f2153f5b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f214c107ff0 con 0x7f214c107620 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.661+0000 7f2151cf7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.661+0000 7f2151cf7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50382/0 (socket says 172.21.15.159:50382) 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.661+0000 7f2151cf7640 1 -- 172.21.15.159:0/3380122930 learned_addr learned my addr 172.21.15.159:0/3380122930 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.661+0000 7f2151cf7640 1 -- 172.21.15.159:0/3380122930 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c108820 con 0x7f214c107620 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.662+0000 7f2151cf7640 1 --2- 172.21.15.159:0/3380122930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c107a20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2148009820 tx=0x7f214802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46134c3621d17d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.662+0000 7f2150cf5640 1 -- 172.21.15.159:0/3380122930 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2148037070 con 0x7f214c107620 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.662+0000 7f2150cf5640 1 -- 172.21.15.159:0/3380122930 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2148032440 con 0x7f214c107620 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.662+0000 7f2150cf5640 1 -- 172.21.15.159:0/3380122930 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2148032740 con 0x7f214c107620 2024-09-19T06:37:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.662+0000 7f2153f5b640 1 -- 172.21.15.159:0/3380122930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 msgr2=0x7f214c107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.662+0000 7f2153f5b640 1 --2- 172.21.15.159:0/3380122930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c107a20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2148009820 tx=0x7f214802a270 comp rx=0 tx=0).stop 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.662+0000 7f2153f5b640 1 -- 172.21.15.159:0/3380122930 shutdown_connections 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.662+0000 7f2153f5b640 1 --2- 172.21.15.159:0/3380122930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c107a20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.662+0000 7f2153f5b640 1 -- 172.21.15.159:0/3380122930 >> 172.21.15.159:0/3380122930 conn(0x7f214c102db0 msgr2=0x7f214c1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.663+0000 7f2153f5b640 1 -- 172.21.15.159:0/3380122930 shutdown_connections 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.663+0000 7f2153f5b640 1 -- 172.21.15.159:0/3380122930 wait complete. 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.663+0000 7f2153f5b640 1 Processor -- start 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.663+0000 7f2153f5b640 1 -- start start 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.663+0000 7f2153f5b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c07db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.663+0000 7f2153f5b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f214c108dc0 con 0x7f214c107620 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.663+0000 7f2151cf7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c07db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.663+0000 7f2151cf7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c07db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50384/0 (socket says 172.21.15.159:50384) 2024-09-19T06:37:50.690 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.663+0000 7f2151cf7640 1 -- 172.21.15.159:0/627564502 learned_addr learned my addr 172.21.15.159:0/627564502 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.664+0000 7f2151cf7640 1 -- 172.21.15.159:0/627564502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c07e080 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.664+0000 7f2151cf7640 1 --2- 172.21.15.159:0/627564502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c07db40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f21480090b0 tx=0x7f21480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.664+0000 7f2142ffd640 1 -- 172.21.15.159:0/627564502 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2148041070 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.664+0000 7f2142ffd640 1 -- 172.21.15.159:0/627564502 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f214803c7a0 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.664+0000 7f2142ffd640 1 -- 172.21.15.159:0/627564502 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2148037040 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.664+0000 7f2153f5b640 1 -- 172.21.15.159:0/627564502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214c07c270 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.664+0000 7f2153f5b640 1 -- 172.21.15.159:0/627564502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214c07c7b0 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.664+0000 7f2142ffd640 1 -- 172.21.15.159:0/627564502 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2148044070 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.664+0000 7f2142ffd640 1 -- 172.21.15.159:0/627564502 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f214803d3f0 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.665+0000 7f2153f5b640 1 -- 172.21.15.159:0/627564502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214c109410 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.667+0000 7f2142ffd640 1 -- 172.21.15.159:0/627564502 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2148046450 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.726+0000 7f2153f5b640 1 -- 172.21.15.159:0/627564502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f214c07cab0 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.729+0000 7f2142ffd640 1 -- 172.21.15.159:0/627564502 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f2148046630 con 0x7f214c107620 2024-09-19T06:37:50.691 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.730+0000 7f2142ffd640 1 -- 172.21.15.159:0/627564502 <== mon.0 v2:172.21.15.159:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2148056070 con 0x7f214c107620 2024-09-19T06:37:50.692 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.731+0000 7f2153f5b640 1 -- 172.21.15.159:0/627564502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 msgr2=0x7f214c07db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:50.692 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.731+0000 7f2153f5b640 1 --2- 172.21.15.159:0/627564502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c07db40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f21480090b0 tx=0x7f21480046c0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.692 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.731+0000 7f2153f5b640 1 -- 172.21.15.159:0/627564502 shutdown_connections 2024-09-19T06:37:50.692 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.731+0000 7f2153f5b640 1 --2- 172.21.15.159:0/627564502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f214c107620 0x7f214c07db40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.692 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.731+0000 7f2153f5b640 1 -- 172.21.15.159:0/627564502 >> 172.21.15.159:0/627564502 conn(0x7f214c102db0 msgr2=0x7f214c18f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:50.692 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.731+0000 7f2153f5b640 1 -- 172.21.15.159:0/627564502 shutdown_connections 2024-09-19T06:37:50.692 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:44.731+0000 7f2153f5b640 1 -- 172.21.15.159:0/627564502 wait complete. 2024-09-19T06:37:50.692 INFO:teuthology.orchestra.run.smithi159.stdout:Generating new minimal ceph.conf... 2024-09-19T06:37:51.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:51 smithi159 ceph-mon[30567]: from='client.? 172.21.15.159:0/2666080905' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.073+0000 7f957a4df640 1 Processor -- start 2024-09-19T06:37:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.073+0000 7f957a4df640 1 -- start start 2024-09-19T06:37:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.073+0000 7f957a4df640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f9574107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.073+0000 7f957a4df640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9574107ff0 con 0x7f9574107620 2024-09-19T06:37:51.719 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.073+0000 7f9573fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f9574107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:51.719 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.074+0000 7f9573fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f9574107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36390/0 (socket says 172.21.15.159:36390) 2024-09-19T06:37:51.720 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.074+0000 7f9573fff640 1 -- 172.21.15.159:0/4047497587 learned_addr learned my addr 172.21.15.159:0/4047497587 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:51.720 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.074+0000 7f9573fff640 1 -- 172.21.15.159:0/4047497587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9574108820 con 0x7f9574107620 2024-09-19T06:37:51.720 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.074+0000 7f9573fff640 1 --2- 172.21.15.159:0/4047497587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f9574107a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9564009820 tx=0x7f956402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9357734fd74ba7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:51.720 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f9572ffd640 1 -- 172.21.15.159:0/4047497587 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9564037070 con 0x7f9574107620 2024-09-19T06:37:51.720 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f9572ffd640 1 -- 172.21.15.159:0/4047497587 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9564032900 con 0x7f9574107620 2024-09-19T06:37:51.720 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f9572ffd640 1 -- 172.21.15.159:0/4047497587 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9564030850 con 0x7f9574107620 2024-09-19T06:37:51.720 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f957a4df640 1 -- 172.21.15.159:0/4047497587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 msgr2=0x7f9574107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:51.720 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f957a4df640 1 --2- 172.21.15.159:0/4047497587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f9574107a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9564009820 tx=0x7f956402a270 comp rx=0 tx=0).stop 2024-09-19T06:37:51.720 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f957a4df640 1 -- 172.21.15.159:0/4047497587 shutdown_connections 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f957a4df640 1 --2- 172.21.15.159:0/4047497587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f9574107a20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f957a4df640 1 -- 172.21.15.159:0/4047497587 >> 172.21.15.159:0/4047497587 conn(0x7f9574102db0 msgr2=0x7f95741051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f957a4df640 1 -- 172.21.15.159:0/4047497587 shutdown_connections 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.075+0000 7f957a4df640 1 -- 172.21.15.159:0/4047497587 wait complete. 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.076+0000 7f957a4df640 1 Processor -- start 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.076+0000 7f957a4df640 1 -- start start 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.076+0000 7f957a4df640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f957419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.076+0000 7f957a4df640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f957410bbd0 con 0x7f9574107620 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.076+0000 7f9573fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f957419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.076+0000 7f9573fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f957419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36394/0 (socket says 172.21.15.159:36394) 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.076+0000 7f9573fff640 1 -- 172.21.15.159:0/2666080905 learned_addr learned my addr 172.21.15.159:0/2666080905 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.077+0000 7f9573fff640 1 -- 172.21.15.159:0/2666080905 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957419bb90 con 0x7f9574107620 2024-09-19T06:37:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.077+0000 7f9573fff640 1 --2- 172.21.15.159:0/2666080905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f957419b650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9564009940 tx=0x7f95640326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.077+0000 7f95717fa640 1 -- 172.21.15.159:0/2666080905 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9564042070 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.077+0000 7f95717fa640 1 -- 172.21.15.159:0/2666080905 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9564032be0 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.077+0000 7f95717fa640 1 -- 172.21.15.159:0/2666080905 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9564037040 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.077+0000 7f957a4df640 1 -- 172.21.15.159:0/2666080905 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957419be20 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.077+0000 7f957a4df640 1 -- 172.21.15.159:0/2666080905 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957419eb10 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.077+0000 7f95717fa640 1 -- 172.21.15.159:0/2666080905 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9564045070 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.077+0000 7f95717fa640 1 -- 172.21.15.159:0/2666080905 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9564047a30 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.078+0000 7f957a4df640 1 -- 172.21.15.159:0/2666080905 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957410bd50 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.080+0000 7f95717fa640 1 -- 172.21.15.159:0/2666080905 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9564032d90 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.138+0000 7f957a4df640 1 -- 172.21.15.159:0/2666080905 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f957419ece0 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.139+0000 7f95717fa640 1 -- 172.21.15.159:0/2666080905 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f956403d430 con 0x7f9574107620 2024-09-19T06:37:51.722 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.140+0000 7f957a4df640 1 -- 172.21.15.159:0/2666080905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 msgr2=0x7f957419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:51.723 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.140+0000 7f957a4df640 1 --2- 172.21.15.159:0/2666080905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f957419b650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9564009940 tx=0x7f95640326e0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.723 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.140+0000 7f957a4df640 1 -- 172.21.15.159:0/2666080905 shutdown_connections 2024-09-19T06:37:51.723 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.140+0000 7f957a4df640 1 --2- 172.21.15.159:0/2666080905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9574107620 0x7f957419b650 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.723 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.140+0000 7f957a4df640 1 -- 172.21.15.159:0/2666080905 >> 172.21.15.159:0/2666080905 conn(0x7f9574102db0 msgr2=0x7f9574103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:51.723 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.140+0000 7f957a4df640 1 -- 172.21.15.159:0/2666080905 shutdown_connections 2024-09-19T06:37:51.723 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:51.140+0000 7f957a4df640 1 -- 172.21.15.159:0/2666080905 wait complete. 2024-09-19T06:37:51.723 INFO:teuthology.orchestra.run.smithi159.stdout:Restarting the monitor... 2024-09-19T06:37:51.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:51 smithi159 systemd[1]: Stopping Ceph mon.a for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:37:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:51 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a[30563]: 2024-09-19T06:37:51.995+0000 7fe3a3516640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:37:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:51 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a[30563]: 2024-09-19T06:37:51.995+0000 7fe3a3516640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T06:37:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:52 smithi159 podman[30810]: 2024-09-19 06:37:52.169807931 +0000 UTC m=+0.294098931 container died 2a4b5999f47d5dd49806bedb6e2887f32ed3696bce114c64d93c248a70b8dd6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:37:52.688 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:52 smithi159 podman[30810]: 2024-09-19 06:37:52.503763333 +0000 UTC m=+0.628054320 container cleanup 2a4b5999f47d5dd49806bedb6e2887f32ed3696bce114c64d93c248a70b8dd6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:37:52.689 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:52 smithi159 bash[30810]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:37:52.996 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:52 smithi159 podman[30822]: 2024-09-19 06:37:52.688085701 +0000 UTC m=+0.513945964 container remove 2a4b5999f47d5dd49806bedb6e2887f32ed3696bce114c64d93c248a70b8dd6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:37:52.996 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:52 smithi159 systemd[1]: ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T06:37:52.996 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:52 smithi159 systemd[1]: Stopped Ceph mon.a for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:37:52.996 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:52 smithi159 systemd[1]: Starting Ceph mon.a for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:37:53.250 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 podman[30916]: 2024-09-19 06:37:53.122295412 +0000 UTC m=+0.098027135 container create 2bf001ca4d2128d1d1a4b070a94cad4fc4d9f7e5b0d2d94218d0c5c3b79d9884 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:37:53.250 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 podman[30916]: 2024-09-19 06:37:53.040162684 +0000 UTC m=+0.015894371 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:37:53.413 INFO:teuthology.orchestra.run.smithi159.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T06:37:53.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 podman[30916]: 2024-09-19 06:37:53.341371697 +0000 UTC m=+0.317103381 container init 2bf001ca4d2128d1d1a4b070a94cad4fc4d9f7e5b0d2d94218d0c5c3b79d9884 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:37:53.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 podman[30916]: 2024-09-19 06:37:53.344465843 +0000 UTC m=+0.320197520 container start 2bf001ca4d2128d1d1a4b070a94cad4fc4d9f7e5b0d2d94218d0c5c3b79d9884 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T06:37:53.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:37:53.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:37:53.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: pidfile_write: ignore empty --pid-file 2024-09-19T06:37:53.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: load: jerasure load: lrc 2024-09-19T06:37:53.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Git sha 0 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: DB SUMMARY 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: DB Session ID: OYYUE4DQJVJA03Z47K0U 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105292 ; 2024-09-19T06:37:53.602 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.env: 0x55c1d7a73940 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.info_log: 0x55c1d9daf6e0 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.statistics: (nil) 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.use_fsync: 0 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:37:53.603 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:37:53.604 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.db_log_dir: 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.wal_dir: 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.write_buffer_manager: 0x55c1d9dbedc0 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:37:53.605 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:37:53.606 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:37:53.606 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:37:53.606 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:37:53.606 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:37:53.606 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:37:53.606 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.unordered_write: 0 2024-09-19T06:37:53.606 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:37:53.606 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:37:53.606 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:37:53.607 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:37:53.607 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.row_cache: None 2024-09-19T06:37:53.607 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.wal_filter: None 2024-09-19T06:37:53.607 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:37:53.608 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:37:53.609 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:37:53.609 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:37:53.609 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.wal_compression: 0 2024-09-19T06:37:53.609 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:37:53.609 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:37:53.609 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:37:53.609 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:37:53.609 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:37:53.610 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:37:53.610 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:37:53.610 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:37:53.610 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:37:53.610 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:37:53.610 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:37:53.610 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:37:53.610 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:37:53.611 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:37:53.611 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:37:53.611 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:37:53.611 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:37:53.612 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:37:53.612 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:37:53.612 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:37:53.612 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:37:53.612 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:37:53.612 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:37:53.612 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_open_files: -1 2024-09-19T06:37:53.612 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:37:53.612 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:37:53.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:37:53.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:37:53.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:37:53.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Compression algorithms supported: 2024-09-19T06:37:53.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: kZSTD supported: 0 2024-09-19T06:37:53.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:37:53.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:37:53.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.merge_operator: 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_filter: None 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:37:53.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c1d9daf320) 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: index_type: 0 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: data_block_index_type: 0 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: index_shortening: 1 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: checksum: 4 2024-09-19T06:37:53.615 INFO:journalctl@ceph.mon.a.smithi159.stdout: no_block_cache: 0 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: block_cache: 0x55c1d9da31f0 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: block_cache_options: 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: capacity : 536870912 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: num_shard_bits : 4 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: strict_capacity_limit : 0 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: block_cache_compressed: (nil) 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: persistent_cache: (nil) 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: block_size: 4096 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: block_size_deviation: 10 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: block_restart_interval: 16 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: index_block_restart_interval: 1 2024-09-19T06:37:53.616 INFO:journalctl@ceph.mon.a.smithi159.stdout: metadata_block_size: 4096 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: partition_filters: 0 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: use_delta_encoding: 1 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: filter_policy: bloomfilter 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: whole_key_filtering: 1 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: verify_compression: 0 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: format_version: 5 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: enable_index_compression: 1 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: block_align: 0 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: max_auto_readahead_size: 262144 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: prepopulate_block_cache: 0 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:37:53.617 INFO:journalctl@ceph.mon.a.smithi159.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression: NoCompression 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.num_levels: 7 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:37:53.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:37:53.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:37:53.620 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:37:53.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:37:53.622 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.ttl: 2592000 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:37:53.623 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T06:37:53.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1ca6219b-4d36-4c59-b9ad-d5c6747b6c98 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727873370142, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727873371167, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100359, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98244, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14290, "raw_average_key_size": 49, "raw_value_size": 90517, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726727873, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1ca6219b-4d36-4c59-b9ad-d5c6747b6c98", "db_session_id": "OYYUE4DQJVJA03Z47K0U", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727873371265, "job": 1, "event": "recovery_finished"} 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c1d9dd0e00 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: DB pointer 0x55c1d9ecc000 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout: ** DB Stats ** 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:37:53.625 INFO:journalctl@ceph.mon.a.smithi159.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: L0 2/0 99.87 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: Sum 2/0 99.87 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:37:53.626 INFO:journalctl@ceph.mon.a.smithi159.stdout: 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 146.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: Cumulative compaction: 0.00 GB write, 30.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:37:53.627 INFO:journalctl@ceph.mon.a.smithi159.stdout: Interval compaction: 0.00 GB write, 30.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: Block cache BinnedLRUCache@0x55c1d9da31f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: starting mon.a rank 0 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mon.a@-1(???) e1 preinit fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mon.a@-1(???).mds e1 new map 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mon.a@-1(???).mds e1 print_map 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: e1 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: btime 2024-09-19T06:37:38:555912+0000 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:37:53.628 INFO:journalctl@ceph.mon.a.smithi159.stdout: legacy client fscid: -1 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout: 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout: No filesystems configured 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 bash[30916]: 2bf001ca4d2128d1d1a4b070a94cad4fc4d9f7e5b0d2d94218d0c5c3b79d9884 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 systemd[1]: Started Ceph mon.a for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: monmap epoch 1 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: last_changed 2024-09-19T06:37:35.440913+0000 2024-09-19T06:37:53.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:37:53.630 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: min_mon_release 19 (squid) 2024-09-19T06:37:53.630 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: election_strategy: 1 2024-09-19T06:37:53.630 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:37:53.630 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: fsmap 2024-09-19T06:37:53.630 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:37:53.630 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:53 smithi159 ceph-mon[30935]: mgrmap e1: no daemons active 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.783+0000 7f85df684640 1 Processor -- start 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.783+0000 7f85df684640 1 -- start start 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.783+0000 7f85df684640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d810a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.783+0000 7f85df684640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f85d807bda0 con 0x7f85d8108160 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.783+0000 7f85dd420640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d810a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.784+0000 7f85dd420640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d810a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36400/0 (socket says 172.21.15.159:36400) 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.784+0000 7f85dd420640 1 -- 172.21.15.159:0/2410158207 learned_addr learned my addr 172.21.15.159:0/2410158207 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.784+0000 7f85dd420640 1 -- 172.21.15.159:0/2410158207 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d810aa90 con 0x7f85d8108160 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.786+0000 7f85dd420640 1 --2- 172.21.15.159:0/2410158207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d810a550 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009820 tx=0x7f85d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59773e76e17055c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:54.372 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.786+0000 7f85cffff640 1 -- 172.21.15.159:0/2410158207 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d4037070 con 0x7f85d8108160 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.786+0000 7f85cffff640 1 -- 172.21.15.159:0/2410158207 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85d4032900 con 0x7f85d8108160 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.786+0000 7f85cffff640 1 -- 172.21.15.159:0/2410158207 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d4030850 con 0x7f85d8108160 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.786+0000 7f85df684640 1 -- 172.21.15.159:0/2410158207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 msgr2=0x7f85d810a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.786+0000 7f85df684640 1 --2- 172.21.15.159:0/2410158207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d810a550 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009820 tx=0x7f85d402a270 comp rx=0 tx=0).stop 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85df684640 1 -- 172.21.15.159:0/2410158207 shutdown_connections 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85df684640 1 --2- 172.21.15.159:0/2410158207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d810a550 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85df684640 1 -- 172.21.15.159:0/2410158207 >> 172.21.15.159:0/2410158207 conn(0x7f85d8101c80 msgr2=0x7f85d81040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85df684640 1 -- 172.21.15.159:0/2410158207 shutdown_connections 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85df684640 1 -- 172.21.15.159:0/2410158207 wait complete. 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85df684640 1 Processor -- start 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85df684640 1 -- start start 2024-09-19T06:37:54.373 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85df684640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85df684640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f85d810ba10 con 0x7f85d8108160 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.787+0000 7f85dd420640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85dd420640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36404/0 (socket says 172.21.15.159:36404) 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85dd420640 1 -- 172.21.15.159:0/2688652397 learned_addr learned my addr 172.21.15.159:0/2688652397 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85dd420640 1 -- 172.21.15.159:0/2688652397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d819bb60 con 0x7f85d8108160 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85dd420640 1 --2- 172.21.15.159:0/2688652397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d819b620 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f85d40097f0 tx=0x7f85d4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85ce7fc640 1 -- 172.21.15.159:0/2688652397 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d4042070 con 0x7f85d8108160 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85ce7fc640 1 -- 172.21.15.159:0/2688652397 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85d4032ca0 con 0x7f85d8108160 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85df684640 1 -- 172.21.15.159:0/2688652397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d819bdf0 con 0x7f85d8108160 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85ce7fc640 1 -- 172.21.15.159:0/2688652397 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d4037040 con 0x7f85d8108160 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85df684640 1 -- 172.21.15.159:0/2688652397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d819eae0 con 0x7f85d8108160 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85ce7fc640 1 -- 172.21.15.159:0/2688652397 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f85d4045070 con 0x7f85d8108160 2024-09-19T06:37:54.374 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.788+0000 7f85ce7fc640 1 -- 172.21.15.159:0/2688652397 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f85d4047ad0 con 0x7f85d8108160 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.789+0000 7f85df684640 1 -- 172.21.15.159:0/2688652397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d81085c0 con 0x7f85d8108160 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.791+0000 7f85ce7fc640 1 -- 172.21.15.159:0/2688652397 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f85d403db10 con 0x7f85d8108160 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.847+0000 7f85df684640 1 -- 172.21.15.159:0/2688652397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f85d819f0c0 con 0x7f85d8108160 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.852+0000 7f85ce7fc640 1 -- 172.21.15.159:0/2688652397 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f85d403d430 con 0x7f85d8108160 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.853+0000 7f85df684640 1 -- 172.21.15.159:0/2688652397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 msgr2=0x7f85d819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.853+0000 7f85df684640 1 --2- 172.21.15.159:0/2688652397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d819b620 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f85d40097f0 tx=0x7f85d4030ec0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.853+0000 7f85df684640 1 -- 172.21.15.159:0/2688652397 shutdown_connections 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.853+0000 7f85df684640 1 --2- 172.21.15.159:0/2688652397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8108160 0x7f85d819b620 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.853+0000 7f85df684640 1 -- 172.21.15.159:0/2688652397 >> 172.21.15.159:0/2688652397 conn(0x7f85d8101c80 msgr2=0x7f85d81028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.853+0000 7f85df684640 1 -- 172.21.15.159:0/2688652397 shutdown_connections 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:53.853+0000 7f85df684640 1 -- 172.21.15.159:0/2688652397 wait complete. 2024-09-19T06:37:54.375 INFO:teuthology.orchestra.run.smithi159.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T06:37:54.436 INFO:teuthology.orchestra.run.smithi159.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:37:54.437 INFO:teuthology.orchestra.run.smithi159.stdout:Creating mgr... 2024-09-19T06:37:54.437 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T06:37:54.437 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T06:37:54.778 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:37:54.778 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Failed to reset failed state of unit ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T06:37:54.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:54 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2688652397' entity='client.admin' 2024-09-19T06:37:54.932 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-82c73dba-7651-11ef-bceb-c7b262605968.target.wants/ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-82c73dba-7651-11ef-bceb-c7b262605968@.service. 2024-09-19T06:37:55.494 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:37:55.494 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout disabled 2024-09-19T06:37:55.502 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:37:55.502 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-09-19T06:37:55.502 INFO:teuthology.orchestra.run.smithi159.stdout:firewalld.service is not enabled 2024-09-19T06:37:55.502 INFO:teuthology.orchestra.run.smithi159.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:37:55.512 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:37:55.512 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout disabled 2024-09-19T06:37:55.520 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:37:55.521 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-09-19T06:37:55.521 INFO:teuthology.orchestra.run.smithi159.stdout:firewalld.service is not enabled 2024-09-19T06:37:55.521 INFO:teuthology.orchestra.run.smithi159.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T06:37:55.521 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mgr to start... 2024-09-19T06:37:55.521 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mgr... 2024-09-19T06:37:55.531 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:55.495+0000 7ffac18cc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:37:55.805 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:55.573+0000 7ffac18cc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:37:55.805 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:55.730+0000 7ffac18cc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:37:55.805 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:55.803+0000 7ffac18cc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:37:56.143 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:56 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2597849788' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:37:56.144 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:55.961+0000 7ffac18cc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:37:56.144 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:56.142+0000 7ffac18cc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:37:56.730 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:56.464+0000 7ffac18cc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:37:56.730 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:56.526+0000 7ffac18cc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:37:56.730 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:56.728+0000 7ffac18cc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:37:57.094 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:37:57.096 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:37:57.096 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsid": "82c73dba-7651-11ef-bceb-c7b262605968", 2024-09-19T06:37:57.096 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:37:57.097 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:37:57.097 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:37:57.097 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:37:57.097 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:37:57.097 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:37:57.097 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:37:57.097 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:37:57.097 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:37:57.097 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:37:57.098 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:37:57.099 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:37:57.099 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:37:57.107 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:37:38:555912+0000", 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:37:57.108 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:37:38.556587+0000", 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:37:57.109 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.918+0000 7fcb309a3640 1 Processor -- start 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.919+0000 7fcb309a3640 1 -- start start 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.919+0000 7fcb309a3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.919+0000 7fcb309a3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c106ee0 con 0x7fcb2c106510 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.919+0000 7fcb2a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.919+0000 7fcb2a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36428/0 (socket says 172.21.15.159:36428) 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.919+0000 7fcb2a59c640 1 -- 172.21.15.159:0/1851678058 learned_addr learned my addr 172.21.15.159:0/1851678058 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.920+0000 7fcb2a59c640 1 -- 172.21.15.159:0/1851678058 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c1076c0 con 0x7fcb2c106510 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.921+0000 7fcb2a59c640 1 --2- 172.21.15.159:0/1851678058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c106910 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009820 tx=0x7fcb1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ed3470b06af74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.921+0000 7fcb2959a640 1 -- 172.21.15.159:0/1851678058 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c037070 con 0x7fcb2c106510 2024-09-19T06:37:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.921+0000 7fcb2959a640 1 -- 172.21.15.159:0/1851678058 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb1c032900 con 0x7fcb2c106510 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.921+0000 7fcb2959a640 1 -- 172.21.15.159:0/1851678058 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c030850 con 0x7fcb2c106510 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.922+0000 7fcb309a3640 1 -- 172.21.15.159:0/1851678058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 msgr2=0x7fcb2c106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.922+0000 7fcb309a3640 1 --2- 172.21.15.159:0/1851678058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c106910 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009820 tx=0x7fcb1c02a270 comp rx=0 tx=0).stop 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.922+0000 7fcb309a3640 1 -- 172.21.15.159:0/1851678058 shutdown_connections 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.922+0000 7fcb309a3640 1 --2- 172.21.15.159:0/1851678058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c106910 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.922+0000 7fcb309a3640 1 -- 172.21.15.159:0/1851678058 >> 172.21.15.159:0/1851678058 conn(0x7fcb2c101ca0 msgr2=0x7fcb2c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.922+0000 7fcb309a3640 1 -- 172.21.15.159:0/1851678058 shutdown_connections 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.922+0000 7fcb309a3640 1 -- 172.21.15.159:0/1851678058 wait complete. 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.923+0000 7fcb309a3640 1 Processor -- start 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.923+0000 7fcb309a3640 1 -- start start 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.923+0000 7fcb309a3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.923+0000 7fcb309a3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c10aa70 con 0x7fcb2c106510 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb2a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:57.111 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb2a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c19b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36442/0 (socket says 172.21.15.159:36442) 2024-09-19T06:37:57.112 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb2a59c640 1 -- 172.21.15.159:0/2597849788 learned_addr learned my addr 172.21.15.159:0/2597849788 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:37:57.112 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb2a59c640 1 -- 172.21.15.159:0/2597849788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c19bb70 con 0x7fcb2c106510 2024-09-19T06:37:57.112 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb2a59c640 1 --2- 172.21.15.159:0/2597849788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c19b630 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0097f0 tx=0x7fcb1c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:57.112 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb1b7fe640 1 -- 172.21.15.159:0/2597849788 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c042070 con 0x7fcb2c106510 2024-09-19T06:37:57.112 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb1b7fe640 1 -- 172.21.15.159:0/2597849788 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb1c032ca0 con 0x7fcb2c106510 2024-09-19T06:37:57.112 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb309a3640 1 -- 172.21.15.159:0/2597849788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c19be00 con 0x7fcb2c106510 2024-09-19T06:37:57.112 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb1b7fe640 1 -- 172.21.15.159:0/2597849788 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c037040 con 0x7fcb2c106510 2024-09-19T06:37:57.112 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.924+0000 7fcb309a3640 1 -- 172.21.15.159:0/2597849788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c19eaf0 con 0x7fcb2c106510 2024-09-19T06:37:57.112 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.925+0000 7fcb1b7fe640 1 -- 172.21.15.159:0/2597849788 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcb1c045070 con 0x7fcb2c106510 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.925+0000 7fcb1b7fe640 1 -- 172.21.15.159:0/2597849788 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcb1c0463b0 con 0x7fcb2c106510 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.926+0000 7fcb309a3640 1 -- 172.21.15.159:0/2597849788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2c10abf0 con 0x7fcb2c106510 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.928+0000 7fcb1b7fe640 1 -- 172.21.15.159:0/2597849788 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcb1c03da60 con 0x7fcb2c106510 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.992+0000 7fcb309a3640 1 -- 172.21.15.159:0/2597849788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcb2c02d940 con 0x7fcb2c106510 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.992+0000 7fcb1b7fe640 1 -- 172.21.15.159:0/2597849788 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fcb1c047440 con 0x7fcb2c106510 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.993+0000 7fcb309a3640 1 -- 172.21.15.159:0/2597849788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 msgr2=0x7fcb2c19b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.993+0000 7fcb309a3640 1 --2- 172.21.15.159:0/2597849788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c19b630 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0097f0 tx=0x7fcb1c030ec0 comp rx=0 tx=0).stop 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.993+0000 7fcb309a3640 1 -- 172.21.15.159:0/2597849788 shutdown_connections 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.993+0000 7fcb309a3640 1 --2- 172.21.15.159:0/2597849788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2c106510 0x7fcb2c19b630 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:57.113 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.993+0000 7fcb309a3640 1 -- 172.21.15.159:0/2597849788 >> 172.21.15.159:0/2597849788 conn(0x7fcb2c101ca0 msgr2=0x7fcb2c102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:57.114 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.993+0000 7fcb309a3640 1 -- 172.21.15.159:0/2597849788 shutdown_connections 2024-09-19T06:37:57.114 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:55.993+0000 7fcb309a3640 1 -- 172.21.15.159:0/2597849788 wait complete. 2024-09-19T06:37:57.114 INFO:teuthology.orchestra.run.smithi159.stdout:mgr not available, waiting (1/15)... 2024-09-19T06:37:57.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:57 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:57.612+0000 7ffac18cc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:37:57.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:57 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:57.679+0000 7ffac18cc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:37:58.642 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:58.386+0000 7ffac18cc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:37:58.642 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:58.500+0000 7ffac18cc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:37:58.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:58.641+0000 7ffac18cc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:37:58.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:58.702+0000 7ffac18cc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:37:58.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:58.848+0000 7ffac18cc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:37:59.203 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:58.915+0000 7ffac18cc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:37:59.203 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:58.975+0000 7ffac18cc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:37:59.203 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:59.136+0000 7ffac18cc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:37:59.203 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:59.202+0000 7ffac18cc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:37:59.476 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:59.269+0000 7ffac18cc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:37:59.477 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:59.352+0000 7ffac18cc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:37:59.477 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:59.416+0000 7ffac18cc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:37:59.477 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:37:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:37:59.475+0000 7ffac18cc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:37:59.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:37:59 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2289602190' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:38:00.203 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:38:00.203 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:38:00.203 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsid": "82c73dba-7651-11ef-bceb-c7b262605968", 2024-09-19T06:38:00.203 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:38:00.203 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:38:00.203 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:38:00.204 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:38:00.205 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:00.205 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:38:00.205 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:38:00.205 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:38:00.205 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:38:00.205 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:38:00.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:37:38:555912+0000", 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:38:00.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:37:38.556587+0000", 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:38:00.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.562+0000 7f36e50e1640 1 Processor -- start 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.562+0000 7f36e50e1640 1 -- start start 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.562+0000 7f36e50e1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e0106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.562+0000 7f36e50e1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f36e0106ee0 con 0x7f36e0106510 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.563+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e0106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.563+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e0106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57482/0 (socket says 172.21.15.159:57482) 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.563+0000 7f36ded9d640 1 -- 172.21.15.159:0/1418746928 learned_addr learned my addr 172.21.15.159:0/1418746928 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.563+0000 7f36ded9d640 1 -- 172.21.15.159:0/1418746928 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e01076c0 con 0x7f36e0106510 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.564+0000 7f36ded9d640 1 --2- 172.21.15.159:0/1418746928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e0106910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009820 tx=0x7f36d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83cedafaf41332c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.564+0000 7f36ddd9b640 1 -- 172.21.15.159:0/1418746928 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36d4037070 con 0x7f36e0106510 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.564+0000 7f36ddd9b640 1 -- 172.21.15.159:0/1418746928 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36d4032900 con 0x7f36e0106510 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.564+0000 7f36ddd9b640 1 -- 172.21.15.159:0/1418746928 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36d4030850 con 0x7f36e0106510 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.564+0000 7f36e50e1640 1 -- 172.21.15.159:0/1418746928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 msgr2=0x7f36e0106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:00.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.564+0000 7f36e50e1640 1 --2- 172.21.15.159:0/1418746928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e0106910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009820 tx=0x7f36d402a270 comp rx=0 tx=0).stop 2024-09-19T06:38:00.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.564+0000 7f36e50e1640 1 -- 172.21.15.159:0/1418746928 shutdown_connections 2024-09-19T06:38:00.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.564+0000 7f36e50e1640 1 --2- 172.21.15.159:0/1418746928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e0106910 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:00.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.564+0000 7f36e50e1640 1 -- 172.21.15.159:0/1418746928 >> 172.21.15.159:0/1418746928 conn(0x7f36e0101ca0 msgr2=0x7f36e01040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:00.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.565+0000 7f36e50e1640 1 -- 172.21.15.159:0/1418746928 shutdown_connections 2024-09-19T06:38:00.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.565+0000 7f36e50e1640 1 -- 172.21.15.159:0/1418746928 wait complete. 2024-09-19T06:38:00.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.565+0000 7f36e50e1640 1 Processor -- start 2024-09-19T06:38:00.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.565+0000 7f36e50e1640 1 -- start start 2024-09-19T06:38:00.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36e50e1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e007ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36e50e1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f36e010aa70 con 0x7f36e0106510 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e007ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e007ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57494/0 (socket says 172.21.15.159:57494) 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36ded9d640 1 -- 172.21.15.159:0/2289602190 learned_addr learned my addr 172.21.15.159:0/2289602190 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36ded9d640 1 -- 172.21.15.159:0/2289602190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e019e370 con 0x7f36e0106510 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36ded9d640 1 --2- 172.21.15.159:0/2289602190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e007ba60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36d40097f0 tx=0x7f36d4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36c7fff640 1 -- 172.21.15.159:0/2289602190 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36d4042070 con 0x7f36e0106510 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36c7fff640 1 -- 172.21.15.159:0/2289602190 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36d4032ca0 con 0x7f36e0106510 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36e50e1640 1 -- 172.21.15.159:0/2289602190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e019e540 con 0x7f36e0106510 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.566+0000 7f36c7fff640 1 -- 172.21.15.159:0/2289602190 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36d4037040 con 0x7f36e0106510 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.567+0000 7f36e50e1640 1 -- 172.21.15.159:0/2289602190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e019e960 con 0x7f36e0106510 2024-09-19T06:38:00.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.567+0000 7f36c5ffb640 1 -- 172.21.15.159:0/2289602190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e010abf0 con 0x7f36e0106510 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.567+0000 7f36c7fff640 1 -- 172.21.15.159:0/2289602190 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f36d4045070 con 0x7f36e0106510 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.568+0000 7f36c7fff640 1 -- 172.21.15.159:0/2289602190 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f36d4047780 con 0x7f36e0106510 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.570+0000 7f36c7fff640 1 -- 172.21.15.159:0/2289602190 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f36d403cda0 con 0x7f36e0106510 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.631+0000 7f36c5ffb640 1 -- 172.21.15.159:0/2289602190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f36e0062e40 con 0x7f36e0106510 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.631+0000 7f36c7fff640 1 -- 172.21.15.159:0/2289602190 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f36d403da60 con 0x7f36e0106510 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.632+0000 7f36c5ffb640 1 -- 172.21.15.159:0/2289602190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 msgr2=0x7f36e007ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.632+0000 7f36c5ffb640 1 --2- 172.21.15.159:0/2289602190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e007ba60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36d40097f0 tx=0x7f36d4030ec0 comp rx=0 tx=0).stop 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.632+0000 7f36c5ffb640 1 -- 172.21.15.159:0/2289602190 shutdown_connections 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.632+0000 7f36c5ffb640 1 --2- 172.21.15.159:0/2289602190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0106510 0x7f36e007ba60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.632+0000 7f36c5ffb640 1 -- 172.21.15.159:0/2289602190 >> 172.21.15.159:0/2289602190 conn(0x7f36e0101ca0 msgr2=0x7f36e0102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.633+0000 7f36c5ffb640 1 -- 172.21.15.159:0/2289602190 shutdown_connections 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:37:59.633+0000 7f36c5ffb640 1 -- 172.21.15.159:0/2289602190 wait complete. 2024-09-19T06:38:00.219 INFO:teuthology.orchestra.run.smithi159.stdout:mgr not available, waiting (2/15)... 2024-09-19T06:38:00.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:00.286+0000 7ffac18cc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:38:01.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: Activating manager daemon x 2024-09-19T06:38:01.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: mgrmap e2: x(active, starting, since 0.00302543s) 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: Manager daemon x is now available 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' 2024-09-19T06:38:01.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:00 smithi159 ceph-mon[30935]: from='mgr.14100 172.21.15.159:0/1801857420' entity='mgr.x' 2024-09-19T06:38:02.544 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:02 smithi159 ceph-mon[30935]: mgrmap e3: x(active, since 1.00745s) 2024-09-19T06:38:03.572 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:03 smithi159 ceph-mon[30935]: mgrmap e4: x(active, since 2s) 2024-09-19T06:38:03.572 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:03 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1311507247' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:38:03.574 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:38:03.586 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:38:03.586 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsid": "82c73dba-7651-11ef-bceb-c7b262605968", 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:38:03.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:38:03.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:38:03.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:37:38:555912+0000", 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:38:03.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:37:38.556587+0000", 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:38:03.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.698+0000 7f782ea70640 1 Processor -- start 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.698+0000 7f782ea70640 1 -- start start 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.698+0000 7f782ea70640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782810a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.698+0000 7f782ea70640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f782807bdc0 con 0x7f7828108140 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.699+0000 7f782c80c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782810a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.699+0000 7f782c80c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782810a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57586/0 (socket says 172.21.15.159:57586) 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.699+0000 7f782c80c640 1 -- 172.21.15.159:0/592941309 learned_addr learned my addr 172.21.15.159:0/592941309 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.699+0000 7f782c80c640 1 -- 172.21.15.159:0/592941309 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782810aa70 con 0x7f7828108140 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f782c80c640 1 --2- 172.21.15.159:0/592941309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782810a530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f781c009820 tx=0x7f781c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622b71111b6c0edb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f78277fe640 1 -- 172.21.15.159:0/592941309 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c037070 con 0x7f7828108140 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f78277fe640 1 -- 172.21.15.159:0/592941309 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f781c032900 con 0x7f7828108140 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f78277fe640 1 -- 172.21.15.159:0/592941309 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c030850 con 0x7f7828108140 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f782ea70640 1 -- 172.21.15.159:0/592941309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 msgr2=0x7f782810a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:03.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f782ea70640 1 --2- 172.21.15.159:0/592941309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782810a530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f781c009820 tx=0x7f781c02a270 comp rx=0 tx=0).stop 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f782ea70640 1 -- 172.21.15.159:0/592941309 shutdown_connections 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f782ea70640 1 --2- 172.21.15.159:0/592941309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782810a530 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f782ea70640 1 -- 172.21.15.159:0/592941309 >> 172.21.15.159:0/592941309 conn(0x7f7828101c80 msgr2=0x7f78281040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f782ea70640 1 -- 172.21.15.159:0/592941309 shutdown_connections 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.700+0000 7f782ea70640 1 -- 172.21.15.159:0/592941309 wait complete. 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.701+0000 7f782ea70640 1 Processor -- start 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.701+0000 7f782ea70640 1 -- start start 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.701+0000 7f782ea70640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.701+0000 7f782ea70640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f782810ba50 con 0x7f7828108140 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.701+0000 7f782c80c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.701+0000 7f782c80c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782819b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57598/0 (socket says 172.21.15.159:57598) 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.701+0000 7f782c80c640 1 -- 172.21.15.159:0/1311507247 learned_addr learned my addr 172.21.15.159:0/1311507247 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.702+0000 7f782c80c640 1 -- 172.21.15.159:0/1311507247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782819bbc0 con 0x7f7828108140 2024-09-19T06:38:03.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.702+0000 7f782c80c640 1 --2- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782819b680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f781c031000 tx=0x7f781c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:03.594 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.702+0000 7f7825ffb640 1 -- 172.21.15.159:0/1311507247 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c042070 con 0x7f7828108140 2024-09-19T06:38:03.594 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.702+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782819be50 con 0x7f7828108140 2024-09-19T06:38:03.594 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.702+0000 7f7825ffb640 1 -- 172.21.15.159:0/1311507247 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f781c032be0 con 0x7f7828108140 2024-09-19T06:38:03.594 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.702+0000 7f7825ffb640 1 -- 172.21.15.159:0/1311507247 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c037040 con 0x7f7828108140 2024-09-19T06:38:03.594 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.702+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782819eb40 con 0x7f7828108140 2024-09-19T06:38:03.594 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.703+0000 7f7825ffb640 1 -- 172.21.15.159:0/1311507247 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f781c045070 con 0x7f7828108140 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.703+0000 7f7825ffb640 1 --2- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f7818039160 0x7f781803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.703+0000 7f7825ffb640 1 -- 172.21.15.159:0/1311507247 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f781c06c360 con 0x7f7828108140 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.703+0000 7f7827fff640 1 --2- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f7818039160 0x7f781803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.703+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78281085a0 con 0x7f7828108140 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.704+0000 7f7827fff640 1 --2- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f7818039160 0x7f781803b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f78140098c0 tx=0x7f7814006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.708+0000 7f7825ffb640 1 -- 172.21.15.159:0/1311507247 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f781c042210 con 0x7f7828108140 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.938+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f782819f040 con 0x7f7828108140 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.938+0000 7f7825ffb640 1 -- 172.21.15.159:0/1311507247 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f781c06bdf0 con 0x7f7828108140 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f7818039160 msgr2=0x7f781803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 --2- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f7818039160 0x7f781803b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f78140098c0 tx=0x7f7814006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 msgr2=0x7f782819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:03.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 --2- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782819b680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f781c031000 tx=0x7f781c0326e0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 shutdown_connections 2024-09-19T06:38:03.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 --2- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f7818039160 0x7f781803b620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 --2- 172.21.15.159:0/1311507247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7828108140 0x7f782819b680 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 >> 172.21.15.159:0/1311507247 conn(0x7f7828101c80 msgr2=0x7f78281028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:03.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 shutdown_connections 2024-09-19T06:38:03.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:02.942+0000 7f782ea70640 1 -- 172.21.15.159:0/1311507247 wait complete. 2024-09-19T06:38:03.597 INFO:teuthology.orchestra.run.smithi159.stdout:mgr is available 2024-09-19T06:38:04.452 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:04 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/308626579' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:38:04.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:38:04.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:38:04.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout fsid = 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:38:04.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.159:3300,v1:172.21.15.159:6789] 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:38:04.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.976+0000 7fcaf8239640 1 Processor -- start 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.976+0000 7fcaf8239640 1 -- start start 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.976+0000 7fcaf8239640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf010a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.976+0000 7fcaf8239640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf007be80 con 0x7fcaf0108090 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.976+0000 7fcaf5fd5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf010a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.976+0000 7fcaf5fd5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf010a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57606/0 (socket says 172.21.15.159:57606) 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.976+0000 7fcaf5fd5640 1 -- 172.21.15.159:0/2435719795 learned_addr learned my addr 172.21.15.159:0/2435719795 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.976+0000 7fcaf5fd5640 1 -- 172.21.15.159:0/2435719795 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf010a9c0 con 0x7fcaf0108090 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.977+0000 7fcaf5fd5640 1 --2- 172.21.15.159:0/2435719795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf010a480 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009820 tx=0x7fcae402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25495e23d2620a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.977+0000 7fcaf4fd3640 1 -- 172.21.15.159:0/2435719795 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcae4037070 con 0x7fcaf0108090 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.977+0000 7fcaf4fd3640 1 -- 172.21.15.159:0/2435719795 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcae4032900 con 0x7fcaf0108090 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.977+0000 7fcaf4fd3640 1 -- 172.21.15.159:0/2435719795 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcae4030850 con 0x7fcaf0108090 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.978+0000 7fcaf8239640 1 -- 172.21.15.159:0/2435719795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 msgr2=0x7fcaf010a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:04.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.978+0000 7fcaf8239640 1 --2- 172.21.15.159:0/2435719795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf010a480 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009820 tx=0x7fcae402a270 comp rx=0 tx=0).stop 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.978+0000 7fcaf8239640 1 -- 172.21.15.159:0/2435719795 shutdown_connections 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.978+0000 7fcaf8239640 1 --2- 172.21.15.159:0/2435719795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf010a480 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.978+0000 7fcaf8239640 1 -- 172.21.15.159:0/2435719795 >> 172.21.15.159:0/2435719795 conn(0x7fcaf0101cb0 msgr2=0x7fcaf01040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.978+0000 7fcaf8239640 1 -- 172.21.15.159:0/2435719795 shutdown_connections 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.978+0000 7fcaf8239640 1 -- 172.21.15.159:0/2435719795 wait complete. 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.978+0000 7fcaf8239640 1 Processor -- start 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.978+0000 7fcaf8239640 1 -- start start 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcaf8239640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf019b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcaf8239640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf010ba60 con 0x7fcaf0108090 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcaf5fd5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf019b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcaf5fd5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf019b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57616/0 (socket says 172.21.15.159:57616) 2024-09-19T06:38:04.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcaf5fd5640 1 -- 172.21.15.159:0/308626579 learned_addr learned my addr 172.21.15.159:0/308626579 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcaf5fd5640 1 -- 172.21.15.159:0/308626579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf019bb60 con 0x7fcaf0108090 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcaf5fd5640 1 --2- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf019b620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcae4031000 tx=0x7fcae40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcae2ffd640 1 -- 172.21.15.159:0/308626579 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcae4042070 con 0x7fcaf0108090 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcae2ffd640 1 -- 172.21.15.159:0/308626579 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcae4032be0 con 0x7fcaf0108090 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf019bdf0 con 0x7fcaf0108090 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcae2ffd640 1 -- 172.21.15.159:0/308626579 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcae4037040 con 0x7fcaf0108090 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.979+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf019eae0 con 0x7fcaf0108090 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.980+0000 7fcae2ffd640 1 -- 172.21.15.159:0/308626579 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fcae4045070 con 0x7fcaf0108090 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.980+0000 7fcae2ffd640 1 --2- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7fcadc0391b0 0x7fcadc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.980+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf01084f0 con 0x7fcaf0108090 2024-09-19T06:38:04.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.980+0000 7fcae2ffd640 1 -- 172.21.15.159:0/308626579 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcae406c150 con 0x7fcaf0108090 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.981+0000 7fcaf57d4640 1 --2- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7fcadc0391b0 0x7fcadc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.981+0000 7fcaf57d4640 1 --2- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7fcadc0391b0 0x7fcadc03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0098c0 tx=0x7fcaec006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:03.985+0000 7fcae2ffd640 1 -- 172.21.15.159:0/308626579 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcae4032d90 con 0x7fcaf0108090 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.153+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fcaf01a0240 con 0x7fcaf0108090 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.154+0000 7fcae2ffd640 1 -- 172.21.15.159:0/308626579 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7fcae403d950 con 0x7fcaf0108090 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7fcadc0391b0 msgr2=0x7fcadc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 --2- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7fcadc0391b0 0x7fcadc03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0098c0 tx=0x7fcaec006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 msgr2=0x7fcaf019b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 --2- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf019b620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcae4031000 tx=0x7fcae40326e0 comp rx=0 tx=0).stop 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 shutdown_connections 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 --2- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7fcadc0391b0 0x7fcadc03b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 --2- 172.21.15.159:0/308626579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaf0108090 0x7fcaf019b620 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:04.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 >> 172.21.15.159:0/308626579 conn(0x7fcaf0101cb0 msgr2=0x7fcaf0102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:04.719 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 shutdown_connections 2024-09-19T06:38:04.719 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:04.157+0000 7fcaf8239640 1 -- 172.21.15.159:0/308626579 wait complete. 2024-09-19T06:38:04.719 INFO:teuthology.orchestra.run.smithi159.stdout:Enabling cephadm module... 2024-09-19T06:38:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:05 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/491322410' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T06:38:05.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: ignoring --setuser ceph since I am not root 2024-09-19T06:38:05.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: ignoring --setgroup ceph since I am not root 2024-09-19T06:38:05.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:05.520+0000 7fee541f5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:38:05.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:05.576+0000 7fee541f5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:38:05.960 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:05.725+0000 7fee541f5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:38:05.960 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:05.791+0000 7fee541f5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:38:05.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:05.936+0000 7fee541f5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.109+0000 7f18cd9bb640 1 Processor -- start 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.109+0000 7f18cd9bb640 1 -- start start 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.109+0000 7f18cd9bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c81068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.109+0000 7f18cd9bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8106ea0 con 0x7f18c81064d0 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.109+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c81068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.109+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c81068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57632/0 (socket says 172.21.15.159:57632) 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.109+0000 7f18c6ffd640 1 -- 172.21.15.159:0/190599487 learned_addr learned my addr 172.21.15.159:0/190599487 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.110+0000 7f18c6ffd640 1 -- 172.21.15.159:0/190599487 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c81076d0 con 0x7f18c81064d0 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.110+0000 7f18c6ffd640 1 --2- 172.21.15.159:0/190599487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c81068d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009820 tx=0x7f18b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e693e84656aa31e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.110+0000 7f18c67fc640 1 -- 172.21.15.159:0/190599487 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8037070 con 0x7f18c81064d0 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.110+0000 7f18c67fc640 1 -- 172.21.15.159:0/190599487 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18b8032900 con 0x7f18c81064d0 2024-09-19T06:38:05.968 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.110+0000 7f18c67fc640 1 -- 172.21.15.159:0/190599487 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8030850 con 0x7f18c81064d0 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.111+0000 7f18cd9bb640 1 -- 172.21.15.159:0/190599487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 msgr2=0x7f18c81068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.111+0000 7f18cd9bb640 1 --2- 172.21.15.159:0/190599487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c81068d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009820 tx=0x7f18b802a270 comp rx=0 tx=0).stop 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.111+0000 7f18cd9bb640 1 -- 172.21.15.159:0/190599487 shutdown_connections 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.111+0000 7f18cd9bb640 1 --2- 172.21.15.159:0/190599487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c81068d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.111+0000 7f18cd9bb640 1 -- 172.21.15.159:0/190599487 >> 172.21.15.159:0/190599487 conn(0x7f18c8101d00 msgr2=0x7f18c8104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.111+0000 7f18cd9bb640 1 -- 172.21.15.159:0/190599487 shutdown_connections 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.111+0000 7f18cd9bb640 1 -- 172.21.15.159:0/190599487 wait complete. 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.112+0000 7f18cd9bb640 1 Processor -- start 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.112+0000 7f18cd9bb640 1 -- start start 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.112+0000 7f18cd9bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c819b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.112+0000 7f18cd9bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f18c810aa80 con 0x7f18c81064d0 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.112+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c819b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:05.969 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.112+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c819b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57646/0 (socket says 172.21.15.159:57646) 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.112+0000 7f18c6ffd640 1 -- 172.21.15.159:0/491322410 learned_addr learned my addr 172.21.15.159:0/491322410 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.112+0000 7f18c6ffd640 1 -- 172.21.15.159:0/491322410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c819bb30 con 0x7f18c81064d0 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.113+0000 7f18c6ffd640 1 --2- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c819b5f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f18b80097f0 tx=0x7f18b8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.113+0000 7f18cc9b9640 1 -- 172.21.15.159:0/491322410 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8037040 con 0x7f18c81064d0 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.113+0000 7f18cc9b9640 1 -- 172.21.15.159:0/491322410 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18b8040070 con 0x7f18c81064d0 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.113+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c819bdc0 con 0x7f18c81064d0 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.113+0000 7f18cc9b9640 1 -- 172.21.15.159:0/491322410 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b803a390 con 0x7f18c81064d0 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.113+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c819eab0 con 0x7f18c81064d0 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.114+0000 7f18cc9b9640 1 -- 172.21.15.159:0/491322410 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f18b803a5e0 con 0x7f18c81064d0 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.114+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c810ac00 con 0x7f18c81064d0 2024-09-19T06:38:05.970 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.114+0000 7f18cc9b9640 1 --2- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f18b40391b0 0x7f18b403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.114+0000 7f18cc9b9640 1 -- 172.21.15.159:0/491322410 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f18b806c4a0 con 0x7f18c81064d0 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.114+0000 7f18be7fc640 1 --2- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f18b40391b0 0x7f18b403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.115+0000 7f18be7fc640 1 --2- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f18b40391b0 0x7f18b403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18b00098c0 tx=0x7f18b0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.119+0000 7f18cc9b9640 1 -- 172.21.15.159:0/491322410 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f18b803a980 con 0x7f18c81064d0 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.332+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f18c819ec80 con 0x7f18c81064d0 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.383+0000 7f18cc9b9640 1 -- 172.21.15.159:0/491322410 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f18b806c200 con 0x7f18c81064d0 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.386+0000 7f18cc9b9640 1 -- 172.21.15.159:0/491322410 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f18b8045460 con 0x7f18c81064d0 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f18b40391b0 msgr2=0x7f18b403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 --2- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f18b40391b0 0x7f18b403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18b00098c0 tx=0x7f18b0006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 msgr2=0x7f18c819b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 --2- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c819b5f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f18b80097f0 tx=0x7f18b8030d80 comp rx=0 tx=0).stop 2024-09-19T06:38:05.971 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 shutdown_connections 2024-09-19T06:38:05.972 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 --2- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f18b40391b0 0x7f18b403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:05.972 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 --2- 172.21.15.159:0/491322410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18c81064d0 0x7f18c819b5f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:05.972 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 >> 172.21.15.159:0/491322410 conn(0x7f18c8101d00 msgr2=0x7f18c8102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:05.972 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 shutdown_connections 2024-09-19T06:38:05.972 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:05.387+0000 7f18cd9bb640 1 -- 172.21.15.159:0/491322410 wait complete. 2024-09-19T06:38:06.211 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:06.084+0000 7fee541f5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:38:06.562 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:06 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/491322410' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T06:38:06.563 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:06 smithi159 ceph-mon[30935]: mgrmap e5: x(active, since 5s) 2024-09-19T06:38:06.563 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:06.407+0000 7fee541f5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:38:06.563 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:06.469+0000 7fee541f5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:38:06.897 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:06.664+0000 7fee541f5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:38:07.150 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:38:07.150 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.354+0000 7f5115e3b640 1 Processor -- start 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.354+0000 7f5115e3b640 1 -- start start 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.354+0000 7f5115e3b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f5110107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.354+0000 7f5115e3b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5110107ff0 con 0x7f5110107620 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.354+0000 7f510f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f5110107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.354+0000 7f510f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f5110107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57670/0 (socket says 172.21.15.159:57670) 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.354+0000 7f510f7fe640 1 -- 172.21.15.159:0/1867819749 learned_addr learned my addr 172.21.15.159:0/1867819749 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:07.151 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.355+0000 7f510f7fe640 1 -- 172.21.15.159:0/1867819749 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5110108820 con 0x7f5110107620 2024-09-19T06:38:07.152 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.355+0000 7f510f7fe640 1 --2- 172.21.15.159:0/1867819749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f5110107a20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5100009e80 tx=0x7f510002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d7efb83019ce9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:07.152 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.355+0000 7f510effd640 1 -- 172.21.15.159:0/1867819749 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5100036070 con 0x7f5110107620 2024-09-19T06:38:07.152 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.356+0000 7f510effd640 1 -- 172.21.15.159:0/1867819749 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51000318c0 con 0x7f5110107620 2024-09-19T06:38:07.152 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.356+0000 7f510effd640 1 -- 172.21.15.159:0/1867819749 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5100007ab0 con 0x7f5110107620 2024-09-19T06:38:07.152 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.356+0000 7f5115e3b640 1 -- 172.21.15.159:0/1867819749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 msgr2=0x7f5110107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:07.152 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.356+0000 7f5115e3b640 1 --2- 172.21.15.159:0/1867819749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f5110107a20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5100009e80 tx=0x7f510002a7a0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.152 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.356+0000 7f5115e3b640 1 -- 172.21.15.159:0/1867819749 shutdown_connections 2024-09-19T06:38:07.152 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.356+0000 7f5115e3b640 1 --2- 172.21.15.159:0/1867819749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f5110107a20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.152 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.356+0000 7f5115e3b640 1 -- 172.21.15.159:0/1867819749 >> 172.21.15.159:0/1867819749 conn(0x7f5110102d90 msgr2=0x7f51101051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.356+0000 7f5115e3b640 1 -- 172.21.15.159:0/1867819749 shutdown_connections 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.356+0000 7f5115e3b640 1 -- 172.21.15.159:0/1867819749 wait complete. 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.357+0000 7f5115e3b640 1 Processor -- start 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.357+0000 7f5115e3b640 1 -- start start 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.357+0000 7f5115e3b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f511007db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.357+0000 7f5115e3b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f511010bbd0 con 0x7f5110107620 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.357+0000 7f510f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f511007db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.357+0000 7f510f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f511007db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57682/0 (socket says 172.21.15.159:57682) 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.357+0000 7f510f7fe640 1 -- 172.21.15.159:0/3675974807 learned_addr learned my addr 172.21.15.159:0/3675974807 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.357+0000 7f510f7fe640 1 -- 172.21.15.159:0/3675974807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511007e080 con 0x7f5110107620 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.358+0000 7f510f7fe640 1 --2- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f511007db40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5100007ce0 tx=0x7f5100031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.358+0000 7f510d7fa640 1 -- 172.21.15.159:0/3675974807 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5100036050 con 0x7f5110107620 2024-09-19T06:38:07.153 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.358+0000 7f510d7fa640 1 -- 172.21.15.159:0/3675974807 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5100042070 con 0x7f5110107620 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.358+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511007c270 con 0x7f5110107620 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.358+0000 7f510d7fa640 1 -- 172.21.15.159:0/3675974807 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510003d8a0 con 0x7f5110107620 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.358+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511007c7b0 con 0x7f5110107620 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.359+0000 7f510d7fa640 1 -- 172.21.15.159:0/3675974807 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f510003dba0 con 0x7f5110107620 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.359+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5110107aa0 con 0x7f5110107620 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.359+0000 7f510d7fa640 1 --2- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f50fc0391b0 0x7f50fc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.359+0000 7f5107fff640 1 -- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f50fc0391b0 msgr2=0x7f50fc03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/141750176 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.359+0000 7f510d7fa640 1 -- 172.21.15.159:0/3675974807 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5100007e00 con 0x7f5110107620 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.359+0000 7f5107fff640 1 --2- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f50fc0391b0 0x7f50fc03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.364+0000 7f510d7fa640 1 -- 172.21.15.159:0/3675974807 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5100044310 con 0x7f5110107620 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.560+0000 7f5107fff640 1 -- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f50fc0391b0 msgr2=0x7f50fc03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/141750176 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.560+0000 7f5107fff640 1 --2- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f50fc0391b0 0x7f50fc03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:38:07.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.579+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f51101a16c0 con 0x7f5110107620 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.579+0000 7f510d7fa640 1 -- 172.21.15.159:0/3675974807 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f510006d0d0 con 0x7f5110107620 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f50fc0391b0 msgr2=0x7f50fc03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 --2- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f50fc0391b0 0x7f50fc03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 msgr2=0x7f511007db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 --2- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f511007db40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5100007ce0 tx=0x7f5100031ca0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 shutdown_connections 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 --2- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f50fc0391b0 0x7f50fc03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 --2- 172.21.15.159:0/3675974807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5110107620 0x7f511007db40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 >> 172.21.15.159:0/3675974807 conn(0x7f5110102d90 msgr2=0x7f51101039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 shutdown_connections 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:06.582+0000 7f5115e3b640 1 -- 172.21.15.159:0/3675974807 wait complete. 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for the mgr to restart... 2024-09-19T06:38:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mgr epoch 5... 2024-09-19T06:38:07.557 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:07 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3675974807' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:38:07.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:07 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:07.569+0000 7fee541f5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:38:07.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:07 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:07.635+0000 7fee541f5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:38:08.453 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:08.337+0000 7fee541f5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:38:08.453 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:08.451+0000 7fee541f5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:38:08.800 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:08.592+0000 7fee541f5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:38:08.800 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:08.651+0000 7fee541f5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:38:08.800 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:08.799+0000 7fee541f5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:38:09.082 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:08.866+0000 7fee541f5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:38:09.083 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:08.925+0000 7fee541f5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:38:09.083 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:09.081+0000 7fee541f5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:38:09.351 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:09.144+0000 7fee541f5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:38:09.351 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:09.210+0000 7fee541f5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:38:09.351 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:09.291+0000 7fee541f5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:38:09.351 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:09.349+0000 7fee541f5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:38:09.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:09.408+0000 7fee541f5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:38:10.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:10.185+0000 7fee541f5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:38:10.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: Active manager daemon x restarted 2024-09-19T06:38:10.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: Activating manager daemon x 2024-09-19T06:38:10.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T06:38:10.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: mgrmap e6: x(active, starting, since 0.00331284s) 2024-09-19T06:38:10.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:38:10.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:38:10.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:38:10.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:38:10.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:38:10.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: Manager daemon x is now available 2024-09-19T06:38:10.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:10.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:10.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:10.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:10.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:38:10.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:10 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:38:11.523 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:11 smithi159 ceph-mon[30935]: Found migration_current of "None". Setting to last migration. 2024-09-19T06:38:11.523 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:11 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:11.523 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:11 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:11.523 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:11 smithi159 ceph-mon[30935]: mgrmap e7: x(active, since 1.00524s) 2024-09-19T06:38:11.828 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:38:11.828 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T06:38:11.828 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:38:11.828 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:38:11.828 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.555+0000 7f3209507640 1 Processor -- start 2024-09-19T06:38:11.828 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.555+0000 7f3209507640 1 -- start start 2024-09-19T06:38:11.828 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.555+0000 7f3209507640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f3204107ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:11.828 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.555+0000 7f3209507640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3204108090 con 0x7f32041076c0 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.555+0000 7f3202ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f3204107ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.555+0000 7f3202ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f3204107ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57688/0 (socket says 172.21.15.159:57688) 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.555+0000 7f3202ffd640 1 -- 172.21.15.159:0/2299561898 learned_addr learned my addr 172.21.15.159:0/2299561898 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.555+0000 7f3202ffd640 1 -- 172.21.15.159:0/2299561898 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3204108820 con 0x7f32041076c0 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.556+0000 7f3202ffd640 1 --2- 172.21.15.159:0/2299561898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f3204107ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009820 tx=0x7f31f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4719bc42bb644c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.556+0000 7f3201ffb640 1 -- 172.21.15.159:0/2299561898 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f4037070 con 0x7f32041076c0 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.556+0000 7f3201ffb640 1 -- 172.21.15.159:0/2299561898 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31f4032900 con 0x7f32041076c0 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.556+0000 7f3201ffb640 1 -- 172.21.15.159:0/2299561898 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f4030850 con 0x7f32041076c0 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.557+0000 7f3209507640 1 -- 172.21.15.159:0/2299561898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 msgr2=0x7f3204107ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.557+0000 7f3209507640 1 --2- 172.21.15.159:0/2299561898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f3204107ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009820 tx=0x7f31f402a270 comp rx=0 tx=0).stop 2024-09-19T06:38:11.829 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.557+0000 7f3209507640 1 -- 172.21.15.159:0/2299561898 shutdown_connections 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.557+0000 7f3209507640 1 --2- 172.21.15.159:0/2299561898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f3204107ac0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.557+0000 7f3209507640 1 -- 172.21.15.159:0/2299561898 >> 172.21.15.159:0/2299561898 conn(0x7f3204102e50 msgr2=0x7f3204105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.557+0000 7f3209507640 1 -- 172.21.15.159:0/2299561898 shutdown_connections 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.557+0000 7f3209507640 1 -- 172.21.15.159:0/2299561898 wait complete. 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.558+0000 7f3209507640 1 Processor -- start 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.558+0000 7f3209507640 1 -- start start 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.558+0000 7f3209507640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f320407db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.558+0000 7f3209507640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f320410bbd0 con 0x7f32041076c0 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.558+0000 7f3202ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f320407db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.558+0000 7f3202ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f320407db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57700/0 (socket says 172.21.15.159:57700) 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.558+0000 7f3202ffd640 1 -- 172.21.15.159:0/622037779 learned_addr learned my addr 172.21.15.159:0/622037779 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.559+0000 7f3202ffd640 1 -- 172.21.15.159:0/622037779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320407e080 con 0x7f32041076c0 2024-09-19T06:38:11.830 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.559+0000 7f3202ffd640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f320407db40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009940 tx=0x7f31f4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.559+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f4042070 con 0x7f32041076c0 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.559+0000 7f3209507640 1 -- 172.21.15.159:0/622037779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320407c270 con 0x7f32041076c0 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.559+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31f40308c0 con 0x7f32041076c0 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.559+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f4037040 con 0x7f32041076c0 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.559+0000 7f3209507640 1 -- 172.21.15.159:0/622037779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320407c7b0 con 0x7f32041076c0 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.560+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f31f4045070 con 0x7f32041076c0 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.560+0000 7f31ebfff640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 0x7f31ec03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.560+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 --> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f31ec03bdd0 con 0x7f31ec039200 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.560+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f31f406c220 con 0x7f32041076c0 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.560+0000 7f32027fc640 1 -- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 msgr2=0x7f31ec03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/141750176 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.561+0000 7f32027fc640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 0x7f31ec03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.762+0000 7f32027fc640 1 -- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 msgr2=0x7f31ec03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/141750176 2024-09-19T06:38:11.831 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:07.762+0000 7f32027fc640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 0x7f31ec03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:38:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:08.163+0000 7f32027fc640 1 -- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 msgr2=0x7f31ec03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/141750176 2024-09-19T06:38:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:08.163+0000 7f32027fc640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 0x7f31ec03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:38:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:08.965+0000 7f32027fc640 1 -- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 msgr2=0x7f31ec03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/141750176 2024-09-19T06:38:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:08.965+0000 7f32027fc640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 0x7f31ec03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:38:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:10.189+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f31f406ada0 con 0x7f32041076c0 2024-09-19T06:38:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:10.189+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 msgr2=0x7f31ec03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:38:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:10.189+0000 7f31ebfff640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 0x7f31ec03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.190+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f31f403c840 con 0x7f32041076c0 2024-09-19T06:38:11.832 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.190+0000 7f31ebfff640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f31ec03cb30 0x7f31ec03ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.190+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f31f406ab90 con 0x7f31ec03cb30 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.190+0000 7f32027fc640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f31ec03cb30 0x7f31ec03ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.191+0000 7f32027fc640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f31ec03cb30 0x7f31ec03ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f31f8003980 tx=0x7f31f80092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.192+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 <== mgr.14118 v2:172.21.15.159:6800/3687310237 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f31f406ab90 con 0x7f31ec03cb30 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.198+0000 7f3209507640 1 -- 172.21.15.159:0/622037779 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f320410bd50 con 0x7f31ec03cb30 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f31ebfff640 1 -- 172.21.15.159:0/622037779 <== mgr.14118 v2:172.21.15.159:6800/3687310237 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f320410bd50 con 0x7f31ec03cb30 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 -- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f31ec03cb30 msgr2=0x7f31ec03ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f31ec03cb30 0x7f31ec03ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f31f8003980 tx=0x7f31f80092b0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 -- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 msgr2=0x7f320407db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f320407db40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009940 tx=0x7f31f4032ce0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 -- 172.21.15.159:0/622037779 shutdown_connections 2024-09-19T06:38:11.833 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f31ec03cb30 0x7f31ec03ef20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.834 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:6800/141750176,v1:172.21.15.159:6801/141750176] conn(0x7f31ec039200 0x7f31ec03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.834 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 --2- 172.21.15.159:0/622037779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32041076c0 0x7f320407db40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.834 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 -- 172.21.15.159:0/622037779 >> 172.21.15.159:0/622037779 conn(0x7f3204102e50 msgr2=0x7f3204103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:11.834 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 -- 172.21.15.159:0/622037779 shutdown_connections 2024-09-19T06:38:11.834 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:11.199+0000 7f3209507640 1 -- 172.21.15.159:0/622037779 wait complete. 2024-09-19T06:38:11.834 INFO:teuthology.orchestra.run.smithi159.stdout:mgr epoch 5 is available 2024-09-19T06:38:11.834 INFO:teuthology.orchestra.run.smithi159.stdout:Setting orchestrator backend to cephadm... 2024-09-19T06:38:12.384 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-mon[30935]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T06:38:12.384 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-mon[30935]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T06:38:12.384 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:12.385 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:12.137+0000 7fedbb54f640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:38:12] ENGINE Error in HTTPServer.serve 2024-09-19T06:38:12.385 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: Traceback (most recent call last): 2024-09-19T06:38:12.385 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:38:12.385 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self._connections.run(self.expiration_interval) 2024-09-19T06:38:12.385 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:38:12.385 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self._run(expiration_interval) 2024-09-19T06:38:12.385 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:38:12.385 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: s = self.context.wrap_socket( 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: return self.sslsocket_class._create( 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self.do_handshake() 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self._sslobj.do_handshake() 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:38:12.386 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:12.915 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.190+0000 7f6e6d40a640 1 Processor -- start 2024-09-19T06:38:12.915 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.190+0000 7f6e6d40a640 1 -- start start 2024-09-19T06:38:12.915 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.190+0000 7f6e6d40a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6810a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:12.915 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.190+0000 7f6e6d40a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6807bdf0 con 0x7f6e681080c0 2024-09-19T06:38:12.915 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.190+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6810a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:12.915 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.190+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6810a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40466/0 (socket says 172.21.15.159:40466) 2024-09-19T06:38:12.915 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.190+0000 7f6e66ffd640 1 -- 172.21.15.159:0/2502847577 learned_addr learned my addr 172.21.15.159:0/2502847577 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:12.915 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.191+0000 7f6e66ffd640 1 -- 172.21.15.159:0/2502847577 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6810a9f0 con 0x7f6e681080c0 2024-09-19T06:38:12.915 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.191+0000 7f6e66ffd640 1 --2- 172.21.15.159:0/2502847577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6810a4b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009820 tx=0x7f6e5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e784821cbae5f15a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:12.916 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.191+0000 7f6e667fc640 1 -- 172.21.15.159:0/2502847577 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58037070 con 0x7f6e681080c0 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.192+0000 7f6e667fc640 1 -- 172.21.15.159:0/2502847577 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e58032900 con 0x7f6e681080c0 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.192+0000 7f6e667fc640 1 -- 172.21.15.159:0/2502847577 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58030850 con 0x7f6e681080c0 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.192+0000 7f6e6d40a640 1 -- 172.21.15.159:0/2502847577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 msgr2=0x7f6e6810a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.192+0000 7f6e6d40a640 1 --2- 172.21.15.159:0/2502847577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6810a4b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009820 tx=0x7f6e5802a270 comp rx=0 tx=0).stop 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.192+0000 7f6e6d40a640 1 -- 172.21.15.159:0/2502847577 shutdown_connections 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.192+0000 7f6e6d40a640 1 --2- 172.21.15.159:0/2502847577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6810a4b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.192+0000 7f6e6d40a640 1 -- 172.21.15.159:0/2502847577 >> 172.21.15.159:0/2502847577 conn(0x7f6e68101ca0 msgr2=0x7f6e681040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.192+0000 7f6e6d40a640 1 -- 172.21.15.159:0/2502847577 shutdown_connections 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.192+0000 7f6e6d40a640 1 -- 172.21.15.159:0/2502847577 wait complete. 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.193+0000 7f6e6d40a640 1 Processor -- start 2024-09-19T06:38:12.917 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.193+0000 7f6e6d40a640 1 -- start start 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.193+0000 7f6e6d40a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.193+0000 7f6e6d40a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810b9d0 con 0x7f6e681080c0 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.193+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.193+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40470/0 (socket says 172.21.15.159:40470) 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.193+0000 7f6e66ffd640 1 -- 172.21.15.159:0/3869168421 learned_addr learned my addr 172.21.15.159:0/3869168421 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.193+0000 7f6e66ffd640 1 -- 172.21.15.159:0/3869168421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6819bb20 con 0x7f6e681080c0 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.194+0000 7f6e66ffd640 1 --2- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6819b5e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e58031000 tx=0x7f6e580326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.194+0000 7f6e64ff9640 1 -- 172.21.15.159:0/3869168421 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58042070 con 0x7f6e681080c0 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.194+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6819bdb0 con 0x7f6e681080c0 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.194+0000 7f6e64ff9640 1 -- 172.21.15.159:0/3869168421 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e58032be0 con 0x7f6e681080c0 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.194+0000 7f6e64ff9640 1 -- 172.21.15.159:0/3869168421 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58037040 con 0x7f6e681080c0 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.194+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6819eaa0 con 0x7f6e681080c0 2024-09-19T06:38:12.918 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.195+0000 7f6e64ff9640 1 -- 172.21.15.159:0/3869168421 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f6e58045070 con 0x7f6e681080c0 2024-09-19T06:38:12.919 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.195+0000 7f6e64ff9640 1 --2- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f6e540390a0 0x7f6e5403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:12.919 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.195+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e68108520 con 0x7f6e681080c0 2024-09-19T06:38:12.919 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.195+0000 7f6e64ff9640 1 -- 172.21.15.159:0/3869168421 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6e5806c0c0 con 0x7f6e681080c0 2024-09-19T06:38:12.919 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.195+0000 7f6e5ffff640 1 --2- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f6e540390a0 0x7f6e5403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:12.919 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.196+0000 7f6e5ffff640 1 --2- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f6e540390a0 0x7f6e5403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e500098c0 tx=0x7f6e50006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:12.919 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.200+0000 7f6e64ff9640 1 -- 172.21.15.159:0/3869168421 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e58046e80 con 0x7f6e681080c0 2024-09-19T06:38:12.919 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.242+0000 7f6e64ff9640 1 -- 172.21.15.159:0/3869168421 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6e5803d430 con 0x7f6e681080c0 2024-09-19T06:38:12.919 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.382+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f6e68102f90 con 0x7f6e540390a0 2024-09-19T06:38:12.919 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.387+0000 7f6e64ff9640 1 -- 172.21.15.159:0/3869168421 <== mgr.14118 v2:172.21.15.159:6800/3687310237 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6e68102f90 con 0x7f6e540390a0 2024-09-19T06:38:12.920 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f6e540390a0 msgr2=0x7f6e5403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:12.920 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 --2- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f6e540390a0 0x7f6e5403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e500098c0 tx=0x7f6e50006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.920 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 msgr2=0x7f6e6819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:12.920 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 --2- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6819b5e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e58031000 tx=0x7f6e580326e0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.920 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 shutdown_connections 2024-09-19T06:38:12.920 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 --2- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f6e540390a0 0x7f6e5403b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.920 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 --2- 172.21.15.159:0/3869168421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e681080c0 0x7f6e6819b5e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.920 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 >> 172.21.15.159:0/3869168421 conn(0x7f6e68101ca0 msgr2=0x7f6e68102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:12.921 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 shutdown_connections 2024-09-19T06:38:12.921 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:12.389+0000 7f6e6d40a640 1 -- 172.21.15.159:0/3869168421 wait complete. 2024-09-19T06:38:13.309 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:13 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:11] ENGINE Bus STARTING 2024-09-19T06:38:13.309 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:13 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:12] ENGINE Serving on http://172.21.15.159:8765 2024-09-19T06:38:13.309 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:13 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:12] ENGINE Serving on https://172.21.15.159:7150 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:13 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:12] ENGINE Bus STARTED 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:13 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:12] ENGINE Error in HTTPServer.serve 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout: Traceback (most recent call last): 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout: self._run(expiration_interval) 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:38:13.310 INFO:journalctl@ceph.mon.a.smithi159.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout: s = self.context.wrap_socket( 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout: return self.sslsocket_class._create( 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout: self.do_handshake() 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout: self._sslobj.do_handshake() 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:13 smithi159 ceph-mon[30935]: mgrmap e8: x(active, since 2s) 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:13 smithi159 ceph-mon[30935]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:13 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:13.311 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:13 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:14.029 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T06:38:14.029 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.307+0000 7f1eaddb4640 1 Processor -- start 2024-09-19T06:38:14.029 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.307+0000 7f1eaddb4640 1 -- start start 2024-09-19T06:38:14.029 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.308+0000 7f1eaddb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea8106900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:14.029 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.308+0000 7f1eaddb4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8106ed0 con 0x7f1ea8106500 2024-09-19T06:38:14.029 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.308+0000 7f1ea77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea8106900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:14.029 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.308+0000 7f1ea77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea8106900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40474/0 (socket says 172.21.15.159:40474) 2024-09-19T06:38:14.029 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.308+0000 7f1ea77fe640 1 -- 172.21.15.159:0/3726369888 learned_addr learned my addr 172.21.15.159:0/3726369888 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.308+0000 7f1ea77fe640 1 -- 172.21.15.159:0/3726369888 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea8107700 con 0x7f1ea8106500 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.309+0000 7f1ea77fe640 1 --2- 172.21.15.159:0/3726369888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea8106900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009820 tx=0x7f1e9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8d1b04099d7dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.309+0000 7f1ea6ffd640 1 -- 172.21.15.159:0/3726369888 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e98037070 con 0x7f1ea8106500 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.309+0000 7f1ea6ffd640 1 -- 172.21.15.159:0/3726369888 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e98032900 con 0x7f1ea8106500 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.309+0000 7f1ea6ffd640 1 -- 172.21.15.159:0/3726369888 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e98030850 con 0x7f1ea8106500 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.310+0000 7f1eaddb4640 1 -- 172.21.15.159:0/3726369888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 msgr2=0x7f1ea8106900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.310+0000 7f1eaddb4640 1 --2- 172.21.15.159:0/3726369888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea8106900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009820 tx=0x7f1e9802a270 comp rx=0 tx=0).stop 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.310+0000 7f1eaddb4640 1 -- 172.21.15.159:0/3726369888 shutdown_connections 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.310+0000 7f1eaddb4640 1 --2- 172.21.15.159:0/3726369888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea8106900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.310+0000 7f1eaddb4640 1 -- 172.21.15.159:0/3726369888 >> 172.21.15.159:0/3726369888 conn(0x7f1ea8101d10 msgr2=0x7f1ea8104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.310+0000 7f1eaddb4640 1 -- 172.21.15.159:0/3726369888 shutdown_connections 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.310+0000 7f1eaddb4640 1 -- 172.21.15.159:0/3726369888 wait complete. 2024-09-19T06:38:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.310+0000 7f1eaddb4640 1 Processor -- start 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.310+0000 7f1eaddb4640 1 -- start start 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1eaddb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1eaddb4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea810aab0 con 0x7f1ea8106500 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1ea77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1ea77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40480/0 (socket says 172.21.15.159:40480) 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1ea77fe640 1 -- 172.21.15.159:0/658156394 learned_addr learned my addr 172.21.15.159:0/658156394 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1ea77fe640 1 -- 172.21.15.159:0/658156394 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea819bb20 con 0x7f1ea8106500 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1ea77fe640 1 --2- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea819b5e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009940 tx=0x7f1e98032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1ea57fa640 1 -- 172.21.15.159:0/658156394 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e98042070 con 0x7f1ea8106500 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1ea57fa640 1 -- 172.21.15.159:0/658156394 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e980308c0 con 0x7f1ea8106500 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea819bdb0 con 0x7f1ea8106500 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1ea57fa640 1 -- 172.21.15.159:0/658156394 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e98037040 con 0x7f1ea8106500 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.311+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea819eaa0 con 0x7f1ea8106500 2024-09-19T06:38:14.031 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.312+0000 7f1ea57fa640 1 -- 172.21.15.159:0/658156394 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1e98045070 con 0x7f1ea8106500 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.312+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea810ac30 con 0x7f1ea8106500 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.313+0000 7f1ea57fa640 1 --2- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1e940391b0 0x7f1e9403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.313+0000 7f1ea57fa640 1 -- 172.21.15.159:0/658156394 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1e9806c4b0 con 0x7f1ea8106500 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.313+0000 7f1e9effd640 1 --2- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1e940391b0 0x7f1e9403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.313+0000 7f1e9effd640 1 --2- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1e940391b0 0x7f1e9403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e900098c0 tx=0x7f1e90006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.317+0000 7f1ea57fa640 1 -- 172.21.15.159:0/658156394 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e98045520 con 0x7f1ea8106500 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.484+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f1ea80008d0 con 0x7f1e940391b0 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.485+0000 7f1ea57fa640 1 -- 172.21.15.159:0/658156394 <== mgr.14118 v2:172.21.15.159:6800/3687310237 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f1ea80008d0 con 0x7f1e940391b0 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1e940391b0 msgr2=0x7f1e9403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 --2- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1e940391b0 0x7f1e9403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e900098c0 tx=0x7f1e90006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 msgr2=0x7f1ea819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 --2- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea819b5e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009940 tx=0x7f1e98032ce0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.032 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 shutdown_connections 2024-09-19T06:38:14.033 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 --2- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1e940391b0 0x7f1e9403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.033 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 --2- 172.21.15.159:0/658156394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ea8106500 0x7f1ea819b5e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.033 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 >> 172.21.15.159:0/658156394 conn(0x7f1ea8101d10 msgr2=0x7f1ea8102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:14.033 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 shutdown_connections 2024-09-19T06:38:14.033 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:13.487+0000 7f1eaddb4640 1 -- 172.21.15.159:0/658156394 wait complete. 2024-09-19T06:38:14.033 INFO:teuthology.orchestra.run.smithi159.stdout:Generating ssh key... 2024-09-19T06:38:14.663 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-mon[30935]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:14.960 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: Generating public/private rsa key pair. 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: Your identification has been saved in /tmp/tmp9qwtynje/key 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: Your public key has been saved in /tmp/tmp9qwtynje/key.pub 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: The key fingerprint is: 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: SHA256:UaUUCQOsswdEAquVWNAncbSuNmbKRA/yNkEZlM4umcU ceph-82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: The key's randomart image is: 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: +---[RSA 3072]----+ 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: |o=*=+...o.++. | 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: | ++*o.. +.. | 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: |o+=+.. . . | 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: |.oE.+ . | 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: |oB. .+ S | 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: |*.+o. . | 2024-09-19T06:38:14.961 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: | oX. . | 2024-09-19T06:38:14.962 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: |o* o | 2024-09-19T06:38:14.962 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: |.. | 2024-09-19T06:38:14.962 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: +----[SHA256]-----+ 2024-09-19T06:38:15.210 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.406+0000 7fe9adebc640 1 Processor -- start 2024-09-19T06:38:15.210 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.406+0000 7fe9adebc640 1 -- start start 2024-09-19T06:38:15.210 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.406+0000 7fe9adebc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a8106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:15.210 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.406+0000 7fe9adebc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a8106ee0 con 0x7fe9a8106510 2024-09-19T06:38:15.210 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.406+0000 7fe9a77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a8106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:15.210 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.406+0000 7fe9a77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a8106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40484/0 (socket says 172.21.15.159:40484) 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.406+0000 7fe9a77fe640 1 -- 172.21.15.159:0/3144587679 learned_addr learned my addr 172.21.15.159:0/3144587679 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.407+0000 7fe9a77fe640 1 -- 172.21.15.159:0/3144587679 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a81076c0 con 0x7fe9a8106510 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.407+0000 7fe9a77fe640 1 --2- 172.21.15.159:0/3144587679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a8106910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe998009820 tx=0x7fe99802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7d4045941c3b5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.407+0000 7fe9a6ffd640 1 -- 172.21.15.159:0/3144587679 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe998037070 con 0x7fe9a8106510 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.407+0000 7fe9a6ffd640 1 -- 172.21.15.159:0/3144587679 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe998032900 con 0x7fe9a8106510 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.407+0000 7fe9a6ffd640 1 -- 172.21.15.159:0/3144587679 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe998030850 con 0x7fe9a8106510 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.408+0000 7fe9adebc640 1 -- 172.21.15.159:0/3144587679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 msgr2=0x7fe9a8106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.408+0000 7fe9adebc640 1 --2- 172.21.15.159:0/3144587679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a8106910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe998009820 tx=0x7fe99802a270 comp rx=0 tx=0).stop 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.408+0000 7fe9adebc640 1 -- 172.21.15.159:0/3144587679 shutdown_connections 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.408+0000 7fe9adebc640 1 --2- 172.21.15.159:0/3144587679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a8106910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.408+0000 7fe9adebc640 1 -- 172.21.15.159:0/3144587679 >> 172.21.15.159:0/3144587679 conn(0x7fe9a8101ca0 msgr2=0x7fe9a81040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.408+0000 7fe9adebc640 1 -- 172.21.15.159:0/3144587679 shutdown_connections 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.408+0000 7fe9adebc640 1 -- 172.21.15.159:0/3144587679 wait complete. 2024-09-19T06:38:15.211 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.409+0000 7fe9adebc640 1 Processor -- start 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.409+0000 7fe9adebc640 1 -- start start 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.409+0000 7fe9adebc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a807ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.409+0000 7fe9adebc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a810aa70 con 0x7fe9a8106510 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.409+0000 7fe9a77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a807ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.409+0000 7fe9a77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a807ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40486/0 (socket says 172.21.15.159:40486) 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.409+0000 7fe9a77fe640 1 -- 172.21.15.159:0/4172288995 learned_addr learned my addr 172.21.15.159:0/4172288995 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.409+0000 7fe9a77fe640 1 -- 172.21.15.159:0/4172288995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a819e3b0 con 0x7fe9a8106510 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.409+0000 7fe9a77fe640 1 --2- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a807ba20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe9980097f0 tx=0x7fe998030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.410+0000 7fe9a57fa640 1 -- 172.21.15.159:0/4172288995 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe998042070 con 0x7fe9a8106510 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.410+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a819e580 con 0x7fe9a8106510 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.410+0000 7fe9a57fa640 1 -- 172.21.15.159:0/4172288995 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe998032ca0 con 0x7fe9a8106510 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.410+0000 7fe9a57fa640 1 -- 172.21.15.159:0/4172288995 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe998037040 con 0x7fe9a8106510 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.410+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a819e920 con 0x7fe9a8106510 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.410+0000 7fe9a57fa640 1 -- 172.21.15.159:0/4172288995 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe998045070 con 0x7fe9a8106510 2024-09-19T06:38:15.212 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.411+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a8106990 con 0x7fe9a8106510 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.411+0000 7fe9a57fa640 1 --2- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fe9940391b0 0x7fe99403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.411+0000 7fe9a57fa640 1 -- 172.21.15.159:0/4172288995 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe99806c2b0 con 0x7fe9a8106510 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.411+0000 7fe99ffff640 1 --2- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fe9940391b0 0x7fe99403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.411+0000 7fe99ffff640 1 --2- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fe9940391b0 0x7fe99403b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe9900098c0 tx=0x7fe990006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.416+0000 7fe9a57fa640 1 -- 172.21.15.159:0/4172288995 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe99806bc00 con 0x7fe9a8106510 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.584+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fe9a8102f40 con 0x7fe9940391b0 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.668+0000 7fe9a57fa640 1 -- 172.21.15.159:0/4172288995 <== mgr.14118 v2:172.21.15.159:6800/3687310237 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe9a8102f40 con 0x7fe9940391b0 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fe9940391b0 msgr2=0x7fe99403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 --2- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fe9940391b0 0x7fe99403b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe9900098c0 tx=0x7fe990006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 msgr2=0x7fe9a807ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 --2- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a807ba20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe9980097f0 tx=0x7fe998030ec0 comp rx=0 tx=0).stop 2024-09-19T06:38:15.213 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 shutdown_connections 2024-09-19T06:38:15.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 --2- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fe9940391b0 0x7fe99403b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:15.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 --2- 172.21.15.159:0/4172288995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a8106510 0x7fe9a807ba20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:15.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 >> 172.21.15.159:0/4172288995 conn(0x7fe9a8101ca0 msgr2=0x7fe9a8102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:15.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 shutdown_connections 2024-09-19T06:38:15.214 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:14.670+0000 7fe9adebc640 1 -- 172.21.15.159:0/4172288995 wait complete. 2024-09-19T06:38:15.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:15 smithi159 ceph-mon[30935]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:15.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:15 smithi159 ceph-mon[30935]: Generating ssh key... 2024-09-19T06:38:15.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:15 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:15.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:15 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:16.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDl3plLDTqPzzYzMxINha6vjRvRazb0oftp4e78Ff2bbkOv1GysppYdiHyKfJjHDshftnDia8aLn3HyoxXtIVrTwpope/ZNFdECIji3ezxXKjrhb7+Yun9d45F8Nd203KHk0+S0TQHEfO56nX3t/mGOCuJn2zk7LovAGg606J3XQFfm++ZGaj+b3QR2AFwLUSD8y0PP9xx7m4ZK8Rjb3AYDWDBhBI3BUIfxL8C2f0G8NW343Mo71LZRRc2+RiQ/LBVoeumgWCeeXZe09VQYpHJP63nMgG9vvrBWYLd3qP5Y5otuZiLp/hPMaizDh2prWXIN6j7uRxmGpDZoEIauLTztDAZtuWmcKsXpzdy5PFegXA3QORlQpNUkrUSz/SYRK8o3zGGoVEPs3IcZILpNPZTmpIvSeZFJHUXGdIq1U+vWWXBTuKclecxuzEOGAl0nCwvF5y9DKYbNeqt+YIiyo+Kio9h7d+rfSUJr3taS6V1kcBSO5qsZavMuMSVUjn+XAbk= ceph-82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:38:16.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.605+0000 7f02dc6ba640 1 Processor -- start 2024-09-19T06:38:16.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.605+0000 7f02dc6ba640 1 -- start start 2024-09-19T06:38:16.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.606+0000 7f02dc6ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d4107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:16.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.606+0000 7f02dc6ba640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f02d4108000 con 0x7f02d4107630 2024-09-19T06:38:16.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.606+0000 7f02da456640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d4107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.606+0000 7f02da456640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d4107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40494/0 (socket says 172.21.15.159:40494) 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.606+0000 7f02da456640 1 -- 172.21.15.159:0/2818383855 learned_addr learned my addr 172.21.15.159:0/2818383855 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.606+0000 7f02da456640 1 -- 172.21.15.159:0/2818383855 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d41087e0 con 0x7f02d4107630 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.607+0000 7f02da456640 1 --2- 172.21.15.159:0/2818383855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d4107a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009820 tx=0x7f02c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbb3117ee3d2fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.607+0000 7f02d9454640 1 -- 172.21.15.159:0/2818383855 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8037070 con 0x7f02d4107630 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.607+0000 7f02d9454640 1 -- 172.21.15.159:0/2818383855 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02c8032900 con 0x7f02d4107630 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.607+0000 7f02d9454640 1 -- 172.21.15.159:0/2818383855 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8030850 con 0x7f02d4107630 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 -- 172.21.15.159:0/2818383855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 msgr2=0x7f02d4107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 --2- 172.21.15.159:0/2818383855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d4107a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009820 tx=0x7f02c802a270 comp rx=0 tx=0).stop 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 -- 172.21.15.159:0/2818383855 shutdown_connections 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 --2- 172.21.15.159:0/2818383855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d4107a30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 -- 172.21.15.159:0/2818383855 >> 172.21.15.159:0/2818383855 conn(0x7f02d4102da0 msgr2=0x7f02d4105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 -- 172.21.15.159:0/2818383855 shutdown_connections 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 -- 172.21.15.159:0/2818383855 wait complete. 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 Processor -- start 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 -- start start 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.608+0000 7f02dc6ba640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f02d410bb90 con 0x7f02d4107630 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02da456640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02da456640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40506/0 (socket says 172.21.15.159:40506) 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02da456640 1 -- 172.21.15.159:0/1153880669 learned_addr learned my addr 172.21.15.159:0/1153880669 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02da456640 1 -- 172.21.15.159:0/1153880669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d419bbc0 con 0x7f02d4107630 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02da456640 1 --2- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d419b680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009940 tx=0x7f02c80326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:16.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02c77fe640 1 -- 172.21.15.159:0/1153880669 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8042070 con 0x7f02d4107630 2024-09-19T06:38:16.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02c77fe640 1 -- 172.21.15.159:0/1153880669 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02c8032be0 con 0x7f02d4107630 2024-09-19T06:38:16.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d419be50 con 0x7f02d4107630 2024-09-19T06:38:16.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02c77fe640 1 -- 172.21.15.159:0/1153880669 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8037040 con 0x7f02d4107630 2024-09-19T06:38:16.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.609+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d419eb40 con 0x7f02d4107630 2024-09-19T06:38:16.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.610+0000 7f02c77fe640 1 -- 172.21.15.159:0/1153880669 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f02c8045070 con 0x7f02d4107630 2024-09-19T06:38:16.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.610+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d410bd10 con 0x7f02d4107630 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.610+0000 7f02c77fe640 1 --2- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f02c00391b0 0x7f02c003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.610+0000 7f02c77fe640 1 -- 172.21.15.159:0/1153880669 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f02c806c1e0 con 0x7f02d4107630 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.610+0000 7f02d9c55640 1 --2- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f02c00391b0 0x7f02c003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.611+0000 7f02d9c55640 1 --2- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f02c00391b0 0x7f02c003b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f02d00098c0 tx=0x7f02d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.615+0000 7f02c77fe640 1 -- 172.21.15.159:0/1153880669 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02c804b170 con 0x7f02d4107630 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.786+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f02d4104060 con 0x7f02c00391b0 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.787+0000 7f02c77fe640 1 -- 172.21.15.159:0/1153880669 <== mgr.14118 v2:172.21.15.159:6800/3687310237 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f02d4104060 con 0x7f02c00391b0 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f02c00391b0 msgr2=0x7f02c003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 --2- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f02c00391b0 0x7f02c003b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f02d00098c0 tx=0x7f02d0006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 msgr2=0x7f02d419b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 --2- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d419b680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009940 tx=0x7f02c80326e0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 shutdown_connections 2024-09-19T06:38:16.396 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 --2- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f02c00391b0 0x7f02c003b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.397 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 --2- 172.21.15.159:0/1153880669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02d4107630 0x7f02d419b680 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.397 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 >> 172.21.15.159:0/1153880669 conn(0x7f02d4102da0 msgr2=0x7f02d4103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:16.397 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 shutdown_connections 2024-09-19T06:38:16.397 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:15.790+0000 7f02dc6ba640 1 -- 172.21.15.159:0/1153880669 wait complete. 2024-09-19T06:38:16.397 INFO:teuthology.orchestra.run.smithi159.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:38:16.397 INFO:teuthology.orchestra.run.smithi159.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T06:38:16.397 INFO:teuthology.orchestra.run.smithi159.stdout:Adding host smithi159... 2024-09-19T06:38:16.968 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:16 smithi159 ceph-mon[30935]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:17.737 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:17 smithi159 ceph-mon[30935]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "addr": "172.21.15.159", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:18.684 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:18 smithi159 ceph-mon[30935]: Deploying cephadm binary to smithi159 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Added host 'smithi159' with addr '172.21.15.159' 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.790+0000 7f5d33ccd640 1 Processor -- start 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.791+0000 7f5d33ccd640 1 -- start start 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.791+0000 7f5d33ccd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.791+0000 7f5d33ccd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c107ff0 con 0x7f5d2c107620 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.791+0000 7f5d31a69640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.791+0000 7f5d31a69640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40520/0 (socket says 172.21.15.159:40520) 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.791+0000 7f5d31a69640 1 -- 172.21.15.159:0/999763613 learned_addr learned my addr 172.21.15.159:0/999763613 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.791+0000 7f5d31a69640 1 -- 172.21.15.159:0/999763613 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c108820 con 0x7f5d2c107620 2024-09-19T06:38:20.667 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.792+0000 7f5d31a69640 1 --2- 172.21.15.159:0/999763613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c107a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009820 tx=0x7f5d2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539b330895fe488 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.792+0000 7f5d30a67640 1 -- 172.21.15.159:0/999763613 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d28037070 con 0x7f5d2c107620 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.792+0000 7f5d30a67640 1 -- 172.21.15.159:0/999763613 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d28032900 con 0x7f5d2c107620 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.792+0000 7f5d30a67640 1 -- 172.21.15.159:0/999763613 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d28030850 con 0x7f5d2c107620 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 -- 172.21.15.159:0/999763613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 msgr2=0x7f5d2c107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 --2- 172.21.15.159:0/999763613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c107a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009820 tx=0x7f5d2802a270 comp rx=0 tx=0).stop 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 -- 172.21.15.159:0/999763613 shutdown_connections 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 --2- 172.21.15.159:0/999763613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c107a20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 -- 172.21.15.159:0/999763613 >> 172.21.15.159:0/999763613 conn(0x7f5d2c102db0 msgr2=0x7f5d2c1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 -- 172.21.15.159:0/999763613 shutdown_connections 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 -- 172.21.15.159:0/999763613 wait complete. 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 Processor -- start 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 -- start start 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:20.668 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.793+0000 7f5d33ccd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c10bbd0 con 0x7f5d2c107620 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d31a69640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d31a69640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40532/0 (socket says 172.21.15.159:40532) 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d31a69640 1 -- 172.21.15.159:0/3405169651 learned_addr learned my addr 172.21.15.159:0/3405169651 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d31a69640 1 -- 172.21.15.159:0/3405169651 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c19bb90 con 0x7f5d2c107620 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d31a69640 1 --2- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c19b650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d280097f0 tx=0x7f5d28030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d22ffd640 1 -- 172.21.15.159:0/3405169651 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d28042070 con 0x7f5d2c107620 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c19be20 con 0x7f5d2c107620 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d22ffd640 1 -- 172.21.15.159:0/3405169651 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d28032ca0 con 0x7f5d2c107620 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d22ffd640 1 -- 172.21.15.159:0/3405169651 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d28037040 con 0x7f5d2c107620 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.794+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2c19eb10 con 0x7f5d2c107620 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.795+0000 7f5d22ffd640 1 -- 172.21.15.159:0/3405169651 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5d28045070 con 0x7f5d2c107620 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.795+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d2c10bd50 con 0x7f5d2c107620 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.795+0000 7f5d22ffd640 1 --2- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f5d180391b0 0x7f5d1803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.795+0000 7f5d22ffd640 1 -- 172.21.15.159:0/3405169651 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5d2806c3a0 con 0x7f5d2c107620 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.795+0000 7f5d31268640 1 --2- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f5d180391b0 0x7f5d1803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.796+0000 7f5d31268640 1 --2- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f5d180391b0 0x7f5d1803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0098c0 tx=0x7f5d1c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.800+0000 7f5d22ffd640 1 -- 172.21.15.159:0/3405169651 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d2803ccd0 con 0x7f5d2c107620 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:16.967+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi159", "addr": "172.21.15.159", "target": ["mon-mgr", ""]}) -- 0x7f5d2c104070 con 0x7f5d180391b0 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.101+0000 7f5d22ffd640 1 -- 172.21.15.159:0/3405169651 <== mgr.14118 v2:172.21.15.159:6800/3687310237 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f5d2c104070 con 0x7f5d180391b0 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f5d180391b0 msgr2=0x7f5d1803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 --2- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f5d180391b0 0x7f5d1803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0098c0 tx=0x7f5d1c006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 msgr2=0x7f5d2c19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 --2- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c19b650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d280097f0 tx=0x7f5d28030ec0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 shutdown_connections 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 --2- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f5d180391b0 0x7f5d1803b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 --2- 172.21.15.159:0/3405169651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d2c107620 0x7f5d2c19b650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 >> 172.21.15.159:0/3405169651 conn(0x7f5d2c102db0 msgr2=0x7f5d2c103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 shutdown_connections 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:20.104+0000 7f5d33ccd640 1 -- 172.21.15.159:0/3405169651 wait complete. 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying unmanaged mon service... 2024-09-19T06:38:21.228 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:21 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:21.229 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:21 smithi159 ceph-mon[30935]: Added host smithi159 2024-09-19T06:38:21.229 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:21 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:22.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:22 smithi159 ceph-mon[30935]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:22.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:22 smithi159 ceph-mon[30935]: Saving service mon spec with placement count:5 2024-09-19T06:38:22.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:22 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:22.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T06:38:22.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.170+0000 7f1bf34e3640 1 Processor -- start 2024-09-19T06:38:22.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.170+0000 7f1bf34e3640 1 -- start start 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.170+0000 7f1bf34e3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.170+0000 7f1bf34e3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec107ff0 con 0x7f1bec107620 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.171+0000 7f1bf127f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.171+0000 7f1bf127f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56814/0 (socket says 172.21.15.159:56814) 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.171+0000 7f1bf127f640 1 -- 172.21.15.159:0/3620005890 learned_addr learned my addr 172.21.15.159:0/3620005890 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.171+0000 7f1bf127f640 1 -- 172.21.15.159:0/3620005890 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec108820 con 0x7f1bec107620 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.172+0000 7f1bf127f640 1 --2- 172.21.15.159:0/3620005890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec107a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009e80 tx=0x7f1bdc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647f438dac5c9ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.172+0000 7f1bebfff640 1 -- 172.21.15.159:0/3620005890 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc036070 con 0x7f1bec107620 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.172+0000 7f1bebfff640 1 -- 172.21.15.159:0/3620005890 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bdc0318c0 con 0x7f1bec107620 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.172+0000 7f1bebfff640 1 -- 172.21.15.159:0/3620005890 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc007ab0 con 0x7f1bec107620 2024-09-19T06:38:22.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.172+0000 7f1bf34e3640 1 -- 172.21.15.159:0/3620005890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 msgr2=0x7f1bec107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.172+0000 7f1bf34e3640 1 --2- 172.21.15.159:0/3620005890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec107a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009e80 tx=0x7f1bdc02a7a0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf34e3640 1 -- 172.21.15.159:0/3620005890 shutdown_connections 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf34e3640 1 --2- 172.21.15.159:0/3620005890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec107a20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf34e3640 1 -- 172.21.15.159:0/3620005890 >> 172.21.15.159:0/3620005890 conn(0x7f1bec102db0 msgr2=0x7f1bec1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf34e3640 1 -- 172.21.15.159:0/3620005890 shutdown_connections 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf34e3640 1 -- 172.21.15.159:0/3620005890 wait complete. 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf34e3640 1 Processor -- start 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf34e3640 1 -- start start 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf34e3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf34e3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec10bbd0 con 0x7f1bec107620 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.173+0000 7f1bf127f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.174+0000 7f1bf127f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec19b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56830/0 (socket says 172.21.15.159:56830) 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.174+0000 7f1bf127f640 1 -- 172.21.15.159:0/1180492098 learned_addr learned my addr 172.21.15.159:0/1180492098 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:22.855 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.174+0000 7f1bf127f640 1 -- 172.21.15.159:0/1180492098 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec19bc00 con 0x7f1bec107620 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.174+0000 7f1bf127f640 1 --2- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec19b6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc02acc0 tx=0x7f1bdc031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.174+0000 7f1bea7fc640 1 -- 172.21.15.159:0/1180492098 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc036050 con 0x7f1bec107620 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.174+0000 7f1bea7fc640 1 -- 172.21.15.159:0/1180492098 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bdc037040 con 0x7f1bec107620 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.174+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bec19be90 con 0x7f1bec107620 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.174+0000 7f1bea7fc640 1 -- 172.21.15.159:0/1180492098 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc03d890 con 0x7f1bec107620 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.174+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bec19eb80 con 0x7f1bec107620 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.175+0000 7f1bea7fc640 1 -- 172.21.15.159:0/1180492098 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1bdc044020 con 0x7f1bec107620 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.175+0000 7f1bea7fc640 1 --2- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1bd40391b0 0x7f1bd403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.175+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bec10bd50 con 0x7f1bec107620 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.175+0000 7f1bea7fc640 1 -- 172.21.15.159:0/1180492098 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1bdc042020 con 0x7f1bec107620 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.175+0000 7f1bf0a7e640 1 --2- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1bd40391b0 0x7f1bd403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.176+0000 7f1bf0a7e640 1 --2- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1bd40391b0 0x7f1bd403b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1be00098c0 tx=0x7f1be0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:22.856 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.180+0000 7f1bea7fc640 1 -- 172.21.15.159:0/1180492098 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1bdc04b020 con 0x7f1bec107620 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.366+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1bec104090 con 0x7f1bd40391b0 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.370+0000 7f1bea7fc640 1 -- 172.21.15.159:0/1180492098 <== mgr.14118 v2:172.21.15.159:6800/3687310237 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1bec104090 con 0x7f1bd40391b0 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1bd40391b0 msgr2=0x7f1bd403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 --2- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1bd40391b0 0x7f1bd403b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1be00098c0 tx=0x7f1be0006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 msgr2=0x7f1bec19b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 --2- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec19b6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc02acc0 tx=0x7f1bdc031ca0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 shutdown_connections 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 --2- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f1bd40391b0 0x7f1bd403b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 --2- 172.21.15.159:0/1180492098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bec107620 0x7f1bec19b6c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 >> 172.21.15.159:0/1180492098 conn(0x7f1bec102db0 msgr2=0x7f1bec103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 shutdown_connections 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:21.373+0000 7f1bf34e3640 1 -- 172.21.15.159:0/1180492098 wait complete. 2024-09-19T06:38:22.857 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying unmanaged mgr service... 2024-09-19T06:38:23.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:23 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:23.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:23 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:24.631 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T06:38:24.631 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.300+0000 7ff1a4462640 1 Processor -- start 2024-09-19T06:38:24.631 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.300+0000 7ff1a4462640 1 -- start start 2024-09-19T06:38:24.631 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.300+0000 7ff1a4462640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c112410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:24.631 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.300+0000 7ff1a4462640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1129e0 con 0x7ff19c111ff0 2024-09-19T06:38:24.631 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.301+0000 7ff1a21fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.301+0000 7ff1a21fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c112410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56834/0 (socket says 172.21.15.159:56834) 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.301+0000 7ff1a21fe640 1 -- 172.21.15.159:0/3614763204 learned_addr learned my addr 172.21.15.159:0/3614763204 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.301+0000 7ff1a21fe640 1 -- 172.21.15.159:0/3614763204 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c1131f0 con 0x7ff19c111ff0 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.301+0000 7ff1a21fe640 1 --2- 172.21.15.159:0/3614763204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c112410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff198009820 tx=0x7ff19802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0db13da9ab767e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.302+0000 7ff1a11fc640 1 -- 172.21.15.159:0/3614763204 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff198037070 con 0x7ff19c111ff0 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.302+0000 7ff1a11fc640 1 -- 172.21.15.159:0/3614763204 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff198032920 con 0x7ff19c111ff0 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.302+0000 7ff1a11fc640 1 -- 172.21.15.159:0/3614763204 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff198030810 con 0x7ff19c111ff0 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.302+0000 7ff1a4462640 1 -- 172.21.15.159:0/3614763204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 msgr2=0x7ff19c112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.302+0000 7ff1a4462640 1 --2- 172.21.15.159:0/3614763204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c112410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff198009820 tx=0x7ff19802a270 comp rx=0 tx=0).stop 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.302+0000 7ff1a4462640 1 -- 172.21.15.159:0/3614763204 shutdown_connections 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.302+0000 7ff1a4462640 1 --2- 172.21.15.159:0/3614763204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c112410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.302+0000 7ff1a4462640 1 -- 172.21.15.159:0/3614763204 >> 172.21.15.159:0/3614763204 conn(0x7ff19c06c970 msgr2=0x7ff19c10fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:24.632 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.303+0000 7ff1a4462640 1 -- 172.21.15.159:0/3614763204 shutdown_connections 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.303+0000 7ff1a4462640 1 -- 172.21.15.159:0/3614763204 wait complete. 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.303+0000 7ff1a4462640 1 Processor -- start 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.303+0000 7ff1a4462640 1 -- start start 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.303+0000 7ff1a4462640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c1a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.303+0000 7ff1a4462640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1165a0 con 0x7ff19c111ff0 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.303+0000 7ff1a21fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c1a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.303+0000 7ff1a21fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c1a60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56840/0 (socket says 172.21.15.159:56840) 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.303+0000 7ff1a21fe640 1 -- 172.21.15.159:0/220617274 learned_addr learned my addr 172.21.15.159:0/220617274 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.304+0000 7ff1a21fe640 1 -- 172.21.15.159:0/220617274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c1a65e0 con 0x7ff19c111ff0 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.304+0000 7ff1a21fe640 1 --2- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c1a60a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1980097f0 tx=0x7ff198030d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.304+0000 7ff1937fe640 1 -- 172.21.15.159:0/220617274 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff198037040 con 0x7ff19c111ff0 2024-09-19T06:38:24.633 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.304+0000 7ff1937fe640 1 -- 172.21.15.159:0/220617274 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff198040070 con 0x7ff19c111ff0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.304+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19c1a6870 con 0x7ff19c111ff0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.304+0000 7ff1937fe640 1 -- 172.21.15.159:0/220617274 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff19803a6d0 con 0x7ff19c111ff0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.304+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19c1a9560 con 0x7ff19c111ff0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.305+0000 7ff1937fe640 1 -- 172.21.15.159:0/220617274 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff19803a940 con 0x7ff19c111ff0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.305+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19c116720 con 0x7ff19c111ff0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.305+0000 7ff1937fe640 1 --2- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ff188039200 0x7ff18803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.305+0000 7ff1937fe640 1 -- 172.21.15.159:0/220617274 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff19806c920 con 0x7ff19c111ff0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.305+0000 7ff1a19fd640 1 --2- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ff188039200 0x7ff18803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.306+0000 7ff1a19fd640 1 --2- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ff188039200 0x7ff18803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0098c0 tx=0x7ff18c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.310+0000 7ff1937fe640 1 -- 172.21.15.159:0/220617274 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff19803ad30 con 0x7ff19c111ff0 2024-09-19T06:38:24.634 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.504+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff19c06d4b0 con 0x7ff188039200 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.511+0000 7ff1937fe640 1 -- 172.21.15.159:0/220617274 <== mgr.14118 v2:172.21.15.159:6800/3687310237 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff19c06d4b0 con 0x7ff188039200 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ff188039200 msgr2=0x7ff18803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 --2- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ff188039200 0x7ff18803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0098c0 tx=0x7ff18c006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 msgr2=0x7ff19c1a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 --2- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c1a60a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1980097f0 tx=0x7ff198030d40 comp rx=0 tx=0).stop 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 shutdown_connections 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 --2- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ff188039200 0x7ff18803b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 --2- 172.21.15.159:0/220617274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff19c111ff0 0x7ff19c1a60a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 >> 172.21.15.159:0/220617274 conn(0x7ff19c06c970 msgr2=0x7ff19c06cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 shutdown_connections 2024-09-19T06:38:24.635 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:23.513+0000 7ff1a4462640 1 -- 172.21.15.159:0/220617274 wait complete. 2024-09-19T06:38:24.643 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:24 smithi159 ceph-mon[30935]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:24.643 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:24 smithi159 ceph-mon[30935]: Saving service mgr spec with placement count:2 2024-09-19T06:38:24.643 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:24 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:24.644 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:24 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:25.803 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.058+0000 7fb0ca489640 1 Processor -- start 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.058+0000 7fb0ca489640 1 -- start start 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.058+0000 7fb0ca489640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c410a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.058+0000 7fb0ca489640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c407be80 con 0x7fb0c4108090 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.058+0000 7fb0c3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c410a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.059+0000 7fb0c3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c410a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56842/0 (socket says 172.21.15.159:56842) 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.059+0000 7fb0c3fff640 1 -- 172.21.15.159:0/3801612556 learned_addr learned my addr 172.21.15.159:0/3801612556 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.059+0000 7fb0c3fff640 1 -- 172.21.15.159:0/3801612556 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c410a9c0 con 0x7fb0c4108090 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.059+0000 7fb0c3fff640 1 --2- 172.21.15.159:0/3801612556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c410a480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009820 tx=0x7fb0b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bde1601b38ea0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0c2ffd640 1 -- 172.21.15.159:0/3801612556 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b4037070 con 0x7fb0c4108090 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0c2ffd640 1 -- 172.21.15.159:0/3801612556 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0b4032920 con 0x7fb0c4108090 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0c2ffd640 1 -- 172.21.15.159:0/3801612556 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b4030810 con 0x7fb0c4108090 2024-09-19T06:38:25.804 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0ca489640 1 -- 172.21.15.159:0/3801612556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 msgr2=0x7fb0c410a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0ca489640 1 --2- 172.21.15.159:0/3801612556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c410a480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009820 tx=0x7fb0b402a270 comp rx=0 tx=0).stop 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0ca489640 1 -- 172.21.15.159:0/3801612556 shutdown_connections 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0ca489640 1 --2- 172.21.15.159:0/3801612556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c410a480 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0ca489640 1 -- 172.21.15.159:0/3801612556 >> 172.21.15.159:0/3801612556 conn(0x7fb0c4101cb0 msgr2=0x7fb0c41040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0ca489640 1 -- 172.21.15.159:0/3801612556 shutdown_connections 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.060+0000 7fb0ca489640 1 -- 172.21.15.159:0/3801612556 wait complete. 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.061+0000 7fb0ca489640 1 Processor -- start 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.061+0000 7fb0ca489640 1 -- start start 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.061+0000 7fb0ca489640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.061+0000 7fb0ca489640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c410baa0 con 0x7fb0c4108090 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.061+0000 7fb0c3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.061+0000 7fb0c3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56858/0 (socket says 172.21.15.159:56858) 2024-09-19T06:38:25.805 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.061+0000 7fb0c3fff640 1 -- 172.21.15.159:0/2560275588 learned_addr learned my addr 172.21.15.159:0/2560275588 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.062+0000 7fb0c3fff640 1 -- 172.21.15.159:0/2560275588 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c419bbc0 con 0x7fb0c4108090 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.062+0000 7fb0c3fff640 1 --2- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c419b680 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40097f0 tx=0x7fb0b40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.062+0000 7fb0c17fa640 1 -- 172.21.15.159:0/2560275588 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b4037040 con 0x7fb0c4108090 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.062+0000 7fb0c17fa640 1 -- 172.21.15.159:0/2560275588 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0b4030c40 con 0x7fb0c4108090 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.062+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c419be50 con 0x7fb0c4108090 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.062+0000 7fb0c17fa640 1 -- 172.21.15.159:0/2560275588 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b403a5d0 con 0x7fb0c4108090 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.062+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c419eb40 con 0x7fb0c4108090 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.063+0000 7fb0c17fa640 1 -- 172.21.15.159:0/2560275588 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb0b403a810 con 0x7fb0c4108090 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.063+0000 7fb0c17fa640 1 --2- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fb0ac0391b0 0x7fb0ac03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.063+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c41084f0 con 0x7fb0c4108090 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.063+0000 7fb0c17fa640 1 -- 172.21.15.159:0/2560275588 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb0b406c8c0 con 0x7fb0c4108090 2024-09-19T06:38:25.806 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.063+0000 7fb0c37fe640 1 --2- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fb0ac0391b0 0x7fb0ac03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.063+0000 7fb0c37fe640 1 --2- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fb0ac0391b0 0x7fb0ac03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80098c0 tx=0x7fb0b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.068+0000 7fb0c17fa640 1 -- 172.21.15.159:0/2560275588 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0b40392f0 con 0x7fb0c4108090 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.247+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fb0c419f120 con 0x7fb0c4108090 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.250+0000 7fb0c17fa640 1 -- 172.21.15.159:0/2560275588 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fb0b403b9d0 con 0x7fb0c4108090 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fb0ac0391b0 msgr2=0x7fb0ac03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 --2- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fb0ac0391b0 0x7fb0ac03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80098c0 tx=0x7fb0b8006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 msgr2=0x7fb0c419b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 --2- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c419b680 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40097f0 tx=0x7fb0b40327b0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 shutdown_connections 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 --2- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fb0ac0391b0 0x7fb0ac03b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 --2- 172.21.15.159:0/2560275588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c4108090 0x7fb0c419b680 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 >> 172.21.15.159:0/2560275588 conn(0x7fb0c4101cb0 msgr2=0x7fb0c41028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 shutdown_connections 2024-09-19T06:38:25.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:25.254+0000 7fb0ca489640 1 -- 172.21.15.159:0/2560275588 wait complete. 2024-09-19T06:38:26.240 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:26 smithi159 ceph-mon[30935]: from='mgr.14118 172.21.15.159:0/3003286344' entity='mgr.x' 2024-09-19T06:38:26.240 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:26 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2560275588' entity='client.admin' 2024-09-19T06:38:27.020 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.246+0000 7fc24173b640 1 Processor -- start 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.246+0000 7fc24173b640 1 -- start start 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.246+0000 7fc24173b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c10a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.246+0000 7fc24173b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c07be30 con 0x7fc23c108080 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.246+0000 7fc23affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c10a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.246+0000 7fc23affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c10a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56866/0 (socket says 172.21.15.159:56866) 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.246+0000 7fc23affd640 1 -- 172.21.15.159:0/1465083904 learned_addr learned my addr 172.21.15.159:0/1465083904 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.247+0000 7fc23affd640 1 -- 172.21.15.159:0/1465083904 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c10a9b0 con 0x7fc23c108080 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.247+0000 7fc23affd640 1 --2- 172.21.15.159:0/1465083904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c10a470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009820 tx=0x7fc22c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f698bedb71d54d08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.247+0000 7fc23a7fc640 1 -- 172.21.15.159:0/1465083904 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c037070 con 0x7fc23c108080 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.248+0000 7fc23a7fc640 1 -- 172.21.15.159:0/1465083904 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc22c032920 con 0x7fc23c108080 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.248+0000 7fc23a7fc640 1 -- 172.21.15.159:0/1465083904 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c030810 con 0x7fc23c108080 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.248+0000 7fc24173b640 1 -- 172.21.15.159:0/1465083904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 msgr2=0x7fc23c10a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:27.021 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.248+0000 7fc24173b640 1 --2- 172.21.15.159:0/1465083904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c10a470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009820 tx=0x7fc22c02a270 comp rx=0 tx=0).stop 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.248+0000 7fc24173b640 1 -- 172.21.15.159:0/1465083904 shutdown_connections 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.248+0000 7fc24173b640 1 --2- 172.21.15.159:0/1465083904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c10a470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.248+0000 7fc24173b640 1 -- 172.21.15.159:0/1465083904 >> 172.21.15.159:0/1465083904 conn(0x7fc23c101ca0 msgr2=0x7fc23c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.248+0000 7fc24173b640 1 -- 172.21.15.159:0/1465083904 shutdown_connections 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.248+0000 7fc24173b640 1 -- 172.21.15.159:0/1465083904 wait complete. 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.249+0000 7fc24173b640 1 Processor -- start 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.249+0000 7fc24173b640 1 -- start start 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.249+0000 7fc24173b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.249+0000 7fc24173b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10ba30 con 0x7fc23c108080 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.249+0000 7fc23affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.249+0000 7fc23affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56882/0 (socket says 172.21.15.159:56882) 2024-09-19T06:38:27.022 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.249+0000 7fc23affd640 1 -- 172.21.15.159:0/3894389637 learned_addr learned my addr 172.21.15.159:0/3894389637 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.249+0000 7fc23affd640 1 -- 172.21.15.159:0/3894389637 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c19bb90 con 0x7fc23c108080 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.250+0000 7fc23affd640 1 --2- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c19b650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0097f0 tx=0x7fc22c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.250+0000 7fc238ff9640 1 -- 172.21.15.159:0/3894389637 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c037040 con 0x7fc23c108080 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.250+0000 7fc238ff9640 1 -- 172.21.15.159:0/3894389637 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc22c030c40 con 0x7fc23c108080 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.250+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c19be20 con 0x7fc23c108080 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.250+0000 7fc238ff9640 1 -- 172.21.15.159:0/3894389637 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c03a5d0 con 0x7fc23c108080 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.250+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc23c19eb10 con 0x7fc23c108080 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.251+0000 7fc238ff9640 1 -- 172.21.15.159:0/3894389637 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc22c03a810 con 0x7fc23c108080 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.251+0000 7fc238ff9640 1 --2- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fc2280391b0 0x7fc22803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.251+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23c1084e0 con 0x7fc23c108080 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.251+0000 7fc238ff9640 1 -- 172.21.15.159:0/3894389637 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc22c06c770 con 0x7fc23c108080 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.251+0000 7fc233fff640 1 --2- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fc2280391b0 0x7fc22803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:27.023 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.251+0000 7fc233fff640 1 --2- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fc2280391b0 0x7fc22803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc2240098c0 tx=0x7fc224006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.256+0000 7fc238ff9640 1 -- 172.21.15.159:0/3894389637 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc22c0371e0 con 0x7fc23c108080 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.445+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fc23c105e70 con 0x7fc23c108080 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.448+0000 7fc238ff9640 1 -- 172.21.15.159:0/3894389637 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fc23c105e70 con 0x7fc23c108080 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.450+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fc2280391b0 msgr2=0x7fc22803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.450+0000 7fc24173b640 1 --2- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fc2280391b0 0x7fc22803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc2240098c0 tx=0x7fc224006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.450+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 msgr2=0x7fc23c19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.450+0000 7fc24173b640 1 --2- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c19b650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0097f0 tx=0x7fc22c0327b0 comp rx=0 tx=0).stop 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.451+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 shutdown_connections 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.451+0000 7fc24173b640 1 --2- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7fc2280391b0 0x7fc22803b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.451+0000 7fc24173b640 1 --2- 172.21.15.159:0/3894389637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc23c108080 0x7fc23c19b650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.451+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 >> 172.21.15.159:0/3894389637 conn(0x7fc23c101ca0 msgr2=0x7fc23c102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.451+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 shutdown_connections 2024-09-19T06:38:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:26.451+0000 7fc24173b640 1 -- 172.21.15.159:0/3894389637 wait complete. 2024-09-19T06:38:27.025 INFO:teuthology.orchestra.run.smithi159.stdout:Enabling the dashboard module... 2024-09-19T06:38:27.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:27 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3894389637' entity='client.admin' 2024-09-19T06:38:28.766 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:28 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2917979458' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T06:38:28.766 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: ignoring --setuser ceph since I am not root 2024-09-19T06:38:28.766 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: ignoring --setgroup ceph since I am not root 2024-09-19T06:38:28.766 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:28.607+0000 7f363fd61040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:38:28.766 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:28.664+0000 7f363fd61040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:38:29.029 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:28.815+0000 7f363fd61040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:38:29.030 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:28.881+0000 7f363fd61040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:38:29.030 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:29.028+0000 7f363fd61040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:38:29.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.411+0000 7f07a4d59640 1 Processor -- start 2024-09-19T06:38:29.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.411+0000 7f07a4d59640 1 -- start start 2024-09-19T06:38:29.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.412+0000 7f07a4d59640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a0107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:29.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.412+0000 7f07a4d59640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f07a0107ff0 con 0x7f07a0107620 2024-09-19T06:38:29.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.412+0000 7f079e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a0107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:29.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.412+0000 7f079e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a0107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56886/0 (socket says 172.21.15.159:56886) 2024-09-19T06:38:29.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.412+0000 7f079e59c640 1 -- 172.21.15.159:0/738373780 learned_addr learned my addr 172.21.15.159:0/738373780 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.412+0000 7f079e59c640 1 -- 172.21.15.159:0/738373780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a0108820 con 0x7f07a0107620 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.413+0000 7f079e59c640 1 --2- 172.21.15.159:0/738373780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a0107a20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0788009820 tx=0x7f078802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fb192ae679ae48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.413+0000 7f079d59a640 1 -- 172.21.15.159:0/738373780 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0788037070 con 0x7f07a0107620 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.413+0000 7f079d59a640 1 -- 172.21.15.159:0/738373780 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0788032920 con 0x7f07a0107620 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.413+0000 7f079d59a640 1 -- 172.21.15.159:0/738373780 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0788030810 con 0x7f07a0107620 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.414+0000 7f07a4d59640 1 -- 172.21.15.159:0/738373780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 msgr2=0x7f07a0107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.414+0000 7f07a4d59640 1 --2- 172.21.15.159:0/738373780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a0107a20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0788009820 tx=0x7f078802a270 comp rx=0 tx=0).stop 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.414+0000 7f07a4d59640 1 -- 172.21.15.159:0/738373780 shutdown_connections 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.414+0000 7f07a4d59640 1 --2- 172.21.15.159:0/738373780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a0107a20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.414+0000 7f07a4d59640 1 -- 172.21.15.159:0/738373780 >> 172.21.15.159:0/738373780 conn(0x7f07a0102db0 msgr2=0x7f07a01051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.414+0000 7f07a4d59640 1 -- 172.21.15.159:0/738373780 shutdown_connections 2024-09-19T06:38:29.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.414+0000 7f07a4d59640 1 -- 172.21.15.159:0/738373780 wait complete. 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.415+0000 7f07a4d59640 1 Processor -- start 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.415+0000 7f07a4d59640 1 -- start start 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.415+0000 7f07a4d59640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.415+0000 7f07a4d59640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f07a010bbd0 con 0x7f07a0107620 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.415+0000 7f079e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.415+0000 7f079e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a019b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56902/0 (socket says 172.21.15.159:56902) 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.415+0000 7f079e59c640 1 -- 172.21.15.159:0/2917979458 learned_addr learned my addr 172.21.15.159:0/2917979458 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.415+0000 7f079e59c640 1 -- 172.21.15.159:0/2917979458 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a019bc00 con 0x7f07a0107620 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.415+0000 7f079e59c640 1 --2- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a019b6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0788030560 tx=0x7f0788032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.416+0000 7f07977fe640 1 -- 172.21.15.159:0/2917979458 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0788037040 con 0x7f07a0107620 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.416+0000 7f07977fe640 1 -- 172.21.15.159:0/2917979458 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0788040070 con 0x7f07a0107620 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.416+0000 7f07977fe640 1 -- 172.21.15.159:0/2917979458 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078803a6d0 con 0x7f07a0107620 2024-09-19T06:38:29.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.416+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a019be90 con 0x7f07a0107620 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.416+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a019eb80 con 0x7f07a0107620 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.416+0000 7f07977fe640 1 -- 172.21.15.159:0/2917979458 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f078803a940 con 0x7f07a0107620 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.417+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a010bd50 con 0x7f07a0107620 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.417+0000 7f07977fe640 1 --2- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f078c0391b0 0x7f078c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.417+0000 7f07977fe640 1 -- 172.21.15.159:0/2917979458 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f078806c980 con 0x7f07a0107620 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.417+0000 7f079dd9b640 1 --2- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f078c0391b0 0x7f078c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.417+0000 7f079dd9b640 1 --2- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f078c0391b0 0x7f078c03b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f07900098c0 tx=0x7f0790006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.421+0000 7f07977fe640 1 -- 172.21.15.159:0/2917979458 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0788032920 con 0x7f07a0107620 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:27.639+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f07a0107aa0 con 0x7f07a0107620 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.451+0000 7f07977fe640 1 -- 172.21.15.159:0/2917979458 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f078803ad30 con 0x7f07a0107620 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.454+0000 7f07977fe640 1 -- 172.21.15.159:0/2917979458 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f0788045980 con 0x7f07a0107620 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f078c0391b0 msgr2=0x7f078c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:29.085 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 --2- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f078c0391b0 0x7f078c03b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f07900098c0 tx=0x7f0790006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 msgr2=0x7f07a019b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:29.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 --2- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a019b6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0788030560 tx=0x7f0788032670 comp rx=0 tx=0).stop 2024-09-19T06:38:29.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 shutdown_connections 2024-09-19T06:38:29.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 --2- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f078c0391b0 0x7f078c03b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 --2- 172.21.15.159:0/2917979458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07a0107620 0x7f07a019b6c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 >> 172.21.15.159:0/2917979458 conn(0x7f07a0102db0 msgr2=0x7f07a0103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:29.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 shutdown_connections 2024-09-19T06:38:29.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:28.455+0000 7f07a4d59640 1 -- 172.21.15.159:0/2917979458 wait complete. 2024-09-19T06:38:29.304 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:29.176+0000 7f363fd61040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:38:29.565 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:29 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2917979458' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T06:38:29.565 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:29 smithi159 ceph-mon[30935]: mgrmap e9: x(active, since 18s) 2024-09-19T06:38:29.565 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:29.500+0000 7f363fd61040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:38:29.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:29.563+0000 7f363fd61040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:38:29.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:29.756+0000 7f363fd61040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:38:30.209 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.496+0000 7ffada711640 1 Processor -- start 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.497+0000 7ffada711640 1 -- start start 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.497+0000 7ffada711640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad4106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.497+0000 7ffada711640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4106ee0 con 0x7ffad4106510 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.497+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad4106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.497+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad4106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36328/0 (socket says 172.21.15.159:36328) 2024-09-19T06:38:30.215 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.497+0000 7ffad3fff640 1 -- 172.21.15.159:0/3847568301 learned_addr learned my addr 172.21.15.159:0/3847568301 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.497+0000 7ffad3fff640 1 -- 172.21.15.159:0/3847568301 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad41076c0 con 0x7ffad4106510 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.498+0000 7ffad3fff640 1 --2- 172.21.15.159:0/3847568301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad4106910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009820 tx=0x7ffac402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0290dcaedef9f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.498+0000 7ffad2ffd640 1 -- 172.21.15.159:0/3847568301 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4037070 con 0x7ffad4106510 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.498+0000 7ffad2ffd640 1 -- 172.21.15.159:0/3847568301 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffac4032920 con 0x7ffad4106510 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.498+0000 7ffad2ffd640 1 -- 172.21.15.159:0/3847568301 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4030810 con 0x7ffad4106510 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.499+0000 7ffada711640 1 -- 172.21.15.159:0/3847568301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 msgr2=0x7ffad4106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.499+0000 7ffada711640 1 --2- 172.21.15.159:0/3847568301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad4106910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009820 tx=0x7ffac402a270 comp rx=0 tx=0).stop 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.499+0000 7ffada711640 1 -- 172.21.15.159:0/3847568301 shutdown_connections 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.499+0000 7ffada711640 1 --2- 172.21.15.159:0/3847568301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad4106910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.499+0000 7ffada711640 1 -- 172.21.15.159:0/3847568301 >> 172.21.15.159:0/3847568301 conn(0x7ffad4101ca0 msgr2=0x7ffad41040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.499+0000 7ffada711640 1 -- 172.21.15.159:0/3847568301 shutdown_connections 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.499+0000 7ffada711640 1 -- 172.21.15.159:0/3847568301 wait complete. 2024-09-19T06:38:30.216 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.500+0000 7ffada711640 1 Processor -- start 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.500+0000 7ffada711640 1 -- start start 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.500+0000 7ffada711640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad41916f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.500+0000 7ffada711640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffad410aa70 con 0x7ffad4106510 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.500+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad41916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.500+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad41916f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36344/0 (socket says 172.21.15.159:36344) 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.500+0000 7ffad3fff640 1 -- 172.21.15.159:0/1406207585 learned_addr learned my addr 172.21.15.159:0/1406207585 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.501+0000 7ffad3fff640 1 -- 172.21.15.159:0/1406207585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad4191c30 con 0x7ffad4106510 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.501+0000 7ffad3fff640 1 --2- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad41916f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffac4030560 tx=0x7ffac4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.501+0000 7ffad17fa640 1 -- 172.21.15.159:0/1406207585 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4037040 con 0x7ffad4106510 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.501+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad418fe20 con 0x7ffad4106510 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.501+0000 7ffad17fa640 1 -- 172.21.15.159:0/1406207585 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffac4040070 con 0x7ffad4106510 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.501+0000 7ffad17fa640 1 -- 172.21.15.159:0/1406207585 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac403a6d0 con 0x7ffad4106510 2024-09-19T06:38:30.217 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.501+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad4190360 con 0x7ffad4106510 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.502+0000 7ffad17fa640 1 -- 172.21.15.159:0/1406207585 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ffac403a940 con 0x7ffad4106510 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.502+0000 7ffad17fa640 1 --2- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ffabc039200 0x7ffabc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.502+0000 7ffad17fa640 1 -- 172.21.15.159:0/1406207585 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffac406c830 con 0x7ffad4106510 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.502+0000 7ffad37fe640 1 -- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ffabc039200 msgr2=0x7ffabc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/3687310237 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.502+0000 7ffad37fe640 1 --2- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ffabc039200 0x7ffabc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.502+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad4106990 con 0x7ffad4106510 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.507+0000 7ffad17fa640 1 -- 172.21.15.159:0/1406207585 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffac4044c70 con 0x7ffad4106510 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.703+0000 7ffad37fe640 1 -- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ffabc039200 msgr2=0x7ffabc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/3687310237 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.703+0000 7ffad37fe640 1 --2- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ffabc039200 0x7ffabc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.726+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ffad4195440 con 0x7ffad4106510 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.727+0000 7ffad17fa640 1 -- 172.21.15.159:0/1406207585 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7ffac4041270 con 0x7ffad4106510 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ffabc039200 msgr2=0x7ffabc03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 --2- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ffabc039200 0x7ffabc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:30.218 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 msgr2=0x7ffad41916f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:30.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 --2- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad41916f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffac4030560 tx=0x7ffac4032670 comp rx=0 tx=0).stop 2024-09-19T06:38:30.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 shutdown_connections 2024-09-19T06:38:30.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 --2- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7ffabc039200 0x7ffabc03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:30.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 --2- 172.21.15.159:0/1406207585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffad4106510 0x7ffad41916f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:30.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 >> 172.21.15.159:0/1406207585 conn(0x7ffad4101ca0 msgr2=0x7ffad4102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:30.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 shutdown_connections 2024-09-19T06:38:30.219 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:29.729+0000 7ffada711640 1 -- 172.21.15.159:0/1406207585 wait complete. 2024-09-19T06:38:30.219 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for the mgr to restart... 2024-09-19T06:38:30.219 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mgr epoch 9... 2024-09-19T06:38:30.646 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:30 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1406207585' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:38:30.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:30 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:30.669+0000 7f363fd61040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:38:30.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:30 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:30.738+0000 7f363fd61040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:38:31.570 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:31.452+0000 7f363fd61040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:38:31.570 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:31.568+0000 7f363fd61040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:38:31.897 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:31.712+0000 7f363fd61040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:38:31.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:31.773+0000 7f363fd61040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:38:32.210 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:31.923+0000 7f363fd61040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:38:32.211 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:31.991+0000 7f363fd61040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:38:32.211 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:32.051+0000 7f363fd61040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:38:32.211 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:32.209+0000 7f363fd61040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:38:32.485 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:32.275+0000 7f363fd61040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:38:32.485 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:32.341+0000 7f363fd61040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:38:32.485 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:32.423+0000 7f363fd61040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:38:32.485 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:32.482+0000 7f363fd61040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:38:32.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:32.540+0000 7f363fd61040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:38:33.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:33.327+0000 7f363fd61040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:38:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: Active manager daemon x restarted 2024-09-19T06:38:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: Activating manager daemon x 2024-09-19T06:38:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T06:38:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: mgrmap e10: x(active, starting, since 0.00354844s) 2024-09-19T06:38:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:38:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:38:33.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:38:33.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:38:33.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:38:33.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: Manager daemon x is now available 2024-09-19T06:38:33.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:33.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:38:33.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:38:35.034 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:34.806+0000 7f35ab075640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:38:34] ENGINE Error in HTTPServer.serve 2024-09-19T06:38:35.034 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: Traceback (most recent call last): 2024-09-19T06:38:35.034 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:38:35.034 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self._connections.run(self.expiration_interval) 2024-09-19T06:38:35.034 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:38:35.034 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self._run(expiration_interval) 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: s = self.context.wrap_socket( 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: return self.sslsocket_class._create( 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self.do_handshake() 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self._sslobj.do_handshake() 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:38:35.035 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:38:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:38:35.042 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.645+0000 7f15d80cf640 1 Processor -- start 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.645+0000 7f15d80cf640 1 -- start start 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.645+0000 7f15d80cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d0107a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.645+0000 7f15d80cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0108020 con 0x7f15d0107650 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.645+0000 7f15d5e6b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d0107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.645+0000 7f15d5e6b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d0107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36356/0 (socket says 172.21.15.159:36356) 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.645+0000 7f15d5e6b640 1 -- 172.21.15.159:0/3337407661 learned_addr learned my addr 172.21.15.159:0/3337407661 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:35.043 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.646+0000 7f15d5e6b640 1 -- 172.21.15.159:0/3337407661 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d0108800 con 0x7f15d0107650 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.647+0000 7f15d5e6b640 1 --2- 172.21.15.159:0/3337407661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d0107a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009820 tx=0x7f15cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694591f207ccba2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.647+0000 7f15d4e69640 1 -- 172.21.15.159:0/3337407661 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15cc037070 con 0x7f15d0107650 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.647+0000 7f15d4e69640 1 -- 172.21.15.159:0/3337407661 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15cc032920 con 0x7f15d0107650 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.647+0000 7f15d4e69640 1 -- 172.21.15.159:0/3337407661 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15cc030810 con 0x7f15d0107650 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.647+0000 7f15d80cf640 1 -- 172.21.15.159:0/3337407661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 msgr2=0x7f15d0107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.647+0000 7f15d80cf640 1 --2- 172.21.15.159:0/3337407661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d0107a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009820 tx=0x7f15cc02a270 comp rx=0 tx=0).stop 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.647+0000 7f15d80cf640 1 -- 172.21.15.159:0/3337407661 shutdown_connections 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.647+0000 7f15d80cf640 1 --2- 172.21.15.159:0/3337407661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d0107a50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.647+0000 7f15d80cf640 1 -- 172.21.15.159:0/3337407661 >> 172.21.15.159:0/3337407661 conn(0x7f15d0102de0 msgr2=0x7f15d0105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.648+0000 7f15d80cf640 1 -- 172.21.15.159:0/3337407661 shutdown_connections 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.648+0000 7f15d80cf640 1 -- 172.21.15.159:0/3337407661 wait complete. 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.648+0000 7f15d80cf640 1 Processor -- start 2024-09-19T06:38:35.044 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.648+0000 7f15d80cf640 1 -- start start 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15d80cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d019b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15d80cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f15d010bbb0 con 0x7f15d0107650 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15d5e6b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d019b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15d5e6b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d019b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36366/0 (socket says 172.21.15.159:36366) 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15d5e6b640 1 -- 172.21.15.159:0/2069435387 learned_addr learned my addr 172.21.15.159:0/2069435387 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15d5e6b640 1 -- 172.21.15.159:0/2069435387 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d019bb60 con 0x7f15d0107650 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15d5e6b640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d019b620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f15cc030560 tx=0x7f15cc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15cc037040 con 0x7f15d0107650 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15cc040070 con 0x7f15d0107650 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.649+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15cc03a740 con 0x7f15d0107650 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.650+0000 7f15d80cf640 1 -- 172.21.15.159:0/2069435387 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d019bdf0 con 0x7f15d0107650 2024-09-19T06:38:35.045 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.650+0000 7f15d80cf640 1 -- 172.21.15.159:0/2069435387 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d019eae0 con 0x7f15d0107650 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.651+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f15cc03bb90 con 0x7f15d0107650 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.651+0000 7f15c6ffd640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 0x7f15bc03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.651+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 --> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f15bc03be30 con 0x7f15bc039260 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.651+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f15cc06c870 con 0x7f15d0107650 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.651+0000 7f15d566a640 1 -- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 msgr2=0x7f15bc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/3687310237 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.651+0000 7f15d566a640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 0x7f15bc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.852+0000 7f15d566a640 1 -- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 msgr2=0x7f15bc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/3687310237 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:30.852+0000 7f15d566a640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 0x7f15bc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:31.253+0000 7f15d566a640 1 -- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 msgr2=0x7f15bc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/3687310237 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:31.253+0000 7f15d566a640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 0x7f15bc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:32.054+0000 7f15d566a640 1 -- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 msgr2=0x7f15bc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/3687310237 2024-09-19T06:38:35.046 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:32.054+0000 7f15d566a640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 0x7f15bc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:33.331+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f15cc06b320 con 0x7f15d0107650 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:33.331+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 msgr2=0x7f15bc03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:33.331+0000 7f15c6ffd640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 0x7f15bc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.332+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f15cc03b420 con 0x7f15d0107650 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.332+0000 7f15c6ffd640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f15bc03cd20 0x7f15bc03f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.333+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f15cc065990 con 0x7f15bc03cd20 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.333+0000 7f15d566a640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f15bc03cd20 0x7f15bc03f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.333+0000 7f15d566a640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f15bc03cd20 0x7f15bc03f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f15c0003980 tx=0x7f15c00092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.334+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f15cc065990 con 0x7f15bc03cd20 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 -- 172.21.15.159:0/2069435387 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f15d010bd30 con 0x7f15bc03cd20 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15c6ffd640 1 -- 172.21.15.159:0/2069435387 <== mgr.14150 v2:172.21.15.159:6800/2390667146 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f15d010bd30 con 0x7f15bc03cd20 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 -- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f15bc03cd20 msgr2=0x7f15bc03f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f15bc03cd20 0x7f15bc03f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f15c0003980 tx=0x7f15c00092b0 comp rx=0 tx=0).stop 2024-09-19T06:38:35.047 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 -- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 msgr2=0x7f15d019b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d019b620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f15cc030560 tx=0x7f15cc032670 comp rx=0 tx=0).stop 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 -- 172.21.15.159:0/2069435387 shutdown_connections 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f15bc03cd20 0x7f15bc03f110 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:6800/3687310237,v1:172.21.15.159:6801/3687310237] conn(0x7f15bc039260 0x7f15bc03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 --2- 172.21.15.159:0/2069435387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d0107650 0x7f15d019b620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.341+0000 7f15d80cf640 1 -- 172.21.15.159:0/2069435387 >> 172.21.15.159:0/2069435387 conn(0x7f15d0102de0 msgr2=0x7f15d01039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.342+0000 7f15d80cf640 1 -- 172.21.15.159:0/2069435387 shutdown_connections 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:34.342+0000 7f15d80cf640 1 -- 172.21.15.159:0/2069435387 wait complete. 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:mgr epoch 9 is available 2024-09-19T06:38:35.048 INFO:teuthology.orchestra.run.smithi159.stdout:Generating a dashboard self-signed certificate... 2024-09-19T06:38:35.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:35 smithi159 ceph-mon[30935]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T06:38:35.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:35 smithi159 ceph-mon[30935]: mgrmap e11: x(active, since 1.00581s) 2024-09-19T06:38:35.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:35 smithi159 ceph-mon[30935]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T06:38:35.619 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:36.256 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T06:38:36.256 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.430+0000 7f9c23fff640 1 Processor -- start 2024-09-19T06:38:36.256 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.430+0000 7f9c23fff640 1 -- start start 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.430+0000 7f9c23fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2410a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.430+0000 7f9c23fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2407bdd0 con 0x7f9c24107f30 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.431+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2410a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.431+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2410a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36448/0 (socket says 172.21.15.159:36448) 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.431+0000 7f9c22ffd640 1 -- 172.21.15.159:0/108756638 learned_addr learned my addr 172.21.15.159:0/108756638 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.431+0000 7f9c22ffd640 1 -- 172.21.15.159:0/108756638 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2410a860 con 0x7f9c24107f30 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c22ffd640 1 --2- 172.21.15.159:0/108756638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2410a320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009820 tx=0x7f9c1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68619ba61f1ae6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c21ffb640 1 -- 172.21.15.159:0/108756638 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c14037070 con 0x7f9c24107f30 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c21ffb640 1 -- 172.21.15.159:0/108756638 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c14032920 con 0x7f9c24107f30 2024-09-19T06:38:36.257 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c21ffb640 1 -- 172.21.15.159:0/108756638 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c14030810 con 0x7f9c24107f30 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c23fff640 1 -- 172.21.15.159:0/108756638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 msgr2=0x7f9c2410a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c23fff640 1 --2- 172.21.15.159:0/108756638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2410a320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009820 tx=0x7f9c1402a270 comp rx=0 tx=0).stop 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c23fff640 1 -- 172.21.15.159:0/108756638 shutdown_connections 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c23fff640 1 --2- 172.21.15.159:0/108756638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2410a320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c23fff640 1 -- 172.21.15.159:0/108756638 >> 172.21.15.159:0/108756638 conn(0x7f9c24101b10 msgr2=0x7f9c24103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c23fff640 1 -- 172.21.15.159:0/108756638 shutdown_connections 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.432+0000 7f9c23fff640 1 -- 172.21.15.159:0/108756638 wait complete. 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.433+0000 7f9c23fff640 1 Processor -- start 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.433+0000 7f9c23fff640 1 -- start start 2024-09-19T06:38:36.258 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.433+0000 7f9c23fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2419b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:36.259 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.433+0000 7f9c23fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2410b880 con 0x7f9c24107f30 2024-09-19T06:38:36.259 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2419b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:36.259 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2419b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36464/0 (socket says 172.21.15.159:36464) 2024-09-19T06:38:36.259 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c22ffd640 1 -- 172.21.15.159:0/2020321204 learned_addr learned my addr 172.21.15.159:0/2020321204 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:36.259 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c22ffd640 1 -- 172.21.15.159:0/2020321204 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2419b930 con 0x7f9c24107f30 2024-09-19T06:38:36.259 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c22ffd640 1 --2- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2419b3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097f0 tx=0x7f9c140327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:36.260 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c1bfff640 1 -- 172.21.15.159:0/2020321204 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c14037040 con 0x7f9c24107f30 2024-09-19T06:38:36.260 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c1bfff640 1 -- 172.21.15.159:0/2020321204 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c14030cc0 con 0x7f9c24107f30 2024-09-19T06:38:36.260 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2419bbc0 con 0x7f9c24107f30 2024-09-19T06:38:36.260 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c1bfff640 1 -- 172.21.15.159:0/2020321204 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c1403a6b0 con 0x7f9c24107f30 2024-09-19T06:38:36.260 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.434+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2419e8b0 con 0x7f9c24107f30 2024-09-19T06:38:36.260 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.435+0000 7f9c1bfff640 1 -- 172.21.15.159:0/2020321204 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f9c1403a8a0 con 0x7f9c24107f30 2024-09-19T06:38:36.261 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.435+0000 7f9c1bfff640 1 --2- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c100390f0 0x7f9c1003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:36.261 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.435+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c24108390 con 0x7f9c24107f30 2024-09-19T06:38:36.261 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.435+0000 7f9c1bfff640 1 -- 172.21.15.159:0/2020321204 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9c1406c7c0 con 0x7f9c24107f30 2024-09-19T06:38:36.261 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.435+0000 7f9c227fc640 1 --2- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c100390f0 0x7f9c1003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:36.261 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.436+0000 7f9c227fc640 1 --2- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c100390f0 0x7f9c1003b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0098c0 tx=0x7f9c0c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:36.261 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.440+0000 7f9c1bfff640 1 -- 172.21.15.159:0/2020321204 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c140448d0 con 0x7f9c24107f30 2024-09-19T06:38:36.261 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.561+0000 7f9c1bfff640 1 -- 172.21.15.159:0/2020321204 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f9c14044400 con 0x7f9c24107f30 2024-09-19T06:38:36.262 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.617+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f9c24102d70 con 0x7f9c100390f0 2024-09-19T06:38:36.262 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.699+0000 7f9c1bfff640 1 -- 172.21.15.159:0/2020321204 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f9c24102d70 con 0x7f9c100390f0 2024-09-19T06:38:36.262 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c100390f0 msgr2=0x7f9c1003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:36.262 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 --2- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c100390f0 0x7f9c1003b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0098c0 tx=0x7f9c0c006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.262 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 msgr2=0x7f9c2419b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:36.262 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 --2- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2419b3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097f0 tx=0x7f9c140327b0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.263 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 shutdown_connections 2024-09-19T06:38:36.263 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 --2- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c100390f0 0x7f9c1003b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.263 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 --2- 172.21.15.159:0/2020321204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c24107f30 0x7f9c2419b3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.263 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 >> 172.21.15.159:0/2020321204 conn(0x7f9c24101b10 msgr2=0x7f9c24102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:36.263 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 shutdown_connections 2024-09-19T06:38:36.263 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:35.701+0000 7f9c23fff640 1 -- 172.21.15.159:0/2020321204 wait complete. 2024-09-19T06:38:36.263 INFO:teuthology.orchestra.run.smithi159.stdout:Creating initial admin user... 2024-09-19T06:38:36.510 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:36 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:34] ENGINE Bus STARTING 2024-09-19T06:38:36.510 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:36 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:34] ENGINE Serving on https://172.21.15.159:7150 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:36 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:34] ENGINE Error in HTTPServer.serve 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: Traceback (most recent call last): 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: self._run(expiration_interval) 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:38:36.511 INFO:journalctl@ceph.mon.a.smithi159.stdout: s = self.context.wrap_socket( 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout: return self.sslsocket_class._create( 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout: self.do_handshake() 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout: self._sslobj.do_handshake() 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:36 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:34] ENGINE Serving on http://172.21.15.159:8765 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:36 smithi159 ceph-mon[30935]: [19/Sep/2024:06:38:34] ENGINE Bus STARTED 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:36 smithi159 ceph-mon[30935]: mgrmap e12: x(active, since 2s) 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:36 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:36 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:36.512 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:36 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:37.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:37 smithi159 ceph-mon[30935]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:37.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:38.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$gPFuSJjWtTjIgmN1NnV43Ow.q3IM3xvdWChbmqFcZcgkC7QgUjN4K", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726727917, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T06:38:38.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.591+0000 7f7d2cd2e640 1 Processor -- start 2024-09-19T06:38:38.086 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.591+0000 7f7d2cd2e640 1 -- start start 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.592+0000 7f7d2cd2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d28106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.592+0000 7f7d2cd2e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7d28106ee0 con 0x7f7d28106510 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.592+0000 7f7d2659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d28106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.592+0000 7f7d2659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d28106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36474/0 (socket says 172.21.15.159:36474) 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.592+0000 7f7d2659c640 1 -- 172.21.15.159:0/3264009654 learned_addr learned my addr 172.21.15.159:0/3264009654 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.592+0000 7f7d2659c640 1 -- 172.21.15.159:0/3264009654 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d281076c0 con 0x7f7d28106510 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.593+0000 7f7d2659c640 1 --2- 172.21.15.159:0/3264009654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d28106910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009820 tx=0x7f7d1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e395b687680236 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.593+0000 7f7d25d9b640 1 -- 172.21.15.159:0/3264009654 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d18037070 con 0x7f7d28106510 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.593+0000 7f7d25d9b640 1 -- 172.21.15.159:0/3264009654 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d18032920 con 0x7f7d28106510 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.593+0000 7f7d25d9b640 1 -- 172.21.15.159:0/3264009654 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d18030810 con 0x7f7d28106510 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.593+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/3264009654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 msgr2=0x7f7d28106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.593+0000 7f7d2cd2e640 1 --2- 172.21.15.159:0/3264009654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d28106910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009820 tx=0x7f7d1802a270 comp rx=0 tx=0).stop 2024-09-19T06:38:38.087 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.593+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/3264009654 shutdown_connections 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.593+0000 7f7d2cd2e640 1 --2- 172.21.15.159:0/3264009654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d28106910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.593+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/3264009654 >> 172.21.15.159:0/3264009654 conn(0x7f7d28101ca0 msgr2=0x7f7d281040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.594+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/3264009654 shutdown_connections 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.594+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/3264009654 wait complete. 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.594+0000 7f7d2cd2e640 1 Processor -- start 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.594+0000 7f7d2cd2e640 1 -- start start 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.594+0000 7f7d2cd2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d2819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.594+0000 7f7d2cd2e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2810aa70 con 0x7f7d28106510 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d2659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d2819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d2659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d2819b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36484/0 (socket says 172.21.15.159:36484) 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d2659c640 1 -- 172.21.15.159:0/1984895715 learned_addr learned my addr 172.21.15.159:0/1984895715 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d2659c640 1 -- 172.21.15.159:0/1984895715 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2819bbc0 con 0x7f7d28106510 2024-09-19T06:38:38.088 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d2659c640 1 --2- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d2819b680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d180097f0 tx=0x7f7d180327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d1f7fe640 1 -- 172.21.15.159:0/1984895715 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d18037040 con 0x7f7d28106510 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2819be50 con 0x7f7d28106510 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d1f7fe640 1 -- 172.21.15.159:0/1984895715 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d18030c40 con 0x7f7d28106510 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d1f7fe640 1 -- 172.21.15.159:0/1984895715 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1803a5b0 con 0x7f7d28106510 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.595+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d2819eb40 con 0x7f7d28106510 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.596+0000 7f7d1f7fe640 1 -- 172.21.15.159:0/1984895715 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f7d1803a7f0 con 0x7f7d28106510 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.596+0000 7f7d1f7fe640 1 --2- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d14039200 0x7f7d1403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.596+0000 7f7d1f7fe640 1 -- 172.21.15.159:0/1984895715 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7d1806c810 con 0x7f7d28106510 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.596+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d2810abf0 con 0x7f7d28106510 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.596+0000 7f7d1ffff640 1 --2- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d14039200 0x7f7d1403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.597+0000 7f7d1ffff640 1 --2- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d14039200 0x7f7d1403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d100098c0 tx=0x7f7d10006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.601+0000 7f7d1f7fe640 1 -- 172.21.15.159:0/1984895715 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d18030df0 con 0x7f7d28106510 2024-09-19T06:38:38.089 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:36.787+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f7d28106990 con 0x7f7d14039200 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.012+0000 7f7d1f7fe640 1 -- 172.21.15.159:0/1984895715 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f7d28106990 con 0x7f7d14039200 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.014+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d14039200 msgr2=0x7f7d1403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.014+0000 7f7d2cd2e640 1 --2- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d14039200 0x7f7d1403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d100098c0 tx=0x7f7d10006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.014+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 msgr2=0x7f7d2819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.014+0000 7f7d2cd2e640 1 --2- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d2819b680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d180097f0 tx=0x7f7d180327b0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.015+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 shutdown_connections 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.015+0000 7f7d2cd2e640 1 --2- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d14039200 0x7f7d1403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.015+0000 7f7d2cd2e640 1 --2- 172.21.15.159:0/1984895715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d28106510 0x7f7d2819b680 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.015+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 >> 172.21.15.159:0/1984895715 conn(0x7f7d28101ca0 msgr2=0x7f7d28102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.015+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 shutdown_connections 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:37.015+0000 7f7d2cd2e640 1 -- 172.21.15.159:0/1984895715 wait complete. 2024-09-19T06:38:38.090 INFO:teuthology.orchestra.run.smithi159.stdout:Fetching dashboard port number... 2024-09-19T06:38:38.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:38 smithi159 ceph-mon[30935]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:39.234 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T06:38:39.234 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.475+0000 7faa162e0640 1 Processor -- start 2024-09-19T06:38:39.234 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.475+0000 7faa162e0640 1 -- start start 2024-09-19T06:38:39.234 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.475+0000 7faa162e0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa1010a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.475+0000 7faa162e0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faa1007bdf0 con 0x7faa101080c0 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.475+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa1010a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.476+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa1010a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36486/0 (socket says 172.21.15.159:36486) 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.476+0000 7faa0ffff640 1 -- 172.21.15.159:0/3926313435 learned_addr learned my addr 172.21.15.159:0/3926313435 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.476+0000 7faa0ffff640 1 -- 172.21.15.159:0/3926313435 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1010a9f0 con 0x7faa101080c0 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.476+0000 7faa0ffff640 1 --2- 172.21.15.159:0/3926313435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa1010a4b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa00009820 tx=0x7faa0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836cf32f3df1aaf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.477+0000 7faa0f7fe640 1 -- 172.21.15.159:0/3926313435 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa00037070 con 0x7faa101080c0 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.477+0000 7faa0f7fe640 1 -- 172.21.15.159:0/3926313435 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa00032920 con 0x7faa101080c0 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.477+0000 7faa0f7fe640 1 -- 172.21.15.159:0/3926313435 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa00030810 con 0x7faa101080c0 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.477+0000 7faa162e0640 1 -- 172.21.15.159:0/3926313435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 msgr2=0x7faa1010a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.477+0000 7faa162e0640 1 --2- 172.21.15.159:0/3926313435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa1010a4b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa00009820 tx=0x7faa0002a270 comp rx=0 tx=0).stop 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.477+0000 7faa162e0640 1 -- 172.21.15.159:0/3926313435 shutdown_connections 2024-09-19T06:38:39.235 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.477+0000 7faa162e0640 1 --2- 172.21.15.159:0/3926313435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa1010a4b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.477+0000 7faa162e0640 1 -- 172.21.15.159:0/3926313435 >> 172.21.15.159:0/3926313435 conn(0x7faa10101ca0 msgr2=0x7faa101040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.478+0000 7faa162e0640 1 -- 172.21.15.159:0/3926313435 shutdown_connections 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.478+0000 7faa162e0640 1 -- 172.21.15.159:0/3926313435 wait complete. 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.478+0000 7faa162e0640 1 Processor -- start 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.478+0000 7faa162e0640 1 -- start start 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.478+0000 7faa162e0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa10107940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.478+0000 7faa162e0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faa1010ba10 con 0x7faa101080c0 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.478+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa10107940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.478+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa10107940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36500/0 (socket says 172.21.15.159:36500) 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.478+0000 7faa0ffff640 1 -- 172.21.15.159:0/149124202 learned_addr learned my addr 172.21.15.159:0/149124202 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.479+0000 7faa0ffff640 1 -- 172.21.15.159:0/149124202 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa10107e80 con 0x7faa101080c0 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.479+0000 7faa0ffff640 1 --2- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa10107940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa00030420 tx=0x7faa00032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:39.236 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.479+0000 7faa0dffb640 1 -- 172.21.15.159:0/149124202 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa00037040 con 0x7faa101080c0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.479+0000 7faa0dffb640 1 -- 172.21.15.159:0/149124202 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa00040070 con 0x7faa101080c0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.479+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa10106070 con 0x7faa101080c0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.479+0000 7faa0dffb640 1 -- 172.21.15.159:0/149124202 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa0003a6e0 con 0x7faa101080c0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.479+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa101065b0 con 0x7faa101080c0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.480+0000 7faa0dffb640 1 -- 172.21.15.159:0/149124202 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7faa0003a9e0 con 0x7faa101080c0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.480+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa10108520 con 0x7faa101080c0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.480+0000 7faa0dffb640 1 --2- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa9fc039200 0x7fa9fc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.480+0000 7faa0dffb640 1 -- 172.21.15.159:0/149124202 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7faa0006cac0 con 0x7faa101080c0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.480+0000 7faa07fff640 1 --2- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa9fc039200 0x7fa9fc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.481+0000 7faa07fff640 1 --2- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa9fc039200 0x7fa9fc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80098c0 tx=0x7fa9f8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:39.237 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.485+0000 7faa0dffb640 1 -- 172.21.15.159:0/149124202 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa00042e10 con 0x7faa101080c0 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.659+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7faa10106d50 con 0x7faa101080c0 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.659+0000 7faa0dffb640 1 -- 172.21.15.159:0/149124202 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7faa0006ce20 con 0x7faa101080c0 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.661+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa9fc039200 msgr2=0x7fa9fc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.661+0000 7faa162e0640 1 --2- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa9fc039200 0x7fa9fc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80098c0 tx=0x7fa9f8006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.661+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 msgr2=0x7faa10107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.661+0000 7faa162e0640 1 --2- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa10107940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa00030420 tx=0x7faa00032670 comp rx=0 tx=0).stop 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.661+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 shutdown_connections 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.661+0000 7faa162e0640 1 --2- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa9fc039200 0x7fa9fc03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.661+0000 7faa162e0640 1 --2- 172.21.15.159:0/149124202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa101080c0 0x7faa10107940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.661+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 >> 172.21.15.159:0/149124202 conn(0x7faa10101ca0 msgr2=0x7faa10102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.662+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 shutdown_connections 2024-09-19T06:38:39.238 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:38.662+0000 7faa162e0640 1 -- 172.21.15.159:0/149124202 wait complete. 2024-09-19T06:38:39.242 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:38:39.242 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout disabled 2024-09-19T06:38:39.252 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:38:39.252 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-09-19T06:38:39.253 INFO:teuthology.orchestra.run.smithi159.stdout:firewalld.service is not enabled 2024-09-19T06:38:39.253 INFO:teuthology.orchestra.run.smithi159.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T06:38:39.253 INFO:teuthology.orchestra.run.smithi159.stdout:Ceph Dashboard is now available at: 2024-09-19T06:38:39.253 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:39.253 INFO:teuthology.orchestra.run.smithi159.stdout: URL: https://smithi159.front.sepia.ceph.com:8443/ 2024-09-19T06:38:39.253 INFO:teuthology.orchestra.run.smithi159.stdout: User: admin 2024-09-19T06:38:39.253 INFO:teuthology.orchestra.run.smithi159.stdout: Password: hzqlbvxcm9 2024-09-19T06:38:39.253 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:39.253 INFO:teuthology.orchestra.run.smithi159.stdout:Saving cluster configuration to /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config directory 2024-09-19T06:38:39.546 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:39 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/149124202' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T06:38:40.459 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.625+0000 7f0b9e0e7640 1 Processor -- start 2024-09-19T06:38:40.459 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.625+0000 7f0b9e0e7640 1 -- start start 2024-09-19T06:38:40.459 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.625+0000 7f0b9e0e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9807c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:40.459 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.625+0000 7f0b9e0e7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9807c8a0 con 0x7f0b9807de70 2024-09-19T06:38:40.459 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.625+0000 7f0b977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9807c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:40.459 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.625+0000 7f0b977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9807c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34594/0 (socket says 172.21.15.159:34594) 2024-09-19T06:38:40.459 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.625+0000 7f0b977fe640 1 -- 172.21.15.159:0/563852474 learned_addr learned my addr 172.21.15.159:0/563852474 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:40.459 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.625+0000 7f0b977fe640 1 -- 172.21.15.159:0/563852474 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9807ca20 con 0x7f0b9807de70 2024-09-19T06:38:40.459 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.626+0000 7f0b977fe640 1 --2- 172.21.15.159:0/563852474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9807c2d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009e80 tx=0x7f0b8802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb82ba61f9853d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.626+0000 7f0b967fc640 1 -- 172.21.15.159:0/563852474 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b88036070 con 0x7f0b9807de70 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.626+0000 7f0b967fc640 1 -- 172.21.15.159:0/563852474 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b880318e0 con 0x7f0b9807de70 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.626+0000 7f0b967fc640 1 -- 172.21.15.159:0/563852474 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b88007a00 con 0x7f0b9807de70 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.627+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/563852474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 msgr2=0x7f0b9807c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.627+0000 7f0b9e0e7640 1 --2- 172.21.15.159:0/563852474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9807c2d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009e80 tx=0x7f0b8802a7a0 comp rx=0 tx=0).stop 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.627+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/563852474 shutdown_connections 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.627+0000 7f0b9e0e7640 1 --2- 172.21.15.159:0/563852474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9807c2d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.627+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/563852474 >> 172.21.15.159:0/563852474 conn(0x7f0b98102db0 msgr2=0x7f0b981051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.627+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/563852474 shutdown_connections 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.627+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/563852474 wait complete. 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.628+0000 7f0b9e0e7640 1 Processor -- start 2024-09-19T06:38:40.460 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.628+0000 7f0b9e0e7640 1 -- start start 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.628+0000 7f0b9e0e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9819d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.628+0000 7f0b9e0e7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9810dcf0 con 0x7f0b9807de70 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.628+0000 7f0b977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9819d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.628+0000 7f0b977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9819d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34596/0 (socket says 172.21.15.159:34596) 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.628+0000 7f0b977fe640 1 -- 172.21.15.159:0/3144705071 learned_addr learned my addr 172.21.15.159:0/3144705071 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.628+0000 7f0b977fe640 1 -- 172.21.15.159:0/3144705071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9819ddc0 con 0x7f0b9807de70 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.628+0000 7f0b977fe640 1 --2- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9819d880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b88031cf0 tx=0x7f0b88031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.629+0000 7f0b94ff9640 1 -- 172.21.15.159:0/3144705071 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b88036050 con 0x7f0b9807de70 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.629+0000 7f0b94ff9640 1 -- 172.21.15.159:0/3144705071 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b88042070 con 0x7f0b9807de70 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.629+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9819e050 con 0x7f0b9807de70 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.629+0000 7f0b94ff9640 1 -- 172.21.15.159:0/3144705071 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b8803d9e0 con 0x7f0b9807de70 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.629+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b981a0d40 con 0x7f0b9807de70 2024-09-19T06:38:40.461 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.630+0000 7f0b94ff9640 1 -- 172.21.15.159:0/3144705071 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f0b8803dce0 con 0x7f0b9807de70 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.630+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9807c350 con 0x7f0b9807de70 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.630+0000 7f0b94ff9640 1 --2- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0b840392a0 0x7f0b8403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.630+0000 7f0b94ff9640 1 -- 172.21.15.159:0/3144705071 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0b8806d9c0 con 0x7f0b9807de70 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.630+0000 7f0b96ffd640 1 --2- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0b840392a0 0x7f0b8403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.630+0000 7f0b96ffd640 1 --2- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0b840392a0 0x7f0b8403b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b800098c0 tx=0x7f0b80006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.634+0000 7f0b94ff9640 1 -- 172.21.15.159:0/3144705071 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b8806fe20 con 0x7f0b9807de70 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.881+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f0b981a0f10 con 0x7f0b9807de70 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.885+0000 7f0b94ff9640 1 -- 172.21.15.159:0/3144705071 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f0b88044310 con 0x7f0b9807de70 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0b840392a0 msgr2=0x7f0b8403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 --2- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0b840392a0 0x7f0b8403b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b800098c0 tx=0x7f0b80006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 msgr2=0x7f0b9819d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:40.462 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 --2- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9819d880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b88031cf0 tx=0x7f0b88031d20 comp rx=0 tx=0).stop 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 shutdown_connections 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 --2- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0b840392a0 0x7f0b8403b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 --2- 172.21.15.159:0/3144705071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b9807de70 0x7f0b9819d880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 >> 172.21.15.159:0/3144705071 conn(0x7f0b98102db0 msgr2=0x7f0b981039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 shutdown_connections 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-09-19T06:38:39.887+0000 7f0b9e0e7640 1 -- 172.21.15.159:0/3144705071 wait complete. 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:40.463 INFO:teuthology.orchestra.run.smithi159.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T06:38:40.464 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:40.464 INFO:teuthology.orchestra.run.smithi159.stdout: ceph telemetry on 2024-09-19T06:38:40.464 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:40.464 INFO:teuthology.orchestra.run.smithi159.stdout:For more information see: 2024-09-19T06:38:40.464 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:40.464 INFO:teuthology.orchestra.run.smithi159.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T06:38:40.464 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:40.464 INFO:teuthology.orchestra.run.smithi159.stdout:Bootstrap complete. 2024-09-19T06:38:40.505 INFO:tasks.cephadm:Fetching config... 2024-09-19T06:38:40.505 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:38:40.505 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T06:38:40.522 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T06:38:40.523 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:38:40.523 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T06:38:40.579 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T06:38:40.580 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:38:40.580 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T06:38:40.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:40 smithi159 ceph-mon[30935]: mgrmap e13: x(active, since 6s) 2024-09-19T06:38:40.621 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:40 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3144705071' entity='client.admin' 2024-09-19T06:38:40.647 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T06:38:40.647 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:38:40.647 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T06:38:40.704 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T06:38:40.704 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDl3plLDTqPzzYzMxINha6vjRvRazb0oftp4e78Ff2bbkOv1GysppYdiHyKfJjHDshftnDia8aLn3HyoxXtIVrTwpope/ZNFdECIji3ezxXKjrhb7+Yun9d45F8Nd203KHk0+S0TQHEfO56nX3t/mGOCuJn2zk7LovAGg606J3XQFfm++ZGaj+b3QR2AFwLUSD8y0PP9xx7m4ZK8Rjb3AYDWDBhBI3BUIfxL8C2f0G8NW343Mo71LZRRc2+RiQ/LBVoeumgWCeeXZe09VQYpHJP63nMgG9vvrBWYLd3qP5Y5otuZiLp/hPMaizDh2prWXIN6j7uRxmGpDZoEIauLTztDAZtuWmcKsXpzdy5PFegXA3QORlQpNUkrUSz/SYRK8o3zGGoVEPs3IcZILpNPZTmpIvSeZFJHUXGdIq1U+vWWXBTuKclecxuzEOGAl0nCwvF5y9DKYbNeqt+YIiyo+Kio9h7d+rfSUJr3taS6V1kcBSO5qsZavMuMSVUjn+XAbk= ceph-82c73dba-7651-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:38:40.781 INFO:teuthology.orchestra.run.smithi159.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDl3plLDTqPzzYzMxINha6vjRvRazb0oftp4e78Ff2bbkOv1GysppYdiHyKfJjHDshftnDia8aLn3HyoxXtIVrTwpope/ZNFdECIji3ezxXKjrhb7+Yun9d45F8Nd203KHk0+S0TQHEfO56nX3t/mGOCuJn2zk7LovAGg606J3XQFfm++ZGaj+b3QR2AFwLUSD8y0PP9xx7m4ZK8Rjb3AYDWDBhBI3BUIfxL8C2f0G8NW343Mo71LZRRc2+RiQ/LBVoeumgWCeeXZe09VQYpHJP63nMgG9vvrBWYLd3qP5Y5otuZiLp/hPMaizDh2prWXIN6j7uRxmGpDZoEIauLTztDAZtuWmcKsXpzdy5PFegXA3QORlQpNUkrUSz/SYRK8o3zGGoVEPs3IcZILpNPZTmpIvSeZFJHUXGdIq1U+vWWXBTuKclecxuzEOGAl0nCwvF5y9DKYbNeqt+YIiyo+Kio9h7d+rfSUJr3taS6V1kcBSO5qsZavMuMSVUjn+XAbk= ceph-82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:38:40.793 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDl3plLDTqPzzYzMxINha6vjRvRazb0oftp4e78Ff2bbkOv1GysppYdiHyKfJjHDshftnDia8aLn3HyoxXtIVrTwpope/ZNFdECIji3ezxXKjrhb7+Yun9d45F8Nd203KHk0+S0TQHEfO56nX3t/mGOCuJn2zk7LovAGg606J3XQFfm++ZGaj+b3QR2AFwLUSD8y0PP9xx7m4ZK8Rjb3AYDWDBhBI3BUIfxL8C2f0G8NW343Mo71LZRRc2+RiQ/LBVoeumgWCeeXZe09VQYpHJP63nMgG9vvrBWYLd3qP5Y5otuZiLp/hPMaizDh2prWXIN6j7uRxmGpDZoEIauLTztDAZtuWmcKsXpzdy5PFegXA3QORlQpNUkrUSz/SYRK8o3zGGoVEPs3IcZILpNPZTmpIvSeZFJHUXGdIq1U+vWWXBTuKclecxuzEOGAl0nCwvF5y9DKYbNeqt+YIiyo+Kio9h7d+rfSUJr3taS6V1kcBSO5qsZavMuMSVUjn+XAbk= ceph-82c73dba-7651-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:38:40.836 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDl3plLDTqPzzYzMxINha6vjRvRazb0oftp4e78Ff2bbkOv1GysppYdiHyKfJjHDshftnDia8aLn3HyoxXtIVrTwpope/ZNFdECIji3ezxXKjrhb7+Yun9d45F8Nd203KHk0+S0TQHEfO56nX3t/mGOCuJn2zk7LovAGg606J3XQFfm++ZGaj+b3QR2AFwLUSD8y0PP9xx7m4ZK8Rjb3AYDWDBhBI3BUIfxL8C2f0G8NW343Mo71LZRRc2+RiQ/LBVoeumgWCeeXZe09VQYpHJP63nMgG9vvrBWYLd3qP5Y5otuZiLp/hPMaizDh2prWXIN6j7uRxmGpDZoEIauLTztDAZtuWmcKsXpzdy5PFegXA3QORlQpNUkrUSz/SYRK8o3zGGoVEPs3IcZILpNPZTmpIvSeZFJHUXGdIq1U+vWWXBTuKclecxuzEOGAl0nCwvF5y9DKYbNeqt+YIiyo+Kio9h7d+rfSUJr3taS6V1kcBSO5qsZavMuMSVUjn+XAbk= ceph-82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:38:40.849 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDl3plLDTqPzzYzMxINha6vjRvRazb0oftp4e78Ff2bbkOv1GysppYdiHyKfJjHDshftnDia8aLn3HyoxXtIVrTwpope/ZNFdECIji3ezxXKjrhb7+Yun9d45F8Nd203KHk0+S0TQHEfO56nX3t/mGOCuJn2zk7LovAGg606J3XQFfm++ZGaj+b3QR2AFwLUSD8y0PP9xx7m4ZK8Rjb3AYDWDBhBI3BUIfxL8C2f0G8NW343Mo71LZRRc2+RiQ/LBVoeumgWCeeXZe09VQYpHJP63nMgG9vvrBWYLd3qP5Y5otuZiLp/hPMaizDh2prWXIN6j7uRxmGpDZoEIauLTztDAZtuWmcKsXpzdy5PFegXA3QORlQpNUkrUSz/SYRK8o3zGGoVEPs3IcZILpNPZTmpIvSeZFJHUXGdIq1U+vWWXBTuKclecxuzEOGAl0nCwvF5y9DKYbNeqt+YIiyo+Kio9h7d+rfSUJr3taS6V1kcBSO5qsZavMuMSVUjn+XAbk= ceph-82c73dba-7651-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:38:40.893 INFO:teuthology.orchestra.run.smithi203.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDl3plLDTqPzzYzMxINha6vjRvRazb0oftp4e78Ff2bbkOv1GysppYdiHyKfJjHDshftnDia8aLn3HyoxXtIVrTwpope/ZNFdECIji3ezxXKjrhb7+Yun9d45F8Nd203KHk0+S0TQHEfO56nX3t/mGOCuJn2zk7LovAGg606J3XQFfm++ZGaj+b3QR2AFwLUSD8y0PP9xx7m4ZK8Rjb3AYDWDBhBI3BUIfxL8C2f0G8NW343Mo71LZRRc2+RiQ/LBVoeumgWCeeXZe09VQYpHJP63nMgG9vvrBWYLd3qP5Y5otuZiLp/hPMaizDh2prWXIN6j7uRxmGpDZoEIauLTztDAZtuWmcKsXpzdy5PFegXA3QORlQpNUkrUSz/SYRK8o3zGGoVEPs3IcZILpNPZTmpIvSeZFJHUXGdIq1U+vWWXBTuKclecxuzEOGAl0nCwvF5y9DKYbNeqt+YIiyo+Kio9h7d+rfSUJr3taS6V1kcBSO5qsZavMuMSVUjn+XAbk= ceph-82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:38:40.903 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T06:38:41.158 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:41.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.644+0000 7f47fc08e640 1 -- 172.21.15.159:0/385626954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 msgr2=0x7f47f4101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:41.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.644+0000 7f47fc08e640 1 --2- 172.21.15.159:0/385626954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 0x7f47f4101a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009880 tx=0x7f47ec02a5d0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.644+0000 7f47fc08e640 1 -- 172.21.15.159:0/385626954 shutdown_connections 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.644+0000 7f47fc08e640 1 --2- 172.21.15.159:0/385626954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 0x7f47f4101a40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.644+0000 7f47fc08e640 1 -- 172.21.15.159:0/385626954 >> 172.21.15.159:0/385626954 conn(0x7f47f40fcdf0 msgr2=0x7f47f40ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.644+0000 7f47fc08e640 1 -- 172.21.15.159:0/385626954 shutdown_connections 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.644+0000 7f47fc08e640 1 -- 172.21.15.159:0/385626954 wait complete. 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.645+0000 7f47fc08e640 1 Processor -- start 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.645+0000 7f47fc08e640 1 -- start start 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.645+0000 7f47fc08e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 0x7f47f4196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.645+0000 7f47fc08e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4107750 con 0x7f47f4101640 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.645+0000 7f47f9e2a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 0x7f47f4196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.645+0000 7f47f9e2a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 0x7f47f4196e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34620/0 (socket says 172.21.15.159:34620) 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.645+0000 7f47f9e2a640 1 -- 172.21.15.159:0/624117439 learned_addr learned my addr 172.21.15.159:0/624117439 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.645+0000 7f47f9e2a640 1 -- 172.21.15.159:0/624117439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f4197390 con 0x7f47f4101640 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.645+0000 7f47f9e2a640 1 --2- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 0x7f47f4196e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009230 tx=0x7f47ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.646+0000 7f47f2ffd640 1 -- 172.21.15.159:0/624117439 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec03f070 con 0x7f47f4101640 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.646+0000 7f47f2ffd640 1 -- 172.21.15.159:0/624117439 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47ec003ad0 con 0x7f47f4101640 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.646+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f4197620 con 0x7f47f4101640 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.646+0000 7f47f2ffd640 1 -- 172.21.15.159:0/624117439 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec035030 con 0x7f47f4101640 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.646+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f419a310 con 0x7f47f4101640 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.646+0000 7f47f2ffd640 1 -- 172.21.15.159:0/624117439 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f47ec042070 con 0x7f47f4101640 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.647+0000 7f47f2ffd640 1 --2- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f47dc0392a0 0x7f47dc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.647+0000 7f47f2ffd640 1 -- 172.21.15.159:0/624117439 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f47ec06d0d0 con 0x7f47f4101640 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.647+0000 7f47f9629640 1 --2- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f47dc0392a0 0x7f47dc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.647+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f4107ed0 con 0x7f47f4101640 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.647+0000 7f47f9629640 1 --2- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f47dc0392a0 0x7f47dc03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f47e800ad30 tx=0x7f47e80093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:41.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.652+0000 7f47f2ffd640 1 -- 172.21.15.159:0/624117439 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f47ec0433b0 con 0x7f47f4101640 2024-09-19T06:38:41.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.844+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f47f418ff80 con 0x7f47f4101640 2024-09-19T06:38:41.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.847+0000 7f47f2ffd640 1 -- 172.21.15.159:0/624117439 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f47ec02f300 con 0x7f47f4101640 2024-09-19T06:38:41.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f47dc0392a0 msgr2=0x7f47dc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:41.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 --2- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f47dc0392a0 0x7f47dc03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f47e800ad30 tx=0x7f47e80093f0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 msgr2=0x7f47f4196e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:41.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 --2- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 0x7f47f4196e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009230 tx=0x7f47ec0048f0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 shutdown_connections 2024-09-19T06:38:41.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 --2- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f47dc0392a0 0x7f47dc03b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 --2- 172.21.15.159:0/624117439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47f4101640 0x7f47f4196e50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 >> 172.21.15.159:0/624117439 conn(0x7f47f40fcdf0 msgr2=0x7f47f40fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:41.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 shutdown_connections 2024-09-19T06:38:41.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:41.849+0000 7f47fc08e640 1 -- 172.21.15.159:0/624117439 wait complete. 2024-09-19T06:38:42.442 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T06:38:42.442 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T06:38:43.100 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:42 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/624117439' entity='client.admin' 2024-09-19T06:38:43.398 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.832+0000 7f6eaac50640 1 -- 172.21.15.159:0/3920103019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 msgr2=0x7f6ea4100300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.832+0000 7f6eaac50640 1 --2- 172.21.15.159:0/3920103019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 0x7f6ea4100300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009880 tx=0x7f6e9802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.832+0000 7f6eaac50640 1 -- 172.21.15.159:0/3920103019 shutdown_connections 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.832+0000 7f6eaac50640 1 --2- 172.21.15.159:0/3920103019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 0x7f6ea4100300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.832+0000 7f6eaac50640 1 -- 172.21.15.159:0/3920103019 >> 172.21.15.159:0/3920103019 conn(0x7f6ea40fbcb0 msgr2=0x7f6ea40fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.832+0000 7f6eaac50640 1 -- 172.21.15.159:0/3920103019 shutdown_connections 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.832+0000 7f6eaac50640 1 -- 172.21.15.159:0/3920103019 wait complete. 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.833+0000 7f6eaac50640 1 Processor -- start 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.833+0000 7f6eaac50640 1 -- start start 2024-09-19T06:38:43.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.833+0000 7f6eaac50640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 0x7f6ea4198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:43.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.833+0000 7f6eaac50640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea4109930 con 0x7f6ea40fff00 2024-09-19T06:38:43.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.833+0000 7f6ea89ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 0x7f6ea4198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:43.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.833+0000 7f6ea89ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 0x7f6ea4198f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34632/0 (socket says 172.21.15.159:34632) 2024-09-19T06:38:43.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.833+0000 7f6ea89ec640 1 -- 172.21.15.159:0/3049384276 learned_addr learned my addr 172.21.15.159:0/3049384276 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:43.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.834+0000 7f6ea89ec640 1 -- 172.21.15.159:0/3049384276 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea41994a0 con 0x7f6ea40fff00 2024-09-19T06:38:43.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.834+0000 7f6ea89ec640 1 --2- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 0x7f6ea4198f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e98004f60 tx=0x7f6e980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:43.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.834+0000 7f6ea1ffb640 1 -- 172.21.15.159:0/3049384276 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9803f070 con 0x7f6ea40fff00 2024-09-19T06:38:43.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.834+0000 7f6ea1ffb640 1 -- 172.21.15.159:0/3049384276 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e98003ad0 con 0x7f6ea40fff00 2024-09-19T06:38:43.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.834+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea4199730 con 0x7f6ea40fff00 2024-09-19T06:38:43.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.834+0000 7f6ea1ffb640 1 -- 172.21.15.159:0/3049384276 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98035030 con 0x7f6ea40fff00 2024-09-19T06:38:43.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.834+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea419c420 con 0x7f6ea40fff00 2024-09-19T06:38:43.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.835+0000 7f6ea1ffb640 1 -- 172.21.15.159:0/3049384276 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f6e98042070 con 0x7f6ea40fff00 2024-09-19T06:38:43.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.835+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea410a0b0 con 0x7f6ea40fff00 2024-09-19T06:38:43.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.835+0000 7f6ea1ffb640 1 --2- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6e94039300 0x7f6e9403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:43.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.836+0000 7f6ea1ffb640 1 -- 172.21.15.159:0/3049384276 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6e9806d040 con 0x7f6ea40fff00 2024-09-19T06:38:43.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.836+0000 7f6ea3fff640 1 --2- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6e94039300 0x7f6e9403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:43.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.836+0000 7f6ea3fff640 1 --2- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6e94039300 0x7f6e9403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6e900098c0 tx=0x7f6e90006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:43.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:43.840+0000 7f6ea1ffb640 1 -- 172.21.15.159:0/3049384276 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e9804a260 con 0x7f6ea40fff00 2024-09-19T06:38:44.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.024+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f6ea402d830 con 0x7f6e94039300 2024-09-19T06:38:44.026 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:44.026 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:44.026 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:38:44.026 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:44.026 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:44.027 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:44.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.028+0000 7f6ea1ffb640 1 -- 172.21.15.159:0/3049384276 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6ea402d830 con 0x7f6e94039300 2024-09-19T06:38:44.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6e94039300 msgr2=0x7f6e9403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:44.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 --2- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6e94039300 0x7f6e9403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6e900098c0 tx=0x7f6e90006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:44.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 msgr2=0x7f6ea4198f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:44.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 --2- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 0x7f6ea4198f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e98004f60 tx=0x7f6e980048f0 comp rx=0 tx=0).stop 2024-09-19T06:38:44.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 shutdown_connections 2024-09-19T06:38:44.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 --2- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6e94039300 0x7f6e9403b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:44.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 --2- 172.21.15.159:0/3049384276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea40fff00 0x7f6ea4198f60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:44.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 >> 172.21.15.159:0/3049384276 conn(0x7f6ea40fbcb0 msgr2=0x7f6ea40fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:44.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 shutdown_connections 2024-09-19T06:38:44.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:44.031+0000 7f6eaac50640 1 -- 172.21.15.159:0/3049384276 wait complete. 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:45.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:45.321 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi189 2024-09-19T06:38:45.321 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:38:45.322 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:38:45.341 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:38:45.341 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:38:45.398 INFO:tasks.cephadm:Adding host smithi189 to orchestrator... 2024-09-19T06:38:45.399 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch host add smithi189 2024-09-19T06:38:45.641 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:46.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.042+0000 7f26eae56640 1 -- 172.21.15.159:0/529394038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 msgr2=0x7f26e4102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:46.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.042+0000 7f26eae56640 1 --2- 172.21.15.159:0/529394038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 0x7f26e4102b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009880 tx=0x7f26d802a670 comp rx=0 tx=0).stop 2024-09-19T06:38:46.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.042+0000 7f26eae56640 1 -- 172.21.15.159:0/529394038 shutdown_connections 2024-09-19T06:38:46.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.042+0000 7f26eae56640 1 --2- 172.21.15.159:0/529394038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 0x7f26e4102b60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.042+0000 7f26eae56640 1 -- 172.21.15.159:0/529394038 >> 172.21.15.159:0/529394038 conn(0x7f26e40fc1a0 msgr2=0x7f26e40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:46.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.042+0000 7f26eae56640 1 -- 172.21.15.159:0/529394038 shutdown_connections 2024-09-19T06:38:46.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.042+0000 7f26eae56640 1 -- 172.21.15.159:0/529394038 wait complete. 2024-09-19T06:38:46.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.043+0000 7f26eae56640 1 Processor -- start 2024-09-19T06:38:46.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.043+0000 7f26eae56640 1 -- start start 2024-09-19T06:38:46.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.043+0000 7f26eae56640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 0x7f26e4197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:46.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.043+0000 7f26eae56640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f26e410bcf0 con 0x7f26e4102780 2024-09-19T06:38:46.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.043+0000 7f26e8bf2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 0x7f26e4197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:46.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.043+0000 7f26e8bf2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 0x7f26e4197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34660/0 (socket says 172.21.15.159:34660) 2024-09-19T06:38:46.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.043+0000 7f26e8bf2640 1 -- 172.21.15.159:0/3926138009 learned_addr learned my addr 172.21.15.159:0/3926138009 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:46.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.043+0000 7f26e8bf2640 1 -- 172.21.15.159:0/3926138009 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e4197770 con 0x7f26e4102780 2024-09-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.044+0000 7f26e8bf2640 1 --2- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 0x7f26e4197230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009230 tx=0x7f26d8003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.044+0000 7f26e1ffb640 1 -- 172.21.15.159:0/3926138009 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d803f070 con 0x7f26e4102780 2024-09-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.044+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e4197a00 con 0x7f26e4102780 2024-09-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.044+0000 7f26e1ffb640 1 -- 172.21.15.159:0/3926138009 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d803bd40 con 0x7f26e4102780 2024-09-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.044+0000 7f26e1ffb640 1 -- 172.21.15.159:0/3926138009 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d8035030 con 0x7f26e4102780 2024-09-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.044+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e4197e60 con 0x7f26e4102780 2024-09-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.045+0000 7f26e1ffb640 1 -- 172.21.15.159:0/3926138009 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f26d8042070 con 0x7f26e4102780 2024-09-19T06:38:46.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.045+0000 7f26e1ffb640 1 --2- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f26d40392a0 0x7f26d403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:46.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.045+0000 7f26e1ffb640 1 -- 172.21.15.159:0/3926138009 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f26d806cf30 con 0x7f26e4102780 2024-09-19T06:38:46.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.045+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e406a7c0 con 0x7f26e4102780 2024-09-19T06:38:46.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.045+0000 7f26e3fff640 1 --2- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f26d40392a0 0x7f26d403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:46.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.045+0000 7f26e3fff640 1 --2- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f26d40392a0 0x7f26d403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f26d00098c0 tx=0x7f26d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:46.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.050+0000 7f26e1ffb640 1 -- 172.21.15.159:0/3926138009 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26d8031de0 con 0x7f26e4102780 2024-09-19T06:38:46.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:46.218+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}) -- 0x7f26e4198590 con 0x7f26d40392a0 2024-09-19T06:38:46.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:46 smithi159 ceph-mon[30935]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:38:47.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:47 smithi159 ceph-mon[30935]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:48.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:48 smithi159 ceph-mon[30935]: Deploying cephadm binary to smithi189 2024-09-19T06:38:49.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.294+0000 7f26e1ffb640 1 -- 172.21.15.159:0/3926138009 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f26e4198590 con 0x7f26d40392a0 2024-09-19T06:38:49.296 INFO:teuthology.orchestra.run.smithi159.stdout:Added host 'smithi189' with addr '172.21.15.189' 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f26d40392a0 msgr2=0x7f26d403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 --2- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f26d40392a0 0x7f26d403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f26d00098c0 tx=0x7f26d0006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 msgr2=0x7f26e4197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 --2- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 0x7f26e4197230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009230 tx=0x7f26d8003d80 comp rx=0 tx=0).stop 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 shutdown_connections 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 --2- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f26d40392a0 0x7f26d403b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 --2- 172.21.15.159:0/3926138009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e4102780 0x7f26e4197230 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 >> 172.21.15.159:0/3926138009 conn(0x7f26e40fc1a0 msgr2=0x7f26e4105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 shutdown_connections 2024-09-19T06:38:49.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:49.296+0000 7f26eae56640 1 -- 172.21.15.159:0/3926138009 wait complete. 2024-09-19T06:38:49.914 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:38:50.153 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:50.586 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:50.586 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:50 smithi159 ceph-mon[30935]: Added host smithi189 2024-09-19T06:38:50.586 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:50.586 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:50.586 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.598+0000 7ff563f18640 1 -- 172.21.15.159:0/354219759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 msgr2=0x7ff55c106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:50.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.598+0000 7ff563f18640 1 --2- 172.21.15.159:0/354219759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 0x7ff55c106970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff558009880 tx=0x7ff55802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:38:50.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.598+0000 7ff563f18640 1 -- 172.21.15.159:0/354219759 shutdown_connections 2024-09-19T06:38:50.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.598+0000 7ff563f18640 1 --2- 172.21.15.159:0/354219759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 0x7ff55c106970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:50.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.598+0000 7ff563f18640 1 -- 172.21.15.159:0/354219759 >> 172.21.15.159:0/354219759 conn(0x7ff55c0fc1a0 msgr2=0x7ff55c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:50.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.598+0000 7ff563f18640 1 -- 172.21.15.159:0/354219759 shutdown_connections 2024-09-19T06:38:50.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.598+0000 7ff563f18640 1 -- 172.21.15.159:0/354219759 wait complete. 2024-09-19T06:38:50.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.599+0000 7ff563f18640 1 Processor -- start 2024-09-19T06:38:50.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.599+0000 7ff563f18640 1 -- start start 2024-09-19T06:38:50.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.599+0000 7ff563f18640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 0x7ff55c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.599+0000 7ff563f18640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c10abc0 con 0x7ff55c106590 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.599+0000 7ff561cb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 0x7ff55c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.599+0000 7ff561cb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 0x7ff55c197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44624/0 (socket says 172.21.15.159:44624) 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.599+0000 7ff561cb4640 1 -- 172.21.15.159:0/2848839189 learned_addr learned my addr 172.21.15.159:0/2848839189 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.599+0000 7ff561cb4640 1 -- 172.21.15.159:0/2848839189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c1984a0 con 0x7ff55c106590 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.600+0000 7ff561cb4640 1 --2- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 0x7ff55c197f60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff558009230 tx=0x7ff558003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.600+0000 7ff552ffd640 1 -- 172.21.15.159:0/2848839189 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff55803f070 con 0x7ff55c106590 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.600+0000 7ff552ffd640 1 -- 172.21.15.159:0/2848839189 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff55803bc80 con 0x7ff55c106590 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.600+0000 7ff552ffd640 1 -- 172.21.15.159:0/2848839189 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff558035030 con 0x7ff55c106590 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.600+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55c198730 con 0x7ff55c106590 2024-09-19T06:38:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.600+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55c198b90 con 0x7ff55c106590 2024-09-19T06:38:50.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.601+0000 7ff552ffd640 1 -- 172.21.15.159:0/2848839189 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7ff558042070 con 0x7ff55c106590 2024-09-19T06:38:50.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.601+0000 7ff552ffd640 1 --2- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff548039300 0x7ff54803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:50.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.601+0000 7ff552ffd640 1 -- 172.21.15.159:0/2848839189 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff55806cfa0 con 0x7ff55c106590 2024-09-19T06:38:50.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.601+0000 7ff5614b3640 1 --2- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff548039300 0x7ff54803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:50.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.601+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55c101c00 con 0x7ff55c106590 2024-09-19T06:38:50.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.601+0000 7ff5614b3640 1 --2- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff548039300 0x7ff54803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0098c0 tx=0x7ff54c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.606+0000 7ff552ffd640 1 -- 172.21.15.159:0/2848839189 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff5580314c0 con 0x7ff55c106590 2024-09-19T06:38:50.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.778+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff55c1069f0 con 0x7ff548039300 2024-09-19T06:38:50.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.779+0000 7ff552ffd640 1 -- 172.21.15.159:0/2848839189 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7ff55c1069f0 con 0x7ff548039300 2024-09-19T06:38:50.780 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:50.781 INFO:teuthology.orchestra.run.smithi159.stdout:[{"addr": "172.21.15.159", "hostname": "smithi159", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}] 2024-09-19T06:38:50.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff548039300 msgr2=0x7ff54803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:50.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 --2- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff548039300 0x7ff54803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0098c0 tx=0x7ff54c006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:50.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 msgr2=0x7ff55c197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:50.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 --2- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 0x7ff55c197f60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff558009230 tx=0x7ff558003d40 comp rx=0 tx=0).stop 2024-09-19T06:38:50.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 shutdown_connections 2024-09-19T06:38:50.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 --2- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff548039300 0x7ff54803b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:50.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 --2- 172.21.15.159:0/2848839189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff55c106590 0x7ff55c197f60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:50.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 >> 172.21.15.159:0/2848839189 conn(0x7ff55c0fc1a0 msgr2=0x7ff55c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:50.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 shutdown_connections 2024-09-19T06:38:50.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:50.781+0000 7ff563f18640 1 -- 172.21.15.159:0/2848839189 wait complete. 2024-09-19T06:38:51.392 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi203 2024-09-19T06:38:51.392 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:38:51.392 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:38:51.412 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:38:51.413 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:38:51.472 INFO:tasks.cephadm:Adding host smithi203 to orchestrator... 2024-09-19T06:38:51.472 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch host add smithi203 2024-09-19T06:38:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:51 smithi159 ceph-mon[30935]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:38:51.709 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:52.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.139+0000 7fb938f44640 1 -- 172.21.15.159:0/1925788799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 msgr2=0x7fb934100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.139+0000 7fb938f44640 1 --2- 172.21.15.159:0/1925788799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 0x7fb934100d70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb924009880 tx=0x7fb92402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.139+0000 7fb938f44640 1 -- 172.21.15.159:0/1925788799 shutdown_connections 2024-09-19T06:38:52.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.139+0000 7fb938f44640 1 --2- 172.21.15.159:0/1925788799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 0x7fb934100d70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.139+0000 7fb938f44640 1 -- 172.21.15.159:0/1925788799 >> 172.21.15.159:0/1925788799 conn(0x7fb934076250 msgr2=0x7fb934076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:52.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.139+0000 7fb938f44640 1 -- 172.21.15.159:0/1925788799 shutdown_connections 2024-09-19T06:38:52.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.139+0000 7fb938f44640 1 -- 172.21.15.159:0/1925788799 wait complete. 2024-09-19T06:38:52.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.140+0000 7fb938f44640 1 Processor -- start 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.140+0000 7fb938f44640 1 -- start start 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.140+0000 7fb938f44640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 0x7fb9340fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.140+0000 7fb938f44640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb93410ab90 con 0x7fb934100990 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.140+0000 7fb93259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 0x7fb9340fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.140+0000 7fb93259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 0x7fb9340fd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44632/0 (socket says 172.21.15.159:44632) 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.140+0000 7fb93259c640 1 -- 172.21.15.159:0/3037291679 learned_addr learned my addr 172.21.15.159:0/3037291679 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.140+0000 7fb93259c640 1 -- 172.21.15.159:0/3037291679 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9340ff6d0 con 0x7fb934100990 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.141+0000 7fb93259c640 1 --2- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 0x7fb9340fd7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb924009230 tx=0x7fb924003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.141+0000 7fb9237fe640 1 -- 172.21.15.159:0/3037291679 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92403f070 con 0x7fb934100990 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.141+0000 7fb9237fe640 1 -- 172.21.15.159:0/3037291679 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb92403bc80 con 0x7fb934100990 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.141+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9340fdd80 con 0x7fb934100990 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.141+0000 7fb9237fe640 1 -- 172.21.15.159:0/3037291679 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb924035030 con 0x7fb934100990 2024-09-19T06:38:52.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.141+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9340fe240 con 0x7fb934100990 2024-09-19T06:38:52.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.142+0000 7fb9237fe640 1 -- 172.21.15.159:0/3037291679 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fb924042070 con 0x7fb934100990 2024-09-19T06:38:52.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.142+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb934101c40 con 0x7fb934100990 2024-09-19T06:38:52.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.142+0000 7fb9237fe640 1 --2- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb91c039300 0x7fb91c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.142+0000 7fb9237fe640 1 -- 172.21.15.159:0/3037291679 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb92406d140 con 0x7fb934100990 2024-09-19T06:38:52.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.142+0000 7fb931d9b640 1 --2- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb91c039300 0x7fb91c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.142+0000 7fb931d9b640 1 --2- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb91c039300 0x7fb91c03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb9280098c0 tx=0x7fb928006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:52.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.147+0000 7fb9237fe640 1 -- 172.21.15.159:0/3037291679 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9240314c0 con 0x7fb934100990 2024-09-19T06:38:52.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:52.323+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}) -- 0x7fb9340fed80 con 0x7fb91c039300 2024-09-19T06:38:52.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:52 smithi159 ceph-mon[30935]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:54 smithi159 ceph-mon[30935]: Deploying cephadm binary to smithi203 2024-09-19T06:38:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:54 smithi159 ceph-mon[30935]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:38:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:38:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:55.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.483+0000 7fb9237fe640 1 -- 172.21.15.159:0/3037291679 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fb9340fed80 con 0x7fb91c039300 2024-09-19T06:38:55.485 INFO:teuthology.orchestra.run.smithi159.stdout:Added host 'smithi203' with addr '172.21.15.203' 2024-09-19T06:38:55.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb91c039300 msgr2=0x7fb91c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:55.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 --2- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb91c039300 0x7fb91c03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb9280098c0 tx=0x7fb928006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:55.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 msgr2=0x7fb9340fd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:55.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 --2- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 0x7fb9340fd7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb924009230 tx=0x7fb924003d40 comp rx=0 tx=0).stop 2024-09-19T06:38:55.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 shutdown_connections 2024-09-19T06:38:55.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 --2- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb91c039300 0x7fb91c03b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:55.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 --2- 172.21.15.159:0/3037291679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb934100990 0x7fb9340fd7e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:55.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 >> 172.21.15.159:0/3037291679 conn(0x7fb934076250 msgr2=0x7fb9340696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:55.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 shutdown_connections 2024-09-19T06:38:55.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:55.486+0000 7fb938f44640 1 -- 172.21.15.159:0/3037291679 wait complete. 2024-09-19T06:38:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:55 smithi159 ceph-mon[30935]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-19T06:38:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:55 smithi159 ceph-mon[30935]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:38:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:55 smithi159 ceph-mon[30935]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:38:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:55 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:55 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:55 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:56.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:38:56.316 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:56.734 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:56 smithi159 ceph-mon[30935]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:38:56.735 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:56 smithi159 ceph-mon[30935]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:38:56.735 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:56 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:56.735 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:56 smithi159 ceph-mon[30935]: Added host smithi203 2024-09-19T06:38:56.735 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:56 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:56.735 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:56 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:56.735 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:56 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:56.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.746+0000 7f744b86f640 1 -- 172.21.15.159:0/1634931913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 msgr2=0x7f7444100950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:56.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.746+0000 7f744b86f640 1 --2- 172.21.15.159:0/1634931913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 0x7f7444100950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7440009880 tx=0x7f744002a670 comp rx=0 tx=0).stop 2024-09-19T06:38:56.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.746+0000 7f744b86f640 1 -- 172.21.15.159:0/1634931913 shutdown_connections 2024-09-19T06:38:56.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.747+0000 7f744b86f640 1 --2- 172.21.15.159:0/1634931913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 0x7f7444100950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.747+0000 7f744b86f640 1 -- 172.21.15.159:0/1634931913 >> 172.21.15.159:0/1634931913 conn(0x7f74440fc1a0 msgr2=0x7f74440fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:56.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.747+0000 7f744b86f640 1 -- 172.21.15.159:0/1634931913 shutdown_connections 2024-09-19T06:38:56.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.747+0000 7f744b86f640 1 -- 172.21.15.159:0/1634931913 wait complete. 2024-09-19T06:38:56.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.747+0000 7f744b86f640 1 Processor -- start 2024-09-19T06:38:56.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.747+0000 7f744b86f640 1 -- start start 2024-09-19T06:38:56.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.747+0000 7f744b86f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 0x7f74441a3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:56.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.747+0000 7f744b86f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7444112300 con 0x7f7444100570 2024-09-19T06:38:56.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f744960b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 0x7f74441a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f744960b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 0x7f74441a3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44650/0 (socket says 172.21.15.159:44650) 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f744960b640 1 -- 172.21.15.159:0/811955821 learned_addr learned my addr 172.21.15.159:0/811955821 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f744960b640 1 -- 172.21.15.159:0/811955821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74441a3990 con 0x7f7444100570 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f744960b640 1 --2- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 0x7f74441a3450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7440009230 tx=0x7f7440003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f743a7fc640 1 -- 172.21.15.159:0/811955821 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744003f070 con 0x7f7444100570 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f743a7fc640 1 -- 172.21.15.159:0/811955821 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f744003bc80 con 0x7f7444100570 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74441a3c20 con 0x7f7444100570 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f743a7fc640 1 -- 172.21.15.159:0/811955821 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7440035030 con 0x7f7444100570 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.748+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744419d610 con 0x7f7444100570 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.749+0000 7f743a7fc640 1 -- 172.21.15.159:0/811955821 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f7440042070 con 0x7f7444100570 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.749+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744406a7c0 con 0x7f7444100570 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.749+0000 7f743a7fc640 1 --2- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74300392a0 0x7f743003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:56.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.749+0000 7f743a7fc640 1 -- 172.21.15.159:0/811955821 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f744006d000 con 0x7f7444100570 2024-09-19T06:38:56.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.749+0000 7f7448e0a640 1 --2- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74300392a0 0x7f743003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:56.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.750+0000 7f7448e0a640 1 --2- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74300392a0 0x7f743003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74340098c0 tx=0x7f7434006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:56.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.754+0000 7f743a7fc640 1 -- 172.21.15.159:0/811955821 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f74400372d0 con 0x7f7444100570 2024-09-19T06:38:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.937+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f744419eb40 con 0x7f74300392a0 2024-09-19T06:38:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.938+0000 7f743a7fc640 1 -- 172.21.15.159:0/811955821 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f744419eb40 con 0x7f74300392a0 2024-09-19T06:38:56.940 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:38:56.940 INFO:teuthology.orchestra.run.smithi159.stdout:[{"addr": "172.21.15.159", "hostname": "smithi159", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}, {"addr": "172.21.15.203", "hostname": "smithi203", "labels": [], "status": ""}] 2024-09-19T06:38:56.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74300392a0 msgr2=0x7f743003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 --2- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74300392a0 0x7f743003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74340098c0 tx=0x7f7434006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 msgr2=0x7f74441a3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 --2- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 0x7f74441a3450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7440009230 tx=0x7f7440003d40 comp rx=0 tx=0).stop 2024-09-19T06:38:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 shutdown_connections 2024-09-19T06:38:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 --2- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74300392a0 0x7f743003b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 --2- 172.21.15.159:0/811955821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7444100570 0x7f74441a3450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 >> 172.21.15.159:0/811955821 conn(0x7f74440fc1a0 msgr2=0x7f74440fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 shutdown_connections 2024-09-19T06:38:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:56.940+0000 7f744b86f640 1 -- 172.21.15.159:0/811955821 wait complete. 2024-09-19T06:38:57.549 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T06:38:57.549 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T06:38:57.789 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:58.132 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:38:58.162 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:57 smithi159 ceph-mon[30935]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:38:58.162 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:57 smithi159 ceph-mon[30935]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:38:58.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.211+0000 7ff80abbf640 1 -- 172.21.15.159:0/573190583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 msgr2=0x7ff804107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:58.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.211+0000 7ff80abbf640 1 --2- 172.21.15.159:0/573190583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 0x7ff804107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009880 tx=0x7ff7f802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:38:58.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.211+0000 7ff80abbf640 1 -- 172.21.15.159:0/573190583 shutdown_connections 2024-09-19T06:38:58.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.211+0000 7ff80abbf640 1 --2- 172.21.15.159:0/573190583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 0x7ff804107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:58.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.211+0000 7ff80abbf640 1 -- 172.21.15.159:0/573190583 >> 172.21.15.159:0/573190583 conn(0x7ff8040fd2b0 msgr2=0x7ff8040ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:58.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.211+0000 7ff80abbf640 1 -- 172.21.15.159:0/573190583 shutdown_connections 2024-09-19T06:38:58.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.211+0000 7ff80abbf640 1 -- 172.21.15.159:0/573190583 wait complete. 2024-09-19T06:38:58.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff80abbf640 1 Processor -- start 2024-09-19T06:38:58.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff80abbf640 1 -- start start 2024-09-19T06:38:58.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff80abbf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 0x7ff8041970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:58.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff80abbf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff80410bc70 con 0x7ff804107660 2024-09-19T06:38:58.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff80895b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 0x7ff8041970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:58.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff80895b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 0x7ff8041970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44668/0 (socket says 172.21.15.159:44668) 2024-09-19T06:38:58.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff80895b640 1 -- 172.21.15.159:0/1365076524 learned_addr learned my addr 172.21.15.159:0/1365076524 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:38:58.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff80895b640 1 -- 172.21.15.159:0/1365076524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8041975e0 con 0x7ff804107660 2024-09-19T06:38:58.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff80895b640 1 --2- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 0x7ff8041970a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009230 tx=0x7ff7f8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:58.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff801ffb640 1 -- 172.21.15.159:0/1365076524 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f803f070 con 0x7ff804107660 2024-09-19T06:38:58.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.212+0000 7ff801ffb640 1 -- 172.21.15.159:0/1365076524 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7f803bc80 con 0x7ff804107660 2024-09-19T06:38:58.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.213+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8041978d0 con 0x7ff804107660 2024-09-19T06:38:58.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.213+0000 7ff801ffb640 1 -- 172.21.15.159:0/1365076524 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f8035030 con 0x7ff804107660 2024-09-19T06:38:58.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.213+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80419b970 con 0x7ff804107660 2024-09-19T06:38:58.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.213+0000 7ff801ffb640 1 -- 172.21.15.159:0/1365076524 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7ff7f8042070 con 0x7ff804107660 2024-09-19T06:38:58.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.214+0000 7ff801ffb640 1 --2- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7f40392a0 0x7ff7f403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:58.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.214+0000 7ff801ffb640 1 -- 172.21.15.159:0/1365076524 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff7f806d000 con 0x7ff804107660 2024-09-19T06:38:58.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.214+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff804102d10 con 0x7ff804107660 2024-09-19T06:38:58.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.214+0000 7ff803fff640 1 --2- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7f40392a0 0x7ff7f403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:58.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.214+0000 7ff803fff640 1 --2- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7f40392a0 0x7ff7f403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00098c0 tx=0x7ff7f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:58.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.218+0000 7ff801ffb640 1 -- 172.21.15.159:0/1365076524 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7f80372d0 con 0x7ff804107660 2024-09-19T06:38:58.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.388+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff804198400 con 0x7ff804107660 2024-09-19T06:38:58.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.835+0000 7ff801ffb640 1 -- 172.21.15.159:0/1365076524 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7ff7f80314c0 con 0x7ff804107660 2024-09-19T06:38:58.837 INFO:teuthology.orchestra.run.smithi159.stderr:adjusted tunables profile to default 2024-09-19T06:38:58.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7f40392a0 msgr2=0x7ff7f403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:58.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 --2- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7f40392a0 0x7ff7f403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00098c0 tx=0x7ff7f0006db0 comp rx=0 tx=0).stop 2024-09-19T06:38:58.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 msgr2=0x7ff8041970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:58.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 --2- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 0x7ff8041970a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009230 tx=0x7ff7f8003d40 comp rx=0 tx=0).stop 2024-09-19T06:38:58.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 shutdown_connections 2024-09-19T06:38:58.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 --2- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7f40392a0 0x7ff7f403b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:58.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 --2- 172.21.15.159:0/1365076524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff804107660 0x7ff8041970a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:58.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 >> 172.21.15.159:0/1365076524 conn(0x7ff8040fd2b0 msgr2=0x7ff8040feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:58.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 shutdown_connections 2024-09-19T06:38:58.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:38:58.837+0000 7ff80abbf640 1 -- 172.21.15.159:0/1365076524 wait complete. 2024-09-19T06:38:59.134 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:58 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1365076524' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:38:59.422 INFO:tasks.cephadm:Adding mon.a on smithi159 2024-09-19T06:38:59.422 INFO:tasks.cephadm:Adding mon.b on smithi189 2024-09-19T06:38:59.422 INFO:tasks.cephadm:Adding mon.c on smithi203 2024-09-19T06:38:59.422 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi159:172.21.15.159=a;smithi189:172.21.15.189=b;smithi203:172.21.15.203=c' 2024-09-19T06:38:59.674 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:38:59.720 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:39:00.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1365076524' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:39:00.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:00.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:00.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:00.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:00.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:00.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:00.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:39:00.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:00.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:00.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:38:59 smithi159 ceph-mon[30935]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T06:39:00.259 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.210+0000 7f9e7278e640 1 -- 172.21.15.203:0/2171381754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 msgr2=0x7f9e6c100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:00.259 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.210+0000 7f9e7278e640 1 --2- 172.21.15.203:0/2171381754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 0x7f9e6c100930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009880 tx=0x7f9e5c02a5d0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.259 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.210+0000 7f9e7278e640 1 -- 172.21.15.203:0/2171381754 shutdown_connections 2024-09-19T06:39:00.259 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.210+0000 7f9e7278e640 1 --2- 172.21.15.203:0/2171381754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 0x7f9e6c100930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.259 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.210+0000 7f9e7278e640 1 -- 172.21.15.203:0/2171381754 >> 172.21.15.203:0/2171381754 conn(0x7f9e6c0fbca0 msgr2=0x7f9e6c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:00.259 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.210+0000 7f9e7278e640 1 -- 172.21.15.203:0/2171381754 shutdown_connections 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.210+0000 7f9e7278e640 1 -- 172.21.15.203:0/2171381754 wait complete. 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.210+0000 7f9e7278e640 1 Processor -- start 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.210+0000 7f9e7278e640 1 -- start start 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.211+0000 7f9e7278e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 0x7f9e6c196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.211+0000 7f9e7278e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c106640 con 0x7f9e6c100530 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.211+0000 7f9e6bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 0x7f9e6c196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.211+0000 7f9e6bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 0x7f9e6c196e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.203:36636/0 (socket says 172.21.15.203:36636) 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.211+0000 7f9e6bfff640 1 -- 172.21.15.203:0/2804515824 learned_addr learned my addr 172.21.15.203:0/2804515824 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.211+0000 7f9e6bfff640 1 -- 172.21.15.203:0/2804515824 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c197380 con 0x7f9e6c100530 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.212+0000 7f9e6bfff640 1 --2- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 0x7f9e6c196e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c004f60 tx=0x7f9e5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.212+0000 7f9e697fa640 1 -- 172.21.15.203:0/2804515824 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e5c03f070 con 0x7f9e6c100530 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.212+0000 7f9e697fa640 1 -- 172.21.15.203:0/2804515824 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e5c004cc0 con 0x7f9e6c100530 2024-09-19T06:39:00.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.212+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6c197610 con 0x7f9e6c100530 2024-09-19T06:39:00.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.212+0000 7f9e697fa640 1 -- 172.21.15.203:0/2804515824 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e5c035030 con 0x7f9e6c100530 2024-09-19T06:39:00.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.212+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6c19a300 con 0x7f9e6c100530 2024-09-19T06:39:00.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.213+0000 7f9e697fa640 1 -- 172.21.15.203:0/2804515824 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f9e5c042070 con 0x7f9e6c100530 2024-09-19T06:39:00.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.213+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6c106dc0 con 0x7f9e6c100530 2024-09-19T06:39:00.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.213+0000 7f9e697fa640 1 --2- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9e540392a0 0x7f9e5403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:00.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.213+0000 7f9e697fa640 1 -- 172.21.15.203:0/2804515824 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9e5c06d140 con 0x7f9e6c100530 2024-09-19T06:39:00.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.213+0000 7f9e6b7fe640 1 --2- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9e540392a0 0x7f9e5403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:00.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.214+0000 7f9e6b7fe640 1 --2- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9e540392a0 0x7f9e5403b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e600098c0 tx=0x7f9e60006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:00.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.218+0000 7f9e697fa640 1 -- 172.21.15.203:0/2804515824 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e5c0433b0 con 0x7f9e6c100530 2024-09-19T06:39:00.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.405+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi159:172.21.15.159=a;smithi189:172.21.15.189=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}) -- 0x7f9e6c062630 con 0x7f9e540392a0 2024-09-19T06:39:00.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.410+0000 7f9e697fa640 1 -- 172.21.15.203:0/2804515824 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9e6c062630 con 0x7f9e540392a0 2024-09-19T06:39:00.412 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mon update... 2024-09-19T06:39:00.413 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9e540392a0 msgr2=0x7f9e5403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:00.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 --2- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9e540392a0 0x7f9e5403b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e600098c0 tx=0x7f9e60006db0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 msgr2=0x7f9e6c196e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:00.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 --2- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 0x7f9e6c196e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c004f60 tx=0x7f9e5c0048f0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 shutdown_connections 2024-09-19T06:39:00.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 --2- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9e540392a0 0x7f9e5403b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 --2- 172.21.15.203:0/2804515824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100530 0x7f9e6c196e40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 >> 172.21.15.203:0/2804515824 conn(0x7f9e6c0fbca0 msgr2=0x7f9e6c069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:00.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 shutdown_connections 2024-09-19T06:39:00.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:00.412+0000 7f9e7278e640 1 -- 172.21.15.203:0/2804515824 wait complete. 2024-09-19T06:39:00.966 DEBUG:teuthology.orchestra.run.smithi189:mon.b> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T06:39:00.968 DEBUG:teuthology.orchestra.run.smithi203:mon.c> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T06:39:00.971 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:39:00.971 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:39:01.239 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:01.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:01.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:39:01.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:39:01.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:01.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:01.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:01.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi159:172.21.15.159=a;smithi189:172.21.15.189=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:01.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: Saving service mon spec with placement smithi159:172.21.15.159=a;smithi189:172.21.15.189=b;smithi203:172.21.15.203=c;count:3 2024-09-19T06:39:01.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:01.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:01.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:01.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:01.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:01.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T06:39:01.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:01.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:01.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:01.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:01 smithi159 ceph-mon[30935]: Reconfiguring daemon mon.a on smithi159 2024-09-19T06:39:01.665 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.661+0000 7fab8005b640 1 -- 172.21.15.203:0/3540214916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 msgr2=0x7fab78107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.661+0000 7fab8005b640 1 --2- 172.21.15.203:0/3540214916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 0x7fab78107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab74009880 tx=0x7fab7402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.661+0000 7fab8005b640 1 -- 172.21.15.203:0/3540214916 shutdown_connections 2024-09-19T06:39:01.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.661+0000 7fab8005b640 1 --2- 172.21.15.203:0/3540214916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 0x7fab78107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.661+0000 7fab8005b640 1 -- 172.21.15.203:0/3540214916 >> 172.21.15.203:0/3540214916 conn(0x7fab780fd2b0 msgr2=0x7fab780ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:01.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.661+0000 7fab8005b640 1 -- 172.21.15.203:0/3540214916 shutdown_connections 2024-09-19T06:39:01.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.661+0000 7fab8005b640 1 -- 172.21.15.203:0/3540214916 wait complete. 2024-09-19T06:39:01.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.662+0000 7fab8005b640 1 Processor -- start 2024-09-19T06:39:01.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.662+0000 7fab8005b640 1 -- start start 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.662+0000 7fab8005b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 0x7fab781970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.662+0000 7fab8005b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fab7810bc70 con 0x7fab78107660 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab7ddf7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 0x7fab781970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab7ddf7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 0x7fab781970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.203:36654/0 (socket says 172.21.15.203:36654) 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab7ddf7640 1 -- 172.21.15.203:0/4101184087 learned_addr learned my addr 172.21.15.203:0/4101184087 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab7ddf7640 1 -- 172.21.15.203:0/4101184087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab781975e0 con 0x7fab78107660 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab7ddf7640 1 --2- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 0x7fab781970a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab74009230 tx=0x7fab74003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab6effd640 1 -- 172.21.15.203:0/4101184087 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7403f070 con 0x7fab78107660 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab6effd640 1 -- 172.21.15.203:0/4101184087 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7403bc80 con 0x7fab78107660 2024-09-19T06:39:01.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab781978d0 con 0x7fab78107660 2024-09-19T06:39:01.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab6effd640 1 -- 172.21.15.203:0/4101184087 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab74035030 con 0x7fab78107660 2024-09-19T06:39:01.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.663+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7819b970 con 0x7fab78107660 2024-09-19T06:39:01.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.664+0000 7fab6effd640 1 -- 172.21.15.203:0/4101184087 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fab74042070 con 0x7fab78107660 2024-09-19T06:39:01.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.664+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab78102d10 con 0x7fab78107660 2024-09-19T06:39:01.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.664+0000 7fab6effd640 1 --2- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fab640392a0 0x7fab6403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.665+0000 7fab6effd640 1 -- 172.21.15.203:0/4101184087 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fab7406d250 con 0x7fab78107660 2024-09-19T06:39:01.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.665+0000 7fab7d5f6640 1 --2- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fab640392a0 0x7fab6403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.665+0000 7fab7d5f6640 1 --2- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fab640392a0 0x7fab6403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fab680098c0 tx=0x7fab68006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:01.670 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.669+0000 7fab6effd640 1 -- 172.21.15.203:0/4101184087 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab7404c350 con 0x7fab78107660 2024-09-19T06:39:01.905 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.904+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fab78107af0 con 0x7fab78107660 2024-09-19T06:39:01.905 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.904+0000 7fab6effd640 1 -- 172.21.15.203:0/4101184087 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7fab78107af0 con 0x7fab78107660 2024-09-19T06:39:01.906 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:39:01.906 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","modified":"2024-09-19T06:37:35.440913Z","created":"2024-09-19T06:37:35.440913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:39:01.906 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-19T06:39:01.907 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fab640392a0 msgr2=0x7fab6403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.908 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 --2- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fab640392a0 0x7fab6403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fab680098c0 tx=0x7fab68006db0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.908 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 msgr2=0x7fab781970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.908 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 --2- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 0x7fab781970a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab74009230 tx=0x7fab74003d40 comp rx=0 tx=0).stop 2024-09-19T06:39:01.908 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 shutdown_connections 2024-09-19T06:39:01.908 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 --2- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fab640392a0 0x7fab6403b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.908 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 --2- 172.21.15.203:0/4101184087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78107660 0x7fab781970a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.908 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 >> 172.21.15.203:0/4101184087 conn(0x7fab780fd2b0 msgr2=0x7fab780feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:01.908 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 shutdown_connections 2024-09-19T06:39:01.908 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:01.906+0000 7fab8005b640 1 -- 172.21.15.203:0/4101184087 wait complete. 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:02 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/4101184087' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:03.607 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:39:03.607 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:39:03.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:03 smithi159 ceph-mon[30935]: Deploying daemon mon.c on smithi203 2024-09-19T06:39:04.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:04 smithi159 ceph-mon[30935]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:04.899 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:39:05.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.519+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/2890234188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 msgr2=0x7f1f84106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.519+0000 7f1f8ad6d640 1 --2- 172.21.15.203:0/2890234188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 0x7f1f84106a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009880 tx=0x7f1f7802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.519+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/2890234188 shutdown_connections 2024-09-19T06:39:05.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.519+0000 7f1f8ad6d640 1 --2- 172.21.15.203:0/2890234188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 0x7f1f84106a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.519+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/2890234188 >> 172.21.15.203:0/2890234188 conn(0x7f1f840fc280 msgr2=0x7f1f840fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:05.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.519+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/2890234188 shutdown_connections 2024-09-19T06:39:05.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.519+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/2890234188 wait complete. 2024-09-19T06:39:05.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.519+0000 7f1f8ad6d640 1 Processor -- start 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.520+0000 7f1f8ad6d640 1 -- start start 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.520+0000 7f1f8ad6d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 0x7f1f840fc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.520+0000 7f1f8ad6d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8410ac80 con 0x7f1f84106650 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.520+0000 7f1f88b09640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 0x7f1f840fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.520+0000 7f1f88b09640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 0x7f1f840fc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.203:44208/0 (socket says 172.21.15.203:44208) 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.520+0000 7f1f88b09640 1 -- 172.21.15.203:0/3813021223 learned_addr learned my addr 172.21.15.203:0/3813021223 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.520+0000 7f1f88b09640 1 -- 172.21.15.203:0/3813021223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f840fe620 con 0x7f1f84106650 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.520+0000 7f1f88b09640 1 --2- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 0x7f1f840fc730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009230 tx=0x7f1f78003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.521+0000 7f1f81ffb640 1 -- 172.21.15.203:0/3813021223 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f7803f070 con 0x7f1f84106650 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.521+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f840fcc70 con 0x7f1f84106650 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.521+0000 7f1f81ffb640 1 -- 172.21.15.203:0/3813021223 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f7803bc80 con 0x7f1f84106650 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.521+0000 7f1f81ffb640 1 -- 172.21.15.203:0/3813021223 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f78035030 con 0x7f1f84106650 2024-09-19T06:39:05.523 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.521+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f840fd130 con 0x7f1f84106650 2024-09-19T06:39:05.524 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.522+0000 7f1f81ffb640 1 -- 172.21.15.203:0/3813021223 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f1f78042070 con 0x7f1f84106650 2024-09-19T06:39:05.524 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.522+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f84101cc0 con 0x7f1f84106650 2024-09-19T06:39:05.524 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.522+0000 7f1f81ffb640 1 --2- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1f740392a0 0x7f1f7403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.522+0000 7f1f81ffb640 1 -- 172.21.15.203:0/3813021223 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1f7806d0b0 con 0x7f1f84106650 2024-09-19T06:39:05.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.522+0000 7f1f83fff640 1 --2- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1f740392a0 0x7f1f7403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.523+0000 7f1f83fff640 1 --2- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1f740392a0 0x7f1f7403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f700098c0 tx=0x7f1f70006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:05.528 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.527+0000 7f1f81ffb640 1 -- 172.21.15.203:0/3813021223 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1f78031e20 con 0x7f1f84106650 2024-09-19T06:39:05.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.773+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1f840fdc60 con 0x7f1f84106650 2024-09-19T06:39:05.775 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.774+0000 7f1f81ffb640 1 -- 172.21.15.203:0/3813021223 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f1f78031570 con 0x7f1f84106650 2024-09-19T06:39:05.775 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:39:05.775 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","modified":"2024-09-19T06:37:35.440913Z","created":"2024-09-19T06:37:35.440913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:39:05.776 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-19T06:39:05.777 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1f740392a0 msgr2=0x7f1f7403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 --2- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1f740392a0 0x7f1f7403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f700098c0 tx=0x7f1f70006db0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 msgr2=0x7f1f840fc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 --2- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 0x7f1f840fc730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009230 tx=0x7f1f78003d40 comp rx=0 tx=0).stop 2024-09-19T06:39:05.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 shutdown_connections 2024-09-19T06:39:05.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 --2- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1f740392a0 0x7f1f7403b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 --2- 172.21.15.203:0/3813021223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f84106650 0x7f1f840fc730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 >> 172.21.15.203:0/3813021223 conn(0x7f1f840fc280 msgr2=0x7f1f84069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:05.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 shutdown_connections 2024-09-19T06:39:05.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:05.776+0000 7f1f8ad6d640 1 -- 172.21.15.203:0/3813021223 wait complete. 2024-09-19T06:39:06.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 podman[35454]: 2024-09-19 06:39:06.427491638 +0000 UTC m=+0.015910409 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:39:06.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:06 smithi159 ceph-mon[30935]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:06.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:06 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/3813021223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:07.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 podman[35454]: 2024-09-19 06:39:06.734169849 +0000 UTC m=+0.322588607 container init c5cd3c7c105ade504ab6513b1b24718c492db0829113697b98eabce0bc3090cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-19T06:39:07.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 podman[35454]: 2024-09-19 06:39:06.737368629 +0000 UTC m=+0.325787387 container start c5cd3c7c105ade504ab6513b1b24718c492db0829113697b98eabce0bc3090cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:39:07.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:39:07.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:39:07.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: pidfile_write: ignore empty --pid-file 2024-09-19T06:39:07.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: load: jerasure load: lrc 2024-09-19T06:39:07.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Git sha 0 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: DB SUMMARY 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: DB Session ID: JTW9W48P50B9BRBJZM9T 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:39:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:39:07.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:39:07.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:39:07.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:39:07.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.env: 0x5567921df940 2024-09-19T06:39:07.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:39:07.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.info_log: 0x5567939116e0 2024-09-19T06:39:07.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.statistics: (nil) 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.use_fsync: 0 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:39:07.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.db_log_dir: 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.wal_dir: 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.write_buffer_manager: 0x556793920dc0 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:39:07.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.unordered_write: 0 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.row_cache: None 2024-09-19T06:39:07.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.wal_filter: None 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.wal_compression: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:39:07.099 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:39:07.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_open_files: -1 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Compression algorithms supported: 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: kZSTD supported: 0 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:39:07.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.merge_operator: 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_filter: None 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556793911320) 2024-09-19T06:39:07.102 INFO:journalctl@ceph.mon.c.smithi203.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: index_type: 0 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: data_block_index_type: 0 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: index_shortening: 1 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: checksum: 4 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: no_block_cache: 0 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache: 0x5567939051f0 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache_options: 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: capacity : 536870912 2024-09-19T06:39:07.103 INFO:journalctl@ceph.mon.c.smithi203.stdout: num_shard_bits : 4 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: strict_capacity_limit : 0 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache_compressed: (nil) 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: persistent_cache: (nil) 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_size: 4096 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_size_deviation: 10 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_restart_interval: 16 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: index_block_restart_interval: 1 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: metadata_block_size: 4096 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: partition_filters: 0 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: use_delta_encoding: 1 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: filter_policy: bloomfilter 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: whole_key_filtering: 1 2024-09-19T06:39:07.104 INFO:journalctl@ceph.mon.c.smithi203.stdout: verify_compression: 0 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout: format_version: 5 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout: enable_index_compression: 1 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_align: 0 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout: max_auto_readahead_size: 262144 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout: prepopulate_block_cache: 0 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression: NoCompression 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:39:07.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.num_levels: 7 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:39:07.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:39:07.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:39:07.108 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:39:07.109 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.ttl: 2592000 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:39:07.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6b52fc8a-92c8-4de5-92fc-d88aa7d1dd43 2024-09-19T06:39:07.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727946764290, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T06:39:07.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T06:39:07.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727946764702, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726727946, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6b52fc8a-92c8-4de5-92fc-d88aa7d1dd43", "db_session_id": "JTW9W48P50B9BRBJZM9T", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:39:07.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727946764804, "job": 1, "event": "recovery_finished"} 2024-09-19T06:39:07.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T06:39:07.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:39:07.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556793932e00 2024-09-19T06:39:07.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: DB pointer 0x556793a2e000 2024-09-19T06:39:07.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:39:07.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** DB Stats ** 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** Compaction Stats [default] ** 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:39:07.113 INFO:journalctl@ceph.mon.c.smithi203.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** Compaction Stats [default] ** 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:39:07.114 INFO:journalctl@ceph.mon.c.smithi203.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: Block cache BinnedLRUCache@0x5567939051f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: using public_addr v2:172.21.15.203:0/0 -> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-19T06:39:07.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: starting mon.c rank -1 at public addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] at bind addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(???) e0 preinit fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout: e1 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout: btime 2024-09-19T06:37:38:555912+0000 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout: legacy client fscid: -1 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout: No filesystems configured 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T06:39:07.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Added host smithi203 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1365076524' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:39:07.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1365076524' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:39:07.119 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi159:172.21.15.159=a;smithi189:172.21.15.189=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Saving service mon spec with placement smithi159:172.21.15.159=a;smithi189:172.21.15.189=b;smithi203:172.21.15.203=c;count:3 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:07.120 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Reconfiguring daemon mon.a on smithi159 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/4101184087' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: Deploying daemon mon.c on smithi203 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:07.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/3813021223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:07.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 ceph-mon[35473]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T06:39:07.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 bash[35454]: c5cd3c7c105ade504ab6513b1b24718c492db0829113697b98eabce0bc3090cd 2024-09-19T06:39:07.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:06 smithi203 systemd[1]: Started Ceph mon.c for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:39:07.366 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:39:07.367 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:39:07.620 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:39:12.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:39:12.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: mon.a calling monitor election 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: mon.c calling monitor election 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: monmap epoch 2 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:12.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: last_changed 2024-09-19T06:39:06.790551+0000 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: min_mon_release 19 (squid) 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: election_strategy: 1 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: fsmap 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: mgrmap e13: x(active, since 38s) 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: overall HEALTH_OK 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:12.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:12.151 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:39:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: mon.a calling monitor election 2024-09-19T06:39:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: mon.c calling monitor election 2024-09-19T06:39:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: monmap epoch 2 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: last_changed 2024-09-19T06:39:06.790551+0000 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: min_mon_release 19 (squid) 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: election_strategy: 1 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: fsmap 2024-09-19T06:39:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:12.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: mgrmap e13: x(active, since 38s) 2024-09-19T06:39:12.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: overall HEALTH_OK 2024-09-19T06:39:12.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:12.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:12.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:12.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:12.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:12.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.458+0000 7f67c7e62640 1 -- 172.21.15.203:0/1338120535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ac003530 msgr2=0x7f67ac0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:12.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.458+0000 7f67c7e62640 1 --2- 172.21.15.203:0/1338120535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ac003530 0x7f67ac0059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67c010d510 tx=0x7f67bc02c490 comp rx=0 tx=0).stop 2024-09-19T06:39:12.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.458+0000 7f67c7e62640 1 -- 172.21.15.203:0/1338120535 shutdown_connections 2024-09-19T06:39:12.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.458+0000 7f67c7e62640 1 --2- 172.21.15.203:0/1338120535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67ac003530 0x7f67ac0059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:12.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.458+0000 7f67c7e62640 1 -- 172.21.15.203:0/1338120535 >> 172.21.15.203:0/1338120535 conn(0x7f67c006b3f0 msgr2=0x7f67c006b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:12.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.458+0000 7f67c7e62640 1 -- 172.21.15.203:0/1338120535 shutdown_connections 2024-09-19T06:39:12.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.458+0000 7f67c7e62640 1 -- 172.21.15.203:0/1338120535 wait complete. 2024-09-19T06:39:12.462 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.459+0000 7f67c7e62640 1 Processor -- start 2024-09-19T06:39:12.462 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.459+0000 7f67c7e62640 1 -- start start 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c7e62640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 0x7f67c01a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c7e62640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67c01a7e50 0x7f67c01a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c7e62640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67c0114180 con 0x7f67c01a7e50 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c7e62640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67c0114000 con 0x7f67ac003530 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c5bfe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 0x7f67c01a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c5bfe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 0x7f67c01a7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:41492/0 (socket says 172.21.15.203:41492) 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c5bfe640 1 -- 172.21.15.203:0/871858449 learned_addr learned my addr 172.21.15.203:0/871858449 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c53fd640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67c01a7e50 0x7f67c01a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c5bfe640 1 -- 172.21.15.203:0/871858449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 msgr2=0x7f67c01a7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c5bfe640 1 -- 172.21.15.203:0/871858449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 msgr2=0x7f67c01a7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c5bfe640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 0x7f67c01a7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c5bfe640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 0x7f67c01a7910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:39:12.463 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c53fd640 1 -- 172.21.15.203:0/871858449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 msgr2=0x7f67c01a7910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:39:12.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c53fd640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 0x7f67c01a7910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:12.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.460+0000 7f67c53fd640 1 -- 172.21.15.203:0/871858449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c01a8460 con 0x7f67c01a7e50 2024-09-19T06:39:12.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.461+0000 7f67c53fd640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67c01a7e50 0x7f67c01a1ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f67b000b3d0 tx=0x7f67b000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:12.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.461+0000 7f67b6ffd640 1 -- 172.21.15.203:0/871858449 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f67b0011630 con 0x7f67c01a7e50 2024-09-19T06:39:12.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.461+0000 7f67b6ffd640 1 -- 172.21.15.203:0/871858449 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67b0011cb0 con 0x7f67c01a7e50 2024-09-19T06:39:12.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.461+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c01a2010 con 0x7f67c01a7e50 2024-09-19T06:39:12.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.461+0000 7f67b6ffd640 1 -- 172.21.15.203:0/871858449 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f67b0010df0 con 0x7f67c01a7e50 2024-09-19T06:39:12.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.461+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c01a25a0 con 0x7f67c01a7e50 2024-09-19T06:39:12.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.462+0000 7f67b6ffd640 1 -- 172.21.15.203:0/871858449 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f67b0018020 con 0x7f67c01a7e50 2024-09-19T06:39:12.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.462+0000 7f67b6ffd640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a4039090 0x7f67a403b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:12.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.462+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c010d7c0 con 0x7f67c01a7e50 2024-09-19T06:39:12.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.462+0000 7f67b6ffd640 1 -- 172.21.15.203:0/871858449 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f67b004bf50 con 0x7f67c01a7e50 2024-09-19T06:39:12.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.462+0000 7f67c5bfe640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a4039090 0x7f67a403b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:12.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.463+0000 7f67c5bfe640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a4039090 0x7f67a403b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67bc012c10 tx=0x7f67bc0323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:12.468 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.467+0000 7f67b6ffd640 1 -- 172.21.15.203:0/871858449 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67b001f020 con 0x7f67c01a7e50 2024-09-19T06:39:12.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.700+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f67c019b960 con 0x7f67c01a7e50 2024-09-19T06:39:12.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.701+0000 7f67b6ffd640 1 -- 172.21.15.203:0/871858449 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f67b0018310 con 0x7f67c01a7e50 2024-09-19T06:39:12.702 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:39:12.702 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","modified":"2024-09-19T06:39:06.790551Z","created":"2024-09-19T06:37:35.440913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:39:12.702 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-09-19T06:39:12.704 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a4039090 msgr2=0x7f67a403b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:12.704 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a4039090 0x7f67a403b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67bc012c10 tx=0x7f67bc0323a0 comp rx=0 tx=0).stop 2024-09-19T06:39:12.704 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67c01a7e50 msgr2=0x7f67c01a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:12.705 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67c01a7e50 0x7f67c01a1ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f67b000b3d0 tx=0x7f67b000b890 comp rx=0 tx=0).stop 2024-09-19T06:39:12.705 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 shutdown_connections 2024-09-19T06:39:12.705 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a4039090 0x7f67a403b550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:12.705 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67c01a7e50 0x7f67c01a1ad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:12.705 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 --2- 172.21.15.203:0/871858449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67ac003530 0x7f67c01a7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:12.705 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 >> 172.21.15.203:0/871858449 conn(0x7f67c006b3f0 msgr2=0x7f67c010a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:12.705 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 shutdown_connections 2024-09-19T06:39:12.705 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:12.703+0000 7f67c7e62640 1 -- 172.21.15.203:0/871858449 wait complete. 2024-09-19T06:39:13.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:12 smithi203 ceph-mon[35473]: Deploying daemon mon.b on smithi189 2024-09-19T06:39:13.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:12 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/871858449' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:13.018 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:13.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:12 smithi159 ceph-mon[30935]: Deploying daemon mon.b on smithi189 2024-09-19T06:39:13.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:12 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/871858449' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:13.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:14.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:13 smithi159 ceph-mon[30935]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:14.272 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:39:14.273 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:39:14.301 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:13 smithi203 ceph-mon[35473]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:14.526 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:39:15.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.042+0000 7f87dc86b640 1 -- 172.21.15.203:0/465121343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8107660 msgr2=0x7f87d8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.042+0000 7f87dc86b640 1 --2- 172.21.15.203:0/465121343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8107660 0x7f87d8107a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009880 tx=0x7f87c002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.042+0000 7f87dc86b640 1 -- 172.21.15.203:0/465121343 shutdown_connections 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.042+0000 7f87dc86b640 1 --2- 172.21.15.203:0/465121343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8107660 0x7f87d8107a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.042+0000 7f87dc86b640 1 -- 172.21.15.203:0/465121343 >> 172.21.15.203:0/465121343 conn(0x7f87d80fd320 msgr2=0x7f87d80ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.042+0000 7f87dc86b640 1 -- 172.21.15.203:0/465121343 shutdown_connections 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.043+0000 7f87dc86b640 1 -- 172.21.15.203:0/465121343 wait complete. 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.043+0000 7f87dc86b640 1 Processor -- start 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.043+0000 7f87dc86b640 1 -- start start 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87dc86b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87d8107660 0x7f87d81973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87dc86b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8197900 0x7f87d819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:15.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87dc86b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f87d810bd20 con 0x7f87d8197900 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87dc86b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f87d810bba0 con 0x7f87d8107660 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8197900 0x7f87d819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8197900 0x7f87d819bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.203:44322/0 (socket says 172.21.15.203:44322) 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d5d9b640 1 -- 172.21.15.203:0/1414820326 learned_addr learned my addr 172.21.15.203:0/1414820326 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d659c640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87d8107660 0x7f87d81973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d659c640 1 -- 172.21.15.203:0/1414820326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87d8107660 msgr2=0x7f87d81973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d659c640 1 -- 172.21.15.203:0/1414820326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87d8107660 msgr2=0x7f87d81973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d659c640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87d8107660 0x7f87d81973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d659c640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87d8107660 0x7f87d81973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d5d9b640 1 -- 172.21.15.203:0/1414820326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87d8107660 msgr2=0x7f87d81973c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d5d9b640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87d8107660 0x7f87d81973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d5d9b640 1 -- 172.21.15.203:0/1414820326 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d8197f20 con 0x7f87d8197900 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.044+0000 7f87d5d9b640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8197900 0x7f87d819bc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f87c800b4a0 tx=0x7f87c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.045+0000 7f87cf7fe640 1 -- 172.21.15.203:0/1414820326 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f87c8010610 con 0x7f87d8197900 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.045+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d819c1d0 con 0x7f87d8197900 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.045+0000 7f87cf7fe640 1 -- 172.21.15.203:0/1414820326 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87c8010c90 con 0x7f87d8197900 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.045+0000 7f87cf7fe640 1 -- 172.21.15.203:0/1414820326 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f87c8017e60 con 0x7f87d8197900 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.045+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d819c710 con 0x7f87d8197900 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.046+0000 7f87cf7fe640 1 -- 172.21.15.203:0/1414820326 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f87c8017070 con 0x7f87d8197900 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.046+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d8102da0 con 0x7f87d8197900 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.046+0000 7f87cf7fe640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f87c4039040 0x7f87c403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.046+0000 7f87cf7fe640 1 -- 172.21.15.203:0/1414820326 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f87c800d040 con 0x7f87d8197900 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.046+0000 7f87d659c640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f87c4039040 0x7f87c403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.047+0000 7f87d659c640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f87c4039040 0x7f87c403b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f87c00314e0 tx=0x7f87c00058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:15.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.051+0000 7f87cf7fe640 1 -- 172.21.15.203:0/1414820326 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87c801e020 con 0x7f87d8197900 2024-09-19T06:39:15.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.279+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f87d819c9d0 con 0x7f87d8197900 2024-09-19T06:39:15.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.279+0000 7f87cf7fe640 1 -- 172.21.15.203:0/1414820326 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f87c800eb40 con 0x7f87d8197900 2024-09-19T06:39:15.281 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:39:15.281 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","modified":"2024-09-19T06:39:06.790551Z","created":"2024-09-19T06:37:35.440913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:39:15.281 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-09-19T06:39:15.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.281+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f87c4039040 msgr2=0x7f87c403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:15.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.281+0000 7f87dc86b640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f87c4039040 0x7f87c403b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f87c00314e0 tx=0x7f87c00058b0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.281+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8197900 msgr2=0x7f87d819bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:15.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.281+0000 7f87dc86b640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8197900 0x7f87d819bc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f87c800b4a0 tx=0x7f87c800b960 comp rx=0 tx=0).stop 2024-09-19T06:39:15.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.281+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 shutdown_connections 2024-09-19T06:39:15.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.281+0000 7f87dc86b640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f87c4039040 0x7f87c403b500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.281+0000 7f87dc86b640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87d8197900 0x7f87d819bc90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.284 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.281+0000 7f87dc86b640 1 --2- 172.21.15.203:0/1414820326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87d8107660 0x7f87d81973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.284 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.281+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 >> 172.21.15.203:0/1414820326 conn(0x7f87d80fd320 msgr2=0x7f87d80fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:15.284 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.282+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 shutdown_connections 2024-09-19T06:39:15.284 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:15.282+0000 7f87dc86b640 1 -- 172.21.15.203:0/1414820326 wait complete. 2024-09-19T06:39:15.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 podman[34861]: 2024-09-19 06:39:15.237649694 +0000 UTC m=+0.015740877 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:39:15.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:15 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/1414820326' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:15.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:15 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/1414820326' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 podman[34861]: 2024-09-19 06:39:15.529812297 +0000 UTC m=+0.307903479 container init 23f295b00c42a35484c4a114f37706cb10eb5d88974323e0ef83a22dddaef27b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:39:15.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 podman[34861]: 2024-09-19 06:39:15.53278938 +0000 UTC m=+0.310880563 container start 23f295b00c42a35484c4a114f37706cb10eb5d88974323e0ef83a22dddaef27b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:39:15.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:39:15.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:39:15.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pidfile_write: ignore empty --pid-file 2024-09-19T06:39:15.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: load: jerasure load: lrc 2024-09-19T06:39:15.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:39:15.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Git sha 0 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: DB SUMMARY 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: DB Session ID: APCQUAUM1HLRU3NXIP8E 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:39:15.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:39:15.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:39:15.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.env: 0x5570cbe95940 2024-09-19T06:39:15.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:39:15.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.info_log: 0x5570cd9196e0 2024-09-19T06:39:15.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:39:15.892 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.statistics: (nil) 2024-09-19T06:39:15.892 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.use_fsync: 0 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:39:15.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.db_log_dir: 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.wal_dir: 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:39:15.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.write_buffer_manager: 0x5570cd928dc0 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.unordered_write: 0 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:39:15.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.row_cache: None 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.wal_filter: None 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.wal_compression: 0 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:39:15.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:39:15.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_open_files: -1 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Compression algorithms supported: 2024-09-19T06:39:15.898 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: kZSTD supported: 0 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.merge_operator: 2024-09-19T06:39:15.899 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_filter: None 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5570cd919320) 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout: index_type: 0 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout: data_block_index_type: 0 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout: index_shortening: 1 2024-09-19T06:39:15.900 INFO:journalctl@ceph.mon.b.smithi189.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: checksum: 4 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: no_block_cache: 0 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: block_cache: 0x5570cd90d1f0 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: block_cache_options: 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: capacity : 536870912 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: num_shard_bits : 4 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: strict_capacity_limit : 0 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: block_cache_compressed: (nil) 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: persistent_cache: (nil) 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: block_size: 4096 2024-09-19T06:39:15.901 INFO:journalctl@ceph.mon.b.smithi189.stdout: block_size_deviation: 10 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: block_restart_interval: 16 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: index_block_restart_interval: 1 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: metadata_block_size: 4096 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: partition_filters: 0 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: use_delta_encoding: 1 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: filter_policy: bloomfilter 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: whole_key_filtering: 1 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: verify_compression: 0 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: format_version: 5 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: enable_index_compression: 1 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: block_align: 0 2024-09-19T06:39:15.902 INFO:journalctl@ceph.mon.b.smithi189.stdout: max_auto_readahead_size: 262144 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout: prepopulate_block_cache: 0 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression: NoCompression 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:39:15.903 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.num_levels: 7 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:39:15.904 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:39:15.905 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:39:15.906 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:39:15.907 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.ttl: 2592000 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:39:15.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T06:39:15.909 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c64142a0-c35e-4d01-86db-1f6a8d144b78 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727955561110, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727955561514, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726727955, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c64142a0-c35e-4d01-86db-1f6a8d144b78", "db_session_id": "APCQUAUM1HLRU3NXIP8E", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727955561611, "job": 1, "event": "recovery_finished"} 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5570cd93ae00 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: DB pointer 0x5570cda36000 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout: ** DB Stats ** 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:39:15.910 INFO:journalctl@ceph.mon.b.smithi189.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:39:15.911 INFO:journalctl@ceph.mon.b.smithi189.stdout: 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:39:15.912 INFO:journalctl@ceph.mon.b.smithi189.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout: Block cache BinnedLRUCache@0x5570cd90d1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout: 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: using public_addr v2:172.21.15.189:0/0 -> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: starting mon.b rank -1 at public addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] at bind addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(???) e0 preinit fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:15.913 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout: e1 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout: btime 2024-09-19T06:37:38:555912+0000 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout: legacy client fscid: -1 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout: 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout: No filesystems configured 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T06:39:15.914 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:39:15.915 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Added host smithi203 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1365076524' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1365076524' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.916 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.917 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.917 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.917 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.917 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:39:15.917 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:15.917 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi159:172.21.15.159=a;smithi189:172.21.15.189=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Saving service mon spec with placement smithi159:172.21.15.159=a;smithi189:172.21.15.189=b;smithi203:172.21.15.203=c;count:3 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.918 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Reconfiguring daemon mon.a on smithi159 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:15.919 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/4101184087' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Deploying daemon mon.c on smithi203 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/3813021223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.a calling monitor election 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:15.920 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:15.921 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.c calling monitor election 2024-09-19T06:39:15.921 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.921 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:15.921 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:15.921 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.921 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:15.921 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: monmap epoch 2 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: last_changed 2024-09-19T06:39:06.790551+0000 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: min_mon_release 19 (squid) 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: election_strategy: 1 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: fsmap 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mgrmap e13: x(active, since 38s) 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: overall HEALTH_OK 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.922 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: Deploying daemon mon.b on smithi189 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/871858449' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/1414820326' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 ceph-mon[34880]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 bash[34861]: 23f295b00c42a35484c4a114f37706cb10eb5d88974323e0ef83a22dddaef27b 2024-09-19T06:39:15.923 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:15 smithi189 systemd[1]: Started Ceph mon.b for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:39:16.793 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:39:16.793 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:39:17.040 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:39:20.677 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.675+0000 7ff8a5d84640 1 -- 172.21.15.203:0/2084968761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff88c003530 msgr2=0x7ff88c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:20.677 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.675+0000 7ff8a5d84640 1 --2- 172.21.15.203:0/2084968761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff88c003530 0x7ff88c0059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0102af0 tx=0x7ff89002c150 comp rx=0 tx=0).stop 2024-09-19T06:39:20.677 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.675+0000 7ff8a5d84640 1 -- 172.21.15.203:0/2084968761 shutdown_connections 2024-09-19T06:39:20.678 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.675+0000 7ff8a5d84640 1 --2- 172.21.15.203:0/2084968761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff88c003530 0x7ff88c0059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:20.678 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.675+0000 7ff8a5d84640 1 -- 172.21.15.203:0/2084968761 >> 172.21.15.203:0/2084968761 conn(0x7ff8a00fd320 msgr2=0x7ff8a00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:20.678 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.675+0000 7ff8a5d84640 1 -- 172.21.15.203:0/2084968761 shutdown_connections 2024-09-19T06:39:20.678 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.675+0000 7ff8a5d84640 1 -- 172.21.15.203:0/2084968761 wait complete. 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.676+0000 7ff8a5d84640 1 Processor -- start 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.676+0000 7ff8a5d84640 1 -- start start 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.676+0000 7ff8a5d84640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c003530 0x7ff8a0197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.676+0000 7ff8a5d84640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 0x7ff8a019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.676+0000 7ff8a5d84640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a019c110 0x7ff8a019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.676+0000 7ff8a5d84640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a0109780 con 0x7ff8a019c110 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.676+0000 7ff8a5d84640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a0109600 con 0x7ff88c003530 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.676+0000 7ff8a5d84640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a0109900 con 0x7ff8a0197840 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.676+0000 7ff897fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 0x7ff8a019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:20.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff897fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 0x7ff8a019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:59202/0 (socket says 172.21.15.203:59202) 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff897fff640 1 -- 172.21.15.203:0/4103355036 learned_addr learned my addr 172.21.15.203:0/4103355036 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89ffff640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a019c110 0x7ff8a019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff897fff640 1 -- 172.21.15.203:0/4103355036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 msgr2=0x7ff8a019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff897fff640 1 -- 172.21.15.203:0/4103355036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 msgr2=0x7ff8a019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff897fff640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 0x7ff8a019bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89f7fe640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c003530 0x7ff8a0197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff897fff640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 0x7ff8a019bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89f7fe640 1 -- 172.21.15.203:0/4103355036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c003530 msgr2=0x7ff8a0197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89f7fe640 1 -- 172.21.15.203:0/4103355036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c003530 msgr2=0x7ff8a0197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89f7fe640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c003530 0x7ff8a0197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89ffff640 1 -- 172.21.15.203:0/4103355036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 msgr2=0x7ff8a019bbd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89f7fe640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c003530 0x7ff8a0197300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:39:20.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89ffff640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 0x7ff8a019bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:20.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89ffff640 1 -- 172.21.15.203:0/4103355036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c003530 msgr2=0x7ff8a0197300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:39:20.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89ffff640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c003530 0x7ff8a0197300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:20.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89ffff640 1 -- 172.21.15.203:0/4103355036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a01a3e80 con 0x7ff8a019c110 2024-09-19T06:39:20.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89ffff640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a019c110 0x7ff8a019c5c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff89800bd50 tx=0x7ff89800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:20.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89d7fa640 1 -- 172.21.15.203:0/4103355036 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898019070 con 0x7ff8a019c110 2024-09-19T06:39:20.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89d7fa640 1 -- 172.21.15.203:0/4103355036 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff898014920 con 0x7ff8a019c110 2024-09-19T06:39:20.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a01a40b0 con 0x7ff8a019c110 2024-09-19T06:39:20.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.677+0000 7ff89d7fa640 1 -- 172.21.15.203:0/4103355036 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898012990 con 0x7ff8a019c110 2024-09-19T06:39:20.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.678+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a01a45c0 con 0x7ff8a019c110 2024-09-19T06:39:20.683 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.678+0000 7ff89d7fa640 1 -- 172.21.15.203:0/4103355036 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7ff89801c070 con 0x7ff8a019c110 2024-09-19T06:39:20.683 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.679+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a010a8b0 con 0x7ff8a019c110 2024-09-19T06:39:20.683 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.679+0000 7ff89d7fa640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff880039730 0x7ff88003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:20.683 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.679+0000 7ff89d7fa640 1 -- 172.21.15.203:0/4103355036 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff89804c130 con 0x7ff8a019c110 2024-09-19T06:39:20.683 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.679+0000 7ff89f7fe640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff880039730 0x7ff88003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:20.683 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.679+0000 7ff89f7fe640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff880039730 0x7ff88003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff890005dc0 tx=0x7ff890005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:20.686 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.684+0000 7ff89d7fa640 1 -- 172.21.15.203:0/4103355036 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff898013ba0 con 0x7ff8a019c110 2024-09-19T06:39:20.929 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.927+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff8a002d7c0 con 0x7ff8a019c110 2024-09-19T06:39:20.929 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.927+0000 7ff89d7fa640 1 -- 172.21.15.203:0/4103355036 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7ff89800e090 con 0x7ff8a019c110 2024-09-19T06:39:20.930 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:39:20.930 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":3,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","modified":"2024-09-19T06:39:15.585847Z","created":"2024-09-19T06:37:35.440913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:39:20.930 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 3 2024-09-19T06:39:20.930 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: mon.c calling monitor election 2024-09-19T06:39:20.930 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:39:20.930 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: mon.a calling monitor election 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: monmap epoch 3 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: last_changed 2024-09-19T06:39:15.585847+0000 2024-09-19T06:39:20.931 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: min_mon_release 19 (squid) 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: election_strategy: 1 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: 2: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: fsmap 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: mgrmap e13: x(active, since 47s) 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: overall HEALTH_OK 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:20.932 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:20.933 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff880039730 msgr2=0x7ff88003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:20.933 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff880039730 0x7ff88003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff890005dc0 tx=0x7ff890005d10 comp rx=0 tx=0).stop 2024-09-19T06:39:20.933 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a019c110 msgr2=0x7ff8a019c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:20.933 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a019c110 0x7ff8a019c5c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff89800bd50 tx=0x7ff89800be40 comp rx=0 tx=0).stop 2024-09-19T06:39:20.933 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 shutdown_connections 2024-09-19T06:39:20.934 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff880039730 0x7ff88003bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:20.934 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8a019c110 0x7ff8a019c5c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:20.934 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8a0197840 0x7ff8a019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:20.934 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 --2- 172.21.15.203:0/4103355036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c003530 0x7ff8a0197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:20.934 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.929+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 >> 172.21.15.203:0/4103355036 conn(0x7ff8a00fd320 msgr2=0x7ff8a00ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:20.934 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.930+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 shutdown_connections 2024-09-19T06:39:20.934 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:20.930+0000 7ff8a5d84640 1 -- 172.21.15.203:0/4103355036 wait complete. 2024-09-19T06:39:21.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: mon.c calling monitor election 2024-09-19T06:39:21.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:39:21.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: mon.a calling monitor election 2024-09-19T06:39:21.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: monmap epoch 3 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: last_changed 2024-09-19T06:39:15.585847+0000 2024-09-19T06:39:21.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: min_mon_release 19 (squid) 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: election_strategy: 1 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: 2: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: fsmap 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: mgrmap e13: x(active, since 47s) 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: overall HEALTH_OK 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:21.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:21.536 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T06:39:21.537 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T06:39:21.793 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:21.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:21 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:21.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:21 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/4103355036' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:21.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:21 smithi203 ceph-mon[35473]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:21.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:21 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:21.891 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:21 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:21.891 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:21 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/4103355036' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:21.891 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:21 smithi159 ceph-mon[30935]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:21.891 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:21 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.164+0000 7fa323166640 1 -- 172.21.15.159:0/3048885928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c106650 msgr2=0x7fa31c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.164+0000 7fa323166640 1 --2- 172.21.15.159:0/3048885928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c106650 0x7fa31c106a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa310009880 tx=0x7fa31002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.164+0000 7fa323166640 1 -- 172.21.15.159:0/3048885928 shutdown_connections 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.164+0000 7fa323166640 1 --2- 172.21.15.159:0/3048885928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c106650 0x7fa31c106a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.164+0000 7fa323166640 1 -- 172.21.15.159:0/3048885928 >> 172.21.15.159:0/3048885928 conn(0x7fa31c0fc280 msgr2=0x7fa31c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.164+0000 7fa323166640 1 -- 172.21.15.159:0/3048885928 shutdown_connections 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.164+0000 7fa323166640 1 -- 172.21.15.159:0/3048885928 wait complete. 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.165+0000 7fa323166640 1 Processor -- start 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.165+0000 7fa323166640 1 -- start start 2024-09-19T06:39:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.165+0000 7fa323166640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa31c106650 0x7fa31c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.165+0000 7fa323166640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31c196920 0x7fa31c19acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.165+0000 7fa323166640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c19b1f0 0x7fa31c19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.165+0000 7fa323166640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c10ac30 con 0x7fa31c19b1f0 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.165+0000 7fa323166640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c10aab0 con 0x7fa31c196920 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.165+0000 7fa323166640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c10adb0 con 0x7fa31c106650 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa321703640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c19b1f0 0x7fa31c19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa321703640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c19b1f0 0x7fa31c19b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58788/0 (socket says 172.21.15.159:58788) 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa321703640 1 -- 172.21.15.159:0/3496668270 learned_addr learned my addr 172.21.15.159:0/3496668270 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa320f02640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa31c106650 0x7fa31c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa31bfff640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31c196920 0x7fa31c19acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa321703640 1 -- 172.21.15.159:0/3496668270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa31c106650 msgr2=0x7fa31c1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa321703640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa31c106650 0x7fa31c1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa321703640 1 -- 172.21.15.159:0/3496668270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31c196920 msgr2=0x7fa31c19acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:22.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa321703640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31c196920 0x7fa31c19acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa321703640 1 -- 172.21.15.159:0/3496668270 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31c1a2f60 con 0x7fa31c19b1f0 2024-09-19T06:39:22.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa321703640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c19b1f0 0x7fa31c19b6a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa31400ba50 tx=0x7fa31400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:22.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa319ffb640 1 -- 172.21.15.159:0/3496668270 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314019070 con 0x7fa31c19b1f0 2024-09-19T06:39:22.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa319ffb640 1 -- 172.21.15.159:0/3496668270 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa31400cbe0 con 0x7fa31c19b1f0 2024-09-19T06:39:22.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa319ffb640 1 -- 172.21.15.159:0/3496668270 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140076a0 con 0x7fa31c19b1f0 2024-09-19T06:39:22.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.166+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31c1a3190 con 0x7fa31c19b1f0 2024-09-19T06:39:22.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.167+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31c1a3720 con 0x7fa31c19b1f0 2024-09-19T06:39:22.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.167+0000 7fa319ffb640 1 -- 172.21.15.159:0/3496668270 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fa31401c070 con 0x7fa31c19b1f0 2024-09-19T06:39:22.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.168+0000 7fa319ffb640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa30c039730 0x7fa30c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:22.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.168+0000 7fa319ffb640 1 -- 172.21.15.159:0/3496668270 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa31404bd30 con 0x7fa31c19b1f0 2024-09-19T06:39:22.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.168+0000 7fa320f02640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa30c039730 0x7fa30c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:22.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.168+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa31c106ab0 con 0x7fa31c19b1f0 2024-09-19T06:39:22.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.168+0000 7fa320f02640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa30c039730 0x7fa30c03bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa310009230 tx=0x7fa310005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:22.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.172+0000 7fa319ffb640 1 -- 172.21.15.159:0/3496668270 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa31400e0a0 con 0x7fa31c19b1f0 2024-09-19T06:39:22.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.353+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa31c1a39b0 con 0x7fa31c19b1f0 2024-09-19T06:39:22.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.353+0000 7fa319ffb640 1 -- 172.21.15.159:0/3496668270 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7fa3140112a0 con 0x7fa31c19b1f0 2024-09-19T06:39:22.355 INFO:teuthology.orchestra.run.smithi159.stdout:# minimal ceph.conf for 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:22.355 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2024-09-19T06:39:22.355 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:22.355 INFO:teuthology.orchestra.run.smithi159.stdout: mon_host = [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-19T06:39:22.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa30c039730 msgr2=0x7fa30c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:22.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa30c039730 0x7fa30c03bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa310009230 tx=0x7fa310005a40 comp rx=0 tx=0).stop 2024-09-19T06:39:22.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c19b1f0 msgr2=0x7fa31c19b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:22.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c19b1f0 0x7fa31c19b6a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa31400ba50 tx=0x7fa31400bf10 comp rx=0 tx=0).stop 2024-09-19T06:39:22.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 shutdown_connections 2024-09-19T06:39:22.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa30c039730 0x7fa30c03bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa31c19b1f0 0x7fa31c19b6a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31c196920 0x7fa31c19acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 --2- 172.21.15.159:0/3496668270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa31c106650 0x7fa31c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 >> 172.21.15.159:0/3496668270 conn(0x7fa31c0fc280 msgr2=0x7fa31c0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:22.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 shutdown_connections 2024-09-19T06:39:22.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:22.356+0000 7fa323166640 1 -- 172.21.15.159:0/3496668270 wait complete. 2024-09-19T06:39:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: mon.c calling monitor election 2024-09-19T06:39:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:39:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: mon.a calling monitor election 2024-09-19T06:39:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:39:22.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: monmap epoch 3 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: last_changed 2024-09-19T06:39:15.585847+0000 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: min_mon_release 19 (squid) 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: election_strategy: 1 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: 2: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: fsmap 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: mgrmap e13: x(active, since 47s) 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: overall HEALTH_OK 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:22.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:22.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:22.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:22.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:22.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/4103355036' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:39:22.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:22.891 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:23.064 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T06:39:23.064 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:39:23.064 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:39:23.091 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:39:23.091 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:39:23.159 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:39:23.159 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:39:23.187 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:39:23.187 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:39:23.252 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:39:23.252 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:39:23.280 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:39:23.280 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:39:23.345 INFO:tasks.cephadm:Adding mgr.x on smithi159 2024-09-19T06:39:23.346 INFO:tasks.cephadm:Adding mgr.y on smithi189 2024-09-19T06:39:23.346 INFO:tasks.cephadm:Adding mgr.z on smithi203 2024-09-19T06:39:23.346 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi159=x;smithi189=y;smithi203=z' 2024-09-19T06:39:23.442 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: mon.b calling monitor election 2024-09-19T06:39:23.442 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: mon.b calling monitor election 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: mon.c calling monitor election 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: mon.a calling monitor election 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: monmap epoch 3 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: last_changed 2024-09-19T06:39:15.585847+0000 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: min_mon_release 19 (squid) 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: election_strategy: 1 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: 2: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-19T06:39:23.443 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: fsmap 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: mgrmap e13: x(active, since 49s) 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: overall HEALTH_OK 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:23.444 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: mon.b calling monitor election 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: mon.b calling monitor election 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: mon.c calling monitor election 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: mon.a calling monitor election 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: monmap epoch 3 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: last_changed 2024-09-19T06:39:15.585847+0000 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:39:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: min_mon_release 19 (squid) 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: election_strategy: 1 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: 2: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: fsmap 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: mgrmap e13: x(active, since 49s) 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: overall HEALTH_OK 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:23.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:23.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:23.623 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: mon.b calling monitor election 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: mon.b calling monitor election 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: mon.c calling monitor election 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: mon.a calling monitor election 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: monmap epoch 3 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: last_changed 2024-09-19T06:39:15.585847+0000 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: created 2024-09-19T06:37:35.440913+0000 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: min_mon_release 19 (squid) 2024-09-19T06:39:23.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: election_strategy: 1 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: 2: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: fsmap 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: mgrmap e13: x(active, since 49s) 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: overall HEALTH_OK 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.640 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:23.640 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:23.640 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:23.640 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:24.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.043+0000 7fc21e832640 1 -- 172.21.15.203:0/1350953604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2181005e0 msgr2=0x7fc2181009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.043+0000 7fc21e832640 1 --2- 172.21.15.203:0/1350953604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2181005e0 0x7fc2181009e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc208009880 tx=0x7fc20802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.043+0000 7fc21e832640 1 -- 172.21.15.203:0/1350953604 shutdown_connections 2024-09-19T06:39:24.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.043+0000 7fc21e832640 1 --2- 172.21.15.203:0/1350953604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2181005e0 0x7fc2181009e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.043+0000 7fc21e832640 1 -- 172.21.15.203:0/1350953604 >> 172.21.15.203:0/1350953604 conn(0x7fc2180fbdb0 msgr2=0x7fc2180fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:24.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.043+0000 7fc21e832640 1 -- 172.21.15.203:0/1350953604 shutdown_connections 2024-09-19T06:39:24.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.043+0000 7fc21e832640 1 -- 172.21.15.203:0/1350953604 wait complete. 2024-09-19T06:39:24.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc21e832640 1 Processor -- start 2024-09-19T06:39:24.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc21e832640 1 -- start start 2024-09-19T06:39:24.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc21e832640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2181005e0 0x7fc21806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:24.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc21e832640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc218199ce0 0x7fc21819c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:24.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc21e832640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc21819c660 0x7fc21819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:24.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc21e832640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc2181066d0 con 0x7fc218199ce0 2024-09-19T06:39:24.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc21e832640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc218106550 con 0x7fc21819c660 2024-09-19T06:39:24.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc21e832640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc218106850 con 0x7fc2181005e0 2024-09-19T06:39:24.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc218199ce0 0x7fc21819c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:24.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc218199ce0 0x7fc21819c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.203:35494/0 (socket says 172.21.15.203:35494) 2024-09-19T06:39:24.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc2177fe640 1 -- 172.21.15.203:0/1427879297 learned_addr learned my addr 172.21.15.203:0/1427879297 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:39:24.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc217fff640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2181005e0 0x7fc21806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:24.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.044+0000 7fc21cdcf640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc21819c660 0x7fc21819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:24.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc2177fe640 1 -- 172.21.15.203:0/1427879297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2181005e0 msgr2=0x7fc21806a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc2177fe640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2181005e0 0x7fc21806a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc2177fe640 1 -- 172.21.15.203:0/1427879297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc21819c660 msgr2=0x7fc21819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc2177fe640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc21819c660 0x7fc21819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc2177fe640 1 -- 172.21.15.203:0/1427879297 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21819f3c0 con 0x7fc218199ce0 2024-09-19T06:39:24.050 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc2177fe640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc218199ce0 0x7fc21819c0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc20000b520 tx=0x7fc20000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:24.052 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc2157fa640 1 -- 172.21.15.203:0/1427879297 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200004230 con 0x7fc218199ce0 2024-09-19T06:39:24.052 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc2157fa640 1 -- 172.21.15.203:0/1427879297 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2000043d0 con 0x7fc218199ce0 2024-09-19T06:39:24.052 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc2157fa640 1 -- 172.21.15.203:0/1427879297 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200003d60 con 0x7fc218199ce0 2024-09-19T06:39:24.052 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21819f6b0 con 0x7fc218199ce0 2024-09-19T06:39:24.052 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.045+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21819fc70 con 0x7fc218199ce0 2024-09-19T06:39:24.052 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.046+0000 7fc2157fa640 1 -- 172.21.15.203:0/1427879297 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fc20000e070 con 0x7fc218199ce0 2024-09-19T06:39:24.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.046+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21818f490 con 0x7fc218199ce0 2024-09-19T06:39:24.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.046+0000 7fc2157fa640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc204039730 0x7fc20403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:24.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.046+0000 7fc2157fa640 1 -- 172.21.15.203:0/1427879297 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc20004be40 con 0x7fc218199ce0 2024-09-19T06:39:24.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.047+0000 7fc217fff640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc204039730 0x7fc20403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:24.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.047+0000 7fc217fff640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc204039730 0x7fc20403bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2080314e0 tx=0x7fc2080315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:24.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.051+0000 7fc2157fa640 1 -- 172.21.15.203:0/1427879297 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc200014020 con 0x7fc218199ce0 2024-09-19T06:39:24.229 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.227+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi159=x;smithi189=y;smithi203=z", "target": ["mon-mgr", ""]}) -- 0x7fc2180626c0 con 0x7fc204039730 2024-09-19T06:39:24.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.233+0000 7fc2157fa640 1 -- 172.21.15.203:0/1427879297 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc2180626c0 con 0x7fc204039730 2024-09-19T06:39:24.235 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mgr update... 2024-09-19T06:39:24.237 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc204039730 msgr2=0x7fc20403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.237 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc204039730 0x7fc20403bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2080314e0 tx=0x7fc2080315d0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.237 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc218199ce0 msgr2=0x7fc21819c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.237 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc218199ce0 0x7fc21819c0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc20000b520 tx=0x7fc20000b9e0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.237 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 shutdown_connections 2024-09-19T06:39:24.238 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc204039730 0x7fc20403bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.238 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc21819c660 0x7fc21819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.238 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc218199ce0 0x7fc21819c0d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.238 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 --2- 172.21.15.203:0/1427879297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2181005e0 0x7fc21806a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.238 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 >> 172.21.15.203:0/1427879297 conn(0x7fc2180fbdb0 msgr2=0x7fc2180fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:24.238 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 shutdown_connections 2024-09-19T06:39:24.238 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:39:24.235+0000 7fc21e832640 1 -- 172.21.15.203:0/1427879297 wait complete. 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: Reconfiguring mon.a (monmap changed)... 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: Reconfiguring daemon mon.a on smithi159 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:24.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:24.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:24 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:24.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:24.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:24.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:24.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: Reconfiguring mon.a (monmap changed)... 2024-09-19T06:39:24.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: Reconfiguring daemon mon.a on smithi159 2024-09-19T06:39:24.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:24.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:24.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:24.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:24.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:24 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:24.739 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:24.739 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: Reconfiguring mon.a (monmap changed)... 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: Reconfiguring daemon mon.a on smithi159 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:24.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:24 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:24.840 DEBUG:teuthology.orchestra.run.smithi189:mgr.y> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T06:39:24.843 DEBUG:teuthology.orchestra.run.smithi203:mgr.z> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T06:39:24.845 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T06:39:24.845 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:39:24.845 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:39:24.861 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:39:24.862 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-09-19T06:39:24.918 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:39:24.918 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:24.918 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T06:39:24.918 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:24.918 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:24.918 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-19 06:38:43.742311237 +0000 2024-09-19T06:39:24.918 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-19 06:33:55.908417164 +0000 2024-09-19T06:39:24.918 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-19 06:33:55.908417164 +0000 2024-09-19T06:39:24.918 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-19 06:33:55.908417164 +0000 2024-09-19T06:39:24.918 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:39:24.982 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-19T06:39:24.983 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-19T06:39:24.983 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000206888 s, 2.5 MB/s 2024-09-19T06:39:24.984 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:39:25.040 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-09-19T06:39:25.096 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:39:25.096 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:25.096 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T06:39:25.096 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:25.096 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:25.096 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-19 06:38:43.777310601 +0000 2024-09-19T06:39:25.096 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-19 06:33:56.230411239 +0000 2024-09-19T06:39:25.096 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-19 06:33:56.230411239 +0000 2024-09-19T06:39:25.097 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-19 06:33:56.230411239 +0000 2024-09-19T06:39:25.097 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:39:25.159 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-19T06:39:25.160 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-19T06:39:25.160 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000206424 s, 2.5 MB/s 2024-09-19T06:39:25.161 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:39:25.217 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-09-19T06:39:25.273 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:39:25.273 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:25.273 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T06:39:25.273 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:25.273 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:25.273 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-19 06:38:43.810310002 +0000 2024-09-19T06:39:25.273 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-19 06:33:56.566405056 +0000 2024-09-19T06:39:25.273 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-19 06:33:56.566405056 +0000 2024-09-19T06:39:25.273 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-19 06:33:56.566405056 +0000 2024-09-19T06:39:25.274 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:39:25.336 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-19T06:39:25.336 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-19T06:39:25.336 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000198647 s, 2.6 MB/s 2024-09-19T06:39:25.337 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:39:25.394 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-09-19T06:39:25.449 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:39:25.450 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:25.450 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T06:39:25.450 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:25.450 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:25.450 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-19 06:38:43.845309366 +0000 2024-09-19T06:39:25.450 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-19 06:33:56.899398929 +0000 2024-09-19T06:39:25.450 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-19 06:33:56.899398929 +0000 2024-09-19T06:39:25.450 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-19 06:33:56.899398929 +0000 2024-09-19T06:39:25.450 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:39:25.511 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:25 smithi159 ceph-mon[30935]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi159=x;smithi189=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:25.511 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:25 smithi159 ceph-mon[30935]: Saving service mgr spec with placement smithi159=x;smithi189=y;smithi203=z;count:3 2024-09-19T06:39:25.511 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:25 smithi159 ceph-mon[30935]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:39:25.512 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:25 smithi159 ceph-mon[30935]: Reconfiguring daemon mgr.x on smithi159 2024-09-19T06:39:25.513 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-19T06:39:25.513 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-19T06:39:25.514 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000168981 s, 3.0 MB/s 2024-09-19T06:39:25.515 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:39:25.573 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-19T06:39:25.573 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:39:25.592 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:39:25.592 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-19T06:39:25.637 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:25 smithi189 ceph-mon[34880]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi159=x;smithi189=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:25.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:25 smithi189 ceph-mon[34880]: Saving service mgr spec with placement smithi159=x;smithi189=y;smithi203=z;count:3 2024-09-19T06:39:25.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:25 smithi189 ceph-mon[34880]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:39:25.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:25 smithi189 ceph-mon[34880]: Reconfiguring daemon mgr.x on smithi159 2024-09-19T06:39:25.651 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:39:25.651 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:25.651 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T06:39:25.651 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:25.651 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:25.651 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-19 06:39:15.048012522 +0000 2024-09-19T06:39:25.651 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-19 06:34:10.852325410 +0000 2024-09-19T06:39:25.652 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-19 06:34:10.852325410 +0000 2024-09-19T06:39:25.652 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-19 06:34:10.852325410 +0000 2024-09-19T06:39:25.652 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:39:25.716 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-19T06:39:25.716 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-19T06:39:25.717 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000279478 s, 1.8 MB/s 2024-09-19T06:39:25.718 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:39:25.774 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-19T06:39:25.830 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:39:25.830 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:25.831 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T06:39:25.831 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:25.831 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:25.831 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-19 06:39:15.048012522 +0000 2024-09-19T06:39:25.831 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-19 06:34:11.174318870 +0000 2024-09-19T06:39:25.831 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-19 06:34:11.174318870 +0000 2024-09-19T06:39:25.831 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-19 06:34:11.174318870 +0000 2024-09-19T06:39:25.831 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:39:25.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:25 smithi203 ceph-mon[35473]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi159=x;smithi189=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:25.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:25 smithi203 ceph-mon[35473]: Saving service mgr spec with placement smithi159=x;smithi189=y;smithi203=z;count:3 2024-09-19T06:39:25.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:25 smithi203 ceph-mon[35473]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:39:25.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:25 smithi203 ceph-mon[35473]: Reconfiguring daemon mgr.x on smithi159 2024-09-19T06:39:25.897 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-19T06:39:25.897 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-19T06:39:25.897 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000186919 s, 2.7 MB/s 2024-09-19T06:39:25.898 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:39:25.955 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-19T06:39:26.011 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:39:26.011 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:26.011 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-19T06:39:26.012 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:26.012 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:26.012 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-19 06:39:15.049012502 +0000 2024-09-19T06:39:26.012 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-19 06:34:11.524311762 +0000 2024-09-19T06:39:26.012 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-19 06:34:11.524311762 +0000 2024-09-19T06:39:26.012 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-19 06:34:11.524311762 +0000 2024-09-19T06:39:26.012 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:39:26.076 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-19T06:39:26.076 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-19T06:39:26.076 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000190087 s, 2.7 MB/s 2024-09-19T06:39:26.077 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:39:26.134 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-19T06:39:26.191 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:39:26.192 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:26.192 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-19T06:39:26.192 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:26.192 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:26.192 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-19 06:39:15.049012502 +0000 2024-09-19T06:39:26.193 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-19 06:34:11.843305283 +0000 2024-09-19T06:39:26.193 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-19 06:34:11.843305283 +0000 2024-09-19T06:39:26.193 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-19 06:34:11.843305283 +0000 2024-09-19T06:39:26.193 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:39:26.257 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-19T06:39:26.258 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-19T06:39:26.258 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000187696 s, 2.7 MB/s 2024-09-19T06:39:26.259 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:39:26.319 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T06:39:26.320 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:39:26.340 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:39:26.340 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-09-19T06:39:26.398 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:39:26.399 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:26.399 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-19T06:39:26.399 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:26.399 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:26.399 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 06:39:05.898361948 +0000 2024-09-19T06:39:26.399 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 06:34:26.584431336 +0000 2024-09-19T06:39:26.399 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 06:34:26.584431336 +0000 2024-09-19T06:39:26.399 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 06:34:26.584431336 +0000 2024-09-19T06:39:26.399 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:39:26.468 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T06:39:26.469 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T06:39:26.469 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000324185 s, 1.6 MB/s 2024-09-19T06:39:26.470 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:39:26.530 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-09-19T06:39:26.589 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:39:26.589 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:26.589 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-19T06:39:26.589 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:26.589 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:26.589 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 06:39:05.899361923 +0000 2024-09-19T06:39:26.589 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 06:34:26.933422331 +0000 2024-09-19T06:39:26.590 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 06:34:26.933422331 +0000 2024-09-19T06:39:26.590 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 06:34:26.933422331 +0000 2024-09-19T06:39:26.590 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:39:26.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:26 smithi189 ceph-mon[34880]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:26.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:26.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:26.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:26.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:26.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:26.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:26 smithi159 ceph-mon[30935]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:26.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:26.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:26.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:26.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:26.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:26.653 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:26 smithi203 ceph-mon[35473]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:26.653 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:26.653 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:26.653 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:26.653 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:26.653 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:26.657 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T06:39:26.657 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T06:39:26.657 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000204988 s, 2.5 MB/s 2024-09-19T06:39:26.658 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:39:26.717 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-09-19T06:39:26.775 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:39:26.775 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:26.776 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T06:39:26.776 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:26.776 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:26.776 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 06:39:05.899361923 +0000 2024-09-19T06:39:26.776 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 06:34:27.271413609 +0000 2024-09-19T06:39:26.776 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 06:34:27.271413609 +0000 2024-09-19T06:39:26.776 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 06:34:27.271413609 +0000 2024-09-19T06:39:26.776 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:39:26.844 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T06:39:26.844 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T06:39:26.844 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000210181 s, 2.4 MB/s 2024-09-19T06:39:26.845 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:39:26.905 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-09-19T06:39:26.963 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:39:26.964 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:39:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-19T06:39:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:39:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:39:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 06:39:05.899361923 +0000 2024-09-19T06:39:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 06:34:27.601405094 +0000 2024-09-19T06:39:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 06:34:27.601405094 +0000 2024-09-19T06:39:26.964 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 06:34:27.601405094 +0000 2024-09-19T06:39:26.964 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:39:27.029 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T06:39:27.029 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T06:39:27.029 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000188889 s, 2.7 MB/s 2024-09-19T06:39:27.031 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:39:27.089 INFO:tasks.cephadm:Deploying osd.0 on smithi159 with /dev/vg_nvme/lv_4... 2024-09-19T06:39:27.089 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:39:27.341 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:27.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:27 smithi189 ceph-mon[34880]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:39:27.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:27 smithi189 ceph-mon[34880]: Reconfiguring daemon mon.b on smithi189 2024-09-19T06:39:27.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:27.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:27.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:27.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:27.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:27.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:27 smithi159 ceph-mon[30935]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:39:27.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:27 smithi159 ceph-mon[30935]: Reconfiguring daemon mon.b on smithi189 2024-09-19T06:39:27.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:27.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:27.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:27.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:27.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:27.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:27 smithi203 ceph-mon[35473]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:39:27.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:27 smithi203 ceph-mon[35473]: Reconfiguring daemon mon.b on smithi189 2024-09-19T06:39:27.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:27.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:27.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:39:27.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:39:27.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:28.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:39:28.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: Reconfiguring daemon mon.c on smithi203 2024-09-19T06:39:28.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:28.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:28.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:28.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:28.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:28.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:28.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:28.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:28.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:39:28.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:28.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:28.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:39:28.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: Reconfiguring daemon mon.c on smithi203 2024-09-19T06:39:28.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:28.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:28.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:28.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:28.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:28.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:28.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:28.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:28.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:39:28.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:28.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: Reconfiguring daemon mon.c on smithi203 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:28.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:39:28.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:28.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:29.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:29 smithi189 ceph-mon[34880]: Deploying daemon mgr.z on smithi203 2024-09-19T06:39:29.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:29 smithi159 ceph-mon[30935]: Deploying daemon mgr.z on smithi203 2024-09-19T06:39:29.674 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:29 smithi203 ceph-mon[35473]: Deploying daemon mgr.z on smithi203 2024-09-19T06:39:29.715 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:39:29.743 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_4 2024-09-19T06:39:29.987 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:30.315 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 systemd[1]: Starting Ceph mgr.z for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:39:30.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.431+0000 7f9005e76640 1 -- 172.21.15.159:0/2134495862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 msgr2=0x7f9000100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.431+0000 7f9005e76640 1 --2- 172.21.15.159:0/2134495862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 0x7f9000100f10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009900 tx=0x7f8ff002a410 comp rx=0 tx=0).stop 2024-09-19T06:39:30.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.431+0000 7f9005e76640 1 -- 172.21.15.159:0/2134495862 shutdown_connections 2024-09-19T06:39:30.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.431+0000 7f9005e76640 1 --2- 172.21.15.159:0/2134495862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90001026d0 0x7f9000108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.431+0000 7f9005e76640 1 --2- 172.21.15.159:0/2134495862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9000101d10 0x7f9000102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.431+0000 7f9005e76640 1 --2- 172.21.15.159:0/2134495862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 0x7f9000100f10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.431+0000 7f9005e76640 1 -- 172.21.15.159:0/2134495862 >> 172.21.15.159:0/2134495862 conn(0x7f90000fc2a0 msgr2=0x7f90000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.431+0000 7f9005e76640 1 -- 172.21.15.159:0/2134495862 shutdown_connections 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.431+0000 7f9005e76640 1 -- 172.21.15.159:0/2134495862 wait complete. 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.432+0000 7f9005e76640 1 Processor -- start 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.432+0000 7f9005e76640 1 -- start start 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.432+0000 7f9005e76640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 0x7f9000196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.432+0000 7f9005e76640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9000101d10 0x7f90001974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.432+0000 7f9005e76640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90001026d0 0x7f900019e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f9005e76640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f900010c870 con 0x7f9000100b10 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f9005e76640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f900010c6f0 con 0x7f9000101d10 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f9005e76640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f900010c9f0 con 0x7f90001026d0 2024-09-19T06:39:30.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8fff7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 0x7f9000196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8fff7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 0x7f9000196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35858/0 (socket says 172.21.15.159:35858) 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8fff7fe640 1 -- 172.21.15.159:0/421755807 learned_addr learned my addr 172.21.15.159:0/421755807 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8ffffff640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90001026d0 0x7f900019e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8ffeffd640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9000101d10 0x7f90001974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8fff7fe640 1 -- 172.21.15.159:0/421755807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90001026d0 msgr2=0x7f900019e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8fff7fe640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90001026d0 0x7f900019e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8fff7fe640 1 -- 172.21.15.159:0/421755807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9000101d10 msgr2=0x7f90001974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8fff7fe640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9000101d10 0x7f90001974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8fff7fe640 1 -- 172.21.15.159:0/421755807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900019ebb0 con 0x7f9000100b10 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8ffffff640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90001026d0 0x7f900019e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8ffeffd640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9000101d10 0x7f90001974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:30.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8fff7fe640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 0x7f9000196f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0031610 tx=0x7f8ff00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8ffcff9640 1 -- 172.21.15.159:0/421755807 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff003f030 con 0x7f9000100b10 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8ffcff9640 1 -- 172.21.15.159:0/421755807 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ff0003ce0 con 0x7f9000100b10 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900019ee40 con 0x7f9000100b10 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f8ffcff9640 1 -- 172.21.15.159:0/421755807 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0035070 con 0x7f9000100b10 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.433+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f900019f310 con 0x7f9000100b10 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.434+0000 7f8ffcff9640 1 -- 172.21.15.159:0/421755807 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f8ff0042030 con 0x7f9000100b10 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.434+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9000108000 con 0x7f9000100b10 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.434+0000 7f8ffcff9640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8fe8039500 0x7f8fe803b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.434+0000 7f8ffcff9640 1 -- 172.21.15.159:0/421755807 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8ff006ccb0 con 0x7f9000100b10 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.435+0000 7f8ffeffd640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8fe8039500 0x7f8fe803b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.435+0000 7f8ffeffd640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8fe8039500 0x7f8fe803b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90001984a0 tx=0x7f8ff4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.439+0000 7f8ffcff9640 1 -- 172.21.15.159:0/421755807 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ff00438e0 con 0x7f9000100b10 2024-09-19T06:39:30.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:30 smithi203 ceph-mon[35473]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:30.592 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 podman[37270]: 2024-09-19 06:39:30.21735631 +0000 UTC m=+0.015570270 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:39:30.592 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 podman[37270]: 2024-09-19 06:39:30.326101966 +0000 UTC m=+0.124315968 container create cd0004496eb1f139ba3db94b22e152517d9df03232ea4c36f9ae60288e654c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:39:30.592 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 podman[37270]: 2024-09-19 06:39:30.528630576 +0000 UTC m=+0.326844550 container init cd0004496eb1f139ba3db94b22e152517d9df03232ea4c36f9ae60288e654c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:39:30.592 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 podman[37270]: 2024-09-19 06:39:30.532138332 +0000 UTC m=+0.330352292 container start cd0004496eb1f139ba3db94b22e152517d9df03232ea4c36f9ae60288e654c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T06:39:30.593 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 ceph-mgr[37288]: -- 172.21.15.203:0/3083993463 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc5ac550e0 con 0x55fc5ac32800 2024-09-19T06:39:30.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:30.614+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9000062630 con 0x7f8fe8039500 2024-09-19T06:39:30.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:30 smithi159 ceph-mon[30935]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:30.875 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 bash[37270]: cd0004496eb1f139ba3db94b22e152517d9df03232ea4c36f9ae60288e654c6e 2024-09-19T06:39:30.875 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 systemd[1]: Started Ceph mgr.z for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:39:30.875 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:30.662+0000 7f6586606040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:39:30.875 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:30.724+0000 7f6586606040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:39:30.875 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:30.873+0000 7f6586606040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:39:30.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:30 smithi189 ceph-mon[34880]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:31.231 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:30.940+0000 7f6586606040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:39:31.231 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:31.089+0000 7f6586606040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:39:31.231 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:31.229+0000 7f6586606040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:39:31.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:39:31.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:39:31.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:31.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:31.551 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:31.551 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:31.551 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:31.551 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:39:31.551 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:31.551 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:39:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:39:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:39:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:31.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:31.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:31.842 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:31.549+0000 7f6586606040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:39:31.842 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:31.610+0000 7f6586606040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:39:31.842 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:31.796+0000 7f6586606040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:39:32.626 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:32 smithi189 ceph-mon[34880]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:32.627 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:32 smithi189 ceph-mon[34880]: Deploying daemon mgr.y on smithi189 2024-09-19T06:39:32.627 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:32 smithi189 ceph-mon[34880]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:32.627 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:32 smithi189 systemd[1]: Starting Ceph mgr.y for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:39:32.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:32 smithi159 ceph-mon[30935]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:32.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:32 smithi159 ceph-mon[30935]: Deploying daemon mgr.y on smithi189 2024-09-19T06:39:32.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:32 smithi159 ceph-mon[30935]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:32.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:32 smithi203 ceph-mon[35473]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:32.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:32 smithi203 ceph-mon[35473]: Deploying daemon mgr.y on smithi189 2024-09-19T06:39:32.689 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:32 smithi203 ceph-mon[35473]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:32.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:32 smithi189 podman[36237]: 2024-09-19 06:39:32.528301924 +0000 UTC m=+0.015849994 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:39:32.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:32 smithi189 podman[36237]: 2024-09-19 06:39:32.631193792 +0000 UTC m=+0.118741904 container create a25f5e01e5272c7c7369871719fba9a068103153ca6aeaf776678f224d33a19c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:39:32.889 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:32 smithi189 podman[36237]: 2024-09-19 06:39:32.816956625 +0000 UTC m=+0.304504696 container init a25f5e01e5272c7c7369871719fba9a068103153ca6aeaf776678f224d33a19c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T06:39:32.889 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:32 smithi189 podman[36237]: 2024-09-19 06:39:32.819737775 +0000 UTC m=+0.307285837 container start a25f5e01e5272c7c7369871719fba9a068103153ca6aeaf776678f224d33a19c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T06:39:32.889 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:32 smithi189 ceph-mgr[36256]: -- 172.21.15.189:0/2380467699 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560eb1a5b0e0 con 0x560eb1a39400 2024-09-19T06:39:33.091 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:32.687+0000 7f6586606040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:39:33.091 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:32.755+0000 7f6586606040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:39:33.160 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:32 smithi189 bash[36237]: a25f5e01e5272c7c7369871719fba9a068103153ca6aeaf776678f224d33a19c 2024-09-19T06:39:33.160 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:32 smithi189 systemd[1]: Started Ceph mgr.y for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:39:33.160 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:32 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:32.942+0000 7f7c34ecd040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:39:33.161 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:33.002+0000 7f7c34ecd040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:39:33.161 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:33.159+0000 7f7c34ecd040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:39:33.442 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:33.228+0000 7f7c34ecd040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:39:33.443 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:33.395+0000 7f7c34ecd040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:39:33.443 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/198367732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2486cf57-4865-4e17-9c7f-77f87827299c"}]: dispatch 2024-09-19T06:39:33.443 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/198367732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2486cf57-4865-4e17-9c7f-77f87827299c"}]': finished 2024-09-19T06:39:33.443 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:39:33.443 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:33.443 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.443 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.443 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.444 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.444 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:33.444 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/198367732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2486cf57-4865-4e17-9c7f-77f87827299c"}]: dispatch 2024-09-19T06:39:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/198367732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2486cf57-4865-4e17-9c7f-77f87827299c"}]': finished 2024-09-19T06:39:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:39:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:33.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.654 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:33.523+0000 7f6586606040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:39:33.654 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:33.639+0000 7f6586606040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:39:33.654 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/198367732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2486cf57-4865-4e17-9c7f-77f87827299c"}]: dispatch 2024-09-19T06:39:33.654 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/198367732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2486cf57-4865-4e17-9c7f-77f87827299c"}]': finished 2024-09-19T06:39:33.654 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:39:33.654 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:33.655 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.655 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.655 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.655 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.655 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:33.655 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:33.709 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:33.549+0000 7f7c34ecd040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:39:34.013 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:33.797+0000 7f6586606040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:39:34.013 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:33.858+0000 7f6586606040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:39:34.013 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:34.012+0000 7f6586606040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:39:34.127 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:33.875+0000 7f7c34ecd040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:39:34.127 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:33.936+0000 7f7c34ecd040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:39:34.314 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:34.083+0000 7f6586606040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:39:34.315 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:34.150+0000 7f6586606040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:39:34.315 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:34.313+0000 7f6586606040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:39:34.388 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:34.125+0000 7f7c34ecd040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:39:34.591 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:34.382+0000 7f6586606040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:39:34.592 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:34.449+0000 7f6586606040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:39:34.592 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:34.532+0000 7f6586606040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:39:34.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:34.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1487538340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:39:34.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:34.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:34.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:34.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:34.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:34.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1487538340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:39:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1487538340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:39:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:35.091 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:34.591+0000 7f6586606040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:39:35.091 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:34.651+0000 7f6586606040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:39:35.388 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:35.020+0000 7f7c34ecd040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:39:35.388 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:35.086+0000 7f7c34ecd040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:39:35.841 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:39:35 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:39:35.439+0000 7f6586606040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:39:36.058 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:35.802+0000 7f7c34ecd040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:39:36.058 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:35.915+0000 7f7c34ecd040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:39:36.058 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.057+0000 7f7c34ecd040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:39:36.334 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.118+0000 7f7c34ecd040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:39:36.334 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.265+0000 7f7c34ecd040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:39:36.334 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.332+0000 7f7c34ecd040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:39:36.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:36.402+0000 7f8ffcff9640 1 -- 172.21.15.159:0/421755807 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 14) ==== 92409+0+0 (secure 0 0 0) 0x7f8ff00433c0 con 0x7f9000100b10 2024-09-19T06:39:36.616 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.391+0000 7f7c34ecd040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:39:36.617 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.550+0000 7f7c34ecd040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:39:36.617 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.615+0000 7f7c34ecd040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:39:36.617 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-mon[34880]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:36.617 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-mon[34880]: Standby manager daemon z started 2024-09-19T06:39:36.617 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:39:36.617 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:39:36.617 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:39:36.617 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:39:36.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:36 smithi159 ceph-mon[30935]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:36.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:36 smithi159 ceph-mon[30935]: Standby manager daemon z started 2024-09-19T06:39:36.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:36 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:39:36.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:36 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:39:36.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:36 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:39:36.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:36 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:39:36.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:36 smithi203 ceph-mon[35473]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:36.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:36 smithi203 ceph-mon[35473]: Standby manager daemon z started 2024-09-19T06:39:36.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:36 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:39:36.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:36 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:39:36.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:36 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:39:36.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:36 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.203:0/1602625472' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:39:36.883 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.681+0000 7f7c34ecd040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:39:36.883 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.763+0000 7f7c34ecd040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:39:36.883 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.822+0000 7f7c34ecd040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:39:36.883 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:36.881+0000 7f7c34ecd040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:39:37.663 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:37 smithi189 ceph-mon[34880]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T06:39:37.663 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:37 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:39:37.693 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:37 smithi159 ceph-mon[30935]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T06:39:37.693 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:39:37.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:37 smithi203 ceph-mon[35473]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T06:39:37.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:37 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:39:38.138 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:39:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:39:37.662+0000 7f7c34ecd040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:39:38.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:38.414+0000 7f8ffcff9640 1 -- 172.21.15.159:0/421755807 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f8ff006c2a0 con 0x7f9000100b10 2024-09-19T06:39:38.572 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:38 smithi159 ceph-mon[30935]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:38.573 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:38 smithi159 ceph-mon[30935]: Standby manager daemon y started 2024-09-19T06:39:38.573 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:38 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:39:38.573 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:38 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:39:38.573 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:38 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:39:38.573 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:38 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:39:38.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:38 smithi203 ceph-mon[35473]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:38 smithi203 ceph-mon[35473]: Standby manager daemon y started 2024-09-19T06:39:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:38 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:39:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:38 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:39:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:38 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:39:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:38 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:39:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:38 smithi189 ceph-mon[34880]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:38 smithi189 ceph-mon[34880]: Standby manager daemon y started 2024-09-19T06:39:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:38 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:39:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:38 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:39:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:38 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:39:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:38 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.189:0/3506672870' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:39:39.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:39 smithi159 ceph-mon[30935]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T06:39:39.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:39:39.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:39 smithi203 ceph-mon[35473]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T06:39:39.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:39:39.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:39 smithi189 ceph-mon[34880]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T06:39:39.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:39:40.474 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:40 smithi159 ceph-mon[30935]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:40.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:40 smithi203 ceph-mon[35473]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:40.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:40 smithi189 ceph-mon[34880]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:41.743 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:41 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:39:41.743 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:41 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:41.763 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:41 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:39:41.763 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:41 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:41.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:41 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:39:41.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:41 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:42.641 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:42 smithi159 ceph-mon[30935]: Deploying daemon osd.0 on smithi159 2024-09-19T06:39:42.641 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:42 smithi159 ceph-mon[30935]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:42.788 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:42 smithi189 ceph-mon[34880]: Deploying daemon osd.0 on smithi159 2024-09-19T06:39:42.788 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:42 smithi189 ceph-mon[34880]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:42.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:42 smithi203 ceph-mon[35473]: Deploying daemon osd.0 on smithi159 2024-09-19T06:39:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:42 smithi203 ceph-mon[35473]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:44.472 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:44 smithi159 ceph-mon[30935]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:44 smithi203 ceph-mon[35473]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:44 smithi189 ceph-mon[34880]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:46.684 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:46 smithi159 ceph-mon[30935]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:46.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:46 smithi203 ceph-mon[35473]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:46 smithi189 ceph-mon[34880]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:47.697 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:47 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:47.697 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:47 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:47.697 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:47 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:47.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:47 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:47.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:47 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:47.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:47 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:47.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:47 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:47.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:47 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:47.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:47 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:48.700 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:48 smithi159 ceph-mon[30935]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:48.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:48 smithi203 ceph-mon[35473]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:48 smithi189 ceph-mon[34880]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:50.438 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:50 smithi159 ceph-mon[30935]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:50.439 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:50.439 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:50.439 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:50.439 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:50.439 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:50.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.818+0000 7f8ffcff9640 1 -- 172.21.15.159:0/421755807 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9000062630 con 0x7f8fe8039500 2024-09-19T06:39:50.819 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 0 on host 'smithi159' 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8fe8039500 msgr2=0x7f8fe803b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8fe8039500 0x7f8fe803b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90001984a0 tx=0x7f8ff4008040 comp rx=0 tx=0).stop 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 msgr2=0x7f9000196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 0x7f9000196f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0031610 tx=0x7f8ff00043b0 comp rx=0 tx=0).stop 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 shutdown_connections 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8fe8039500 0x7f8fe803b9c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90001026d0 0x7f900019e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9000101d10 0x7f90001974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 --2- 172.21.15.159:0/421755807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9000100b10 0x7f9000196f80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 >> 172.21.15.159:0/421755807 conn(0x7f90000fc2a0 msgr2=0x7f90001051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.820+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 shutdown_connections 2024-09-19T06:39:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:39:50.821+0000 7f9005e76640 1 -- 172.21.15.159:0/421755807 wait complete. 2024-09-19T06:39:50.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:50 smithi203 ceph-mon[35473]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:50.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:50 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:50.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:50 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:50.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:50 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:50.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:50 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:50.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:50 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:50 smithi189 ceph-mon[34880]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:50 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:50 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:50 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:50 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:50 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:51.389 DEBUG:teuthology.orchestra.run.smithi159:osd.0> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T06:39:51.392 INFO:tasks.cephadm:Deploying osd.1 on smithi189 with /dev/vg_nvme/lv_4... 2024-09-19T06:39:51.392 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:39:51.633 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:39:51.638 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:51.638 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:51.638 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:51.753 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:51.753 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:51.753 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:51.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:51.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:51.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:52.638 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:52 smithi159 ceph-mon[30935]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:52.757 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:52 smithi189 ceph-mon[34880]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:52.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:52 smithi203 ceph-mon[35473]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:53.648 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:39:53 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0[45333]: 2024-09-19T06:39:53.576+0000 7fb1a7563640 -1 osd.0 0 log_to_monitors true 2024-09-19T06:39:54.070 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:39:54.098 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-09-19T06:39:54.340 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:39:54.712 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:54 smithi189 ceph-mon[34880]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:54.712 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:54 smithi189 ceph-mon[34880]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:39:54.712 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.712 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.712 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:39:54.712 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.712 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:54.712 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:54.712 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.795+0000 7fd565e8d640 1 -- 172.21.15.189:0/3721917313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 msgr2=0x7fd560102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.795+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3721917313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 0x7fd560102190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd548009900 tx=0x7fd54802a410 comp rx=0 tx=0).stop 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.795+0000 7fd565e8d640 1 -- 172.21.15.189:0/3721917313 shutdown_connections 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.795+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3721917313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5601026d0 0x7fd560108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.795+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3721917313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 0x7fd560102190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.795+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3721917313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd560100b10 0x7fd560100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.795+0000 7fd565e8d640 1 -- 172.21.15.189:0/3721917313 >> 172.21.15.189:0/3721917313 conn(0x7fd5600fc2a0 msgr2=0x7fd5600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.795+0000 7fd565e8d640 1 -- 172.21.15.189:0/3721917313 shutdown_connections 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.795+0000 7fd565e8d640 1 -- 172.21.15.189:0/3721917313 wait complete. 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd565e8d640 1 Processor -- start 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd565e8d640 1 -- start start 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd565e8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560100b10 0x7fd5601980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd565e8d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 0x7fd560198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd565e8d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5601026d0 0x7fd56019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd565e8d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd56010c890 con 0x7fd560100b10 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd565e8d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd56010c710 con 0x7fd560101d10 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd565e8d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd56010ca10 con 0x7fd5601026d0 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 0x7fd560198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 0x7fd560198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56664/0 (socket says 172.21.15.189:56664) 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55effd640 1 -- 172.21.15.189:0/3066165887 learned_addr learned my addr 172.21.15.189:0/3066165887 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55f7fe640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560100b10 0x7fd5601980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55ffff640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5601026d0 0x7fd56019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55effd640 1 -- 172.21.15.189:0/3066165887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5601026d0 msgr2=0x7fd56019f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55effd640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5601026d0 0x7fd56019f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55effd640 1 -- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560100b10 msgr2=0x7fd5601980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55effd640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560100b10 0x7fd5601980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.796+0000 7fd55effd640 1 -- 172.21.15.189:0/3066165887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56019fd10 con 0x7fd560101d10 2024-09-19T06:39:54.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.797+0000 7fd55ffff640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5601026d0 0x7fd56019f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:54.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.797+0000 7fd55effd640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 0x7fd560198620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd548009230 tx=0x7fd548004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:54.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.797+0000 7fd55cff9640 1 -- 172.21.15.189:0/3066165887 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54803f030 con 0x7fd560101d10 2024-09-19T06:39:54.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.797+0000 7fd55cff9640 1 -- 172.21.15.189:0/3066165887 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd548003ce0 con 0x7fd560101d10 2024-09-19T06:39:54.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.797+0000 7fd55cff9640 1 -- 172.21.15.189:0/3066165887 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd548035070 con 0x7fd560101d10 2024-09-19T06:39:54.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.797+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd56019ffa0 con 0x7fd560101d10 2024-09-19T06:39:54.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.797+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5601a0470 con 0x7fd560101d10 2024-09-19T06:39:54.802 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.798+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5601a06a0 con 0x7fd560101d10 2024-09-19T06:39:54.802 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.799+0000 7fd55cff9640 1 -- 172.21.15.189:0/3066165887 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7fd548042030 con 0x7fd560101d10 2024-09-19T06:39:54.802 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.800+0000 7fd55cff9640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd54c0a31e0 0x7fd54c0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.802 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.800+0000 7fd55cff9640 1 -- 172.21.15.189:0/3066165887 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7fd5480ee3c0 con 0x7fd560101d10 2024-09-19T06:39:54.802 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.800+0000 7fd55f7fe640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd54c0a31e0 0x7fd54c0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.802 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.800+0000 7fd55f7fe640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd54c0a31e0 0x7fd54c0a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd560101b70 tx=0x7fd550009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:54.805 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.804+0000 7fd55cff9640 1 -- 172.21.15.189:0/3066165887 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5480bcce0 con 0x7fd560101d10 2024-09-19T06:39:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:54 smithi203 ceph-mon[35473]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:54 smithi203 ceph-mon[35473]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:39:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:39:54.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:54.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:54.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:54 smithi159 ceph-mon[30935]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:54 smithi159 ceph-mon[30935]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:39:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:39:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:39:54.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:39:54.976+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd56006af90 con 0x7fd54c0a31e0 2024-09-19T06:39:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi159 2024-09-19T06:39:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-19T06:39:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:39:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:39:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:39:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:39:55.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:39:55.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:55.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:55 smithi189 ceph-mon[34880]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi159 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:55 smithi203 ceph-mon[35473]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:39:55.898 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0[45333]: 2024-09-19T06:39:55.450+0000 7fb1a34e6640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T06:39:55.898 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0[45333]: 2024-09-19T06:39:55.455+0000 7fb19f30e640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:39:55.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi159 2024-09-19T06:39:55.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-19T06:39:55.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:39:55.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:39:55.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:39:55.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:55.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:39:55.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:39:55.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:55.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:55 smithi159 ceph-mon[30935]: from='osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:39:56.581 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:56 smithi189 ceph-mon[34880]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:56.581 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:56 smithi189 ceph-mon[34880]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:56.581 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:56 smithi189 ceph-mon[34880]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:39:56.581 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:56 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:56.581 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:56 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:56.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:56 smithi203 ceph-mon[35473]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:56 smithi203 ceph-mon[35473]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:56 smithi203 ceph-mon[35473]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:39:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:56 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:56 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:56.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:56 smithi159 ceph-mon[30935]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:56.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:56 smithi159 ceph-mon[30935]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:56.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:56 smithi159 ceph-mon[30935]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:39:56.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:56 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:56.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:56 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] boot 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: from='client.? 172.21.15.189:0/3825430057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84853b71-3763-46a8-bd4d-56bf68801c09"}]: dispatch 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84853b71-3763-46a8-bd4d-56bf68801c09"}]: dispatch 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84853b71-3763-46a8-bd4d-56bf68801c09"}]': finished 2024-09-19T06:39:57.817 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T06:39:57.818 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] boot 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: from='client.? 172.21.15.189:0/3825430057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84853b71-3763-46a8-bd4d-56bf68801c09"}]: dispatch 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84853b71-3763-46a8-bd4d-56bf68801c09"}]: dispatch 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84853b71-3763-46a8-bd4d-56bf68801c09"}]': finished 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T06:39:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:39:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:39:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:39:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: osd.0 [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] boot 2024-09-19T06:39:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:39:57.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:39:57.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: from='client.? 172.21.15.189:0/3825430057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84853b71-3763-46a8-bd4d-56bf68801c09"}]: dispatch 2024-09-19T06:39:57.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84853b71-3763-46a8-bd4d-56bf68801c09"}]: dispatch 2024-09-19T06:39:57.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84853b71-3763-46a8-bd4d-56bf68801c09"}]': finished 2024-09-19T06:39:57.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T06:39:57.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:39:58.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:58 smithi203 ceph-mon[35473]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:58.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:39:58 smithi203 ceph-mon[35473]: from='client.? 172.21.15.189:0/3466893393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:39:58.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:58 smithi189 ceph-mon[34880]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:58.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:39:58 smithi189 ceph-mon[34880]: from='client.? 172.21.15.189:0/3466893393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:39:58.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:58 smithi159 ceph-mon[30935]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:39:58.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:39:58 smithi159 ceph-mon[30935]: from='client.? 172.21.15.189:0/3466893393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:40:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:00 smithi189 ceph-mon[34880]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:00 smithi189 ceph-mon[34880]: overall HEALTH_OK 2024-09-19T06:40:00.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:00 smithi203 ceph-mon[35473]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:00 smithi203 ceph-mon[35473]: overall HEALTH_OK 2024-09-19T06:40:00.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:00 smithi159 ceph-mon[30935]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:00.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:00 smithi159 ceph-mon[30935]: overall HEALTH_OK 2024-09-19T06:40:02.734 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:02 smithi189 ceph-mon[34880]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:02.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:02 smithi203 ceph-mon[35473]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:02 smithi159 ceph-mon[30935]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:04 smithi189 ceph-mon[34880]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:04 smithi203 ceph-mon[35473]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:04.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:04 smithi159 ceph-mon[30935]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:05.821 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:40:05.821 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:05.849 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:40:05.850 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:05.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:40:05.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:06.820 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:06 smithi189 ceph-mon[34880]: Deploying daemon osd.1 on smithi189 2024-09-19T06:40:06.821 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:06 smithi189 ceph-mon[34880]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:06 smithi203 ceph-mon[35473]: Deploying daemon osd.1 on smithi189 2024-09-19T06:40:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:06 smithi203 ceph-mon[35473]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:06.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:06 smithi159 ceph-mon[30935]: Deploying daemon osd.1 on smithi189 2024-09-19T06:40:06.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:06 smithi159 ceph-mon[30935]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:08.789 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:08 smithi189 ceph-mon[34880]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:08.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:08 smithi203 ceph-mon[35473]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:08.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:08 smithi159 ceph-mon[30935]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:10.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:10 smithi189 ceph-mon[34880]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:10 smithi203 ceph-mon[35473]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:10 smithi159 ceph-mon[30935]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:12 smithi189 ceph-mon[34880]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:12 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:12 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:12 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:12.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:12 smithi203 ceph-mon[35473]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:12.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:12 smithi159 ceph-mon[30935]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:14.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:14 smithi189 ceph-mon[34880]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:14.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:14.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:14.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:14.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:14.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:14 smithi203 ceph-mon[35473]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:14 smithi159 ceph-mon[30935]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:15.904 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.902+0000 7fd55cff9640 1 -- 172.21.15.189:0/3066165887 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd56006af90 con 0x7fd54c0a31e0 2024-09-19T06:40:15.904 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 1 on host 'smithi189' 2024-09-19T06:40:15.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.904+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd54c0a31e0 msgr2=0x7fd54c0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.904+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd54c0a31e0 0x7fd54c0a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd560101b70 tx=0x7fd550009110 comp rx=0 tx=0).stop 2024-09-19T06:40:15.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.904+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 msgr2=0x7fd560198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.904+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 0x7fd560198620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd548009230 tx=0x7fd548004430 comp rx=0 tx=0).stop 2024-09-19T06:40:15.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.905+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 shutdown_connections 2024-09-19T06:40:15.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.905+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd54c0a31e0 0x7fd54c0a56a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.905+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5601026d0 0x7fd56019f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.905+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd560101d10 0x7fd560198620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.905+0000 7fd565e8d640 1 --2- 172.21.15.189:0/3066165887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560100b10 0x7fd5601980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.907 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.905+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 >> 172.21.15.189:0/3066165887 conn(0x7fd5600fc2a0 msgr2=0x7fd56006a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:15.907 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.905+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 shutdown_connections 2024-09-19T06:40:15.907 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:40:15.905+0000 7fd565e8d640 1 -- 172.21.15.189:0/3066165887 wait complete. 2024-09-19T06:40:16.536 DEBUG:teuthology.orchestra.run.smithi189:osd.1> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T06:40:16.539 INFO:tasks.cephadm:Deploying osd.2 on smithi203 with /dev/vg_nvme/lv_4... 2024-09-19T06:40:16.539 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:40:16.750 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:16 smithi189 ceph-mon[34880]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:16.751 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:16 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:16.751 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:16 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:16.751 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:16 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:16.792 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:40:16.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:16 smithi203 ceph-mon[35473]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:16.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:16 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:16.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:16 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:16.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:16 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:16.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:16 smithi159 ceph-mon[30935]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:16.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:16 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:16.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:16 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:16.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:16 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:17.888 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:17 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1[39328]: 2024-09-19T06:40:17.829+0000 7fc4f9b0c640 -1 osd.1 0 log_to_monitors true 2024-09-19T06:40:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:18 smithi203 ceph-mon[35473]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:18 smithi203 ceph-mon[35473]: from='osd.1 [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:40:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:18 smithi203 ceph-mon[35473]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:40:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:18 smithi189 ceph-mon[34880]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:18 smithi189 ceph-mon[34880]: from='osd.1 [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:40:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:18 smithi189 ceph-mon[34880]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:40:18.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:18 smithi159 ceph-mon[30935]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:18.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:18 smithi159 ceph-mon[30935]: from='osd.1 [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:40:18.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:18 smithi159 ceph-mon[30935]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:40:19.265 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:40:19.294 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_4 2024-09-19T06:40:19.544 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:40:19.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:40:19.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='osd.1 [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:40:19.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:40:19.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:19.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:40:19.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:40:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:40:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:19.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:40:19.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='osd.1 [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:40:19.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:40:19.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:19.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:40:19.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:19.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:19.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:40:19.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:40:19.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:19.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:40:19.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='osd.1 [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:40:19.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:40:19.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:19.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:40:19.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:19.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:19.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:19.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:40:19.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:40:19.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:20.040 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.031+0000 7f8110c8d640 1 -- 172.21.15.203:0/4260521557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c107900 msgr2=0x7f810c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.031+0000 7f8110c8d640 1 --2- 172.21.15.203:0/4260521557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c107900 0x7f810c109d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8104009ca0 tx=0x7f810402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.032+0000 7f8110c8d640 1 -- 172.21.15.203:0/4260521557 shutdown_connections 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.032+0000 7f8110c8d640 1 --2- 172.21.15.203:0/4260521557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c107900 0x7f810c109d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.032+0000 7f8110c8d640 1 --2- 172.21.15.203:0/4260521557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f810c104fd0 0x7f810c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.032+0000 7f8110c8d640 1 --2- 172.21.15.203:0/4260521557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c1026a0 0x7f810c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.032+0000 7f8110c8d640 1 -- 172.21.15.203:0/4260521557 >> 172.21.15.203:0/4260521557 conn(0x7f810c0fc2a0 msgr2=0x7f810c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.032+0000 7f8110c8d640 1 -- 172.21.15.203:0/4260521557 shutdown_connections 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.032+0000 7f8110c8d640 1 -- 172.21.15.203:0/4260521557 wait complete. 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.032+0000 7f8110c8d640 1 Processor -- start 2024-09-19T06:40:20.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.032+0000 7f8110c8d640 1 -- start start 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8110c8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c1026a0 0x7f810c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8110c8d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c104fd0 0x7f810c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8110c8d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f810c107900 0x7f810c19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8110c8d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f810c10d920 con 0x7f810c1026a0 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8110c8d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f810c10d7a0 con 0x7f810c107900 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8110c8d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f810c10daa0 con 0x7f810c104fd0 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8109d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c104fd0 0x7f810c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8109d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c104fd0 0x7f810c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:51392/0 (socket says 172.21.15.203:51392) 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8109d9b640 1 -- 172.21.15.203:0/3664003247 learned_addr learned my addr 172.21.15.203:0/3664003247 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f810ad9d640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f810c107900 0x7f810c19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:20.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f810a59c640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c1026a0 0x7f810c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8109d9b640 1 -- 172.21.15.203:0/3664003247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f810c107900 msgr2=0x7f810c19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8109d9b640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f810c107900 0x7f810c19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8109d9b640 1 -- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c1026a0 msgr2=0x7f810c197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8109d9b640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c1026a0 0x7f810c197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8109d9b640 1 -- 172.21.15.203:0/3664003247 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c19fb80 con 0x7f810c104fd0 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f810a59c640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c1026a0 0x7f810c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8109d9b640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c104fd0 0x7f810c198490 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00d770 tx=0x7f80fc00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f80fb7fe640 1 -- 172.21.15.203:0/3664003247 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc017070 con 0x7f810c104fd0 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f80fb7fe640 1 -- 172.21.15.203:0/3664003247 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80fc009c30 con 0x7f810c104fd0 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810c19fe70 con 0x7f810c104fd0 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f80fb7fe640 1 -- 172.21.15.203:0/3664003247 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00f620 con 0x7f810c104fd0 2024-09-19T06:40:20.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.033+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810c1a03a0 con 0x7f810c104fd0 2024-09-19T06:40:20.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.034+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f810c0fdd90 con 0x7f810c104fd0 2024-09-19T06:40:20.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.035+0000 7f80fb7fe640 1 -- 172.21.15.203:0/3664003247 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f80fc01a070 con 0x7f810c104fd0 2024-09-19T06:40:20.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.036+0000 7f80fb7fe640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f80f40a31e0 0x7f80f40a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:20.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.036+0000 7f80fb7fe640 1 -- 172.21.15.203:0/3664003247 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7f80fc0cda50 con 0x7f810c104fd0 2024-09-19T06:40:20.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.036+0000 7f810a59c640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f80f40a31e0 0x7f80f40a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:20.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.037+0000 7f810a59c640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f80f40a31e0 0x7f80f40a56a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8100006fd0 tx=0x7f8100008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:20.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.041+0000 7f80fb7fe640 1 -- 172.21.15.203:0/3664003247 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80fc09c0e0 con 0x7f810c104fd0 2024-09-19T06:40:20.218 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:20.217+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f810c062630 con 0x7f80f40a31e0 2024-09-19T06:40:20.388 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1[39328]: 2024-09-19T06:40:19.906+0000 7fc4f5a8f640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T06:40:20.388 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:19 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1[39328]: 2024-09-19T06:40:19.910+0000 7fc4ed8af640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:40:20.818 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:20 smithi203 ceph-mon[35473]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:20.818 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:20 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi189 2024-09-19T06:40:20.819 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:20 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-19T06:40:20.819 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:20.819 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:20 smithi203 ceph-mon[35473]: from='osd.1 ' entity='osd.1' 2024-09-19T06:40:20.819 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:40:20.819 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:40:20.819 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:20.819 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:20 smithi189 ceph-mon[34880]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:20 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi189 2024-09-19T06:40:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:20 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-19T06:40:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:20 smithi189 ceph-mon[34880]: from='osd.1 ' entity='osd.1' 2024-09-19T06:40:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:40:20.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:40:20.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:20.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:20 smithi159 ceph-mon[30935]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:20 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi189 2024-09-19T06:40:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:20 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-19T06:40:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:20 smithi159 ceph-mon[30935]: from='osd.1 ' entity='osd.1' 2024-09-19T06:40:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:40:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:40:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:21.555 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:21 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:40:21.555 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:21 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:40:21.555 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:21 smithi203 ceph-mon[35473]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:21.555 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:21 smithi203 ceph-mon[35473]: osd.1 [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] boot 2024-09-19T06:40:21.556 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:21 smithi203 ceph-mon[35473]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T06:40:21.556 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:21 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:21 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:40:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:21 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:40:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:21 smithi189 ceph-mon[34880]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:21 smithi189 ceph-mon[34880]: osd.1 [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] boot 2024-09-19T06:40:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:21 smithi189 ceph-mon[34880]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T06:40:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:21 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:21.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:21 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:40:21.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:21 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:40:21.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:21 smithi159 ceph-mon[30935]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:21.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:21 smithi159 ceph-mon[30935]: osd.1 [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] boot 2024-09-19T06:40:21.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:21 smithi159 ceph-mon[30935]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T06:40:21.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:21 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:22.832 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:22 smithi203 ceph-mon[35473]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:22.832 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:22 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/344707579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49aa2a29-471b-48e6-97f0-04f58c824dde"}]: dispatch 2024-09-19T06:40:22.832 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:22 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49aa2a29-471b-48e6-97f0-04f58c824dde"}]: dispatch 2024-09-19T06:40:22.832 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:22 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49aa2a29-471b-48e6-97f0-04f58c824dde"}]': finished 2024-09-19T06:40:22.832 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:22 smithi203 ceph-mon[35473]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T06:40:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:22 smithi189 ceph-mon[34880]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:22 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/344707579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49aa2a29-471b-48e6-97f0-04f58c824dde"}]: dispatch 2024-09-19T06:40:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:22 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49aa2a29-471b-48e6-97f0-04f58c824dde"}]: dispatch 2024-09-19T06:40:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:22 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49aa2a29-471b-48e6-97f0-04f58c824dde"}]': finished 2024-09-19T06:40:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:22 smithi189 ceph-mon[34880]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T06:40:22.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:22 smithi159 ceph-mon[30935]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:40:22.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:22 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/344707579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49aa2a29-471b-48e6-97f0-04f58c824dde"}]: dispatch 2024-09-19T06:40:22.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:22 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49aa2a29-471b-48e6-97f0-04f58c824dde"}]: dispatch 2024-09-19T06:40:22.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:22 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49aa2a29-471b-48e6-97f0-04f58c824dde"}]': finished 2024-09-19T06:40:22.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:22 smithi159 ceph-mon[30935]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T06:40:23.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:23.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:23 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/1091581301' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:40:23.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:23.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:23 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/1091581301' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:40:23.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:23.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:23 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/1091581301' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:40:24.799 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:24 smithi159 ceph-mon[30935]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:24.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:24 smithi203 ceph-mon[35473]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:24.864 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:24 smithi189 ceph-mon[34880]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:26 smithi203 ceph-mon[35473]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:26.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:26 smithi189 ceph-mon[34880]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:26.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:26 smithi159 ceph-mon[30935]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:28.825 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:28 smithi203 ceph-mon[35473]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:28 smithi189 ceph-mon[34880]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:28.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:28 smithi159 ceph-mon[30935]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:30.781 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:30 smithi203 ceph-mon[35473]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:30 smithi189 ceph-mon[34880]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:30.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:30 smithi159 ceph-mon[30935]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:31.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:40:31.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:31.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:40:31.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:31.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:40:31.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:32.564 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:32 smithi203 ceph-mon[35473]: Deploying daemon osd.2 on smithi203 2024-09-19T06:40:32.564 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:32 smithi203 ceph-mon[35473]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:32 smithi189 ceph-mon[34880]: Deploying daemon osd.2 on smithi203 2024-09-19T06:40:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:32 smithi189 ceph-mon[34880]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:32.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:32 smithi159 ceph-mon[30935]: Deploying daemon osd.2 on smithi203 2024-09-19T06:40:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:32 smithi159 ceph-mon[30935]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:33.794 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:33 smithi203 ceph-mon[35473]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:33.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:33 smithi189 ceph-mon[34880]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:33.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:33 smithi159 ceph-mon[30935]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:36.552 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:36 smithi203 ceph-mon[35473]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:36.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:36 smithi189 ceph-mon[34880]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:36.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:36 smithi159 ceph-mon[30935]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:37.707 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:37 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:37.707 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:37 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:37.707 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:37 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:37.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:37 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:37.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:37 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:37.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:37 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:37.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:37.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:37.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:38.776 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:38 smithi203 ceph-mon[35473]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:38 smithi189 ceph-mon[34880]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:38.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:38 smithi159 ceph-mon[30935]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:40.739 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:40 smithi203 ceph-mon[35473]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:40.739 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:40 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:40.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:40 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:40.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:40 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:40.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:40 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:40.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:40 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:40.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:40 smithi189 ceph-mon[34880]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:40.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:40 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:40.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:40 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:40.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:40 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:40.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:40 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:40.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:40 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:40.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:40 smithi159 ceph-mon[30935]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:40.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:40 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:40.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:40 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:40.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:40 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:40.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:40 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:40.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:40 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:41.353 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.351+0000 7f80fb7fe640 1 -- 172.21.15.203:0/3664003247 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f810c062630 con 0x7f80f40a31e0 2024-09-19T06:40:41.354 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 2 on host 'smithi203' 2024-09-19T06:40:41.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f80f40a31e0 msgr2=0x7f80f40a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:41.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f80f40a31e0 0x7f80f40a56a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8100006fd0 tx=0x7f8100008040 comp rx=0 tx=0).stop 2024-09-19T06:40:41.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c104fd0 msgr2=0x7f810c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:41.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c104fd0 0x7f810c198490 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00d770 tx=0x7f80fc00dc30 comp rx=0 tx=0).stop 2024-09-19T06:40:41.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 shutdown_connections 2024-09-19T06:40:41.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f80f40a31e0 0x7f80f40a56a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:41.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f810c107900 0x7f810c19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:41.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f810c104fd0 0x7f810c198490 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:41.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 --2- 172.21.15.203:0/3664003247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c1026a0 0x7f810c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:41.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 >> 172.21.15.203:0/3664003247 conn(0x7f810c0fc2a0 msgr2=0x7f810c102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:41.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 shutdown_connections 2024-09-19T06:40:41.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:40:41.354+0000 7f8110c8d640 1 -- 172.21.15.203:0/3664003247 wait complete. 2024-09-19T06:40:41.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:41 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:41 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:41 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:41.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:41 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:41.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:41 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:41.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:41 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:41.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:41 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:41.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:41 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:41.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:41 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:42.036 DEBUG:teuthology.orchestra.run.smithi203:osd.2> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T06:40:42.038 INFO:tasks.cephadm:Deploying osd.3 on smithi159 with /dev/vg_nvme/lv_3... 2024-09-19T06:40:42.038 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:40:42.297 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:42.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:42 smithi203 ceph-mon[35473]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:42.747 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:42 smithi159 ceph-mon[30935]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:42.789 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:42 smithi189 ceph-mon[34880]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:43.219 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:42 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2[40417]: 2024-09-19T06:40:42.958+0000 7f781dcb1640 -1 osd.2 0 log_to_monitors true 2024-09-19T06:40:43.512 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:43 smithi203 ceph-mon[35473]: from='osd.2 [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:40:43.512 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:43 smithi203 ceph-mon[35473]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:40:43.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:43 smithi159 ceph-mon[30935]: from='osd.2 [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:40:43.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:43 smithi159 ceph-mon[30935]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:40:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:43 smithi189 ceph-mon[34880]: from='osd.2 [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:40:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:43 smithi189 ceph-mon[34880]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:40:44.432 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:44 smithi203 ceph-mon[35473]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:44.432 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:44 smithi203 ceph-mon[35473]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:40:44.432 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:44 smithi203 ceph-mon[35473]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:40:44.432 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:44.433 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:44 smithi203 ceph-mon[35473]: from='osd.2 [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:40:44.433 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:44 smithi203 ceph-mon[35473]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:40:44.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:44 smithi159 ceph-mon[30935]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:44.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:44 smithi159 ceph-mon[30935]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:40:44.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:44 smithi159 ceph-mon[30935]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:40:44.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:44.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:44 smithi159 ceph-mon[30935]: from='osd.2 [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:40:44.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:44 smithi159 ceph-mon[30935]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:40:44.728 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:40:44.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_3 2024-09-19T06:40:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:44 smithi189 ceph-mon[34880]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:44 smithi189 ceph-mon[34880]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:40:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:44 smithi189 ceph-mon[34880]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:40:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:44 smithi189 ceph-mon[34880]: from='osd.2 [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:40:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:44 smithi189 ceph-mon[34880]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:40:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:45.092 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2[40417]: 2024-09-19T06:40:44.857+0000 7f7819c34640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T06:40:45.092 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2[40417]: 2024-09-19T06:40:44.861+0000 7f7811a54640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:40:45.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.521+0000 7fef507d8640 1 -- 172.21.15.159:0/4243970415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 msgr2=0x7fef48100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:45.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.521+0000 7fef507d8640 1 --2- 172.21.15.159:0/4243970415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 0x7fef48100f10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fef44009900 tx=0x7fef4402a410 comp rx=0 tx=0).stop 2024-09-19T06:40:45.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.521+0000 7fef507d8640 1 -- 172.21.15.159:0/4243970415 shutdown_connections 2024-09-19T06:40:45.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.521+0000 7fef507d8640 1 --2- 172.21.15.159:0/4243970415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef481026d0 0x7fef48108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:45.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.521+0000 7fef507d8640 1 --2- 172.21.15.159:0/4243970415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef48101d10 0x7fef48102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:45.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.521+0000 7fef507d8640 1 --2- 172.21.15.159:0/4243970415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 0x7fef48100f10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:45.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.521+0000 7fef507d8640 1 -- 172.21.15.159:0/4243970415 >> 172.21.15.159:0/4243970415 conn(0x7fef480fc2a0 msgr2=0x7fef480fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:45.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.521+0000 7fef507d8640 1 -- 172.21.15.159:0/4243970415 shutdown_connections 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.521+0000 7fef507d8640 1 -- 172.21.15.159:0/4243970415 wait complete. 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef507d8640 1 Processor -- start 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef507d8640 1 -- start start 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef507d8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 0x7fef48196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef507d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef48101d10 0x7fef48197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef507d8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef481026d0 0x7fef4819e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef507d8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fef4810c790 con 0x7fef48100b10 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef507d8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef4810c610 con 0x7fef48101d10 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef507d8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef4810c910 con 0x7fef481026d0 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef4e574640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 0x7fef48196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:45.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef4e574640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 0x7fef48196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47196/0 (socket says 172.21.15.159:47196) 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.522+0000 7fef4e574640 1 -- 172.21.15.159:0/1696174042 learned_addr learned my addr 172.21.15.159:0/1696174042 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4e574640 1 -- 172.21.15.159:0/1696174042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef481026d0 msgr2=0x7fef4819e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4ed75640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef481026d0 0x7fef4819e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4e574640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef481026d0 0x7fef4819e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4e574640 1 -- 172.21.15.159:0/1696174042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef48101d10 msgr2=0x7fef48197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4dd73640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef48101d10 0x7fef48197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4e574640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef48101d10 0x7fef48197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4e574640 1 -- 172.21.15.159:0/1696174042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4819ea50 con 0x7fef48100b10 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4ed75640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef481026d0 0x7fef4819e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4dd73640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef48101d10 0x7fef48197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef4e574640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 0x7fef48196e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fef44031610 tx=0x7fef44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:45.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef3f7fe640 1 -- 172.21.15.159:0/1696174042 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44046070 con 0x7fef48100b10 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef3f7fe640 1 -- 172.21.15.159:0/1696174042 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef44003ad0 con 0x7fef48100b10 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4806a790 con 0x7fef48100b10 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef3f7fe640 1 -- 172.21.15.159:0/1696174042 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44035050 con 0x7fef48100b10 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.523+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4806ac70 con 0x7fef48100b10 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.524+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4806b690 con 0x7fef48100b10 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.525+0000 7fef3f7fe640 1 -- 172.21.15.159:0/1696174042 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7fef44049070 con 0x7fef48100b10 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.526+0000 7fef3f7fe640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef340a31e0 0x7fef340a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.526+0000 7fef4dd73640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef340a31e0 0x7fef340a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.526+0000 7fef3f7fe640 1 -- 172.21.15.159:0/1696174042 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2571+0+0 (secure 0 0 0) 0x7fef440efd70 con 0x7fef48100b10 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.526+0000 7fef4dd73640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef340a31e0 0x7fef340a56a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef48198340 tx=0x7fef38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:45.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.530+0000 7fef3f7fe640 1 -- 172.21.15.159:0/1696174042 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef4407e210 con 0x7fef48100b10 2024-09-19T06:40:45.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:45.704+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fef4806aed0 con 0x7fef340a31e0 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='osd.2 ' entity='osd.2' 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:45.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='osd.2 ' entity='osd.2' 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:40:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:40:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='osd.2 ' entity='osd.2' 2024-09-19T06:40:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:45.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:45.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:45.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:45.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:46.744 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:40:46.744 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:40:46.744 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi203 2024-09-19T06:40:46.745 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi203 to 17088M 2024-09-19T06:40:46.745 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:46.745 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:46.745 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:40:46.745 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:40:46.746 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:46.746 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: osd.2 [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] boot 2024-09-19T06:40:46.746 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T06:40:46.746 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:46 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi203 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi203 to 17088M 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: osd.2 [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] boot 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T06:40:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:46 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:40:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:40:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi203 2024-09-19T06:40:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi203 to 17088M 2024-09-19T06:40:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:40:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:40:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:40:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:46.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: osd.2 [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] boot 2024-09-19T06:40:46.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T06:40:46.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:46 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:47.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:47 smithi159 ceph-mon[30935]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:47.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:47 smithi159 ceph-mon[30935]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T06:40:48.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:47 smithi203 ceph-mon[35473]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:48.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:47 smithi203 ceph-mon[35473]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T06:40:48.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:47 smithi189 ceph-mon[34880]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:48.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:47 smithi189 ceph-mon[34880]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T06:40:48.554 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:40:48 smithi159 sudo[50209]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:40:48.554 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:40:48 smithi159 sudo[50209]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:48.554 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:40:48 smithi159 sudo[50209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:48.554 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:40:48 smithi159 sudo[50209]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:48.897 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:40:48 smithi159 sudo[50220]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:40:48.898 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:40:48 smithi159 sudo[50220]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:48.898 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:40:48 smithi159 sudo[50220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:48.898 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:40:48 smithi159 sudo[50220]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: pgmap v74: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:40:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:40:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:40:48.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:40:48.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3835153561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "446be896-916b-4fca-80f9-132c9786a9bf"}]: dispatch 2024-09-19T06:40:48.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:40:48.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3835153561' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "446be896-916b-4fca-80f9-132c9786a9bf"}]': finished 2024-09-19T06:40:48.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T06:40:48.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:48.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1339848813' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:40:48.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:49.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: pgmap v74: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3835153561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "446be896-916b-4fca-80f9-132c9786a9bf"}]: dispatch 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3835153561' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "446be896-916b-4fca-80f9-132c9786a9bf"}]': finished 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1339848813' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:40:49.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:49.128 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:48 smithi189 sudo[43481]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:40:49.128 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:48 smithi189 sudo[43481]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:49.128 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:48 smithi189 sudo[43481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:49.129 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:48 smithi189 sudo[43481]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:49.129 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: pgmap v74: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:49.129 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:40:49.129 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:40:49.129 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:40:49.129 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:40:49.130 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3835153561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "446be896-916b-4fca-80f9-132c9786a9bf"}]: dispatch 2024-09-19T06:40:49.130 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:40:49.130 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3835153561' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "446be896-916b-4fca-80f9-132c9786a9bf"}]': finished 2024-09-19T06:40:49.130 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T06:40:49.130 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:49.130 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1339848813' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:40:49.130 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:49.388 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:49 smithi189 sudo[43484]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:40:49.388 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:49 smithi189 sudo[43484]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:49.388 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:49 smithi189 sudo[43484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:49.388 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:40:49 smithi189 sudo[43484]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:49.654 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:49 smithi203 sudo[44354]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:40:49.654 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:49 smithi203 sudo[44354]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:49.654 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:49 smithi203 sudo[44354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:49.654 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:49 smithi203 sudo[44354]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:50.091 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:49 smithi203 sudo[44357]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:40:50.092 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:49 smithi203 sudo[44357]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:50.092 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:49 smithi203 sudo[44357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:50.092 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:40:49 smithi203 sudo[44357]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:50.174 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:49 smithi159 sudo[50447]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:40:50.174 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:49 smithi159 sudo[50447]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:50.175 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:49 smithi159 sudo[50447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:50.175 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:49 smithi159 sudo[50447]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:50.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:40:50.190+0000 7fef3f7fe640 1 -- 172.21.15.159:0/1696174042 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fef44003c80 con 0x7fef48100b10 2024-09-19T06:40:50.438 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 ceph-mon[35473]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:40:50.438 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:50.438 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:50.438 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 ceph-mon[35473]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:50.438 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:50.439 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:40:50.439 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 sudo[44360]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:40:50.439 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 sudo[44360]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:50.439 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 sudo[44360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:50.439 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 sudo[44360]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:50.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 ceph-mon[34880]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:40:50.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:50.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:50.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 ceph-mon[34880]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:50.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:50.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 ceph-mon[34880]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:40:50.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 sudo[50633]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:40:50.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 sudo[50633]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:50.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 sudo[50633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:50.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 sudo[50633]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:50.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 ceph-mon[30935]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:40:50.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:50.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:50.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 ceph-mon[30935]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:50.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:40:50.650 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:50 smithi159 ceph-mon[30935]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:40:50.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 sudo[44363]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:40:50.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 sudo[44363]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:50.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 sudo[44363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:50.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:50 smithi203 sudo[44363]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:51.172 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 sudo[43487]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:40:51.173 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 sudo[43487]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:51.173 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 sudo[43487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:51.173 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:50 smithi189 sudo[43487]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:40:51.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:40:51.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:51.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:51.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:51.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:51 smithi203 ceph-mon[35473]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:40:51.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 sudo[43490]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:40:51.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 sudo[43490]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:40:51.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 sudo[43490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:40:51.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 sudo[43490]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:40:51.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:40:51.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:51.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:51.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:51.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:51.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:51 smithi189 ceph-mon[34880]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:40:51.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:51.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:51.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:51.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:51 smithi159 ceph-mon[30935]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:40:52.544 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:52 smithi159 ceph-mon[30935]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:52.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:52 smithi203 ceph-mon[35473]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:52 smithi189 ceph-mon[34880]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:54 smithi159 ceph-mon[30935]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:54.763 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:54 smithi203 ceph-mon[35473]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:54 smithi189 ceph-mon[34880]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:56.726 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:56 smithi159 ceph-mon[30935]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:56.726 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:56 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:40:56.727 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:56 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:56.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:56 smithi203 ceph-mon[35473]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:56 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:40:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:56 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:56.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:56 smithi189 ceph-mon[34880]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:56.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:56 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:40:56.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:56 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:57.593 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:57 smithi159 ceph-mon[30935]: Deploying daemon osd.3 on smithi159 2024-09-19T06:40:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:57 smithi203 ceph-mon[35473]: Deploying daemon osd.3 on smithi159 2024-09-19T06:40:57.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:57 smithi189 ceph-mon[34880]: Deploying daemon osd.3 on smithi159 2024-09-19T06:40:58.532 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:40:58 smithi159 ceph-mon[30935]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:58.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:40:58 smithi203 ceph-mon[35473]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:40:58.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:40:58 smithi189 ceph-mon[34880]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:00.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:00 smithi203 ceph-mon[35473]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:00.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:00 smithi189 ceph-mon[34880]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:00.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:00 smithi159 ceph-mon[30935]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:02.841 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:02 smithi159 ceph-mon[30935]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:02.858 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:02.858 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:02.858 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:02.859 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:02 smithi203 ceph-mon[35473]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:02.859 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:02.859 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:02.859 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:02 smithi189 ceph-mon[34880]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:04 smithi159 ceph-mon[30935]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:04 smithi203 ceph-mon[35473]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:04 smithi189 ceph-mon[34880]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:05.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.942+0000 7fef3f7fe640 1 -- 172.21.15.159:0/1696174042 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fef4806aed0 con 0x7fef340a31e0 2024-09-19T06:41:05.944 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 3 on host 'smithi159' 2024-09-19T06:41:05.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef340a31e0 msgr2=0x7fef340a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef340a31e0 0x7fef340a56a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef48198340 tx=0x7fef38005f90 comp rx=0 tx=0).stop 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 msgr2=0x7fef48196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 0x7fef48196e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fef44031610 tx=0x7fef44004270 comp rx=0 tx=0).stop 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 shutdown_connections 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef340a31e0 0x7fef340a56a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef481026d0 0x7fef4819e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef48101d10 0x7fef48197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 --2- 172.21.15.159:0/1696174042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef48100b10 0x7fef48196e20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 >> 172.21.15.159:0/1696174042 conn(0x7fef480fc2a0 msgr2=0x7fef48105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 shutdown_connections 2024-09-19T06:41:05.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:41:05.945+0000 7fef507d8640 1 -- 172.21.15.159:0/1696174042 wait complete. 2024-09-19T06:41:06.268 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:06 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.268 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:06 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.269 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:06 smithi159 ceph-mon[30935]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:06.269 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:06 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:06.269 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:06 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:06.269 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:06 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.269 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:06 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:06.269 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:06 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.269 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:06 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:06 smithi203 ceph-mon[35473]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:06 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:06 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:06 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:06 smithi189 ceph-mon[34880]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:06.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:06 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:06.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:06 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:06.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:06 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:06 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:06.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:06 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:06 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:06.654 DEBUG:teuthology.orchestra.run.smithi159:osd.3> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T06:41:06.656 INFO:tasks.cephadm:Deploying osd.4 on smithi189 with /dev/vg_nvme/lv_3... 2024-09-19T06:41:06.656 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:41:06.909 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:41:08.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:08 smithi159 ceph-mon[30935]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:08.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:08 smithi159 ceph-mon[30935]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:41:08.648 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:41:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3[52213]: 2024-09-19T06:41:08.245+0000 7f48205e9640 -1 osd.3 0 log_to_monitors true 2024-09-19T06:41:08.827 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:08 smithi189 ceph-mon[34880]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:08.827 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:08 smithi189 ceph-mon[34880]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:41:08.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:08 smithi203 ceph-mon[35473]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:08.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:08 smithi203 ceph-mon[35473]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:41:09.544 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:09 smithi159 ceph-mon[30935]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:41:09.544 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:09 smithi159 ceph-mon[30935]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:41:09.544 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:09 smithi159 ceph-mon[30935]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:41:09.544 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:09.544 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:09 smithi159 ceph-mon[30935]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:41:09.559 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:09 smithi189 ceph-mon[34880]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:41:09.559 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:09 smithi189 ceph-mon[34880]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:41:09.559 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:09 smithi189 ceph-mon[34880]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:41:09.559 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:09.559 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:09 smithi189 ceph-mon[34880]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:41:09.562 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:41:09.589 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-09-19T06:41:09.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:09 smithi203 ceph-mon[35473]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:41:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:09 smithi203 ceph-mon[35473]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:41:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:09 smithi203 ceph-mon[35473]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:41:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:09 smithi203 ceph-mon[35473]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:41:09.847 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:41:10.147 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:41:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3[52213]: 2024-09-19T06:41:09.827+0000 7f481c56c640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T06:41:10.148 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:41:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3[52213]: 2024-09-19T06:41:09.832+0000 7f481438c640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:41:10.354 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.348+0000 7f7ec1438640 1 -- 172.21.15.189:0/912455132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ebc104f90 msgr2=0x7f7ebc107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.354 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.348+0000 7f7ec1438640 1 --2- 172.21.15.189:0/912455132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ebc104f90 0x7f7ebc107380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009860 tx=0x7f7ea402a340 comp rx=0 tx=0).stop 2024-09-19T06:41:10.354 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 -- 172.21.15.189:0/912455132 shutdown_connections 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 --2- 172.21.15.189:0/912455132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ebc1078c0 0x7f7ebc109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 --2- 172.21.15.189:0/912455132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ebc104f90 0x7f7ebc107380 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 --2- 172.21.15.189:0/912455132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ebc102660 0x7f7ebc104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 -- 172.21.15.189:0/912455132 >> 172.21.15.189:0/912455132 conn(0x7f7ebc0fc280 msgr2=0x7f7ebc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 -- 172.21.15.189:0/912455132 shutdown_connections 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 -- 172.21.15.189:0/912455132 wait complete. 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 Processor -- start 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 -- start start 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ebc102660 0x7f7ebc197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.355 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ebc104f90 0x7f7ebc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.356 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.349+0000 7f7ec1438640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ebc1078c0 0x7f7ebc19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.356 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7ec1438640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc10d840 con 0x7f7ebc1078c0 2024-09-19T06:41:10.356 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7ec1438640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc10d6c0 con 0x7f7ebc104f90 2024-09-19T06:41:10.356 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7ec1438640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc10d9c0 con 0x7f7ebc102660 2024-09-19T06:41:10.356 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ebc104f90 0x7f7ebc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.356 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ebc104f90 0x7f7ebc198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:58168/0 (socket says 172.21.15.189:58168) 2024-09-19T06:41:10.356 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb3fff640 1 -- 172.21.15.189:0/2679557623 learned_addr learned my addr 172.21.15.189:0/2679557623 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-19T06:41:10.356 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7ebaffd640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ebc102660 0x7f7ebc197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7ebb7fe640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ebc1078c0 0x7f7ebc19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb3fff640 1 -- 172.21.15.189:0/2679557623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ebc102660 msgr2=0x7f7ebc197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb3fff640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ebc102660 0x7f7ebc197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb3fff640 1 -- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ebc1078c0 msgr2=0x7f7ebc19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb3fff640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ebc1078c0 0x7f7ebc19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb3fff640 1 -- 172.21.15.189:0/2679557623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc19faf0 con 0x7f7ebc104f90 2024-09-19T06:41:10.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb3fff640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ebc104f90 0x7f7ebc198400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40305b0 tx=0x7f7ea4033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb8ff9640 1 -- 172.21.15.189:0/2679557623 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea403f020 con 0x7f7ebc104f90 2024-09-19T06:41:10.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ebc19fd80 con 0x7f7ebc104f90 2024-09-19T06:41:10.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb8ff9640 1 -- 172.21.15.189:0/2679557623 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ea4030850 con 0x7f7ebc104f90 2024-09-19T06:41:10.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7eb8ff9640 1 -- 172.21.15.189:0/2679557623 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4037040 con 0x7f7ebc104f90 2024-09-19T06:41:10.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.350+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ebc1a0200 con 0x7f7ebc104f90 2024-09-19T06:41:10.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.352+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ebc0fdd70 con 0x7f7ebc104f90 2024-09-19T06:41:10.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.353+0000 7f7eb8ff9640 1 -- 172.21.15.189:0/2679557623 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f7ea4042020 con 0x7f7ebc104f90 2024-09-19T06:41:10.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.353+0000 7f7eb8ff9640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7ea80a3270 0x7f7ea80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.354+0000 7f7eb8ff9640 1 -- 172.21.15.189:0/2679557623 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7f7ea40ee960 con 0x7f7ebc104f90 2024-09-19T06:41:10.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.354+0000 7f7ebaffd640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7ea80a3270 0x7f7ea80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.354+0000 7f7ebaffd640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7ea80a3270 0x7f7ea80a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7eac005fd0 tx=0x7f7eac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.358+0000 7f7eb8ff9640 1 -- 172.21.15.189:0/2679557623 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ea4049020 con 0x7f7ebc104f90 2024-09-19T06:41:10.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:10.537+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7ebc062630 con 0x7f7ea80a3270 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:10.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:10.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' 2024-09-19T06:41:10.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] boot 2024-09-19T06:41:10.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T06:41:10.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:10.865 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:10.865 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:41:10.865 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:10.865 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:10.865 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.865 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.865 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:10.865 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:10.866 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.866 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:10.866 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:10.866 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.866 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' 2024-09-19T06:41:10.866 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] boot 2024-09-19T06:41:10.866 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T06:41:10.866 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:41:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:10.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:10.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:10.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:10.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465]' entity='osd.3' 2024-09-19T06:41:10.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: osd.3 [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] boot 2024-09-19T06:41:10.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T06:41:10.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:11.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:11 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:41:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:11 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:41:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:11 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi159 2024-09-19T06:41:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:11 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-19T06:41:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:11 smithi203 ceph-mon[35473]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:41:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:41:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:11 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:41:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:11 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:41:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:11 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi159 2024-09-19T06:41:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:11 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-19T06:41:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:11 smithi189 ceph-mon[34880]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:11 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:41:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:11 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:41:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:11 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:11 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:41:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:11 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:41:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:11 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi159 2024-09-19T06:41:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:11 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-19T06:41:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:11 smithi159 ceph-mon[30935]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:41:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:41:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:12.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:12 smithi189 ceph-mon[34880]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:12.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:12 smithi189 ceph-mon[34880]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:41:12.743 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:12 smithi203 ceph-mon[35473]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:12.743 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:12 smithi203 ceph-mon[35473]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:41:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:12 smithi159 ceph-mon[30935]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:41:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:12 smithi159 ceph-mon[30935]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:41:13.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:13 smithi189 ceph-mon[34880]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T06:41:13.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:13 smithi189 ceph-mon[34880]: from='client.? 172.21.15.189:0/3087162395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88500d1e-e298-47a6-a704-07c09f025773"}]: dispatch 2024-09-19T06:41:13.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:13 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88500d1e-e298-47a6-a704-07c09f025773"}]: dispatch 2024-09-19T06:41:13.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:13 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88500d1e-e298-47a6-a704-07c09f025773"}]': finished 2024-09-19T06:41:13.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:13 smithi189 ceph-mon[34880]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T06:41:13.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:13 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:13.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:13 smithi203 ceph-mon[35473]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T06:41:13.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:13 smithi203 ceph-mon[35473]: from='client.? 172.21.15.189:0/3087162395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88500d1e-e298-47a6-a704-07c09f025773"}]: dispatch 2024-09-19T06:41:13.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:13 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88500d1e-e298-47a6-a704-07c09f025773"}]: dispatch 2024-09-19T06:41:13.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:13 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88500d1e-e298-47a6-a704-07c09f025773"}]': finished 2024-09-19T06:41:13.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:13 smithi203 ceph-mon[35473]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T06:41:13.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:13 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:13 smithi159 ceph-mon[30935]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T06:41:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:13 smithi159 ceph-mon[30935]: from='client.? 172.21.15.189:0/3087162395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88500d1e-e298-47a6-a704-07c09f025773"}]: dispatch 2024-09-19T06:41:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:13 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88500d1e-e298-47a6-a704-07c09f025773"}]: dispatch 2024-09-19T06:41:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:13 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88500d1e-e298-47a6-a704-07c09f025773"}]': finished 2024-09-19T06:41:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:13 smithi159 ceph-mon[30935]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T06:41:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:13 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:14.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:14 smithi203 ceph-mon[35473]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:14 smithi203 ceph-mon[35473]: from='client.? 172.21.15.189:0/380358181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:41:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:14 smithi203 ceph-mon[35473]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:41:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:14 smithi189 ceph-mon[34880]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:14 smithi189 ceph-mon[34880]: from='client.? 172.21.15.189:0/380358181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:41:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:14 smithi189 ceph-mon[34880]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:41:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:14 smithi159 ceph-mon[30935]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:14 smithi159 ceph-mon[30935]: from='client.? 172.21.15.189:0/380358181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:41:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:14 smithi159 ceph-mon[30935]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:41:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:16.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:16 smithi203 ceph-mon[35473]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:16 smithi189 ceph-mon[34880]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:16.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:16 smithi159 ceph-mon[30935]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:18.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:18 smithi189 ceph-mon[34880]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:41:18.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:18 smithi203 ceph-mon[35473]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:41:18.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:18 smithi159 ceph-mon[30935]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:41:20.560 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:20 smithi189 ceph-mon[34880]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T06:41:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:20 smithi203 ceph-mon[35473]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T06:41:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:20 smithi159 ceph-mon[30935]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T06:41:22.629 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:22 smithi189 ceph-mon[34880]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T06:41:22.629 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:41:22.629 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:22.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:22 smithi203 ceph-mon[35473]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T06:41:22.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:22 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:41:22.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:22 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:22.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:22 smithi159 ceph-mon[30935]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T06:41:22.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:22 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:41:22.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:22 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:23.599 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:23 smithi189 ceph-mon[34880]: Deploying daemon osd.4 on smithi189 2024-09-19T06:41:23.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:23 smithi203 ceph-mon[35473]: Deploying daemon osd.4 on smithi189 2024-09-19T06:41:23.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:23 smithi159 ceph-mon[30935]: Deploying daemon osd.4 on smithi189 2024-09-19T06:41:24.713 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:24 smithi189 ceph-mon[34880]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:41:24.799 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:24 smithi159 ceph-mon[30935]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:41:24.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:24 smithi203 ceph-mon[35473]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:41:26.724 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:26 smithi189 ceph-mon[34880]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T06:41:26.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:26 smithi203 ceph-mon[35473]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T06:41:26.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:26 smithi159 ceph-mon[30935]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T06:41:28.742 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:28 smithi189 ceph-mon[34880]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:41:28.742 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:28.742 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:28.742 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:28.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:28 smithi203 ceph-mon[35473]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:41:28.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:28 smithi159 ceph-mon[30935]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:41:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:30.773 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:30 smithi189 ceph-mon[34880]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:30.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:30 smithi203 ceph-mon[35473]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:30.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:30 smithi159 ceph-mon[30935]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:32.227 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:32.228 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:32.228 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:32.228 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:32.228 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:31 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:32.228 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:31 smithi189 ceph-mon[34880]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:32.268 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.267+0000 7f7eb8ff9640 1 -- 172.21.15.189:0/2679557623 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7ebc062630 con 0x7f7ea80a3270 2024-09-19T06:41:32.269 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 4 on host 'smithi189' 2024-09-19T06:41:32.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7ea80a3270 msgr2=0x7f7ea80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:32.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7ea80a3270 0x7f7ea80a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7eac005fd0 tx=0x7f7eac009260 comp rx=0 tx=0).stop 2024-09-19T06:41:32.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ebc104f90 msgr2=0x7f7ebc198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:32.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ebc104f90 0x7f7ebc198400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40305b0 tx=0x7f7ea4033d90 comp rx=0 tx=0).stop 2024-09-19T06:41:32.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 shutdown_connections 2024-09-19T06:41:32.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7ea80a3270 0x7f7ea80a5730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:32.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ebc1078c0 0x7f7ebc19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:32.271 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ebc104f90 0x7f7ebc198400 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:32.272 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 --2- 172.21.15.189:0/2679557623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ebc102660 0x7f7ebc197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:32.272 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 >> 172.21.15.189:0/2679557623 conn(0x7f7ebc0fc280 msgr2=0x7f7ebc102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:32.272 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 shutdown_connections 2024-09-19T06:41:32.272 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:41:32.270+0000 7f7ec1438640 1 -- 172.21.15.189:0/2679557623 wait complete. 2024-09-19T06:41:32.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:32.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:32.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:32.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:32.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:31 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:32.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:31 smithi203 ceph-mon[35473]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:32.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:32.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:32.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:32.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:32.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:31 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:32.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:31 smithi159 ceph-mon[30935]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:32.910 DEBUG:teuthology.orchestra.run.smithi189:osd.4> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T06:41:32.912 INFO:tasks.cephadm:Deploying osd.5 on smithi203 with /dev/vg_nvme/lv_3... 2024-09-19T06:41:32.912 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:41:33.132 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:32 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:33.132 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:32 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:33.132 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:32 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:33.169 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:41:33.289 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:32 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:33.289 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:32 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:33.289 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:32 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:33.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:32 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:33.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:32 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:33.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:32 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:34.302 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:33 smithi203 ceph-mon[35473]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:34.382 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:33 smithi189 ceph-mon[34880]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:34.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:33 smithi159 ceph-mon[30935]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:34.638 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:41:34 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4[46230]: 2024-09-19T06:41:34.617+0000 7fb86619d640 -1 osd.4 0 log_to_monitors true 2024-09-19T06:41:35.257 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:34 smithi189 ceph-mon[34880]: from='osd.4 [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:41:35.257 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:34 smithi189 ceph-mon[34880]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:41:35.293 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:34 smithi203 ceph-mon[35473]: from='osd.4 [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:41:35.293 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:34 smithi203 ceph-mon[35473]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:41:35.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:34 smithi159 ceph-mon[30935]: from='osd.4 [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:41:35.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:34 smithi159 ceph-mon[30935]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:41:35.583 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:41:35.610 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_3 2024-09-19T06:41:35.858 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:41:36.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:41:36.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:41:36.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='osd.4 [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:41:36.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:36.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:41:36.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:36.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:36.342 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 -- 172.21.15.203:0/1082905811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef601026a0 msgr2=0x7fef60104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:36.342 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 --2- 172.21.15.203:0/1082905811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef601026a0 0x7fef60104a90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fef54009900 tx=0x7fef5402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:41:36.342 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 -- 172.21.15.203:0/1082905811 shutdown_connections 2024-09-19T06:41:36.342 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 --2- 172.21.15.203:0/1082905811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef60107900 0x7fef60109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:36.342 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 --2- 172.21.15.203:0/1082905811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef60104fd0 0x7fef601073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:36.342 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 --2- 172.21.15.203:0/1082905811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef601026a0 0x7fef60104a90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 -- 172.21.15.203:0/1082905811 >> 172.21.15.203:0/1082905811 conn(0x7fef600fc2a0 msgr2=0x7fef600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 -- 172.21.15.203:0/1082905811 shutdown_connections 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 -- 172.21.15.203:0/1082905811 wait complete. 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.318+0000 7fef66c15640 1 Processor -- start 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef66c15640 1 -- start start 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef66c15640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef601026a0 0x7fef60197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef66c15640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef60104fd0 0x7fef60198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef66c15640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef60107900 0x7fef6019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef66c15640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010d8b0 con 0x7fef601026a0 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef66c15640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010d730 con 0x7fef60104fd0 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef66c15640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010da30 con 0x7fef60107900 2024-09-19T06:41:36.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef651b2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef60107900 0x7fef6019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef651b2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef60107900 0x7fef6019f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:48958/0 (socket says 172.21.15.203:48958) 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef651b2640 1 -- 172.21.15.203:0/3637615732 learned_addr learned my addr 172.21.15.203:0/3637615732 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef5ffff640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef60104fd0 0x7fef60198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef649b1640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef601026a0 0x7fef60197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef651b2640 1 -- 172.21.15.203:0/3637615732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef60104fd0 msgr2=0x7fef60198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef651b2640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef60104fd0 0x7fef60198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef651b2640 1 -- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef601026a0 msgr2=0x7fef60197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef651b2640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef601026a0 0x7fef60197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef651b2640 1 -- 172.21.15.203:0/3637615732 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6019fa70 con 0x7fef60107900 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef651b2640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef60107900 0x7fef6019f400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fef5800cce0 tx=0x7fef5800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:36.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef5dffb640 1 -- 172.21.15.203:0/3637615732 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5800f450 con 0x7fef60107900 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6019fd60 con 0x7fef60107900 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef5dffb640 1 -- 172.21.15.203:0/3637615732 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef5800fad0 con 0x7fef60107900 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.319+0000 7fef5dffb640 1 -- 172.21.15.203:0/3637615732 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58018b60 con 0x7fef60107900 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.320+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef601a01f0 con 0x7fef60107900 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.321+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef600fdd90 con 0x7fef60107900 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.322+0000 7fef5dffb640 1 -- 172.21.15.203:0/3637615732 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fef5800fc80 con 0x7fef60107900 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.322+0000 7fef5dffb640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef500a3270 0x7fef500a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.322+0000 7fef5dffb640 1 -- 172.21.15.203:0/3637615732 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7fef580cec70 con 0x7fef60107900 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.323+0000 7fef649b1640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef500a3270 0x7fef500a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.323+0000 7fef649b1640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef500a3270 0x7fef500a5730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef54000c00 tx=0x7fef54031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:36.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.327+0000 7fef5dffb640 1 -- 172.21.15.203:0/3637615732 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef58014030 con 0x7fef60107900 2024-09-19T06:41:36.388 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4[46230]: 2024-09-19T06:41:35.992+0000 7fb862120640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T06:41:36.388 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4[46230]: 2024-09-19T06:41:35.997+0000 7fb85df48640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:41:36.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:41:36.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:41:36.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='osd.4 [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:41:36.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:36.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:36.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='osd.4 [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:36.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:36.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:36.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:41:36.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:41:36.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:36.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:36.503 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:36.502+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fef60062630 con 0x7fef500a3270 2024-09-19T06:41:37.162 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi189 2024-09-19T06:41:37.162 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-19T06:41:37.162 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:37.162 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:41:37.162 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:41:37.162 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:37.163 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:37.163 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: osd.4 [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] boot 2024-09-19T06:41:37.163 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T06:41:37.163 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:37 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:37.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi189 2024-09-19T06:41:37.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-19T06:41:37.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:37.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:41:37.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:41:37.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:37.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:37.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: osd.4 [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] boot 2024-09-19T06:41:37.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T06:41:37.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:37 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi189 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: osd.4 [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] boot 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T06:41:37.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:37 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:38.213 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:38 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:41:38.213 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:38 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:41:38.213 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:38 smithi203 ceph-mon[35473]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:38.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:38 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:41:38.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:38 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:41:38.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:38 smithi189 ceph-mon[34880]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:38.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:38 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:41:38.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:38 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:41:38.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:38 smithi159 ceph-mon[30935]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:41:39.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:39 smithi203 ceph-mon[35473]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T06:41:39.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:39 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/1485159622' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a156a5d-e640-45d6-bb29-c50a3b827351"}]: dispatch 2024-09-19T06:41:39.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:39 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a156a5d-e640-45d6-bb29-c50a3b827351"}]: dispatch 2024-09-19T06:41:39.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:39 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a156a5d-e640-45d6-bb29-c50a3b827351"}]': finished 2024-09-19T06:41:39.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:39 smithi203 ceph-mon[35473]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T06:41:39.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:41:39.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:39 smithi189 ceph-mon[34880]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T06:41:39.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:39 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/1485159622' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a156a5d-e640-45d6-bb29-c50a3b827351"}]: dispatch 2024-09-19T06:41:39.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:39 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a156a5d-e640-45d6-bb29-c50a3b827351"}]: dispatch 2024-09-19T06:41:39.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:39 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a156a5d-e640-45d6-bb29-c50a3b827351"}]': finished 2024-09-19T06:41:39.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:39 smithi189 ceph-mon[34880]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T06:41:39.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:41:39.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:39 smithi159 ceph-mon[30935]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T06:41:39.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:39 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/1485159622' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a156a5d-e640-45d6-bb29-c50a3b827351"}]: dispatch 2024-09-19T06:41:39.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:39 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a156a5d-e640-45d6-bb29-c50a3b827351"}]: dispatch 2024-09-19T06:41:39.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:39 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a156a5d-e640-45d6-bb29-c50a3b827351"}]': finished 2024-09-19T06:41:39.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:39 smithi159 ceph-mon[30935]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T06:41:39.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:41:40.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:40 smithi203 ceph-mon[35473]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:40.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:40 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/2380111585' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:41:40.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:40 smithi189 ceph-mon[34880]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:40.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:40 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/2380111585' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:41:40.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:40 smithi159 ceph-mon[30935]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:40.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:40 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/2380111585' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:41:42.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:42 smithi203 ceph-mon[35473]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:42.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:42 smithi189 ceph-mon[34880]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:42.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:42 smithi159 ceph-mon[30935]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:44.518 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:44 smithi203 ceph-mon[35473]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:44 smithi189 ceph-mon[34880]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:44.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:44 smithi159 ceph-mon[30935]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:46.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:46 smithi203 ceph-mon[35473]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:46 smithi189 ceph-mon[34880]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:46.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:46 smithi159 ceph-mon[30935]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:47.753 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:47 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:41:47.753 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:47 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:47.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:47 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:41:47.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:47 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:47.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:47 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:41:47.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:47 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:48.774 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:48 smithi203 ceph-mon[35473]: Deploying daemon osd.5 on smithi203 2024-09-19T06:41:48.774 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:48 smithi203 ceph-mon[35473]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:48.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:48 smithi189 ceph-mon[34880]: Deploying daemon osd.5 on smithi203 2024-09-19T06:41:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:48 smithi189 ceph-mon[34880]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:48.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:48 smithi159 ceph-mon[30935]: Deploying daemon osd.5 on smithi203 2024-09-19T06:41:48.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:48 smithi159 ceph-mon[30935]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:50.835 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:50 smithi203 ceph-mon[35473]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:50 smithi189 ceph-mon[34880]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:50.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:50 smithi159 ceph-mon[30935]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:52.520 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:52 smithi203 ceph-mon[35473]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:52 smithi189 ceph-mon[34880]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:52.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:52 smithi159 ceph-mon[30935]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:54.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:54 smithi203 ceph-mon[35473]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:54.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:54.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:54.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:54.699 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:54 smithi159 ceph-mon[30935]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:54.699 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:54.699 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:54.700 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:54 smithi189 ceph-mon[34880]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:56.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:56 smithi203 ceph-mon[35473]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:56.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:56 smithi189 ceph-mon[34880]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:56.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:56 smithi159 ceph-mon[30935]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:57.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.646+0000 7fef5dffb640 1 -- 172.21.15.203:0/3637615732 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fef60062630 con 0x7fef500a3270 2024-09-19T06:41:57.648 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 5 on host 'smithi203' 2024-09-19T06:41:57.649 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.648+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef500a3270 msgr2=0x7fef500a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.648+0000 7fef66c15640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef500a3270 0x7fef500a5730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef54000c00 tx=0x7fef54031400 comp rx=0 tx=0).stop 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.648+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef60107900 msgr2=0x7fef6019f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.648+0000 7fef66c15640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef60107900 0x7fef6019f400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fef5800cce0 tx=0x7fef5800a620 comp rx=0 tx=0).stop 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.649+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 shutdown_connections 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.649+0000 7fef66c15640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fef500a3270 0x7fef500a5730 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.649+0000 7fef66c15640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef60107900 0x7fef6019f400 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.649+0000 7fef66c15640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef60104fd0 0x7fef60198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.649+0000 7fef66c15640 1 --2- 172.21.15.203:0/3637615732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef601026a0 0x7fef60197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.649+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 >> 172.21.15.203:0/3637615732 conn(0x7fef600fc2a0 msgr2=0x7fef60102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.649+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 shutdown_connections 2024-09-19T06:41:57.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:41:57.649+0000 7fef66c15640 1 -- 172.21.15.203:0/3637615732 wait complete. 2024-09-19T06:41:58.038 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.038 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.038 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:58.038 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:58.038 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.038 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:57 smithi203 ceph-mon[35473]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:58.038 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:58.038 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.038 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:57 smithi189 ceph-mon[34880]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:57 smithi159 ceph-mon[30935]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:41:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:41:58.315 DEBUG:teuthology.orchestra.run.smithi203:osd.5> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T06:41:58.318 INFO:tasks.cephadm:Deploying osd.6 on smithi159 with /dev/vg_nvme/lv_2... 2024-09-19T06:41:58.318 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:41:58.579 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:59.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:59 smithi203 ceph-mon[35473]: from='osd.5 [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:41:59.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:41:59 smithi203 ceph-mon[35473]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:41:59.592 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:41:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:41:59.318+0000 7fa3d7dff640 -1 osd.5 0 log_to_monitors true 2024-09-19T06:41:59.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:59 smithi189 ceph-mon[34880]: from='osd.5 [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:41:59.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:41:59 smithi189 ceph-mon[34880]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:41:59.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:59 smithi159 ceph-mon[30935]: from='osd.5 [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:41:59.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:41:59 smithi159 ceph-mon[30935]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:42:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:00 smithi159 ceph-mon[30935]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:42:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:00 smithi159 ceph-mon[30935]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:42:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:00 smithi159 ceph-mon[30935]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T06:42:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:00 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:00 smithi159 ceph-mon[30935]: from='osd.5 [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:42:00.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:00 smithi159 ceph-mon[30935]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:42:00.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:00 smithi203 ceph-mon[35473]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:42:00.721 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:00 smithi203 ceph-mon[35473]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:42:00.721 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:00 smithi203 ceph-mon[35473]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T06:42:00.721 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:00 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:00.721 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:00 smithi203 ceph-mon[35473]: from='osd.5 [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:42:00.721 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:00 smithi203 ceph-mon[35473]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:42:00.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:00 smithi189 ceph-mon[34880]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:42:00.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:00 smithi189 ceph-mon[34880]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:42:00.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:00 smithi189 ceph-mon[34880]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T06:42:00.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:00 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:00.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:00 smithi189 ceph-mon[34880]: from='osd.5 [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:42:00.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:00 smithi189 ceph-mon[34880]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:42:01.062 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:42:00 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:42:00.839+0000 7fa3d3d82640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T06:42:01.063 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:42:00 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:42:00.846+0000 7fa3cbba2640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:42:01.068 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:42:01.095 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_2 2024-09-19T06:42:01.345 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:01.654 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:01 smithi159 ceph-mon[30935]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:42:01.654 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:01 smithi159 ceph-mon[30935]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:42:01.654 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:01.654 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:01.655 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:01 smithi159 ceph-mon[30935]: from='osd.5 ' entity='osd.5' 2024-09-19T06:42:01.655 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:01 smithi159 ceph-mon[30935]: osd.5 [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] boot 2024-09-19T06:42:01.655 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:01 smithi159 ceph-mon[30935]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T06:42:01.655 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:01.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:01 smithi203 ceph-mon[35473]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:42:01.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:01 smithi203 ceph-mon[35473]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:42:01.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:01 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:01.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:01 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:01.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:01 smithi203 ceph-mon[35473]: from='osd.5 ' entity='osd.5' 2024-09-19T06:42:01.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:01 smithi203 ceph-mon[35473]: osd.5 [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] boot 2024-09-19T06:42:01.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:01 smithi203 ceph-mon[35473]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T06:42:01.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:01 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.851+0000 7f4695213640 1 -- 172.21.15.159:0/109888343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 msgr2=0x7f4690102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.851+0000 7f4695213640 1 --2- 172.21.15.159:0/109888343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 0x7f4690102000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4680009900 tx=0x7f468002a410 comp rx=0 tx=0).stop 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.851+0000 7f4695213640 1 -- 172.21.15.159:0/109888343 shutdown_connections 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.851+0000 7f4695213640 1 --2- 172.21.15.159:0/109888343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46901037c0 0x7f469010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.851+0000 7f4695213640 1 --2- 172.21.15.159:0/109888343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4690102e00 0x7f4690103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.851+0000 7f4695213640 1 --2- 172.21.15.159:0/109888343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 0x7f4690102000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.851+0000 7f4695213640 1 -- 172.21.15.159:0/109888343 >> 172.21.15.159:0/109888343 conn(0x7f46900fd390 msgr2=0x7f46900ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.851+0000 7f4695213640 1 -- 172.21.15.159:0/109888343 shutdown_connections 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.851+0000 7f4695213640 1 -- 172.21.15.159:0/109888343 wait complete. 2024-09-19T06:42:01.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.852+0000 7f4695213640 1 Processor -- start 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.852+0000 7f4695213640 1 -- start start 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.852+0000 7f4695213640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 0x7f469019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f4695213640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4690102e00 0x7f469019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f4695213640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46901037c0 0x7f46901a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f4695213640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f469010d860 con 0x7f4690101c00 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f4695213640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f469010d6e0 con 0x7f46901037c0 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f4695213640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f469010d9e0 con 0x7f4690102e00 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 0x7f469019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 0x7f469019a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41220/0 (socket says 172.21.15.159:41220) 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468ed9d640 1 -- 172.21.15.159:0/37678514 learned_addr learned my addr 172.21.15.159:0/37678514 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:42:01.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468e59c640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4690102e00 0x7f469019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468f59e640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46901037c0 0x7f46901a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468ed9d640 1 -- 172.21.15.159:0/37678514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4690102e00 msgr2=0x7f469019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468ed9d640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4690102e00 0x7f469019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468ed9d640 1 -- 172.21.15.159:0/37678514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46901037c0 msgr2=0x7f46901a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468ed9d640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46901037c0 0x7f46901a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468ed9d640 1 -- 172.21.15.159:0/37678514 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46901a1d40 con 0x7f4690101c00 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f468ed9d640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 0x7f469019a110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4680031610 tx=0x7f46800043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f4677fff640 1 -- 172.21.15.159:0/37678514 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468003f030 con 0x7f4690101c00 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f4677fff640 1 -- 172.21.15.159:0/37678514 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4680003ce0 con 0x7f4690101c00 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46901a1fd0 con 0x7f4690101c00 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.853+0000 7f4677fff640 1 -- 172.21.15.159:0/37678514 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680035070 con 0x7f4690101c00 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.854+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46901a23d0 con 0x7f4690101c00 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.855+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46901a2600 con 0x7f4690101c00 2024-09-19T06:42:01.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.856+0000 7f4677fff640 1 -- 172.21.15.159:0/37678514 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f4680042030 con 0x7f4690101c00 2024-09-19T06:42:01.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.856+0000 7f4677fff640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f46780a3270 0x7f46780a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:01.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.856+0000 7f468e59c640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f46780a3270 0x7f46780a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:01.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.856+0000 7f4677fff640 1 -- 172.21.15.159:0/37678514 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4566+0+0 (secure 0 0 0) 0x7f46800eefc0 con 0x7f4690101c00 2024-09-19T06:42:01.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.857+0000 7f468e59c640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f46780a3270 0x7f46780a5730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f469019b630 tx=0x7f468400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:01.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:01.861+0000 7f4677fff640 1 -- 172.21.15.159:0/37678514 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f46800bcb80 con 0x7f4690101c00 2024-09-19T06:42:01.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:01 smithi189 ceph-mon[34880]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:42:01.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:01 smithi189 ceph-mon[34880]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:42:01.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:01 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:01.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:01 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:01.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:01 smithi189 ceph-mon[34880]: from='osd.5 ' entity='osd.5' 2024-09-19T06:42:01.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:01 smithi189 ceph-mon[34880]: osd.5 [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] boot 2024-09-19T06:42:01.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:01 smithi189 ceph-mon[34880]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T06:42:01.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:01 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:42:02.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:02.034+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4690109cf0 con 0x7f46780a3270 2024-09-19T06:42:02.664 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:42:02.664 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:42:02.664 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi203 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi203 to 8544M 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:02.665 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:02 smithi159 ceph-mon[30935]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T06:42:02.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:42:02.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:42:02.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi203 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi203 to 8544M 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:02.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:02 smithi203 ceph-mon[35473]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T06:42:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:42:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:42:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:42:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi203 2024-09-19T06:42:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:02.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi203 to 8544M 2024-09-19T06:42:02.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:02.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:02.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:02.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:42:02.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:42:02.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:02.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:02 smithi189 ceph-mon[34880]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T06:42:03.705 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:03 smithi159 ceph-mon[30935]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:03.705 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:03 smithi159 ceph-mon[30935]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:42:03.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:03 smithi203 ceph-mon[35473]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:03.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:03 smithi203 ceph-mon[35473]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:42:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:03 smithi189 ceph-mon[34880]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:03 smithi189 ceph-mon[34880]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:42:04.667 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:04 smithi159 ceph-mon[30935]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:04 smithi203 ceph-mon[35473]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:04 smithi189 ceph-mon[34880]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:05.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:05 smithi203 ceph-mon[35473]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:42:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:05 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2185515445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cda5238c-fc5d-4c45-b495-781bc5de8142"}]: dispatch 2024-09-19T06:42:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:05 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2185515445' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cda5238c-fc5d-4c45-b495-781bc5de8142"}]': finished 2024-09-19T06:42:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:05 smithi203 ceph-mon[35473]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T06:42:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:05 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2026906012' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:42:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:05 smithi189 ceph-mon[34880]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:42:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:05 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2185515445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cda5238c-fc5d-4c45-b495-781bc5de8142"}]: dispatch 2024-09-19T06:42:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:05 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2185515445' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cda5238c-fc5d-4c45-b495-781bc5de8142"}]': finished 2024-09-19T06:42:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:05 smithi189 ceph-mon[34880]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T06:42:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:05 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2026906012' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:42:05.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:05 smithi159 ceph-mon[30935]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:42:05.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:05 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2185515445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cda5238c-fc5d-4c45-b495-781bc5de8142"}]: dispatch 2024-09-19T06:42:05.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:05 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2185515445' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cda5238c-fc5d-4c45-b495-781bc5de8142"}]': finished 2024-09-19T06:42:05.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:05 smithi159 ceph-mon[30935]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T06:42:05.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:05.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:05 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2026906012' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:42:06.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:06 smithi203 ceph-mon[35473]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:06 smithi189 ceph-mon[34880]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:06.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:06 smithi159 ceph-mon[30935]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:08.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:08 smithi203 ceph-mon[35473]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T06:42:08.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:08 smithi189 ceph-mon[34880]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T06:42:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:08 smithi159 ceph-mon[30935]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T06:42:10.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:10 smithi159 ceph-mon[30935]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:42:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:10 smithi203 ceph-mon[35473]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:42:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:10 smithi189 ceph-mon[34880]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:42:12.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:12 smithi159 ceph-mon[30935]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:42:12.690 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:12 smithi189 ceph-mon[34880]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:42:12.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:12 smithi203 ceph-mon[35473]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:42:13.692 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:13 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:42:13.693 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:13 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:13.705 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:13 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:42:13.705 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:13 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:13.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:13 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:42:13.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:13 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:14.711 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:14 smithi159 ceph-mon[30935]: Deploying daemon osd.6 on smithi159 2024-09-19T06:42:14.711 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:14 smithi159 ceph-mon[30935]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T06:42:14.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:14 smithi203 ceph-mon[35473]: Deploying daemon osd.6 on smithi159 2024-09-19T06:42:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:14 smithi203 ceph-mon[35473]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T06:42:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:14 smithi189 ceph-mon[34880]: Deploying daemon osd.6 on smithi159 2024-09-19T06:42:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:14 smithi189 ceph-mon[34880]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T06:42:16.718 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:16 smithi159 ceph-mon[30935]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T06:42:16.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:16 smithi203 ceph-mon[35473]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T06:42:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:16 smithi189 ceph-mon[34880]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T06:42:18.506 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:18 smithi159 ceph-mon[30935]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:42:18.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:18 smithi203 ceph-mon[35473]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:42:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:18 smithi189 ceph-mon[34880]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:42:19.771 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:19.772 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:19.772 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:19.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:19.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:19.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:19.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:19.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:19.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:20.745 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:20 smithi159 ceph-mon[30935]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:20.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:20 smithi203 ceph-mon[35473]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:20 smithi189 ceph-mon[34880]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:22.771 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:22 smithi159 ceph-mon[30935]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:22.772 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:22 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:22.772 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:22 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:22.772 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:22 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:22.772 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:22 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:22.772 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:22 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:22.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.812+0000 7f4677fff640 1 -- 172.21.15.159:0/37678514 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4690109cf0 con 0x7f46780a3270 2024-09-19T06:42:22.813 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 6 on host 'smithi159' 2024-09-19T06:42:22.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f46780a3270 msgr2=0x7f46780a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:22.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f46780a3270 0x7f46780a5730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f469019b630 tx=0x7f468400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 msgr2=0x7f469019a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 0x7f469019a110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4680031610 tx=0x7f46800043b0 comp rx=0 tx=0).stop 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 shutdown_connections 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f46780a3270 0x7f46780a5730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46901037c0 0x7f46901a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4690102e00 0x7f469019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 --2- 172.21.15.159:0/37678514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4690101c00 0x7f469019a110 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 >> 172.21.15.159:0/37678514 conn(0x7f46900fd390 msgr2=0x7f46901085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 shutdown_connections 2024-09-19T06:42:22.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:42:22.814+0000 7f4695213640 1 -- 172.21.15.159:0/37678514 wait complete. 2024-09-19T06:42:22.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:22 smithi203 ceph-mon[35473]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:22.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:22 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:22.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:22 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:22.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:22 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:22.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:22 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:22.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:22 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:22 smithi189 ceph-mon[34880]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:22 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:23.518 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:23.518 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:23.518 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:23 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:23.546 DEBUG:teuthology.orchestra.run.smithi159:osd.6> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T06:42:23.549 INFO:tasks.cephadm:Deploying osd.7 on smithi189 with /dev/vg_nvme/lv_2... 2024-09-19T06:42:23.549 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:42:23.805 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:42:23.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:23.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:23.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:23 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:23.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:23.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:23.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:23 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:24.715 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:24 smithi159 ceph-mon[30935]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:24.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:24 smithi203 ceph-mon[35473]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:24.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:24 smithi189 ceph-mon[34880]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:24.979 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:42:24 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:42:24.713+0000 7f514c6c4640 -1 osd.6 0 log_to_monitors true 2024-09-19T06:42:25.616 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:25 smithi159 ceph-mon[30935]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:42:25.746 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:25 smithi189 ceph-mon[34880]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:42:25.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:25 smithi203 ceph-mon[35473]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:42:26.455 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:42:26.480 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-09-19T06:42:26.739 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:42:26.768 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:26 smithi189 ceph-mon[34880]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:26.768 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:26 smithi189 ceph-mon[34880]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:42:26.768 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:26 smithi189 ceph-mon[34880]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:42:26.769 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:26 smithi189 ceph-mon[34880]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:42:26.769 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:26.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:26 smithi203 ceph-mon[35473]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:26 smithi203 ceph-mon[35473]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:42:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:26 smithi203 ceph-mon[35473]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:42:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:26 smithi203 ceph-mon[35473]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:42:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:26.892 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:26 smithi159 ceph-mon[30935]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:26.892 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:26 smithi159 ceph-mon[30935]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:42:26.893 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:26 smithi159 ceph-mon[30935]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:42:26.893 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:26 smithi159 ceph-mon[30935]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:42:26.893 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:27.147 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:42:26 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:42:26.890+0000 7f5148647640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T06:42:27.148 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:42:26 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:42:26.897+0000 7f5140467640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 -- 172.21.15.189:0/1793713535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 msgr2=0x7fe5f4108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/1793713535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 0x7fe5f4108f20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009ca0 tx=0x7fe5e402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 -- 172.21.15.189:0/1793713535 shutdown_connections 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/1793713535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 0x7fe5f4108f20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/1793713535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4101cd0 0x7fe5f4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/1793713535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5f4100ad0 0x7fe5f4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 -- 172.21.15.189:0/1793713535 >> 172.21.15.189:0/1793713535 conn(0x7fe5f40fc280 msgr2=0x7fe5f40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 -- 172.21.15.189:0/1793713535 shutdown_connections 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 -- 172.21.15.189:0/1793713535 wait complete. 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 Processor -- start 2024-09-19T06:42:27.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.249+0000 7fe5f8be4640 1 -- start start 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f8be4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5f4100ad0 0x7fe5f4197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f8be4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4101cd0 0x7fe5f41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f8be4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 0x7fe5f419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f8be4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f410d880 con 0x7fe5f4100ad0 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f8be4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f410d700 con 0x7fe5f4102690 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f8be4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f410da00 con 0x7fe5f4101cd0 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5f4100ad0 0x7fe5f4197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f2d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 0x7fe5f419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5f4100ad0 0x7fe5f4197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.189:48050/0 (socket says 172.21.15.189:48050) 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f259c640 1 -- 172.21.15.189:0/2732567817 learned_addr learned my addr 172.21.15.189:0/2732567817 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-19T06:42:27.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f2d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 0x7fe5f419f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:50150/0 (socket says 172.21.15.189:50150) 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f1d9b640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4101cd0 0x7fe5f41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f2d9d640 1 -- 172.21.15.189:0/2732567817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4101cd0 msgr2=0x7fe5f41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f2d9d640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4101cd0 0x7fe5f41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f2d9d640 1 -- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5f4100ad0 msgr2=0x7fe5f4197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f2d9d640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5f4100ad0 0x7fe5f4197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f2d9d640 1 -- 172.21.15.189:0/2732567817 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f419fae0 con 0x7fe5f4102690 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f259c640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5f4100ad0 0x7fe5f4197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.250+0000 7fe5f2d9d640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 0x7fe5f419f470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4031ae0 tx=0x7fe5e4031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.251+0000 7fe5eb7fe640 1 -- 172.21.15.189:0/2732567817 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4003c30 con 0x7fe5f4102690 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.251+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f419fd70 con 0x7fe5f4102690 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.251+0000 7fe5eb7fe640 1 -- 172.21.15.189:0/2732567817 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5e4003dd0 con 0x7fe5f4102690 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.251+0000 7fe5eb7fe640 1 -- 172.21.15.189:0/2732567817 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e402fd40 con 0x7fe5f4102690 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.251+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f41a0220 con 0x7fe5f4102690 2024-09-19T06:42:27.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.252+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f4100ed0 con 0x7fe5f4102690 2024-09-19T06:42:27.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.253+0000 7fe5eb7fe640 1 -- 172.21.15.189:0/2732567817 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fe5e4004050 con 0x7fe5f4102690 2024-09-19T06:42:27.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.253+0000 7fe5eb7fe640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe5e00a3270 0x7fe5e00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:27.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.253+0000 7fe5eb7fe640 1 -- 172.21.15.189:0/2732567817 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7fe5e40efde0 con 0x7fe5f4102690 2024-09-19T06:42:27.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.254+0000 7fe5f259c640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe5e00a3270 0x7fe5e00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:27.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.254+0000 7fe5f259c640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe5e00a3270 0x7fe5e00a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0104e0 tx=0x7fe5ec00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:27.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.258+0000 7fe5eb7fe640 1 -- 172.21.15.189:0/2732567817 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5e40bd930 con 0x7fe5f4102690 2024-09-19T06:42:27.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:27.441+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe5f4062630 con 0x7fe5e00a3270 2024-09-19T06:42:27.764 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:42:27.764 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.765 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' 2024-09-19T06:42:27.766 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:42:27.766 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:42:27.766 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:27.766 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:27 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:27.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:27.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:27.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' 2024-09-19T06:42:27.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:42:27.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:42:27.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:27.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:27 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:27.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:42:27.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:42:27.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:27.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:27.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:27.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645]' entity='osd.6' 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:27.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:27 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:28 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:42:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:28 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:42:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:28 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi159 2024-09-19T06:42:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:28 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-19T06:42:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:28 smithi203 ceph-mon[35473]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:28 smithi203 ceph-mon[35473]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:28 smithi203 ceph-mon[35473]: osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] boot 2024-09-19T06:42:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:28 smithi203 ceph-mon[35473]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T06:42:28.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:28 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:28 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:42:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:28 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:42:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:28 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi159 2024-09-19T06:42:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:28 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-19T06:42:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:28 smithi189 ceph-mon[34880]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:28 smithi189 ceph-mon[34880]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:28 smithi189 ceph-mon[34880]: osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] boot 2024-09-19T06:42:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:28 smithi189 ceph-mon[34880]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T06:42:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:28 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:28.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:28 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:42:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:28 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:42:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:28 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi159 2024-09-19T06:42:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:28 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-19T06:42:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:28 smithi159 ceph-mon[30935]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:42:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:28 smithi159 ceph-mon[30935]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:28 smithi159 ceph-mon[30935]: osd.6 [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] boot 2024-09-19T06:42:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:28 smithi159 ceph-mon[30935]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T06:42:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:28 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:42:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:30 smithi203 ceph-mon[35473]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:30 smithi203 ceph-mon[35473]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T06:42:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:30 smithi203 ceph-mon[35473]: from='client.? 172.21.15.189:0/3737846175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4"}]: dispatch 2024-09-19T06:42:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:30 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4"}]: dispatch 2024-09-19T06:42:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:30 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4"}]': finished 2024-09-19T06:42:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:30 smithi203 ceph-mon[35473]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T06:42:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:30 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:30 smithi203 ceph-mon[35473]: from='client.? 172.21.15.189:0/680263704' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:42:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:30 smithi189 ceph-mon[34880]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:30 smithi189 ceph-mon[34880]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T06:42:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:30 smithi189 ceph-mon[34880]: from='client.? 172.21.15.189:0/3737846175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4"}]: dispatch 2024-09-19T06:42:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:30 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4"}]: dispatch 2024-09-19T06:42:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:30 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4"}]': finished 2024-09-19T06:42:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:30 smithi189 ceph-mon[34880]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T06:42:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:30 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:30 smithi189 ceph-mon[34880]: from='client.? 172.21.15.189:0/680263704' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:42:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:30 smithi159 ceph-mon[30935]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:30 smithi159 ceph-mon[30935]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T06:42:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:30 smithi159 ceph-mon[30935]: from='client.? 172.21.15.189:0/3737846175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4"}]: dispatch 2024-09-19T06:42:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:30 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4"}]: dispatch 2024-09-19T06:42:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:30 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4"}]': finished 2024-09-19T06:42:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:30 smithi159 ceph-mon[30935]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T06:42:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:30 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:30 smithi159 ceph-mon[30935]: from='client.? 172.21.15.189:0/680263704' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:42:32.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:32 smithi203 ceph-mon[35473]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:32 smithi189 ceph-mon[34880]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:32.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:32 smithi159 ceph-mon[30935]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:34.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:34 smithi189 ceph-mon[34880]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:34.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:34 smithi203 ceph-mon[35473]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:34.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:34 smithi159 ceph-mon[30935]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:36.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:36 smithi203 ceph-mon[35473]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:36.853 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:36 smithi189 ceph-mon[34880]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:36.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:36 smithi159 ceph-mon[30935]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:38.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:38 smithi189 ceph-mon[34880]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:38.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:38 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:42:38.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:38 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:38.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:38 smithi203 ceph-mon[35473]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:38.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:38 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:42:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:38 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:38.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:38 smithi159 ceph-mon[30935]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:38.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:38 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:42:38.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:38 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:39.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:39 smithi189 ceph-mon[34880]: Deploying daemon osd.7 on smithi189 2024-09-19T06:42:39.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:39 smithi203 ceph-mon[35473]: Deploying daemon osd.7 on smithi189 2024-09-19T06:42:39.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:39 smithi159 ceph-mon[30935]: Deploying daemon osd.7 on smithi189 2024-09-19T06:42:40.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:40 smithi189 ceph-mon[34880]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:40.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:40 smithi203 ceph-mon[35473]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:40.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:40 smithi159 ceph-mon[30935]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:42.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:42 smithi189 ceph-mon[34880]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:42.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:42 smithi203 ceph-mon[35473]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:42.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:42 smithi159 ceph-mon[30935]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:44.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:44 smithi203 ceph-mon[35473]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:44.851 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:44 smithi189 ceph-mon[34880]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:44.851 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:44.851 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:44.851 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:44.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:44 smithi159 ceph-mon[30935]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:44.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:46.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:46 smithi203 ceph-mon[35473]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:46.848 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:46 smithi189 ceph-mon[34880]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:46.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:46 smithi159 ceph-mon[30935]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:48.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.166+0000 7fe5eb7fe640 1 -- 172.21.15.189:0/2732567817 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe5f4062630 con 0x7fe5e00a3270 2024-09-19T06:42:48.168 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 7 on host 'smithi189' 2024-09-19T06:42:48.170 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe5e00a3270 msgr2=0x7fe5e00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:48.170 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe5e00a3270 0x7fe5e00a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0104e0 tx=0x7fe5ec00b410 comp rx=0 tx=0).stop 2024-09-19T06:42:48.170 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 msgr2=0x7fe5f419f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:48.170 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 0x7fe5f419f470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4031ae0 tx=0x7fe5e4031ee0 comp rx=0 tx=0).stop 2024-09-19T06:42:48.170 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 shutdown_connections 2024-09-19T06:42:48.170 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe5e00a3270 0x7fe5e00a5730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:48.170 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f4102690 0x7fe5f419f470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:48.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4101cd0 0x7fe5f41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:48.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 --2- 172.21.15.189:0/2732567817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5f4100ad0 0x7fe5f4197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:48.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 >> 172.21.15.189:0/2732567817 conn(0x7fe5f40fc280 msgr2=0x7fe5f4105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:48.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 shutdown_connections 2024-09-19T06:42:48.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:42:48.169+0000 7fe5f8be4640 1 -- 172.21.15.189:0/2732567817 wait complete. 2024-09-19T06:42:48.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:48.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:48.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:48.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:48.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:48.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:48 smithi189 ceph-mon[34880]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:48.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:48.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:48.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:48.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:48.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:48.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:48 smithi159 ceph-mon[30935]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:48.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:48.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:48.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:48.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:48.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:48.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:48 smithi203 ceph-mon[35473]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:48.835 DEBUG:teuthology.orchestra.run.smithi189:osd.7> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T06:42:48.838 INFO:tasks.cephadm:Deploying osd.8 on smithi203 with /dev/vg_nvme/lv_2... 2024-09-19T06:42:48.838 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:42:49.094 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:42:49.215 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:49 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:49.215 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:49 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:49.215 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:49 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:49.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:49 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:49.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:49 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:49.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:49 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:49.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:49 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:49.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:49 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:49.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:49 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:50.335 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:50 smithi189 ceph-mon[34880]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:50.336 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:50 smithi189 ceph-mon[34880]: from='osd.7 [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:42:50.336 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:50 smithi189 ceph-mon[34880]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:42:50.336 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:42:50 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:42:50.039+0000 7f192efd1640 -1 osd.7 0 log_to_monitors true 2024-09-19T06:42:50.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:50 smithi159 ceph-mon[30935]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:50.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:50 smithi159 ceph-mon[30935]: from='osd.7 [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:42:50.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:50 smithi159 ceph-mon[30935]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:42:50.441 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:50 smithi203 ceph-mon[35473]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:50.441 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:50 smithi203 ceph-mon[35473]: from='osd.7 [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:42:50.441 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:50 smithi203 ceph-mon[35473]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:42:51.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:51 smithi203 ceph-mon[35473]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:42:51.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:51 smithi203 ceph-mon[35473]: from='osd.7 [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:42:51.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:51 smithi203 ceph-mon[35473]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:42:51.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:51 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:51.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:51 smithi203 ceph-mon[35473]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:42:51.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:51 smithi189 ceph-mon[34880]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:42:51.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:51 smithi189 ceph-mon[34880]: from='osd.7 [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:42:51.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:51 smithi189 ceph-mon[34880]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:42:51.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:51 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:51.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:51 smithi189 ceph-mon[34880]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:42:51.388 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:42:51 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:42:51.122+0000 7f192af54640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T06:42:51.389 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:42:51 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:42:51.129+0000 7f1926d7c640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:42:51.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:51 smithi159 ceph-mon[30935]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:42:51.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:51 smithi159 ceph-mon[30935]: from='osd.7 [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:42:51.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:51 smithi159 ceph-mon[30935]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:42:51.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:51 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:51.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:51 smithi159 ceph-mon[30935]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:42:51.698 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:42:51.725 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_2 2024-09-19T06:42:51.988 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:42:52.366 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:42:52.366 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:42:52.366 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:52.367 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:52.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:52.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:52.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:52.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:42:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:42:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:42:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:52.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:52.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:42:52.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:52.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:52.399 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:42:52.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 -- 172.21.15.203:0/1567371685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10105070 msgr2=0x7fef10107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:52.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 --2- 172.21.15.203:0/1567371685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10105070 0x7fef10107460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fef00009900 tx=0x7fef0002a410 comp rx=0 tx=0).stop 2024-09-19T06:42:52.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 -- 172.21.15.203:0/1567371685 shutdown_connections 2024-09-19T06:42:52.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 --2- 172.21.15.203:0/1567371685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef101079a0 0x7fef10109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 --2- 172.21.15.203:0/1567371685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10105070 0x7fef10107460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 --2- 172.21.15.203:0/1567371685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef10102740 0x7fef10104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 -- 172.21.15.203:0/1567371685 >> 172.21.15.203:0/1567371685 conn(0x7fef100fc2a0 msgr2=0x7fef100fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:52.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 -- 172.21.15.203:0/1567371685 shutdown_connections 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 -- 172.21.15.203:0/1567371685 wait complete. 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.550+0000 7fef15b83640 1 Processor -- start 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef15b83640 1 -- start start 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef15b83640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10102740 0x7fef101020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef15b83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef10105070 0x7fef101006f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef15b83640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef101079a0 0x7fef10100c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef15b83640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fef1010d870 con 0x7fef10105070 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef15b83640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef1010d6f0 con 0x7fef101079a0 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef15b83640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef1010d9f0 con 0x7fef10102740 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0f7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10102740 0x7fef101020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef10105070 0x7fef101006f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:52.554 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0f7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10102740 0x7fef101020a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:52946/0 (socket says 172.21.15.203:52946) 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0f7fe640 1 -- 172.21.15.203:0/1047422064 learned_addr learned my addr 172.21.15.203:0/1047422064 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0ffff640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef101079a0 0x7fef10100c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0f7fe640 1 -- 172.21.15.203:0/1047422064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef101079a0 msgr2=0x7fef10100c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0f7fe640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef101079a0 0x7fef10100c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0f7fe640 1 -- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef10105070 msgr2=0x7fef101006f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0f7fe640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef10105070 0x7fef101006f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0f7fe640 1 -- 172.21.15.203:0/1047422064 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef101014f0 con 0x7fef10102740 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.551+0000 7fef0effd640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef10105070 0x7fef101006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.552+0000 7fef0f7fe640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10102740 0x7fef101020a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feef800d950 tx=0x7feef800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.552+0000 7fef0cff9640 1 -- 172.21.15.203:0/1047422064 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8017070 con 0x7fef10102740 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.552+0000 7fef0cff9640 1 -- 172.21.15.203:0/1047422064 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feef8009c30 con 0x7fef10102740 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.552+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef101a20b0 con 0x7fef10102740 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.552+0000 7fef0cff9640 1 -- 172.21.15.203:0/1047422064 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef800f6b0 con 0x7fef10102740 2024-09-19T06:42:52.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.552+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef101a25c0 con 0x7fef10102740 2024-09-19T06:42:52.556 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.553+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef10105450 con 0x7fef10102740 2024-09-19T06:42:52.556 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.554+0000 7fef0cff9640 1 -- 172.21.15.203:0/1047422064 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7feef80109d0 con 0x7fef10102740 2024-09-19T06:42:52.557 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.555+0000 7fef0cff9640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7feefc0a3240 0x7feefc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:52.557 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.555+0000 7fef0cff9640 1 -- 172.21.15.203:0/1047422064 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5430+0+0 (secure 0 0 0) 0x7feef80ce970 con 0x7fef10102740 2024-09-19T06:42:52.557 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.555+0000 7fef0effd640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7feefc0a3240 0x7feefc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:52.557 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.556+0000 7fef0effd640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7feefc0a3240 0x7feefc0a5700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fef00005ab0 tx=0x7fef00000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:52.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.559+0000 7fef0cff9640 1 -- 172.21.15.203:0/1047422064 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feef8009de0 con 0x7fef10102740 2024-09-19T06:42:52.734 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:42:52.733+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fef10062630 con 0x7feefc0a3240 2024-09-19T06:42:53.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:42:53.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:42:53.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi189 2024-09-19T06:42:53.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-19T06:42:53.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:53.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: osd.7 [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] boot 2024-09-19T06:42:53.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T06:42:53.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:53.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:42:53.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:42:53.389 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:53 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:53.395 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:42:53.395 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:42:53.396 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi189 2024-09-19T06:42:53.396 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-19T06:42:53.396 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:53.396 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: osd.7 [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] boot 2024-09-19T06:42:53.396 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T06:42:53.396 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:53.396 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:42:53.396 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:42:53.396 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:53 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi189 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: osd.7 [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] boot 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:42:53.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:53 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:54.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:54 smithi159 ceph-mon[30935]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:54.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:54 smithi159 ceph-mon[30935]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T06:42:54.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:54 smithi159 ceph-mon[30935]: pgmap v168: 1 pgs: 1 unknown; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:42:54.469 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:54 smithi203 ceph-mon[35473]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:54.469 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:54 smithi203 ceph-mon[35473]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T06:42:54.469 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:54 smithi203 ceph-mon[35473]: pgmap v168: 1 pgs: 1 unknown; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:42:54.627 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:54 smithi189 ceph-mon[34880]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:54.627 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:54 smithi189 ceph-mon[34880]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T06:42:54.627 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:54 smithi189 ceph-mon[34880]: pgmap v168: 1 pgs: 1 unknown; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:42:55.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:55 smithi159 ceph-mon[30935]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T06:42:55.452 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:55 smithi203 ceph-mon[35473]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T06:42:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:55 smithi189 ceph-mon[34880]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T06:42:56.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:56 smithi203 ceph-mon[35473]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T06:42:56.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:56 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/2240342839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "351b6b47-cfc7-4274-9cc5-a11b341f8695"}]: dispatch 2024-09-19T06:42:56.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:56 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "351b6b47-cfc7-4274-9cc5-a11b341f8695"}]: dispatch 2024-09-19T06:42:56.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:56 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "351b6b47-cfc7-4274-9cc5-a11b341f8695"}]': finished 2024-09-19T06:42:56.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:56 smithi203 ceph-mon[35473]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:42:56.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:56 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:42:56.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:56 smithi203 ceph-mon[35473]: pgmap v172: 1 pgs: 1 unknown; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:42:56.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:56 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/2599420224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:42:56.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:56 smithi189 ceph-mon[34880]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T06:42:56.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:56 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/2240342839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "351b6b47-cfc7-4274-9cc5-a11b341f8695"}]: dispatch 2024-09-19T06:42:56.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:56 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "351b6b47-cfc7-4274-9cc5-a11b341f8695"}]: dispatch 2024-09-19T06:42:56.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:56 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "351b6b47-cfc7-4274-9cc5-a11b341f8695"}]': finished 2024-09-19T06:42:56.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:56 smithi189 ceph-mon[34880]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:42:56.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:56 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:42:56.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:56 smithi189 ceph-mon[34880]: pgmap v172: 1 pgs: 1 unknown; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:42:56.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:56 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/2599420224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:42:56.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:56 smithi159 ceph-mon[30935]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T06:42:56.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:56 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/2240342839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "351b6b47-cfc7-4274-9cc5-a11b341f8695"}]: dispatch 2024-09-19T06:42:56.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:56 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "351b6b47-cfc7-4274-9cc5-a11b341f8695"}]: dispatch 2024-09-19T06:42:56.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:56 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "351b6b47-cfc7-4274-9cc5-a11b341f8695"}]': finished 2024-09-19T06:42:56.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:56 smithi159 ceph-mon[30935]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:42:56.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:56 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:42:56.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:56 smithi159 ceph-mon[30935]: pgmap v172: 1 pgs: 1 unknown; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:42:56.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:56 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/2599420224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:42:58.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:42:58 smithi203 ceph-mon[35473]: pgmap v173: 1 pgs: 1 unknown; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:42:58.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:42:58 smithi189 ceph-mon[34880]: pgmap v173: 1 pgs: 1 unknown; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:42:58.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:42:58 smithi159 ceph-mon[30935]: pgmap v173: 1 pgs: 1 unknown; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:00.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:00 smithi203 ceph-mon[35473]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:00.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:00 smithi189 ceph-mon[34880]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:00.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:00 smithi159 ceph-mon[30935]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:02.768 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:02 smithi203 ceph-mon[35473]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:02 smithi189 ceph-mon[34880]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:02.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:02 smithi159 ceph-mon[30935]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:03.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:03 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:43:03.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:03 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:03 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:43:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:03 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:03.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:03 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:43:03.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:03 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:04.544 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:04 smithi203 ceph-mon[35473]: Deploying daemon osd.8 on smithi203 2024-09-19T06:43:04.544 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:04 smithi203 ceph-mon[35473]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:04 smithi189 ceph-mon[34880]: Deploying daemon osd.8 on smithi203 2024-09-19T06:43:04.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:04 smithi189 ceph-mon[34880]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:04.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:04 smithi159 ceph-mon[30935]: Deploying daemon osd.8 on smithi203 2024-09-19T06:43:04.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:04 smithi159 ceph-mon[30935]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:06.710 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:06 smithi203 ceph-mon[35473]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:06 smithi189 ceph-mon[34880]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:06.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:06 smithi159 ceph-mon[30935]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:08.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:08 smithi203 ceph-mon[35473]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:08.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:08 smithi189 ceph-mon[34880]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:08.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:08 smithi159 ceph-mon[30935]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:09.726 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:09.726 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:09.726 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:09.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:10.729 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:10 smithi203 ceph-mon[35473]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:10.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:10 smithi189 ceph-mon[34880]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:10 smithi159 ceph-mon[30935]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:12.624 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:12 smithi203 ceph-mon[35473]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:12.624 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:12.624 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:12.624 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:12.625 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:12.625 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:12 smithi189 ceph-mon[34880]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:12 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:12 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:12 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:12 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:12 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:12 smithi159 ceph-mon[30935]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:13.254 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 8 on host 'smithi203' 2024-09-19T06:43:13.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.253+0000 7fef0cff9640 1 -- 172.21.15.203:0/1047422064 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fef10062630 con 0x7feefc0a3240 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.255+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7feefc0a3240 msgr2=0x7feefc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.255+0000 7fef15b83640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7feefc0a3240 0x7feefc0a5700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fef00005ab0 tx=0x7fef00000bc0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10102740 msgr2=0x7fef101020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10102740 0x7fef101020a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feef800d950 tx=0x7feef800de10 comp rx=0 tx=0).stop 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 shutdown_connections 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7feefc0a3240 0x7feefc0a5700 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef101079a0 0x7fef10100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef10105070 0x7fef101006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 --2- 172.21.15.203:0/1047422064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef10102740 0x7fef101020a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 >> 172.21.15.203:0/1047422064 conn(0x7fef100fc2a0 msgr2=0x7fef10103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:13.258 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 shutdown_connections 2024-09-19T06:43:13.258 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:43:13.256+0000 7fef15b83640 1 -- 172.21.15.203:0/1047422064 wait complete. 2024-09-19T06:43:13.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:13 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:13.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:13 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:13.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:13 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:13.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:13 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:13.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:13 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:13.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:13 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:13.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:13 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:13 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:13 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:13.979 DEBUG:teuthology.orchestra.run.smithi203:osd.8> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T06:43:13.981 INFO:tasks.cephadm:Deploying osd.9 on smithi159 with /dev/vg_nvme/lv_1... 2024-09-19T06:43:13.981 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:43:14.240 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:14 smithi203 ceph-mon[35473]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:14.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:14 smithi159 ceph-mon[30935]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:14 smithi189 ceph-mon[34880]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:15.138 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:43:15 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:43:15.065+0000 7fca7158d640 -1 osd.8 0 log_to_monitors true 2024-09-19T06:43:15.722 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:15 smithi203 ceph-mon[35473]: from='osd.8 [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:43:15.722 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:15 smithi203 ceph-mon[35473]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:43:15.817 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:15 smithi159 ceph-mon[30935]: from='osd.8 [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:43:15.817 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:15 smithi159 ceph-mon[30935]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:43:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:15 smithi189 ceph-mon[34880]: from='osd.8 [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:43:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:15 smithi189 ceph-mon[34880]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:43:16.786 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:16 smithi159 ceph-mon[30935]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:16.786 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:16 smithi159 ceph-mon[30935]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:43:16.787 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:16 smithi159 ceph-mon[30935]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:43:16.787 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:16 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:16.787 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:16 smithi159 ceph-mon[30935]: from='osd.8 [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:43:16.787 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:16 smithi159 ceph-mon[30935]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:43:16.842 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:43:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:43:16.474+0000 7fca6d510640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T06:43:16.842 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:43:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:43:16.483+0000 7fca69338640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:43:16.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:16 smithi203 ceph-mon[35473]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:16.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:16 smithi203 ceph-mon[35473]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:43:16.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:16 smithi203 ceph-mon[35473]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:43:16.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:16 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:16.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:16 smithi203 ceph-mon[35473]: from='osd.8 [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:43:16.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:16 smithi203 ceph-mon[35473]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:43:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:16 smithi189 ceph-mon[34880]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:16 smithi189 ceph-mon[34880]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:43:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:16 smithi189 ceph-mon[34880]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:43:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:16 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:16 smithi189 ceph-mon[34880]: from='osd.8 [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:43:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:16 smithi189 ceph-mon[34880]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:43:16.938 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:43:16.970 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_1 2024-09-19T06:43:17.229 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:17.639 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:43:17.639 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:43:17.639 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:17.639 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:17.639 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: osd.8 [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] boot 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T06:43:17.640 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:17.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.721+0000 7fe321777640 1 -- 172.21.15.159:0/236270798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c101c00 msgr2=0x7fe31c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:17.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.721+0000 7fe321777640 1 --2- 172.21.15.159:0/236270798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c101c00 0x7fe31c102000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009900 tx=0x7fe30c02a410 comp rx=0 tx=0).stop 2024-09-19T06:43:17.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.721+0000 7fe321777640 1 -- 172.21.15.159:0/236270798 shutdown_connections 2024-09-19T06:43:17.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.721+0000 7fe321777640 1 --2- 172.21.15.159:0/236270798 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe31c1037c0 0x7fe31c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.721+0000 7fe321777640 1 --2- 172.21.15.159:0/236270798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31c102e00 0x7fe31c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.721+0000 7fe321777640 1 --2- 172.21.15.159:0/236270798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c101c00 0x7fe31c102000 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.721+0000 7fe321777640 1 -- 172.21.15.159:0/236270798 >> 172.21.15.159:0/236270798 conn(0x7fe31c0fd390 msgr2=0x7fe31c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:17.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.721+0000 7fe321777640 1 -- 172.21.15.159:0/236270798 shutdown_connections 2024-09-19T06:43:17.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.721+0000 7fe321777640 1 -- 172.21.15.159:0/236270798 wait complete. 2024-09-19T06:43:17.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe321777640 1 Processor -- start 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe321777640 1 -- start start 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe321777640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31c101c00 0x7fe31c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe321777640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c102e00 0x7fe31c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe321777640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe31c1037c0 0x7fe31c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe321777640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c10d890 con 0x7fe31c102e00 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe321777640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c10d710 con 0x7fe31c101c00 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe321777640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c10da10 con 0x7fe31c1037c0 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c102e00 0x7fe31c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c102e00 0x7fe31c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35610/0 (socket says 172.21.15.159:35610) 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe31a7fc640 1 -- 172.21.15.159:0/389234950 learned_addr learned my addr 172.21.15.159:0/389234950 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.722+0000 7fe31b7fe640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe31c1037c0 0x7fe31c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe31affd640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31c101c00 0x7fe31c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe31a7fc640 1 -- 172.21.15.159:0/389234950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe31c1037c0 msgr2=0x7fe31c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe31a7fc640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe31c1037c0 0x7fe31c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe31a7fc640 1 -- 172.21.15.159:0/389234950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31c101c00 msgr2=0x7fe31c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe31a7fc640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31c101c00 0x7fe31c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe31a7fc640 1 -- 172.21.15.159:0/389234950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c0753e0 con 0x7fe31c102e00 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe31a7fc640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c102e00 0x7fe31c0745e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe31000e9f0 tx=0x7fe31000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe303fff640 1 -- 172.21.15.159:0/389234950 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31000cd80 con 0x7fe31c102e00 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c1a2060 con 0x7fe31c102e00 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe303fff640 1 -- 172.21.15.159:0/389234950 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe310010910 con 0x7fe31c102e00 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe303fff640 1 -- 172.21.15.159:0/389234950 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310018990 con 0x7fe31c102e00 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.723+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c1a2570 con 0x7fe31c102e00 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.724+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31c108fa0 con 0x7fe31c102e00 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.726+0000 7fe303fff640 1 -- 172.21.15.159:0/389234950 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fe310010ac0 con 0x7fe31c102e00 2024-09-19T06:43:17.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.727+0000 7fe303fff640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe3040a3240 0x7fe3040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.727+0000 7fe31affd640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe3040a3240 0x7fe3040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.727+0000 7fe303fff640 1 -- 172.21.15.159:0/389234950 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5862+0+0 (secure 0 0 0) 0x7fe3100cf6e0 con 0x7fe31c102e00 2024-09-19T06:43:17.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.727+0000 7fe31affd640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe3040a3240 0x7fe3040a5700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006010 tx=0x7fe30c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:17.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.730+0000 7fe303fff640 1 -- 172.21.15.159:0/389234950 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe31009cd90 con 0x7fe31c102e00 2024-09-19T06:43:17.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:43:17.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:43:17.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:17.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:17.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: osd.8 [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] boot 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T06:43:17.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:43:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:43:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:17.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:17.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:17.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:17.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:17.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: osd.8 [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] boot 2024-09-19T06:43:17.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T06:43:17.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:43:17.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:17.905+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe31c062630 con 0x7fe3040a3240 2024-09-19T06:43:18.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:18 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:43:18.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:18 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:43:18.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:18 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi203 2024-09-19T06:43:18.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:18 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi203 to 5696M 2024-09-19T06:43:18.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:18 smithi159 ceph-mon[30935]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:18.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:18 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:43:18.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:18 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:43:18.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:18 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:18.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:18 smithi159 ceph-mon[30935]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T06:43:18.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:18 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:43:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:18 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:43:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:18 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi203 2024-09-19T06:43:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:18 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi203 to 5696M 2024-09-19T06:43:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:18 smithi203 ceph-mon[35473]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:18 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:43:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:18 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:43:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:18 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:18.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:18 smithi203 ceph-mon[35473]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T06:43:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:18 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:43:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:18 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:43:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:18 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi203 2024-09-19T06:43:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:18 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi203 to 5696M 2024-09-19T06:43:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:18 smithi189 ceph-mon[34880]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:43:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:18 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:43:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:18 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:43:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:18 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:18 smithi189 ceph-mon[34880]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T06:43:19.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:19 smithi159 ceph-mon[30935]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:19.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:19 smithi159 ceph-mon[30935]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:43:19.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:19 smithi203 ceph-mon[35473]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:19.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:19 smithi203 ceph-mon[35473]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:43:19.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:19 smithi189 ceph-mon[34880]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:19.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:19 smithi189 ceph-mon[34880]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:43:20.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:20 smithi203 ceph-mon[35473]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:20 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2758054259' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76ab4227-85ea-40eb-b916-b897d8496768"}]: dispatch 2024-09-19T06:43:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:20 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2758054259' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76ab4227-85ea-40eb-b916-b897d8496768"}]': finished 2024-09-19T06:43:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:20 smithi203 ceph-mon[35473]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T06:43:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:20 smithi189 ceph-mon[34880]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:20 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2758054259' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76ab4227-85ea-40eb-b916-b897d8496768"}]: dispatch 2024-09-19T06:43:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:20 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2758054259' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76ab4227-85ea-40eb-b916-b897d8496768"}]': finished 2024-09-19T06:43:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:20 smithi189 ceph-mon[34880]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T06:43:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:20.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:20 smithi159 ceph-mon[30935]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:20.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:20 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2758054259' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76ab4227-85ea-40eb-b916-b897d8496768"}]: dispatch 2024-09-19T06:43:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:20 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2758054259' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76ab4227-85ea-40eb-b916-b897d8496768"}]': finished 2024-09-19T06:43:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:20 smithi159 ceph-mon[30935]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T06:43:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:21.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:21 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3016620930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:43:21.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:21 smithi203 ceph-mon[35473]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:43:21.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:21 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:21.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:21 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3016620930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:43:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:21 smithi189 ceph-mon[34880]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:43:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:21 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:21.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:21 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3016620930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:43:21.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:21 smithi159 ceph-mon[30935]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:43:21.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:21 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:22.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:22 smithi203 ceph-mon[35473]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:22 smithi189 ceph-mon[34880]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:22.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:22 smithi159 ceph-mon[30935]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:24.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:24 smithi203 ceph-mon[35473]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T06:43:24.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:24 smithi189 ceph-mon[34880]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T06:43:24.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:24 smithi159 ceph-mon[30935]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-19T06:43:26.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:26 smithi203 ceph-mon[35473]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:43:26.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:26 smithi189 ceph-mon[34880]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:43:26.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:26 smithi159 ceph-mon[30935]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:43:28.802 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:28 smithi159 ceph-mon[30935]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:43:28.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:28 smithi203 ceph-mon[35473]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:43:28.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:28 smithi189 ceph-mon[34880]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:43:29.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:29 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:43:29.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:29 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:29.856 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:29 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:43:29.856 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:29 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:29.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:29 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:43:29.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:29 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:30.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:30 smithi159 ceph-mon[30935]: Deploying daemon osd.9 on smithi159 2024-09-19T06:43:30.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:30 smithi159 ceph-mon[30935]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T06:43:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:30 smithi203 ceph-mon[35473]: Deploying daemon osd.9 on smithi159 2024-09-19T06:43:30.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:30 smithi203 ceph-mon[35473]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T06:43:30.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:30 smithi189 ceph-mon[34880]: Deploying daemon osd.9 on smithi159 2024-09-19T06:43:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:30 smithi189 ceph-mon[34880]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T06:43:32.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:32 smithi159 ceph-mon[30935]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:43:32.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:32 smithi203 ceph-mon[35473]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:43:32.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:32 smithi189 ceph-mon[34880]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:43:34.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:34 smithi203 ceph-mon[35473]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:43:34.885 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:34 smithi159 ceph-mon[30935]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:43:34.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:34 smithi189 ceph-mon[34880]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:43:35.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:35.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:35.624 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:35 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:35.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:35.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:35.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:35 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:35.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:35.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:35.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:35 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:36.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:36 smithi203 ceph-mon[35473]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:36.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:36 smithi189 ceph-mon[34880]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:36.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:36 smithi159 ceph-mon[30935]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:38 smithi203 ceph-mon[35473]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:38 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:38 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:38 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:38 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:38.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:38 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:38 smithi189 ceph-mon[34880]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:38 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:38 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:38 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:38 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:38 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:38.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:38 smithi159 ceph-mon[30935]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:38.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:38 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:38.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:38 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:38.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:38 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:38.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:38 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:38.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:38 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:38.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.936+0000 7fe303fff640 1 -- 172.21.15.159:0/389234950 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe31c062630 con 0x7fe3040a3240 2024-09-19T06:43:38.939 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 9 on host 'smithi159' 2024-09-19T06:43:38.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe3040a3240 msgr2=0x7fe3040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe3040a3240 0x7fe3040a5700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006010 tx=0x7fe30c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c102e00 msgr2=0x7fe31c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c102e00 0x7fe31c0745e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe31000e9f0 tx=0x7fe31000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 shutdown_connections 2024-09-19T06:43:38.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe3040a3240 0x7fe3040a5700 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe31c1037c0 0x7fe31c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31c102e00 0x7fe31c0745e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 --2- 172.21.15.159:0/389234950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31c101c00 0x7fe31c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 >> 172.21.15.159:0/389234950 conn(0x7fe31c0fd390 msgr2=0x7fe31c106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 shutdown_connections 2024-09-19T06:43:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:43:38.939+0000 7fe321777640 1 -- 172.21.15.159:0/389234950 wait complete. 2024-09-19T06:43:39.691 DEBUG:teuthology.orchestra.run.smithi159:osd.9> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T06:43:39.693 INFO:tasks.cephadm:Deploying osd.10 on smithi189 with /dev/vg_nvme/lv_1... 2024-09-19T06:43:39.693 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:43:39.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:39.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:39.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:39.878 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:39.878 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:39.878 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:39.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:39.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:39.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:39.952 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:43:40.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:40 smithi189 ceph-mon[34880]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:40.831 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:40 smithi159 ceph-mon[30935]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:40.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:40 smithi203 ceph-mon[35473]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:41.819 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:41 smithi189 ceph-mon[34880]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:43:41.829 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:41 smithi159 ceph-mon[30935]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:43:41.829 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:43:41 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:43:41.483+0000 7fd854805640 -1 osd.9 0 log_to_monitors true 2024-09-19T06:43:41.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:41 smithi203 ceph-mon[35473]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:43:42.583 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-19T06:43:42.609 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-09-19T06:43:42.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:42 smithi159 ceph-mon[30935]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:42.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:42 smithi159 ceph-mon[30935]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:43:42.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:42 smithi159 ceph-mon[30935]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:43:42.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:42 smithi159 ceph-mon[30935]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:43:42.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:42 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:42.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:42 smithi203 ceph-mon[35473]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:42 smithi203 ceph-mon[35473]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:43:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:42 smithi203 ceph-mon[35473]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:43:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:42 smithi203 ceph-mon[35473]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:43:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:42 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:42.861 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:43:42.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:42 smithi189 ceph-mon[34880]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:42.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:42 smithi189 ceph-mon[34880]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:43:42.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:42 smithi189 ceph-mon[34880]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:43:42.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:42 smithi189 ceph-mon[34880]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-19T06:43:42.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:42 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:42.949 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:43:42 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:43:42.932+0000 7fd850788640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T06:43:43.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.344+0000 7effcb101640 1 -- 172.21.15.189:0/152204428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4102660 msgr2=0x7effc4104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:43.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.344+0000 7effcb101640 1 --2- 172.21.15.189:0/152204428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4102660 0x7effc4104a50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7effb8009900 tx=0x7effb802a410 comp rx=0 tx=0).stop 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.344+0000 7effcb101640 1 -- 172.21.15.189:0/152204428 shutdown_connections 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.344+0000 7effcb101640 1 --2- 172.21.15.189:0/152204428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7effc41078c0 0x7effc4109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.344+0000 7effcb101640 1 --2- 172.21.15.189:0/152204428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effc4104f90 0x7effc4107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 --2- 172.21.15.189:0/152204428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4102660 0x7effc4104a50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 -- 172.21.15.189:0/152204428 >> 172.21.15.189:0/152204428 conn(0x7effc40fc280 msgr2=0x7effc40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 -- 172.21.15.189:0/152204428 shutdown_connections 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 -- 172.21.15.189:0/152204428 wait complete. 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 Processor -- start 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 -- start start 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effc4102660 0x7effc4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4104f90 0x7effc4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:43.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7effc41078c0 0x7effc419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7effc410d890 con 0x7effc4102660 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7effc410d710 con 0x7effc4104f90 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effcb101640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7effc410da10 con 0x7effc41078c0 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effc3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4104f90 0x7effc4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effc3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4104f90 0x7effc4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56274/0 (socket says 172.21.15.189:56274) 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.345+0000 7effc3fff640 1 -- 172.21.15.189:0/2796877369 learned_addr learned my addr 172.21.15.189:0/2796877369 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc969e640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7effc41078c0 0x7effc419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc8e9d640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effc4102660 0x7effc4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc3fff640 1 -- 172.21.15.189:0/2796877369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7effc41078c0 msgr2=0x7effc419f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc3fff640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7effc41078c0 0x7effc419f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc3fff640 1 -- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effc4102660 msgr2=0x7effc4197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:43.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc3fff640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effc4102660 0x7effc4197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc3fff640 1 -- 172.21.15.189:0/2796877369 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc419fb50 con 0x7effc4104f90 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc969e640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7effc41078c0 0x7effc419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc3fff640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4104f90 0x7effc4198460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effb000c970 tx=0x7effb000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc1ffb640 1 -- 172.21.15.189:0/2796877369 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0007bb0 con 0x7effc4104f90 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc1ffb640 1 -- 172.21.15.189:0/2796877369 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effb0007d50 con 0x7effc4104f90 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc419fe40 con 0x7effc4104f90 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effc1ffb640 1 -- 172.21.15.189:0/2796877369 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb000f450 con 0x7effc4104f90 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.346+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc41a02f0 con 0x7effc4104f90 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.347+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc40fdd70 con 0x7effc4104f90 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.348+0000 7effc1ffb640 1 -- 172.21.15.189:0/2796877369 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7effb00046c0 con 0x7effc4104f90 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.349+0000 7effc1ffb640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7effb40a3270 0x7effb40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.349+0000 7effc1ffb640 1 -- 172.21.15.189:0/2796877369 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5981+0+0 (secure 0 0 0) 0x7effb00cefb0 con 0x7effc4104f90 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.349+0000 7effc8e9d640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7effb40a3270 0x7effb40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:43.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.350+0000 7effc8e9d640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7effb40a3270 0x7effb40a5730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7effb80314e0 tx=0x7effb8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:43.372 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.352+0000 7effc1ffb640 1 -- 172.21.15.189:0/2796877369 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7effb0014030 con 0x7effc4104f90 2024-09-19T06:43:43.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:43:42 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:43:42.947+0000 7fd8485a8640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:43:43.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:43:43.536+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7effc4062630 con 0x7effb40a3270 2024-09-19T06:43:43.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:43 smithi203 ceph-mon[35473]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:43.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:43.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:43 smithi189 ceph-mon[34880]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:43.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:43:43.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:43 smithi159 ceph-mon[30935]: from='osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511]' entity='osd.9' 2024-09-19T06:43:44.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi159 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] boot 2024-09-19T06:43:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T06:43:44.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:43:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:43:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi159 2024-09-19T06:43:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-19T06:43:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:43:44.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:43:44.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:44.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] boot 2024-09-19T06:43:44.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T06:43:44.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:44.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi159 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: osd.9 [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] boot 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T06:43:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:43:46.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:45 smithi189 ceph-mon[34880]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T06:43:46.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:45 smithi189 ceph-mon[34880]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:46.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:45 smithi203 ceph-mon[35473]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T06:43:46.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:45 smithi203 ceph-mon[35473]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:46.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:45 smithi159 ceph-mon[30935]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T06:43:46.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:45 smithi159 ceph-mon[30935]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:47.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:46 smithi203 ceph-mon[35473]: from='client.? 172.21.15.189:0/3667625690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72665ec5-c275-4e11-a0a2-2326c4a08be9"}]: dispatch 2024-09-19T06:43:47.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:46 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72665ec5-c275-4e11-a0a2-2326c4a08be9"}]: dispatch 2024-09-19T06:43:47.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:46 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72665ec5-c275-4e11-a0a2-2326c4a08be9"}]': finished 2024-09-19T06:43:47.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:46 smithi203 ceph-mon[35473]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T06:43:47.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:46 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:43:47.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:46 smithi203 ceph-mon[35473]: from='client.? 172.21.15.189:0/4197550870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:43:47.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:46 smithi189 ceph-mon[34880]: from='client.? 172.21.15.189:0/3667625690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72665ec5-c275-4e11-a0a2-2326c4a08be9"}]: dispatch 2024-09-19T06:43:47.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:46 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72665ec5-c275-4e11-a0a2-2326c4a08be9"}]: dispatch 2024-09-19T06:43:47.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:46 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72665ec5-c275-4e11-a0a2-2326c4a08be9"}]': finished 2024-09-19T06:43:47.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:46 smithi189 ceph-mon[34880]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T06:43:47.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:46 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:43:47.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:46 smithi189 ceph-mon[34880]: from='client.? 172.21.15.189:0/4197550870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:43:47.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:46 smithi159 ceph-mon[30935]: from='client.? 172.21.15.189:0/3667625690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72665ec5-c275-4e11-a0a2-2326c4a08be9"}]: dispatch 2024-09-19T06:43:47.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:46 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72665ec5-c275-4e11-a0a2-2326c4a08be9"}]: dispatch 2024-09-19T06:43:47.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:46 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72665ec5-c275-4e11-a0a2-2326c4a08be9"}]': finished 2024-09-19T06:43:47.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:46 smithi159 ceph-mon[30935]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T06:43:47.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:46 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:43:47.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:46 smithi159 ceph-mon[30935]: from='client.? 172.21.15.189:0/4197550870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:43:48.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:47 smithi203 ceph-mon[35473]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:48.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:47 smithi189 ceph-mon[34880]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:48.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:47 smithi159 ceph-mon[30935]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:50.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:50 smithi203 ceph-mon[35473]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:50 smithi189 ceph-mon[34880]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:50.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:50 smithi159 ceph-mon[30935]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:52.781 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:52 smithi189 ceph-mon[34880]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:52.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:52 smithi203 ceph-mon[35473]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:52.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:52 smithi159 ceph-mon[30935]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:54.700 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:54 smithi159 ceph-mon[30935]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:54.700 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:43:54.700 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:54.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:54 smithi203 ceph-mon[35473]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:54.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:43:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:54.850 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:54 smithi189 ceph-mon[34880]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:54.850 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:43:54.850 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:55.719 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:55 smithi159 ceph-mon[30935]: Deploying daemon osd.10 on smithi189 2024-09-19T06:43:55.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:55 smithi203 ceph-mon[35473]: Deploying daemon osd.10 on smithi189 2024-09-19T06:43:55.885 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:55 smithi189 ceph-mon[34880]: Deploying daemon osd.10 on smithi189 2024-09-19T06:43:56.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:56 smithi203 ceph-mon[35473]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:56.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:56 smithi189 ceph-mon[34880]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:56.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:56 smithi159 ceph-mon[30935]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:58.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:43:58 smithi189 ceph-mon[34880]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:58.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:43:58 smithi203 ceph-mon[35473]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:43:58.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:43:58 smithi159 ceph-mon[30935]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:00.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:00 smithi203 ceph-mon[35473]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:00.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:00 smithi189 ceph-mon[34880]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:00.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:00 smithi159 ceph-mon[30935]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:01.742 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:01 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:01.742 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:01 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:01.742 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:01 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:01.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:01 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:01.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:01 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:01.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:01 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:01.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:01.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:01.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:01 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:02.785 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:02 smithi189 ceph-mon[34880]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:02.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:02 smithi203 ceph-mon[35473]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:02.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:02 smithi159 ceph-mon[30935]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:04.011 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.010+0000 7effc1ffb640 1 -- 172.21.15.189:0/2796877369 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7effc4062630 con 0x7effb40a3270 2024-09-19T06:44:04.011 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 10 on host 'smithi189' 2024-09-19T06:44:04.013 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7effb40a3270 msgr2=0x7effb40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:04.013 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7effb40a3270 0x7effb40a5730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7effb80314e0 tx=0x7effb8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.013 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4104f90 msgr2=0x7effc4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:04.013 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4104f90 0x7effc4198460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effb000c970 tx=0x7effb000ce30 comp rx=0 tx=0).stop 2024-09-19T06:44:04.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 shutdown_connections 2024-09-19T06:44:04.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7effb40a3270 0x7effb40a5730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7effc41078c0 0x7effc419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc4104f90 0x7effc4198460 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 --2- 172.21.15.189:0/2796877369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effc4102660 0x7effc4197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:04.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 >> 172.21.15.189:0/2796877369 conn(0x7effc40fc280 msgr2=0x7effc4102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:04.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 shutdown_connections 2024-09-19T06:44:04.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-19T06:44:04.012+0000 7effcb101640 1 -- 172.21.15.189:0/2796877369 wait complete. 2024-09-19T06:44:04.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:04 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:04 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:04 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:04.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:04 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:04.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:04 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:04 smithi203 ceph-mon[35473]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:04.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:04 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:04.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:04 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:04 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:04 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:04 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:04 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:04 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:04 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:04 smithi189 ceph-mon[34880]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:04 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:04 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:04 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:04 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:04 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:04 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:04 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:04 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:04 smithi159 ceph-mon[30935]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:04 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:04 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:04 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:04.761 DEBUG:teuthology.orchestra.run.smithi189:osd.10> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T06:44:04.763 INFO:tasks.cephadm:Deploying osd.11 on smithi203 with /dev/vg_nvme/lv_1... 2024-09-19T06:44:04.763 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:44:05.019 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:44:06.621 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:06 smithi189 ceph-mon[34880]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:06.622 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:44:06 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:44:06.514+0000 7fa962749640 -1 osd.10 0 log_to_monitors true 2024-09-19T06:44:06.706 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:06 smithi203 ceph-mon[35473]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:06.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:06 smithi159 ceph-mon[30935]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:07.704 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:07 smithi203 ceph-mon[35473]: from='osd.10 [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:44:07.704 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:07 smithi203 ceph-mon[35473]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:44:07.707 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T06:44:07.734 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_1 2024-09-19T06:44:07.827 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:07 smithi189 ceph-mon[34880]: from='osd.10 [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:44:07.827 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:07 smithi189 ceph-mon[34880]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:44:07.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:07 smithi159 ceph-mon[30935]: from='osd.10 [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:44:07.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:07 smithi159 ceph-mon[30935]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:44:07.993 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:44:08.499 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.483+0000 7fa263ca6640 1 -- 172.21.15.203:0/3565940741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 msgr2=0x7fa25c105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.499 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.483+0000 7fa263ca6640 1 --2- 172.21.15.203:0/3565940741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 0x7fa25c105c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa254009ca0 tx=0x7fa25402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.483+0000 7fa263ca6640 1 -- 172.21.15.203:0/3565940741 shutdown_connections 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.483+0000 7fa263ca6640 1 --2- 172.21.15.203:0/3565940741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 0x7fa25c105c40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.483+0000 7fa263ca6640 1 --2- 172.21.15.203:0/3565940741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa25c102de0 0x7fa25c105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.483+0000 7fa263ca6640 1 --2- 172.21.15.203:0/3565940741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c100490 0x7fa25c1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.483+0000 7fa263ca6640 1 -- 172.21.15.203:0/3565940741 >> 172.21.15.203:0/3565940741 conn(0x7fa25c0fc2a0 msgr2=0x7fa25c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.483+0000 7fa263ca6640 1 -- 172.21.15.203:0/3565940741 shutdown_connections 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.483+0000 7fa263ca6640 1 -- 172.21.15.203:0/3565940741 wait complete. 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa263ca6640 1 Processor -- start 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa263ca6640 1 -- start start 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa263ca6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa25c100490 0x7fa25c19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.500 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa263ca6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c102de0 0x7fa25c19e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa263ca6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 0x7fa25c1a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa263ca6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c113ea0 con 0x7fa25c102de0 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa263ca6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c113d20 con 0x7fa25c100490 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa263ca6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c114020 con 0x7fa25c105790 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa262243640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 0x7fa25c1a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa262243640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 0x7fa25c1a5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:36642/0 (socket says 172.21.15.203:36642) 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa262243640 1 -- 172.21.15.203:0/2668169577 learned_addr learned my addr 172.21.15.203:0/2668169577 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa261a42640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa25c100490 0x7fa25c19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa261241640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c102de0 0x7fa25c19e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa262243640 1 -- 172.21.15.203:0/2668169577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa25c100490 msgr2=0x7fa25c19e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa262243640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa25c100490 0x7fa25c19e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.501 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa262243640 1 -- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c102de0 msgr2=0x7fa25c19e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa262243640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c102de0 0x7fa25c19e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.484+0000 7fa262243640 1 -- 172.21.15.203:0/2668169577 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c1a60b0 con 0x7fa25c105790 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.485+0000 7fa262243640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 0x7fa25c1a5a40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa254005e30 tx=0x7fa254031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.485+0000 7fa252ffd640 1 -- 172.21.15.203:0/2668169577 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254003c30 con 0x7fa25c105790 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.485+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25c1a6340 con 0x7fa25c105790 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.485+0000 7fa252ffd640 1 -- 172.21.15.203:0/2668169577 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa254003dd0 con 0x7fa25c105790 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.485+0000 7fa252ffd640 1 -- 172.21.15.203:0/2668169577 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25402fde0 con 0x7fa25c105790 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.485+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25c1a68d0 con 0x7fa25c105790 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.486+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25c0fdd90 con 0x7fa25c105790 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.487+0000 7fa252ffd640 1 -- 172.21.15.203:0/2668169577 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa254004050 con 0x7fa25c105790 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.488+0000 7fa252ffd640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa2480a3270 0x7fa2480a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.489+0000 7fa261a42640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa2480a3270 0x7fa2480a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.489+0000 7fa252ffd640 1 -- 172.21.15.203:0/2668169577 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6414+0+0 (secure 0 0 0) 0x7fa2540f05d0 con 0x7fa25c105790 2024-09-19T06:44:08.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.489+0000 7fa261a42640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa2480a3270 0x7fa2480a5730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00bbe0 tx=0x7fa24c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:08.503 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.492+0000 7fa252ffd640 1 -- 172.21.15.203:0/2668169577 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa2540bda40 con 0x7fa25c105790 2024-09-19T06:44:08.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:08.666+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa25c062630 con 0x7fa2480a3270 2024-09-19T06:44:08.668 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:08.668 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:44:08.668 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='osd.10 [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:08.669 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:44:08.460+0000 7fa95e6cc640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T06:44:08.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:44:08.471+0000 7fa95a4f4640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='osd.10 [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:08.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:08.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='osd.10 [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:08.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:08.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:08.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:08.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:09.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi189 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: osd.10 [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] boot 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T06:44:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:09 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi189 2024-09-19T06:44:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-19T06:44:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:44:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:44:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:44:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:44:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: osd.10 [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] boot 2024-09-19T06:44:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T06:44:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:09 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:09.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi189 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: osd.10 [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] boot 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T06:44:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:09 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:44:10.570 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:10 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:44:10.570 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:10 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:44:10.571 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:10 smithi203 ceph-mon[35473]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:10.571 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:10 smithi203 ceph-mon[35473]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:10.571 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:10 smithi203 ceph-mon[35473]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T06:44:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:10 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:44:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:10 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:44:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:10 smithi189 ceph-mon[34880]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:10 smithi189 ceph-mon[34880]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:10 smithi189 ceph-mon[34880]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T06:44:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:10 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:44:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:10 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:44:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:10 smithi159 ceph-mon[30935]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:10 smithi159 ceph-mon[30935]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:44:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:10 smithi159 ceph-mon[30935]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T06:44:11.700 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:11 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/4041374142' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bef0c50-64ad-4014-a6ad-db56a89ad139"}]: dispatch 2024-09-19T06:44:11.700 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:11 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bef0c50-64ad-4014-a6ad-db56a89ad139"}]: dispatch 2024-09-19T06:44:11.701 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:11 smithi203 ceph-mon[35473]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bef0c50-64ad-4014-a6ad-db56a89ad139"}]': finished 2024-09-19T06:44:11.701 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:11 smithi203 ceph-mon[35473]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T06:44:11.701 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:11 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/4041374142' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bef0c50-64ad-4014-a6ad-db56a89ad139"}]: dispatch 2024-09-19T06:44:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:11 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bef0c50-64ad-4014-a6ad-db56a89ad139"}]: dispatch 2024-09-19T06:44:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:11 smithi189 ceph-mon[34880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bef0c50-64ad-4014-a6ad-db56a89ad139"}]': finished 2024-09-19T06:44:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:11 smithi189 ceph-mon[34880]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T06:44:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:11 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:11.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:11 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/4041374142' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bef0c50-64ad-4014-a6ad-db56a89ad139"}]: dispatch 2024-09-19T06:44:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:11 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bef0c50-64ad-4014-a6ad-db56a89ad139"}]: dispatch 2024-09-19T06:44:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:11 smithi159 ceph-mon[30935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bef0c50-64ad-4014-a6ad-db56a89ad139"}]': finished 2024-09-19T06:44:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:11 smithi159 ceph-mon[30935]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T06:44:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:12.789 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:12 smithi189 ceph-mon[34880]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:12.789 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:12 smithi189 ceph-mon[34880]: from='client.? 172.21.15.203:0/2677097986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:44:12.789 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:12 smithi189 ceph-mon[34880]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T06:44:12.789 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:12 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:12 smithi203 ceph-mon[35473]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:12 smithi203 ceph-mon[35473]: from='client.? 172.21.15.203:0/2677097986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:44:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:12 smithi203 ceph-mon[35473]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T06:44:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:12 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:12 smithi159 ceph-mon[30935]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:12 smithi159 ceph-mon[30935]: from='client.? 172.21.15.203:0/2677097986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:44:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:12 smithi159 ceph-mon[30935]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T06:44:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:12 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:14.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:14 smithi189 ceph-mon[34880]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:44:14.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:14.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:14 smithi189 ceph-mon[34880]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T06:44:14.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:14 smithi203 ceph-mon[35473]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:44:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:14 smithi203 ceph-mon[35473]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T06:44:14.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:14 smithi159 ceph-mon[30935]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:44:14.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:14.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:14 smithi159 ceph-mon[30935]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T06:44:16.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:16 smithi203 ceph-mon[35473]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:44:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:16 smithi189 ceph-mon[34880]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:44:16.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:16 smithi159 ceph-mon[30935]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:44:18.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:18 smithi203 ceph-mon[35473]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T06:44:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:18 smithi189 ceph-mon[34880]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T06:44:18.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:18 smithi159 ceph-mon[30935]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T06:44:20.582 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:20 smithi203 ceph-mon[35473]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:44:20.583 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:44:20.583 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:20 smithi189 ceph-mon[34880]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:44:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:44:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:20.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:20 smithi159 ceph-mon[30935]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:44:20.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:44:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:21.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:21 smithi203 ceph-mon[35473]: Deploying daemon osd.11 on smithi203 2024-09-19T06:44:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:21 smithi189 ceph-mon[34880]: Deploying daemon osd.11 on smithi203 2024-09-19T06:44:21.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:21 smithi159 ceph-mon[30935]: Deploying daemon osd.11 on smithi203 2024-09-19T06:44:22.572 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:22 smithi203 ceph-mon[35473]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:44:22.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:22 smithi189 ceph-mon[34880]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:44:22.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:22 smithi159 ceph-mon[30935]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:44:24.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:24 smithi203 ceph-mon[35473]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:24.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:24 smithi189 ceph-mon[34880]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:24.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:24 smithi159 ceph-mon[30935]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:26.574 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:26 smithi203 ceph-mon[35473]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:26.574 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:26.574 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:26.574 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:26 smithi189 ceph-mon[34880]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:26.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:26 smithi159 ceph-mon[30935]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:26.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:26.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:26.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:28.740 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:28 smithi203 ceph-mon[35473]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:28.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:28 smithi189 ceph-mon[34880]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:28.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:28 smithi159 ceph-mon[30935]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:29.641 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.640+0000 7fa252ffd640 1 -- 172.21.15.203:0/2668169577 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa25c062630 con 0x7fa2480a3270 2024-09-19T06:44:29.641 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 11 on host 'smithi203' 2024-09-19T06:44:29.644 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa2480a3270 msgr2=0x7fa2480a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.644 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa2480a3270 0x7fa2480a5730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00bbe0 tx=0x7fa24c00b390 comp rx=0 tx=0).stop 2024-09-19T06:44:29.644 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 msgr2=0x7fa25c1a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.644 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 0x7fa25c1a5a40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa254005e30 tx=0x7fa254031ee0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.644 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 shutdown_connections 2024-09-19T06:44:29.644 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa2480a3270 0x7fa2480a5730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.644 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c105790 0x7fa25c1a5a40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.645 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c102de0 0x7fa25c19e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.645 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 --2- 172.21.15.203:0/2668169577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa25c100490 0x7fa25c19e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.645 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 >> 172.21.15.203:0/2668169577 conn(0x7fa25c0fc2a0 msgr2=0x7fa25c100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:29.645 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 shutdown_connections 2024-09-19T06:44:29.645 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:29.643+0000 7fa263ca6640 1 -- 172.21.15.203:0/2668169577 wait complete. 2024-09-19T06:44:30.328 DEBUG:teuthology.orchestra.run.smithi203:osd.11> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T06:44:30.331 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T06:44:30.331 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:44:30.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:30 smithi203 ceph-mon[35473]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:30.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:30 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:30 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:30 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:30 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.599 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:30.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:30 smithi159 ceph-mon[30935]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:30.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:30 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:30 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:30 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:30 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:30 smithi189 ceph-mon[34880]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:30 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:30 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:30 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:30 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:31.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.072+0000 7f6b3e49c640 1 -- 172.21.15.159:0/1181715642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 msgr2=0x7f6b38103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.072+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/1181715642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 0x7f6b38103280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009900 tx=0x7f6b2c02a410 comp rx=0 tx=0).stop 2024-09-19T06:44:31.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.072+0000 7f6b3e49c640 1 -- 172.21.15.159:0/1181715642 shutdown_connections 2024-09-19T06:44:31.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.072+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/1181715642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b381037c0 0x7f6b3810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.072+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/1181715642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 0x7f6b38103280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.072+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/1181715642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b38101c00 0x7f6b38102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.072+0000 7f6b3e49c640 1 -- 172.21.15.159:0/1181715642 >> 172.21.15.159:0/1181715642 conn(0x7f6b380fd390 msgr2=0x7f6b380ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.072+0000 7f6b3e49c640 1 -- 172.21.15.159:0/1181715642 shutdown_connections 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.072+0000 7f6b3e49c640 1 -- 172.21.15.159:0/1181715642 wait complete. 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b3e49c640 1 Processor -- start 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b3e49c640 1 -- start start 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b3e49c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b38101c00 0x7f6b38197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b3e49c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 0x7f6b38198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b3e49c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b381037c0 0x7f6b3819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b3e49c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3810d880 con 0x7f6b38102e00 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b3e49c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3810d700 con 0x7f6b38101c00 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b3e49c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3810da00 con 0x7f6b381037c0 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b377fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 0x7f6b38198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b377fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 0x7f6b38198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50564/0 (socket says 172.21.15.159:50564) 2024-09-19T06:44:31.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b377fe640 1 -- 172.21.15.159:0/4043042997 learned_addr learned my addr 172.21.15.159:0/4043042997 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.073+0000 7f6b3ca39640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b381037c0 0x7f6b3819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b37fff640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b38101c00 0x7f6b38197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b377fe640 1 -- 172.21.15.159:0/4043042997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b381037c0 msgr2=0x7f6b3819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b377fe640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b381037c0 0x7f6b3819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b377fe640 1 -- 172.21.15.159:0/4043042997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b38101c00 msgr2=0x7f6b38197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b377fe640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b38101c00 0x7f6b38197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b377fe640 1 -- 172.21.15.159:0/4043042997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3819fb00 con 0x7f6b38102e00 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b3ca39640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b381037c0 0x7f6b3819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b37fff640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b38101c00 0x7f6b38197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b377fe640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 0x7f6b38198410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009230 tx=0x7f6b2c031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b357fa640 1 -- 172.21.15.159:0/4043042997 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c03f030 con 0x7f6b38102e00 2024-09-19T06:44:31.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b357fa640 1 -- 172.21.15.159:0/4043042997 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b2c003ad0 con 0x7f6b38102e00 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b357fa640 1 -- 172.21.15.159:0/4043042997 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c035070 con 0x7f6b38102e00 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b3819fd90 con 0x7f6b38102e00 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.074+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b381a0210 con 0x7f6b38102e00 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.075+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b38108fd0 con 0x7f6b38102e00 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.076+0000 7f6b357fa640 1 -- 172.21.15.159:0/4043042997 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f6b2c042030 con 0x7f6b38102e00 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.077+0000 7f6b357fa640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6b200a3270 0x7f6b200a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.077+0000 7f6b37fff640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6b200a3270 0x7f6b200a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.077+0000 7f6b357fa640 1 -- 172.21.15.159:0/4043042997 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6809+0+0 (secure 0 0 0) 0x7f6b2c0ef970 con 0x7f6b38102e00 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.077+0000 7f6b37fff640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6b200a3270 0x7f6b200a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005d00 tx=0x7f6b28005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.081+0000 7f6b357fa640 1 -- 172.21.15.159:0/4043042997 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b2c0bcc70 con 0x7f6b38102e00 2024-09-19T06:44:31.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.250+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6b3802da30 con 0x7f6b38102e00 2024-09-19T06:44:31.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.250+0000 7f6b357fa640 1 -- 172.21.15.159:0/4043042997 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f6b2c0dc020 con 0x7f6b38102e00 2024-09-19T06:44:31.253 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.252+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6b200a3270 msgr2=0x7f6b200a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.252+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6b200a3270 0x7f6b200a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005d00 tx=0x7f6b28005ef0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.252+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 msgr2=0x7f6b38198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.252+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 0x7f6b38198410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009230 tx=0x7f6b2c031b60 comp rx=0 tx=0).stop 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.253+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 shutdown_connections 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.253+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6b200a3270 0x7f6b200a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.253+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b381037c0 0x7f6b3819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.253+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b38102e00 0x7f6b38198410 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.253+0000 7f6b3e49c640 1 --2- 172.21.15.159:0/4043042997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b38101c00 0x7f6b38197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.253+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 >> 172.21.15.159:0/4043042997 conn(0x7f6b380fd390 msgr2=0x7f6b381061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.253+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 shutdown_connections 2024-09-19T06:44:31.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:31.253+0000 7f6b3e49c640 1 -- 172.21.15.159:0/4043042997 wait complete. 2024-09-19T06:44:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:31 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/4043042997' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:44:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:31 smithi159 ceph-mon[30935]: from='osd.11 [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:44:31.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:31 smithi159 ceph-mon[30935]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:44:31.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:31 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/4043042997' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:44:31.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:31 smithi203 ceph-mon[35473]: from='osd.11 [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:44:31.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:31 smithi203 ceph-mon[35473]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:44:31.842 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:44:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:44:31.428+0000 7fcae39ed640 -1 osd.11 0 log_to_monitors true 2024-09-19T06:44:31.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:31 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/4043042997' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:44:31.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:31 smithi189 ceph-mon[34880]: from='osd.11 [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:44:31.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:31 smithi189 ceph-mon[34880]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:44:31.995 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726728249,"num_in_osds":12,"osd_in_since":1726728251,"num_remapped_pgs":0} 2024-09-19T06:44:32.499 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:44:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:44:32.485+0000 7fcadf970640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T06:44:32.499 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:44:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:44:32.497+0000 7fcadb798640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:44:32.499 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:32 smithi203 ceph-mon[35473]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:32.499 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:32 smithi203 ceph-mon[35473]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:44:32.499 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:32 smithi203 ceph-mon[35473]: from='osd.11 [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:44:32.500 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:32 smithi203 ceph-mon[35473]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:44:32.500 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:32 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:32.500 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:32 smithi203 ceph-mon[35473]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:44:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:32 smithi189 ceph-mon[34880]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:32 smithi189 ceph-mon[34880]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:44:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:32 smithi189 ceph-mon[34880]: from='osd.11 [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:44:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:32 smithi189 ceph-mon[34880]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:44:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:32 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:32 smithi189 ceph-mon[34880]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:44:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:32 smithi159 ceph-mon[30935]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:32 smithi159 ceph-mon[30935]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:44:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:32 smithi159 ceph-mon[30935]: from='osd.11 [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:44:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:32 smithi159 ceph-mon[30935]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:44:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:32 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:32 smithi159 ceph-mon[30935]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T06:44:32.997 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:44:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:33.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:33 smithi203 ceph-mon[35473]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:44:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:33 smithi203 ceph-mon[35473]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:44:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:33.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:33 smithi159 ceph-mon[30935]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:44:33.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:33 smithi159 ceph-mon[30935]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:44:33.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:33.629 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:33.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.707+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/384088969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64107920 msgr2=0x7f8d64109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:33.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.707+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/384088969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64107920 0x7f8d64109d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009ca0 tx=0x7f8d5c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.707+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/384088969 shutdown_connections 2024-09-19T06:44:33.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.707+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/384088969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64107920 0x7f8d64109d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.707+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/384088969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d64104ff0 0x7f8d641073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.707+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/384088969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d641026c0 0x7f8d64104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.707+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/384088969 >> 172.21.15.159:0/384088969 conn(0x7f8d640fc280 msgr2=0x7f8d640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.707+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/384088969 shutdown_connections 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.707+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/384088969 wait complete. 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6c5e0640 1 Processor -- start 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6c5e0640 1 -- start start 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6c5e0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641026c0 0x7f8d64197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6c5e0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64104ff0 0x7f8d64198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6c5e0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d64107920 0x7f8d6419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6c5e0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6410d880 con 0x7f8d64104ff0 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6c5e0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6410d700 con 0x7f8d641026c0 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6c5e0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6410da00 con 0x7f8d64107920 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d69b7b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64104ff0 0x7f8d64198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:33.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d69b7b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64104ff0 0x7f8d64198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50588/0 (socket says 172.21.15.159:50588) 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d69b7b640 1 -- 172.21.15.159:0/2728983830 learned_addr learned my addr 172.21.15.159:0/2728983830 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6ab7d640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d64107920 0x7f8d6419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.708+0000 7f8d6a37c640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641026c0 0x7f8d64197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.709+0000 7f8d69b7b640 1 -- 172.21.15.159:0/2728983830 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d64107920 msgr2=0x7f8d6419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.709+0000 7f8d69b7b640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d64107920 0x7f8d6419f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.709+0000 7f8d69b7b640 1 -- 172.21.15.159:0/2728983830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641026c0 msgr2=0x7f8d64197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.709+0000 7f8d69b7b640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641026c0 0x7f8d64197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.709+0000 7f8d69b7b640 1 -- 172.21.15.159:0/2728983830 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6419fb10 con 0x7f8d64104ff0 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.709+0000 7f8d6a37c640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641026c0 0x7f8d64197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.709+0000 7f8d69b7b640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64104ff0 0x7f8d64198420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400d770 tx=0x7f8d5400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.711+0000 7f8d5b7fe640 1 -- 172.21.15.159:0/2728983830 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54017070 con 0x7f8d64104ff0 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.711+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6419fe00 con 0x7f8d64104ff0 2024-09-19T06:44:33.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.711+0000 7f8d5b7fe640 1 -- 172.21.15.159:0/2728983830 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d54009c30 con 0x7f8d64104ff0 2024-09-19T06:44:33.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.711+0000 7f8d5b7fe640 1 -- 172.21.15.159:0/2728983830 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5400f620 con 0x7f8d64104ff0 2024-09-19T06:44:33.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.711+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d641a0300 con 0x7f8d64104ff0 2024-09-19T06:44:33.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.712+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d640fdd70 con 0x7f8d64104ff0 2024-09-19T06:44:33.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.713+0000 7f8d5b7fe640 1 -- 172.21.15.159:0/2728983830 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8d5401a070 con 0x7f8d64104ff0 2024-09-19T06:44:33.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.714+0000 7f8d5b7fe640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8d500a3270 0x7f8d500a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:33.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.714+0000 7f8d6a37c640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8d500a3270 0x7f8d500a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:33.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.714+0000 7f8d5b7fe640 1 -- 172.21.15.159:0/2728983830 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f8d540cef40 con 0x7f8d64104ff0 2024-09-19T06:44:33.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.714+0000 7f8d6a37c640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8d500a3270 0x7f8d500a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009c20 tx=0x7f8d60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:33.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.718+0000 7f8d5b7fe640 1 -- 172.21.15.159:0/2728983830 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d5409c0e0 con 0x7f8d64104ff0 2024-09-19T06:44:33.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:33 smithi189 ceph-mon[34880]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T06:44:33.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:33 smithi189 ceph-mon[34880]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:44:33.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:33.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:33.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.894+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8d6402d9c0 con 0x7f8d64104ff0 2024-09-19T06:44:33.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.895+0000 7f8d5b7fe640 1 -- 172.21.15.159:0/2728983830 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f8d5409b9e0 con 0x7f8d64104ff0 2024-09-19T06:44:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8d500a3270 msgr2=0x7f8d500a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8d500a3270 0x7f8d500a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009c20 tx=0x7f8d60005f90 comp rx=0 tx=0).stop 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64104ff0 msgr2=0x7f8d64198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64104ff0 0x7f8d64198420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400d770 tx=0x7f8d5400dc30 comp rx=0 tx=0).stop 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 shutdown_connections 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8d500a3270 0x7f8d500a5730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d64107920 0x7f8d6419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d64104ff0 0x7f8d64198420 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 --2- 172.21.15.159:0/2728983830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d641026c0 0x7f8d64197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.897+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 >> 172.21.15.159:0/2728983830 conn(0x7f8d640fc280 msgr2=0x7f8d64102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:33.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.898+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 shutdown_connections 2024-09-19T06:44:33.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:33.898+0000 7f8d6c5e0640 1 -- 172.21.15.159:0/2728983830 wait complete. 2024-09-19T06:44:34.513 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1726728273,"num_in_osds":12,"osd_in_since":1726728251,"num_remapped_pgs":0} 2024-09-19T06:44:34.514 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:44:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: purged_snaps scrub starts 2024-09-19T06:44:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: purged_snaps scrub ok 2024-09-19T06:44:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: osd.11 [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] boot 2024-09-19T06:44:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T06:44:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:34 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2728983830' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:44:34.758 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:34.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: purged_snaps scrub starts 2024-09-19T06:44:34.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: purged_snaps scrub ok 2024-09-19T06:44:34.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:34.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: osd.11 [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] boot 2024-09-19T06:44:34.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T06:44:34.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:34.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:34 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2728983830' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:44:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: purged_snaps scrub starts 2024-09-19T06:44:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: purged_snaps scrub ok 2024-09-19T06:44:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:44:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: osd.11 [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] boot 2024-09-19T06:44:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T06:44:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:44:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:44:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:34.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:34.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:34.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:34.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:34 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2728983830' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:44:35.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.231+0000 7f1cd4820640 1 -- 172.21.15.159:0/3643296956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd0102db0 msgr2=0x7f1cd0103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.231+0000 7f1cd4820640 1 --2- 172.21.15.159:0/3643296956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd0102db0 0x7f1cd0103190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009930 tx=0x7f1cc002a440 comp rx=0 tx=0).stop 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.232+0000 7f1cd4820640 1 -- 172.21.15.159:0/3643296956 shutdown_connections 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.232+0000 7f1cd4820640 1 --2- 172.21.15.159:0/3643296956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cd01082e0 0x7f1cd010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.232+0000 7f1cd4820640 1 --2- 172.21.15.159:0/3643296956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cd0103760 0x7f1cd0107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.232+0000 7f1cd4820640 1 --2- 172.21.15.159:0/3643296956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd0102db0 0x7f1cd0103190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.232+0000 7f1cd4820640 1 -- 172.21.15.159:0/3643296956 >> 172.21.15.159:0/3643296956 conn(0x7f1cd00fc7d0 msgr2=0x7f1cd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.232+0000 7f1cd4820640 1 -- 172.21.15.159:0/3643296956 shutdown_connections 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.232+0000 7f1cd4820640 1 -- 172.21.15.159:0/3643296956 wait complete. 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.232+0000 7f1cd4820640 1 Processor -- start 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.232+0000 7f1cd4820640 1 -- start start 2024-09-19T06:44:35.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cd4820640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cd0102db0 0x7f1cd0198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cd4820640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cd0103760 0x7f1cd0198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cd4820640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd01082e0 0x7f1cd019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cd4820640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd0112170 con 0x7f1cd01082e0 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cd4820640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd0111ff0 con 0x7f1cd0103760 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cd4820640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd01122f0 con 0x7f1cd0102db0 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cced9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd01082e0 0x7f1cd019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cced9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd01082e0 0x7f1cd019d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50596/0 (socket says 172.21.15.159:50596) 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cced9d640 1 -- 172.21.15.159:0/527682302 learned_addr learned my addr 172.21.15.159:0/527682302 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cce59c640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cd0102db0 0x7f1cd0198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1ccdd9b640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cd0103760 0x7f1cd0198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cced9d640 1 -- 172.21.15.159:0/527682302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cd0102db0 msgr2=0x7f1cd0198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:35.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cced9d640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cd0102db0 0x7f1cd0198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cced9d640 1 -- 172.21.15.159:0/527682302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cd0103760 msgr2=0x7f1cd0198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cced9d640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cd0103760 0x7f1cd0198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cced9d640 1 -- 172.21.15.159:0/527682302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd019d700 con 0x7f1cd01082e0 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1ccdd9b640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cd0103760 0x7f1cd0198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cced9d640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd01082e0 0x7f1cd019d020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800b970 tx=0x7f1cc800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cc77fe640 1 -- 172.21.15.159:0/527682302 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8019070 con 0x7f1cd01082e0 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd019d9f0 con 0x7f1cd01082e0 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cc77fe640 1 -- 172.21.15.159:0/527682302 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cc800cb40 con 0x7f1cd01082e0 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.233+0000 7f1cc77fe640 1 -- 172.21.15.159:0/527682302 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8007650 con 0x7f1cd01082e0 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.234+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd01a52d0 con 0x7f1cd01082e0 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.234+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd006a7d0 con 0x7f1cd01082e0 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.236+0000 7f1cc77fe640 1 -- 172.21.15.159:0/527682302 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f1cc801c070 con 0x7f1cd01082e0 2024-09-19T06:44:35.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.236+0000 7f1cc77fe640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1cbc0a3240 0x7f1cbc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:35.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.236+0000 7f1cce59c640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1cbc0a3240 0x7f1cbc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:35.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.236+0000 7f1cc77fe640 1 -- 172.21.15.159:0/527682302 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f1cc80ceef0 con 0x7f1cd01082e0 2024-09-19T06:44:35.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.237+0000 7f1cce59c640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1cbc0a3240 0x7f1cbc0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0006010 tx=0x7f1cc00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:35.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.239+0000 7f1cc77fe640 1 -- 172.21.15.159:0/527682302 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cc809ba60 con 0x7f1cd01082e0 2024-09-19T06:44:35.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.406+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cd0103210 con 0x7f1cd01082e0 2024-09-19T06:44:35.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.407+0000 7f1cc77fe640 1 -- 172.21.15.159:0/527682302 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18526 (secure 0 0 0) 0x7f1cd0103210 con 0x7f1cd01082e0 2024-09-19T06:44:35.408 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:44:35.408 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":74,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:44:34.853734+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:44:35.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1cbc0a3240 msgr2=0x7f1cbc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:35.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1cbc0a3240 0x7f1cbc0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0006010 tx=0x7f1cc00058d0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd01082e0 msgr2=0x7f1cd019d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:35.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd01082e0 0x7f1cd019d020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800b970 tx=0x7f1cc800be30 comp rx=0 tx=0).stop 2024-09-19T06:44:35.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 shutdown_connections 2024-09-19T06:44:35.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1cbc0a3240 0x7f1cbc0a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cd01082e0 0x7f1cd019d020 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cd0103760 0x7f1cd0198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 --2- 172.21.15.159:0/527682302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cd0102db0 0x7f1cd0198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:35.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 >> 172.21.15.159:0/527682302 conn(0x7f1cd00fc7d0 msgr2=0x7f1cd0105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:35.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 shutdown_connections 2024-09-19T06:44:35.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:35.409+0000 7f1cd4820640 1 -- 172.21.15.159:0/527682302 wait complete. 2024-09-19T06:44:35.717 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:35 smithi159 ceph-mon[30935]: Detected new or changed devices on smithi203 2024-09-19T06:44:35.717 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:35 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi203 to 4272M 2024-09-19T06:44:35.717 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:35 smithi159 ceph-mon[30935]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T06:44:35.717 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:35 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/527682302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:44:35.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:35 smithi203 ceph-mon[35473]: Detected new or changed devices on smithi203 2024-09-19T06:44:35.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:35 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi203 to 4272M 2024-09-19T06:44:35.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:35 smithi203 ceph-mon[35473]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T06:44:35.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:35 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/527682302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:44:35.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:35 smithi189 ceph-mon[34880]: Detected new or changed devices on smithi203 2024-09-19T06:44:35.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:35 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi203 to 4272M 2024-09-19T06:44:35.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:35 smithi189 ceph-mon[34880]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T06:44:35.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:35 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/527682302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:44:36.082 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:40:47.637521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:44:36.083 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T06:44:36.327 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:36.697 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:36 smithi159 ceph-mon[30935]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:36.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.779+0000 7fb34ae66640 1 -- 172.21.15.159:0/3847030522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 msgr2=0x7fb344106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:36.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.779+0000 7fb34ae66640 1 --2- 172.21.15.159:0/3847030522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 0x7fb344106e60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb338009930 tx=0x7fb33802a420 comp rx=0 tx=0).stop 2024-09-19T06:44:36.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.779+0000 7fb34ae66640 1 -- 172.21.15.159:0/3847030522 shutdown_connections 2024-09-19T06:44:36.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.779+0000 7fb34ae66640 1 --2- 172.21.15.159:0/3847030522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb344101420 0x7fb34410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.779+0000 7fb34ae66640 1 --2- 172.21.15.159:0/3847030522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb344100a80 0x7fb344100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.779+0000 7fb34ae66640 1 --2- 172.21.15.159:0/3847030522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 0x7fb344106e60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.779+0000 7fb34ae66640 1 -- 172.21.15.159:0/3847030522 >> 172.21.15.159:0/3847030522 conn(0x7fb3440fc7a0 msgr2=0x7fb3440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.779+0000 7fb34ae66640 1 -- 172.21.15.159:0/3847030522 shutdown_connections 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.779+0000 7fb34ae66640 1 -- 172.21.15.159:0/3847030522 wait complete. 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb34ae66640 1 Processor -- start 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb34ae66640 1 -- start start 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb34ae66640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb344100a80 0x7fb344102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb34ae66640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb344101420 0x7fb344102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb34ae66640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 0x7fb3441030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb34ae66640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb344110e80 con 0x7fb344106a80 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb34ae66640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb344110d00 con 0x7fb344100a80 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb34ae66640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb344111000 con 0x7fb344101420 2024-09-19T06:44:36.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb349403640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 0x7fb3441030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb349403640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 0x7fb3441030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50618/0 (socket says 172.21.15.159:50618) 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb349403640 1 -- 172.21.15.159:0/2249522573 learned_addr learned my addr 172.21.15.159:0/2249522573 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb348c02640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb344100a80 0x7fb344102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.780+0000 7fb343fff640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb344101420 0x7fb344102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb349403640 1 -- 172.21.15.159:0/2249522573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb344101420 msgr2=0x7fb344102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb349403640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb344101420 0x7fb344102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb349403640 1 -- 172.21.15.159:0/2249522573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb344100a80 msgr2=0x7fb344102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb349403640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb344100a80 0x7fb344102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb349403640 1 -- 172.21.15.159:0/2249522573 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3441a6930 con 0x7fb344106a80 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb343fff640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb344101420 0x7fb344102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:36.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb349403640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 0x7fb3441030d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00eb10 tx=0x7fb33c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb341ffb640 1 -- 172.21.15.159:0/2249522573 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c004b20 con 0x7fb344106a80 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb341ffb640 1 -- 172.21.15.159:0/2249522573 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb33c004cc0 con 0x7fb344106a80 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3441a6c20 con 0x7fb344106a80 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb341ffb640 1 -- 172.21.15.159:0/2249522573 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c010760 con 0x7fb344106a80 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.781+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3441a7110 con 0x7fb344106a80 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.782+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb344100ee0 con 0x7fb344106a80 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.783+0000 7fb341ffb640 1 -- 172.21.15.159:0/2249522573 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb33c005020 con 0x7fb344106a80 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.784+0000 7fb341ffb640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3340a3240 0x7fb3340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.784+0000 7fb348c02640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3340a3240 0x7fb3340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.784+0000 7fb341ffb640 1 -- 172.21.15.159:0/2249522573 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fb33c0cfa10 con 0x7fb344106a80 2024-09-19T06:44:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.784+0000 7fb348c02640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3340a3240 0x7fb3340a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb338009900 tx=0x7fb3380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:36.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.788+0000 7fb341ffb640 1 -- 172.21.15.159:0/2249522573 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb33c09cbd0 con 0x7fb344106a80 2024-09-19T06:44:36.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:36 smithi203 ceph-mon[35473]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:36.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:36 smithi189 ceph-mon[34880]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:36.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.953+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb3441a7340 con 0x7fb344106a80 2024-09-19T06:44:36.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.953+0000 7fb341ffb640 1 -- 172.21.15.159:0/2249522573 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7fb33c09c4d0 con 0x7fb344106a80 2024-09-19T06:44:36.955 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-09-19T06:44:36.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.955+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3340a3240 msgr2=0x7fb3340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:36.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.955+0000 7fb34ae66640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3340a3240 0x7fb3340a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb338009900 tx=0x7fb3380058d0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.955+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 msgr2=0x7fb3441030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:36.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.955+0000 7fb34ae66640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 0x7fb3441030d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00eb10 tx=0x7fb33c00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.956+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 shutdown_connections 2024-09-19T06:44:36.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.956+0000 7fb34ae66640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3340a3240 0x7fb3340a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.956+0000 7fb34ae66640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb344106a80 0x7fb3441030d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.956+0000 7fb34ae66640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb344101420 0x7fb344102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.956+0000 7fb34ae66640 1 --2- 172.21.15.159:0/2249522573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb344100a80 0x7fb344102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:36.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.956+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 >> 172.21.15.159:0/2249522573 conn(0x7fb3440fc7a0 msgr2=0x7fb34406a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:36.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.956+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 shutdown_connections 2024-09-19T06:44:36.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:36.956+0000 7fb34ae66640 1 -- 172.21.15.159:0/2249522573 wait complete. 2024-09-19T06:44:37.595 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:37 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2249522573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:44:37.625 INFO:tasks.cephadm:Adding mds.a on smithi159 2024-09-19T06:44:37.625 INFO:tasks.cephadm:Adding mds.d on smithi159 2024-09-19T06:44:37.625 INFO:tasks.cephadm:Adding mds.g on smithi159 2024-09-19T06:44:37.625 INFO:tasks.cephadm:Adding mds.j on smithi159 2024-09-19T06:44:37.625 INFO:tasks.cephadm:Adding mds.b on smithi189 2024-09-19T06:44:37.625 INFO:tasks.cephadm:Adding mds.e on smithi189 2024-09-19T06:44:37.625 INFO:tasks.cephadm:Adding mds.h on smithi189 2024-09-19T06:44:37.625 INFO:tasks.cephadm:Adding mds.k on smithi189 2024-09-19T06:44:37.626 INFO:tasks.cephadm:Adding mds.c on smithi203 2024-09-19T06:44:37.626 INFO:tasks.cephadm:Adding mds.f on smithi203 2024-09-19T06:44:37.626 INFO:tasks.cephadm:Adding mds.i on smithi203 2024-09-19T06:44:37.626 INFO:tasks.cephadm:Adding mds.l on smithi203 2024-09-19T06:44:37.626 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi159=a;smithi159=d;smithi159=g;smithi159=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l' 2024-09-19T06:44:37.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:37 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2249522573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:44:37.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:37 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2249522573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:44:37.888 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.413+0000 7fde67d24640 1 -- 172.21.15.203:0/1057970324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 msgr2=0x7fde60100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.413+0000 7fde67d24640 1 --2- 172.21.15.203:0/1057970324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 0x7fde60100ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009900 tx=0x7fde5c02a410 comp rx=0 tx=0).stop 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.413+0000 7fde67d24640 1 -- 172.21.15.203:0/1057970324 shutdown_connections 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.413+0000 7fde67d24640 1 --2- 172.21.15.203:0/1057970324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60102690 0x7fde60108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.413+0000 7fde67d24640 1 --2- 172.21.15.203:0/1057970324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde60101cd0 0x7fde60102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.413+0000 7fde67d24640 1 --2- 172.21.15.203:0/1057970324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 0x7fde60100ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.413+0000 7fde67d24640 1 -- 172.21.15.203:0/1057970324 >> 172.21.15.203:0/1057970324 conn(0x7fde600fc280 msgr2=0x7fde600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.413+0000 7fde67d24640 1 -- 172.21.15.203:0/1057970324 shutdown_connections 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.413+0000 7fde67d24640 1 -- 172.21.15.203:0/1057970324 wait complete. 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde67d24640 1 Processor -- start 2024-09-19T06:44:38.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde67d24640 1 -- start start 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde67d24640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 0x7fde60104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde67d24640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde60101cd0 0x7fde601030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde67d24640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60102690 0x7fde601035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde67d24640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010c7b0 con 0x7fde60102690 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde67d24640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010c630 con 0x7fde60101cd0 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde67d24640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010c930 con 0x7fde60100ad0 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde65ac0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 0x7fde60104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde65ac0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 0x7fde60104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:60308/0 (socket says 172.21.15.203:60308) 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde65ac0640 1 -- 172.21.15.203:0/3829389347 learned_addr learned my addr 172.21.15.203:0/3829389347 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde662c1640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60102690 0x7fde601035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde652bf640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde60101cd0 0x7fde601030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde65ac0640 1 -- 172.21.15.203:0/3829389347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde60101cd0 msgr2=0x7fde601030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:38.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde65ac0640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde60101cd0 0x7fde601030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde65ac0640 1 -- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60102690 msgr2=0x7fde601035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde65ac0640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60102690 0x7fde601035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde65ac0640 1 -- 172.21.15.203:0/3829389347 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde60103eb0 con 0x7fde60100ad0 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.414+0000 7fde662c1640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60102690 0x7fde601035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.415+0000 7fde65ac0640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 0x7fde60104a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde5c031610 tx=0x7fde5c0043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.415+0000 7fde56ffd640 1 -- 172.21.15.203:0/3829389347 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c03f030 con 0x7fde60100ad0 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.415+0000 7fde56ffd640 1 -- 172.21.15.203:0/3829389347 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde5c003ce0 con 0x7fde60100ad0 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.415+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde601a20b0 con 0x7fde60100ad0 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.415+0000 7fde56ffd640 1 -- 172.21.15.203:0/3829389347 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c035070 con 0x7fde60100ad0 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.415+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde601a2630 con 0x7fde60100ad0 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.416+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde601a2860 con 0x7fde60100ad0 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.417+0000 7fde56ffd640 1 -- 172.21.15.203:0/3829389347 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fde5c042030 con 0x7fde60100ad0 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.417+0000 7fde56ffd640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fde4c0a32c0 0x7fde4c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:38.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.418+0000 7fde56ffd640 1 -- 172.21.15.203:0/3829389347 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fde5c0efa70 con 0x7fde60100ad0 2024-09-19T06:44:38.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.418+0000 7fde652bf640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fde4c0a32c0 0x7fde4c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:38.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.418+0000 7fde652bf640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fde4c0a32c0 0x7fde4c0a5780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde601047e0 tx=0x7fde50008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:38.460 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.422+0000 7fde56ffd640 1 -- 172.21.15.203:0/3829389347 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde5c0bcc30 con 0x7fde60100ad0 2024-09-19T06:44:38.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:38 smithi203 ceph-mon[35473]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:38.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.610+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi159=a;smithi159=d;smithi159=g;smithi159=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}) -- 0x7fde6006a7d0 con 0x7fde4c0a32c0 2024-09-19T06:44:38.622 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.620+0000 7fde56ffd640 1 -- 172.21.15.203:0/3829389347 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fde6006a7d0 con 0x7fde4c0a32c0 2024-09-19T06:44:38.622 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mds.all update... 2024-09-19T06:44:38.624 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fde4c0a32c0 msgr2=0x7fde4c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fde4c0a32c0 0x7fde4c0a5780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde601047e0 tx=0x7fde50008040 comp rx=0 tx=0).stop 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 msgr2=0x7fde60104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 0x7fde60104a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde5c031610 tx=0x7fde5c0043b0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 shutdown_connections 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fde4c0a32c0 0x7fde4c0a5780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60102690 0x7fde601035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde60101cd0 0x7fde601030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 --2- 172.21.15.203:0/3829389347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde60100ad0 0x7fde60104a60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.622+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 >> 172.21.15.203:0/3829389347 conn(0x7fde600fc280 msgr2=0x7fde60069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.623+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 shutdown_connections 2024-09-19T06:44:38.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T06:44:38.623+0000 7fde67d24640 1 -- 172.21.15.203:0/3829389347 wait complete. 2024-09-19T06:44:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:38 smithi189 ceph-mon[34880]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:38.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:38 smithi159 ceph-mon[30935]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:39.342 DEBUG:teuthology.orchestra.run.smithi159:mds.a> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T06:44:39.345 DEBUG:teuthology.orchestra.run.smithi159:mds.d> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T06:44:39.388 DEBUG:teuthology.orchestra.run.smithi159:mds.g> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T06:44:39.431 DEBUG:teuthology.orchestra.run.smithi159:mds.j> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T06:44:39.474 DEBUG:teuthology.orchestra.run.smithi189:mds.b> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T06:44:39.478 DEBUG:teuthology.orchestra.run.smithi189:mds.e> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T06:44:39.521 DEBUG:teuthology.orchestra.run.smithi189:mds.h> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T06:44:39.564 DEBUG:teuthology.orchestra.run.smithi189:mds.k> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T06:44:39.607 DEBUG:teuthology.orchestra.run.smithi203:mds.c> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T06:44:39.609 DEBUG:teuthology.orchestra.run.smithi203:mds.f> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T06:44:39.653 DEBUG:teuthology.orchestra.run.smithi203:mds.i> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T06:44:39.696 DEBUG:teuthology.orchestra.run.smithi203:mds.l> sudo journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T06:44:39.739 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T06:44:39.740 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:44:39.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi159=a;smithi159=d;smithi159=g;smithi159=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: Saving service mds.all spec with placement smithi159=a;smithi159=d;smithi159=g;smithi159=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: Deploying daemon mds.l on smithi203 2024-09-19T06:44:39.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:39 smithi189 ceph-mon[34880]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:39.896 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi159=a;smithi159=d;smithi159=g;smithi159=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: Saving service mds.all spec with placement smithi159=a;smithi159=d;smithi159=g;smithi159=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:39.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: Deploying daemon mds.l on smithi203 2024-09-19T06:44:39.898 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:39 smithi203 ceph-mon[35473]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:39.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi159=a;smithi159=d;smithi159=g;smithi159=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:39.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: Saving service mds.all spec with placement smithi159=a;smithi159=d;smithi159=g;smithi159=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: Deploying daemon mds.l on smithi203 2024-09-19T06:44:39.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:39 smithi159 ceph-mon[30935]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:39.984 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:40.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 -- 172.21.15.159:0/2365738643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa410bfc0 msgr2=0x7f8aa410e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/2365738643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa410bfc0 0x7f8aa410e460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009ca0 tx=0x7f8a9c02a950 comp rx=0 tx=0).stop 2024-09-19T06:44:40.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 -- 172.21.15.159:0/2365738643 shutdown_connections 2024-09-19T06:44:40.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/2365738643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa410bfc0 0x7f8aa410e460 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/2365738643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa41034b0 0x7f8aa410b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/2365738643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa4102b90 0x7f8aa4102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 -- 172.21.15.159:0/2365738643 >> 172.21.15.159:0/2365738643 conn(0x7f8aa40fc610 msgr2=0x7f8aa40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:40.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 -- 172.21.15.159:0/2365738643 shutdown_connections 2024-09-19T06:44:40.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 -- 172.21.15.159:0/2365738643 wait complete. 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 Processor -- start 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.507+0000 7f8aab3a2640 1 -- start start 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aab3a2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa4102b90 0x7f8aa4198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aab3a2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa41034b0 0x7f8aa4198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aab3a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa410bfc0 0x7f8aa419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aab3a2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4111d90 con 0x7f8aa41034b0 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aab3a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4111c10 con 0x7f8aa410bfc0 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aab3a2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4111f10 con 0x7f8aa4102b90 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aa9b9f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa41034b0 0x7f8aa4198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aa9b9f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa41034b0 0x7f8aa4198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53138/0 (socket says 172.21.15.159:53138) 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aa9b9f640 1 -- 172.21.15.159:0/133240718 learned_addr learned my addr 172.21.15.159:0/133240718 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aaa3a0640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa4102b90 0x7f8aa4198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aa9b9f640 1 -- 172.21.15.159:0/133240718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa4102b90 msgr2=0x7f8aa4198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aaaba1640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa410bfc0 0x7f8aa419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aa9b9f640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa4102b90 0x7f8aa4198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aa9b9f640 1 -- 172.21.15.159:0/133240718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa410bfc0 msgr2=0x7f8aa419caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aa9b9f640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa410bfc0 0x7f8aa419caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aa9b9f640 1 -- 172.21.15.159:0/133240718 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa419d1d0 con 0x7f8aa41034b0 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aaa3a0640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa4102b90 0x7f8aa4198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aa9b9f640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa41034b0 0x7f8aa4198760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c940 tx=0x7f8a9400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8a9b7fe640 1 -- 172.21.15.159:0/133240718 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004220 con 0x7f8aa41034b0 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8a9b7fe640 1 -- 172.21.15.159:0/133240718 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a940043c0 con 0x7f8aa41034b0 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa419d4c0 con 0x7f8aa41034b0 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8a9b7fe640 1 -- 172.21.15.159:0/133240718 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004a00 con 0x7f8aa41034b0 2024-09-19T06:44:40.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.508+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa41a4da0 con 0x7f8aa41034b0 2024-09-19T06:44:40.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.509+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa4102f70 con 0x7f8aa41034b0 2024-09-19T06:44:40.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.511+0000 7f8a9b7fe640 1 -- 172.21.15.159:0/133240718 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8a940079b0 con 0x7f8aa41034b0 2024-09-19T06:44:40.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.511+0000 7f8a9b7fe640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8a900a3240 0x7f8a900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:40.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.511+0000 7f8aaa3a0640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8a900a3240 0x7f8a900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:40.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.511+0000 7f8a9b7fe640 1 -- 172.21.15.159:0/133240718 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f8a940cf470 con 0x7f8aa41034b0 2024-09-19T06:44:40.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.512+0000 7f8aaa3a0640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8a900a3240 0x7f8a900a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000abe0 tx=0x7f8aa000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:40.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.516+0000 7f8a9b7fe640 1 -- 172.21.15.159:0/133240718 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a94014030 con 0x7f8aa41034b0 2024-09-19T06:44:40.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.718+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8aa4199580 con 0x7f8aa41034b0 2024-09-19T06:44:40.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.718+0000 7f8a9b7fe640 1 -- 172.21.15.159:0/133240718 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f8a9409c630 con 0x7f8aa41034b0 2024-09-19T06:44:40.720 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:44:40.720 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"btime":"2024-09-19T06:37:38:555912+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T06:44:40.720 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 1 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8a900a3240 msgr2=0x7f8a900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8a900a3240 0x7f8a900a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000abe0 tx=0x7f8aa000a5c0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa41034b0 msgr2=0x7f8aa4198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa41034b0 0x7f8aa4198760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c940 tx=0x7f8a9400ce00 comp rx=0 tx=0).stop 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 shutdown_connections 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8a900a3240 0x7f8a900a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa410bfc0 0x7f8aa419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aa41034b0 0x7f8aa4198760 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 --2- 172.21.15.159:0/133240718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa4102b90 0x7f8aa4198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 >> 172.21.15.159:0/133240718 conn(0x7f8aa40fc610 msgr2=0x7f8aa40fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 shutdown_connections 2024-09-19T06:44:40.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:40.720+0000 7f8aab3a2640 1 -- 172.21.15.159:0/133240718 wait complete. 2024-09-19T06:44:41.253 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:41 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/133240718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:41.254 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 06:44:41 smithi203 systemd[1]: Starting Ceph mds.l for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:44:41.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:41 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/133240718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:41.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:41 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/133240718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:41.532 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 06:44:41 smithi203 podman[64696]: 2024-09-19 06:44:41.155418818 +0000 UTC m=+0.015826331 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:44:41.532 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 06:44:41 smithi203 podman[64696]: 2024-09-19 06:44:41.294900353 +0000 UTC m=+0.155307853 container create ecef4d148ff30547809c8f17bab59d7da8ac1c5a7bafa73bd98572ae992995df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T06:44:41.532 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 06:44:41 smithi203 podman[64696]: 2024-09-19 06:44:41.531370527 +0000 UTC m=+0.391778026 container init ecef4d148ff30547809c8f17bab59d7da8ac1c5a7bafa73bd98572ae992995df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:44:41.841 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 06:44:41 smithi203 podman[64696]: 2024-09-19 06:44:41.534290461 +0000 UTC m=+0.394697963 container start ecef4d148ff30547809c8f17bab59d7da8ac1c5a7bafa73bd98572ae992995df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T06:44:41.842 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 06:44:41 smithi203 ceph-mds[64715]: -- 172.21.15.203:0/3027768327 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561c103ed860 con 0x561c103ca800 2024-09-19T06:44:41.842 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 06:44:41 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-l[64711]: starting mds.l at 2024-09-19T06:44:41.842 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 06:44:41 smithi203 bash[64696]: ecef4d148ff30547809c8f17bab59d7da8ac1c5a7bafa73bd98572ae992995df 2024-09-19T06:44:41.842 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 06:44:41 smithi203 systemd[1]: Started Ceph mds.l for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:44:42.697 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:42.698 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.203:6832/4124611480,v1:172.21.15.203:6833/4124611480] up:boot 2024-09-19T06:44:42.698 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: fsmap 1 up:standby 2024-09-19T06:44:42.698 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:44:42.698 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:42.698 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:42.698 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:42.698 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:42.698 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:42.698 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:42 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.203:6832/4124611480,v1:172.21.15.203:6833/4124611480] up:boot 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: fsmap 1 up:standby 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:42 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:42.900 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:42.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.203:6832/4124611480,v1:172.21.15.203:6833/4124611480] up:boot 2024-09-19T06:44:42.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: fsmap 1 up:standby 2024-09-19T06:44:42.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:44:42.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:42.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:42.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:42.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:42.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:42.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:42 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:43.542 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:44:43.680 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:43 smithi189 ceph-mon[34880]: Deploying daemon mds.k on smithi189 2024-09-19T06:44:43.799 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:43.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:43 smithi203 ceph-mon[35473]: Deploying daemon mds.k on smithi189 2024-09-19T06:44:43.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:43 smithi159 ceph-mon[30935]: Deploying daemon mds.k on smithi189 2024-09-19T06:44:44.088 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 06:44:43 smithi189 systemd[1]: Starting Ceph mds.k for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:44:44.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 -- 172.21.15.159:0/1670853441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 msgr2=0x7fe5501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:44.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 --2- 172.21.15.159:0/1670853441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 0x7fe5501067e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe538009900 tx=0x7fe53802a410 comp rx=0 tx=0).stop 2024-09-19T06:44:44.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 -- 172.21.15.159:0/1670853441 shutdown_connections 2024-09-19T06:44:44.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 --2- 172.21.15.159:0/1670853441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe550106f10 0x7fe55010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 --2- 172.21.15.159:0/1670853441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 0x7fe5501067e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 --2- 172.21.15.159:0/1670853441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe550101de0 0x7fe5501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 -- 172.21.15.159:0/1670853441 >> 172.21.15.159:0/1670853441 conn(0x7fe5500fd8c0 msgr2=0x7fe5500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 -- 172.21.15.159:0/1670853441 shutdown_connections 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 -- 172.21.15.159:0/1670853441 wait complete. 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.263+0000 7fe55689e640 1 Processor -- start 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe55689e640 1 -- start start 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe55689e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe550101de0 0x7fe5500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe55689e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 0x7fe550074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe55689e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe550106f10 0x7fe550074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:44.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe55689e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe550111fc0 con 0x7fe550102790 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe55689e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe550111e40 con 0x7fe550106f10 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe55689e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe550112140 con 0x7fe550101de0 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 0x7fe550074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 0x7fe550074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53148/0 (socket says 172.21.15.159:53148) 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54f7fe640 1 -- 172.21.15.159:0/201547808 learned_addr learned my addr 172.21.15.159:0/201547808 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe554e3b640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe550106f10 0x7fe550074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54f7fe640 1 -- 172.21.15.159:0/201547808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe550101de0 msgr2=0x7fe5500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54ffff640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe550101de0 0x7fe5500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54f7fe640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe550101de0 0x7fe5500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54f7fe640 1 -- 172.21.15.159:0/201547808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe550106f10 msgr2=0x7fe550074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54f7fe640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe550106f10 0x7fe550074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:44.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54f7fe640 1 -- 172.21.15.159:0/201547808 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5501a6990 con 0x7fe550102790 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.264+0000 7fe54f7fe640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 0x7fe550074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe538004770 tx=0x7fe538003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.265+0000 7fe54d7fa640 1 -- 172.21.15.159:0/201547808 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53803f070 con 0x7fe550102790 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.265+0000 7fe54d7fa640 1 -- 172.21.15.159:0/201547808 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe538031ca0 con 0x7fe550102790 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.265+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5501a6c20 con 0x7fe550102790 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.265+0000 7fe54d7fa640 1 -- 172.21.15.159:0/201547808 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538035030 con 0x7fe550102790 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.265+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5501a7100 con 0x7fe550102790 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.266+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5501021c0 con 0x7fe550102790 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.267+0000 7fe54d7fa640 1 -- 172.21.15.159:0/201547808 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fe538042070 con 0x7fe550102790 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.268+0000 7fe54d7fa640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe53c0a3240 0x7fe53c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.268+0000 7fe54ffff640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe53c0a3240 0x7fe53c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.268+0000 7fe54d7fa640 1 -- 172.21.15.159:0/201547808 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fe5380efba0 con 0x7fe550102790 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.268+0000 7fe54ffff640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe53c0a3240 0x7fe53c0a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe540009aa0 tx=0x7fe540005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:44.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.272+0000 7fe54d7fa640 1 -- 172.21.15.159:0/201547808 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5380bcd60 con 0x7fe550102790 2024-09-19T06:44:44.373 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 06:44:44 smithi189 podman[64195]: 2024-09-19 06:44:43.989942944 +0000 UTC m=+0.016327448 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:44:44.373 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 06:44:44 smithi189 podman[64195]: 2024-09-19 06:44:44.111734181 +0000 UTC m=+0.138118668 container create 44ac5cdd8d069f109a8b95888876671e2f7bb0bfd9a1215d19c063287483cc8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T06:44:44.374 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 06:44:44 smithi189 podman[64195]: 2024-09-19 06:44:44.37324067 +0000 UTC m=+0.399625158 container init 44ac5cdd8d069f109a8b95888876671e2f7bb0bfd9a1215d19c063287483cc8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:44:44.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.474+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe55010a150 con 0x7fe550102790 2024-09-19T06:44:44.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.475+0000 7fe54d7fa640 1 -- 172.21.15.159:0/201547808 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fe5380bc660 con 0x7fe550102790 2024-09-19T06:44:44.476 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:44:44.476 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":2,"btime":"2024-09-19T06:44:41:562717+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:44:44.477 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 2 2024-09-19T06:44:44.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe53c0a3240 msgr2=0x7fe53c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe53c0a3240 0x7fe53c0a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe540009aa0 tx=0x7fe540005f90 comp rx=0 tx=0).stop 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 msgr2=0x7fe550074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 0x7fe550074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe538004770 tx=0x7fe538003c10 comp rx=0 tx=0).stop 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 shutdown_connections 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe53c0a3240 0x7fe53c0a5700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe550106f10 0x7fe550074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe550102790 0x7fe550074a30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 --2- 172.21.15.159:0/201547808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe550101de0 0x7fe5500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 >> 172.21.15.159:0/201547808 conn(0x7fe5500fd8c0 msgr2=0x7fe5500fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.477+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 shutdown_connections 2024-09-19T06:44:44.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:44.478+0000 7fe55689e640 1 -- 172.21.15.159:0/201547808 wait complete. 2024-09-19T06:44:44.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-mon[34880]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:44.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/201547808' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:44.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:44.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:44.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:44.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:44.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:44.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:44.639 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 06:44:44 smithi189 podman[64195]: 2024-09-19 06:44:44.376168745 +0000 UTC m=+0.402553244 container start 44ac5cdd8d069f109a8b95888876671e2f7bb0bfd9a1215d19c063287483cc8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:44:44.639 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-mds[64214]: -- 172.21.15.189:0/2028734190 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a425e21860 con 0x55a425dfe800 2024-09-19T06:44:44.639 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 06:44:44 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-k[64210]: starting mds.k at 2024-09-19T06:44:44.639 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 06:44:44 smithi189 bash[64195]: 44ac5cdd8d069f109a8b95888876671e2f7bb0bfd9a1215d19c063287483cc8e 2024-09-19T06:44:44.639 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 06:44:44 smithi189 systemd[1]: Started Ceph mds.k for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:44:44.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:44 smithi203 ceph-mon[35473]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:44.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:44 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/201547808' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:44 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:44.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:44 smithi159 ceph-mon[30935]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:44 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/201547808' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:44 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:45.821 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:45 smithi159 ceph-mon[30935]: Deploying daemon mds.j on smithi159 2024-09-19T06:44:45.822 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:45 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.189:6832/2134153159,v1:172.21.15.189:6833/2134153159] up:boot 2024-09-19T06:44:45.822 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:45 smithi159 ceph-mon[30935]: fsmap 2 up:standby 2024-09-19T06:44:45.822 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:45 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:44:45.822 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:45 smithi159 ceph-mon[30935]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:45.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:45 smithi203 ceph-mon[35473]: Deploying daemon mds.j on smithi159 2024-09-19T06:44:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:45 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.189:6832/2134153159,v1:172.21.15.189:6833/2134153159] up:boot 2024-09-19T06:44:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:45 smithi203 ceph-mon[35473]: fsmap 2 up:standby 2024-09-19T06:44:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:45 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:44:45.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:45 smithi203 ceph-mon[35473]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:45 smithi189 ceph-mon[34880]: Deploying daemon mds.j on smithi159 2024-09-19T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:45 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.189:6832/2134153159,v1:172.21.15.189:6833/2134153159] up:boot 2024-09-19T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:45 smithi189 ceph-mon[34880]: fsmap 2 up:standby 2024-09-19T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:45 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:45 smithi189 ceph-mon[34880]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:47.286 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:44:47.296 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 06:44:47 smithi159 systemd[1]: Starting Ceph mds.j for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:44:47.549 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 06:44:47 smithi159 podman[70744]: 2024-09-19 06:44:47.198099862 +0000 UTC m=+0.015940439 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:44:47.549 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 06:44:47 smithi159 podman[70744]: 2024-09-19 06:44:47.312640073 +0000 UTC m=+0.130480635 container create f8ea31394b3d33f19d12f94d41b639917e6145267cdc9848f44773c10f958beb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T06:44:47.550 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 06:44:47 smithi159 podman[70744]: 2024-09-19 06:44:47.549036242 +0000 UTC m=+0.366876809 container init f8ea31394b3d33f19d12f94d41b639917e6145267cdc9848f44773c10f958beb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T06:44:47.728 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:47.850 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 06:44:47 smithi159 podman[70744]: 2024-09-19 06:44:47.552336209 +0000 UTC m=+0.370176782 container start f8ea31394b3d33f19d12f94d41b639917e6145267cdc9848f44773c10f958beb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T06:44:47.850 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 06:44:47 smithi159 ceph-mds[70793]: -- 172.21.15.159:0/59704231 <== mon.0 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b138745860 con 0x55b138723000 2024-09-19T06:44:47.850 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 06:44:47 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-j[70777]: starting mds.j at 2024-09-19T06:44:47.851 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 06:44:47 smithi159 bash[70744]: f8ea31394b3d33f19d12f94d41b639917e6145267cdc9848f44773c10f958beb 2024-09-19T06:44:47.851 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 06:44:47 smithi159 systemd[1]: Started Ceph mds.j for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:44:48.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 -- 172.21.15.159:0/1173546836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102ef0 msgr2=0x7f0d0810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:48.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/1173546836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102ef0 0x7f0d0810da40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009ca0 tx=0x7f0d0002a950 comp rx=0 tx=0).stop 2024-09-19T06:44:48.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 -- 172.21.15.159:0/1173546836 shutdown_connections 2024-09-19T06:44:48.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/1173546836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102ef0 0x7f0d0810da40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/1173546836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d08102570 0x7f0d081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/1173546836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d08100e20 0x7f0d08101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 -- 172.21.15.159:0/1173546836 >> 172.21.15.159:0/1173546836 conn(0x7f0d080fc7d0 msgr2=0x7f0d080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 -- 172.21.15.159:0/1173546836 shutdown_connections 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 -- 172.21.15.159:0/1173546836 wait complete. 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 Processor -- start 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.201+0000 7f0d0ed97640 1 -- start start 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d0ed97640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d08100e20 0x7f0d080fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d0ed97640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102570 0x7f0d080fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d0ed97640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d08102ef0 0x7f0d080fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d0ed97640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0d08111020 con 0x7f0d08102570 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d0ed97640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0d08110ea0 con 0x7f0d08102ef0 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d0ed97640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081111a0 con 0x7f0d08100e20 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d07fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102570 0x7f0d080fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:48.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d07fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102570 0x7f0d080fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53192/0 (socket says 172.21.15.159:53192) 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d07fff640 1 -- 172.21.15.159:0/2896343856 learned_addr learned my addr 172.21.15.159:0/2896343856 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d0d334640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d08102ef0 0x7f0d080fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d0cb33640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d08100e20 0x7f0d080fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d07fff640 1 -- 172.21.15.159:0/2896343856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d08100e20 msgr2=0x7f0d080fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d07fff640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d08100e20 0x7f0d080fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d07fff640 1 -- 172.21.15.159:0/2896343856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d08102ef0 msgr2=0x7f0d080fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d07fff640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d08102ef0 0x7f0d080fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d07fff640 1 -- 172.21.15.159:0/2896343856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d081a6aa0 con 0x7f0d08102570 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d07fff640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102570 0x7f0d080fd1c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400b4a0 tx=0x7f0cf400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d05ffb640 1 -- 172.21.15.159:0/2896343856 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4014070 con 0x7f0d08102570 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d05ffb640 1 -- 172.21.15.159:0/2896343856 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cf4010af0 con 0x7f0d08102570 2024-09-19T06:44:48.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d081a6d90 con 0x7f0d08102570 2024-09-19T06:44:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.202+0000 7f0d05ffb640 1 -- 172.21.15.159:0/2896343856 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4017d10 con 0x7f0d08102570 2024-09-19T06:44:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.203+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d081a7220 con 0x7f0d08102570 2024-09-19T06:44:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.204+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d08101280 con 0x7f0d08102570 2024-09-19T06:44:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.205+0000 7f0d05ffb640 1 -- 172.21.15.159:0/2896343856 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f0cf4017070 con 0x7f0d08102570 2024-09-19T06:44:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.205+0000 7f0d05ffb640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0cf80a3240 0x7f0cf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.206+0000 7f0d0cb33640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0cf80a3240 0x7f0cf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.206+0000 7f0d05ffb640 1 -- 172.21.15.159:0/2896343856 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f0cf40ce840 con 0x7f0d08102570 2024-09-19T06:44:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.206+0000 7f0d0cb33640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0cf80a3240 0x7f0cf80a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009890 tx=0x7f0cfc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.210+0000 7f0d05ffb640 1 -- 172.21.15.159:0/2896343856 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0cf409ba00 con 0x7f0d08102570 2024-09-19T06:44:48.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.419+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d0810a0a0 con 0x7f0d08102570 2024-09-19T06:44:48.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.420+0000 7f0d05ffb640 1 -- 172.21.15.159:0/2896343856 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f0cf409b300 con 0x7f0d08102570 2024-09-19T06:44:48.421 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:44:48.421 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":3,"btime":"2024-09-19T06:44:44:570537+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:44:48.421 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 3 2024-09-19T06:44:48.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0cf80a3240 msgr2=0x7f0cf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:48.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0cf80a3240 0x7f0cf80a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009890 tx=0x7f0cfc008040 comp rx=0 tx=0).stop 2024-09-19T06:44:48.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102570 msgr2=0x7f0d080fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:48.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102570 0x7f0d080fd1c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400b4a0 tx=0x7f0cf400b960 comp rx=0 tx=0).stop 2024-09-19T06:44:48.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 shutdown_connections 2024-09-19T06:44:48.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0cf80a3240 0x7f0cf80a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d08102ef0 0x7f0d080fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d08102570 0x7f0d080fd1c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 --2- 172.21.15.159:0/2896343856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d08100e20 0x7f0d080fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:48.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 >> 172.21.15.159:0/2896343856 conn(0x7f0d080fc7d0 msgr2=0x7f0d0806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:48.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 shutdown_connections 2024-09-19T06:44:48.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:48.422+0000 7f0d0ed97640 1 -- 172.21.15.159:0/2896343856 wait complete. 2024-09-19T06:44:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:48 smithi203 ceph-mon[35473]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:48 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:48 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2896343856' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:48 smithi189 ceph-mon[34880]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:48 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:48 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2896343856' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:48 smithi159 ceph-mon[30935]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:48 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:48 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2896343856' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:49.497 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:49 smithi159 ceph-mon[30935]: Deploying daemon mds.d on smithi159 2024-09-19T06:44:49.497 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:49 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.159:6834/2983935292,v1:172.21.15.159:6835/2983935292] up:boot 2024-09-19T06:44:49.497 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:49 smithi159 ceph-mon[30935]: fsmap 3 up:standby 2024-09-19T06:44:49.497 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:49 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:44:49.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:49 smithi203 ceph-mon[35473]: Deploying daemon mds.d on smithi159 2024-09-19T06:44:49.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:49 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.159:6834/2983935292,v1:172.21.15.159:6835/2983935292] up:boot 2024-09-19T06:44:49.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:49 smithi203 ceph-mon[35473]: fsmap 3 up:standby 2024-09-19T06:44:49.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:49 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:44:49.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:49 smithi189 ceph-mon[34880]: Deploying daemon mds.d on smithi159 2024-09-19T06:44:49.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:49 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.159:6834/2983935292,v1:172.21.15.159:6835/2983935292] up:boot 2024-09-19T06:44:49.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:49 smithi189 ceph-mon[34880]: fsmap 3 up:standby 2024-09-19T06:44:49.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:49 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:44:50.841 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:50 smithi159 ceph-mon[30935]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:50.841 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:44:50 smithi159 systemd[1]: Starting Ceph mds.d for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:44:50.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:50 smithi203 ceph-mon[35473]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:50 smithi189 ceph-mon[34880]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:51.108 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:44:50 smithi159 podman[71162]: 2024-09-19 06:44:50.742809712 +0000 UTC m=+0.016011919 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:44:51.109 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:44:50 smithi159 podman[71162]: 2024-09-19 06:44:50.846043283 +0000 UTC m=+0.119245520 container create 7e716c69227407ba4775b913dc4fe223d3891fce65c6219ba5987f03d074c785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:44:51.109 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:44:51 smithi159 podman[71162]: 2024-09-19 06:44:51.082101061 +0000 UTC m=+0.355303265 container init 7e716c69227407ba4775b913dc4fe223d3891fce65c6219ba5987f03d074c785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4) 2024-09-19T06:44:51.109 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:44:51 smithi159 podman[71162]: 2024-09-19 06:44:51.085068741 +0000 UTC m=+0.358270938 container start 7e716c69227407ba4775b913dc4fe223d3891fce65c6219ba5987f03d074c785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:44:51.109 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:44:51 smithi159 ceph-mds[71181]: -- 172.21.15.159:0/3937714535 <== mon.0 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5573b25f9860 con 0x5573b25d7400 2024-09-19T06:44:51.277 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:44:51.397 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:44:51 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-d[71177]: starting mds.d at 2024-09-19T06:44:51.398 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:44:51 smithi159 bash[71162]: 7e716c69227407ba4775b913dc4fe223d3891fce65c6219ba5987f03d074c785 2024-09-19T06:44:51.398 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:44:51 smithi159 systemd[1]: Started Ceph mds.d for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:44:51.529 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:52.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 -- 172.21.15.159:0/3732275957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074620 msgr2=0x7f7190074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:52.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 --2- 172.21.15.159:0/3732275957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074620 0x7f7190074a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f718c009900 tx=0x7f718c02a480 comp rx=0 tx=0).stop 2024-09-19T06:44:52.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 -- 172.21.15.159:0/3732275957 shutdown_connections 2024-09-19T06:44:52.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 --2- 172.21.15.159:0/3732275957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f719010e3c0 0x7f7190110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 --2- 172.21.15.159:0/3732275957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7190074f40 0x7f719010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 --2- 172.21.15.159:0/3732275957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074620 0x7f7190074a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 -- 172.21.15.159:0/3732275957 >> 172.21.15.159:0/3732275957 conn(0x7f71900fd8c0 msgr2=0x7f71900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:52.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 -- 172.21.15.159:0/3732275957 shutdown_connections 2024-09-19T06:44:52.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 -- 172.21.15.159:0/3732275957 wait complete. 2024-09-19T06:44:52.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 Processor -- start 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.009+0000 7f7197eaf640 1 -- start start 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f7197eaf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7190074620 0x7f719019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f7197eaf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074f40 0x7f719019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f7197eaf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f719010e3c0 0x7f719019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f7197eaf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7190114170 con 0x7f7190074f40 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f7197eaf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7190113ff0 con 0x7f7190074620 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f7197eaf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71901142f0 con 0x7f719010e3c0 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719544a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074f40 0x7f719019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719544a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074f40 0x7f719019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52718/0 (socket says 172.21.15.159:52718) 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719544a640 1 -- 172.21.15.159:0/1448062428 learned_addr learned my addr 172.21.15.159:0/1448062428 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:52.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719644c640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f719010e3c0 0x7f719019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f7195c4b640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7190074620 0x7f719019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719544a640 1 -- 172.21.15.159:0/1448062428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f719010e3c0 msgr2=0x7f719019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719544a640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f719010e3c0 0x7f719019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719544a640 1 -- 172.21.15.159:0/1448062428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7190074620 msgr2=0x7f719019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719544a640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7190074620 0x7f719019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719544a640 1 -- 172.21.15.159:0/1448062428 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719019f620 con 0x7f7190074f40 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719644c640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f719010e3c0 0x7f719019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.010+0000 7f719544a640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074f40 0x7f719019abb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f718000c970 tx=0x7f718000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.011+0000 7f7186ffd640 1 -- 172.21.15.159:0/1448062428 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180007bb0 con 0x7f7190074f40 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.011+0000 7f7186ffd640 1 -- 172.21.15.159:0/1448062428 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7180007d50 con 0x7f7190074f40 2024-09-19T06:44:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.011+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719019f910 con 0x7f7190074f40 2024-09-19T06:44:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.011+0000 7f7186ffd640 1 -- 172.21.15.159:0/1448062428 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718000f450 con 0x7f7190074f40 2024-09-19T06:44:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.011+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71901a71f0 con 0x7f7190074f40 2024-09-19T06:44:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.012+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7190074a00 con 0x7f7190074f40 2024-09-19T06:44:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.013+0000 7f7186ffd640 1 -- 172.21.15.159:0/1448062428 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f7180005020 con 0x7f7190074f40 2024-09-19T06:44:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.013+0000 7f7186ffd640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f717c0a3240 0x7f717c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.013+0000 7f7195c4b640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f717c0a3240 0x7f717c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.013+0000 7f7186ffd640 1 -- 172.21.15.159:0/1448062428 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f71800cf1a0 con 0x7f7190074f40 2024-09-19T06:44:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.014+0000 7f7195c4b640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f717c0a3240 0x7f717c0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f718c009230 tx=0x7f718c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.017+0000 7f7186ffd640 1 -- 172.21.15.159:0/1448062428 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7180014030 con 0x7f7190074f40 2024-09-19T06:44:52.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.221+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7190108fb0 con 0x7f7190074f40 2024-09-19T06:44:52.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.222+0000 7f7186ffd640 1 -- 172.21.15.159:0/1448062428 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3922 (secure 0 0 0) 0x7f718009bd10 con 0x7f7190074f40 2024-09-19T06:44:52.224 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:44:52.224 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":5,"btime":"2024-09-19T06:44:51:465155+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:44:52.224 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 5 2024-09-19T06:44:52.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.224+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f717c0a3240 msgr2=0x7f717c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:52.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.224+0000 7f7197eaf640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f717c0a3240 0x7f717c0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f718c009230 tx=0x7f718c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.224+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074f40 msgr2=0x7f719019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:52.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.224+0000 7f7197eaf640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074f40 0x7f719019abb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f718000c970 tx=0x7f718000ce30 comp rx=0 tx=0).stop 2024-09-19T06:44:52.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.225+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 shutdown_connections 2024-09-19T06:44:52.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.225+0000 7f7197eaf640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f717c0a3240 0x7f717c0a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.225+0000 7f7197eaf640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f719010e3c0 0x7f719019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.225+0000 7f7197eaf640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190074f40 0x7f719019abb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.225+0000 7f7197eaf640 1 --2- 172.21.15.159:0/1448062428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7190074620 0x7f719019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:52.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.225+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 >> 172.21.15.159:0/1448062428 conn(0x7f71900fd8c0 msgr2=0x7f71900fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:52.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.225+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 shutdown_connections 2024-09-19T06:44:52.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:52.225+0000 7f7197eaf640 1 -- 172.21.15.159:0/1448062428 wait complete. 2024-09-19T06:44:52.534 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:52.534 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:52.534 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:52.534 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:52.534 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:52.534 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:52.535 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: Deploying daemon mds.e on smithi189 2024-09-19T06:44:52.535 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:52.535 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.159:6836/1806152492,v1:172.21.15.159:6837/1806152492] up:boot 2024-09-19T06:44:52.535 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: fsmap 4 up:standby 2024-09-19T06:44:52.535 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:44:52.535 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:52 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1448062428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:52.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:52.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: Deploying daemon mds.e on smithi189 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.159:6836/1806152492,v1:172.21.15.159:6837/1806152492] up:boot 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: fsmap 4 up:standby 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:44:52.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:52 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1448062428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: Deploying daemon mds.e on smithi189 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.159:6836/1806152492,v1:172.21.15.159:6837/1806152492] up:boot 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: fsmap 4 up:standby 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:44:52.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:52 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1448062428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:53.638 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 06:44:53 smithi189 podman[64495]: 2024-09-19 06:44:53.593138093 +0000 UTC m=+0.138196199 container create 4bdc73a359bf782758659511064ea42efb2e358fb86394f023278e490ab34359 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:44:54.138 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 06:44:53 smithi189 podman[64495]: 2024-09-19 06:44:53.87157154 +0000 UTC m=+0.416629650 container init 4bdc73a359bf782758659511064ea42efb2e358fb86394f023278e490ab34359 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:44:54.138 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 06:44:53 smithi189 podman[64495]: 2024-09-19 06:44:53.874491966 +0000 UTC m=+0.419550070 container start 4bdc73a359bf782758659511064ea42efb2e358fb86394f023278e490ab34359 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:44:54.138 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 06:44:53 smithi189 ceph-mds[64514]: -- 172.21.15.189:0/2288365589 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652a1979c20 con 0x5652a1957000 2024-09-19T06:44:54.138 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 06:44:53 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-e[64510]: starting mds.e at 2024-09-19T06:44:54.138 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 06:44:53 smithi189 bash[64495]: 4bdc73a359bf782758659511064ea42efb2e358fb86394f023278e490ab34359 2024-09-19T06:44:54.138 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 06:44:53 smithi189 systemd[1]: Started Ceph mds.e for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:44:54.793 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:54 smithi203 ceph-mon[35473]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:54.794 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:54.794 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:54.794 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:54.794 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:54.794 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:54.794 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:54 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:54 smithi189 ceph-mon[34880]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:54 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:54 smithi159 ceph-mon[30935]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:54 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:55.021 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:44:55.290 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:55.568 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:55 smithi159 ceph-mon[30935]: Deploying daemon mds.f on smithi203 2024-09-19T06:44:55.568 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:55 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.189:6834/3575906757,v1:172.21.15.189:6835/3575906757] up:boot 2024-09-19T06:44:55.568 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:55 smithi159 ceph-mon[30935]: fsmap 5 up:standby 2024-09-19T06:44:55.568 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:55 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:44:55.753 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:55 smithi203 ceph-mon[35473]: Deploying daemon mds.f on smithi203 2024-09-19T06:44:55.754 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:55 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.189:6834/3575906757,v1:172.21.15.189:6835/3575906757] up:boot 2024-09-19T06:44:55.754 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:55 smithi203 ceph-mon[35473]: fsmap 5 up:standby 2024-09-19T06:44:55.754 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:55 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:44:55.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.754+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/3508923995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d641036e0 msgr2=0x7f6d64107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.754+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/3508923995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d641036e0 0x7f6d64107b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009930 tx=0x7f6d5402a420 comp rx=0 tx=0).stop 2024-09-19T06:44:55.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.754+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/3508923995 shutdown_connections 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.754+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/3508923995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d641082a0 0x7f6d6410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.754+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/3508923995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d641036e0 0x7f6d64107b90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.754+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/3508923995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d64102d30 0x7f6d64103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.754+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/3508923995 >> 172.21.15.159:0/3508923995 conn(0x7f6d640fc7d0 msgr2=0x7f6d640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.754+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/3508923995 shutdown_connections 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.754+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/3508923995 wait complete. 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6c7a3640 1 Processor -- start 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6c7a3640 1 -- start start 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6c7a3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d64102d30 0x7f6d641985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6c7a3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d641036e0 0x7f6d64198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6c7a3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d641082a0 0x7f6d6419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6c7a3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6d641120a0 con 0x7f6d64102d30 2024-09-19T06:44:55.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6c7a3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64111f20 con 0x7f6d641036e0 2024-09-19T06:44:55.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6c7a3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64112220 con 0x7f6d641082a0 2024-09-19T06:44:55.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6a53f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d64102d30 0x7f6d641985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6a53f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d64102d30 0x7f6d641985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52726/0 (socket says 172.21.15.159:52726) 2024-09-19T06:44:55.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6a53f640 1 -- 172.21.15.159:0/1670205226 learned_addr learned my addr 172.21.15.159:0/1670205226 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:55.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.755+0000 7f6d6ad40640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d641082a0 0x7f6d6419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d69d3e640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d641036e0 0x7f6d64198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d6a53f640 1 -- 172.21.15.159:0/1670205226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d641082a0 msgr2=0x7f6d6419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d6a53f640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d641082a0 0x7f6d6419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d6a53f640 1 -- 172.21.15.159:0/1670205226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d641036e0 msgr2=0x7f6d64198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d6a53f640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d641036e0 0x7f6d64198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d6a53f640 1 -- 172.21.15.159:0/1670205226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6419d590 con 0x7f6d64102d30 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d6a53f640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d64102d30 0x7f6d641985e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000e9f0 tx=0x7f6d6000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d5b7fe640 1 -- 172.21.15.159:0/1670205226 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000cd80 con 0x7f6d64102d30 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d6419d880 con 0x7f6d64102d30 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d5b7fe640 1 -- 172.21.15.159:0/1670205226 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d60005500 con 0x7f6d64102d30 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d5b7fe640 1 -- 172.21.15.159:0/1670205226 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60010690 con 0x7f6d64102d30 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.756+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d641a5160 con 0x7f6d64102d30 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.757+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6406a850 con 0x7f6d64102d30 2024-09-19T06:44:55.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.758+0000 7f6d5b7fe640 1 -- 172.21.15.159:0/1670205226 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f6d600046c0 con 0x7f6d64102d30 2024-09-19T06:44:55.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.759+0000 7f6d5b7fe640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6d500a3240 0x7f6d500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.759+0000 7f6d69d3e640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6d500a3240 0x7f6d500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.759+0000 7f6d5b7fe640 1 -- 172.21.15.159:0/1670205226 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f6d600cf850 con 0x7f6d64102d30 2024-09-19T06:44:55.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.760+0000 7f6d69d3e640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6d500a3240 0x7f6d500a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005940 tx=0x7f6d540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.763+0000 7f6d5b7fe640 1 -- 172.21.15.159:0/1670205226 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d6009ca10 con 0x7f6d64102d30 2024-09-19T06:44:55.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:55 smithi189 ceph-mon[34880]: Deploying daemon mds.f on smithi203 2024-09-19T06:44:55.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:55 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.189:6834/3575906757,v1:172.21.15.189:6835/3575906757] up:boot 2024-09-19T06:44:55.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:55 smithi189 ceph-mon[34880]: fsmap 5 up:standby 2024-09-19T06:44:55.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:55 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:44:55.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.970+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d6410a2b0 con 0x7f6d64102d30 2024-09-19T06:44:55.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.971+0000 7f6d5b7fe640 1 -- 172.21.15.159:0/1670205226 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4750 (secure 0 0 0) 0x7f6d6009c310 con 0x7f6d64102d30 2024-09-19T06:44:55.972 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:44:55.972 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":6,"btime":"2024-09-19T06:44:54:455388+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T06:44:55.972 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 6 2024-09-19T06:44:55.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6d500a3240 msgr2=0x7f6d500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6d500a3240 0x7f6d500a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005940 tx=0x7f6d540058d0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d64102d30 msgr2=0x7f6d641985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d64102d30 0x7f6d641985e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000e9f0 tx=0x7f6d6000edf0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 shutdown_connections 2024-09-19T06:44:55.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6d500a3240 0x7f6d500a5700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d641082a0 0x7f6d6419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d641036e0 0x7f6d64198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 --2- 172.21.15.159:0/1670205226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d64102d30 0x7f6d641985e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 >> 172.21.15.159:0/1670205226 conn(0x7f6d640fc7d0 msgr2=0x7f6d64105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:55.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 shutdown_connections 2024-09-19T06:44:55.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:55.974+0000 7f6d6c7a3640 1 -- 172.21.15.159:0/1670205226 wait complete. 2024-09-19T06:44:56.091 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 06:44:55 smithi203 systemd[1]: Starting Ceph mds.f for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:44:56.428 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 06:44:56 smithi203 podman[65000]: 2024-09-19 06:44:56.051047232 +0000 UTC m=+0.015965167 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:44:56.428 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 06:44:56 smithi203 podman[65000]: 2024-09-19 06:44:56.174793097 +0000 UTC m=+0.139711023 container create 6e733e568cd8fe321b104d8d426603090e8e17bbf95fb7a3fbd1f5c646137f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-19T06:44:56.428 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 06:44:56 smithi203 podman[65000]: 2024-09-19 06:44:56.427469175 +0000 UTC m=+0.392387097 container init 6e733e568cd8fe321b104d8d426603090e8e17bbf95fb7a3fbd1f5c646137f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T06:44:56.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:56 smithi159 ceph-mon[30935]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:56.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:56 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1670205226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:56 smithi203 ceph-mon[35473]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:56 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1670205226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:56.842 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 06:44:56 smithi203 podman[65000]: 2024-09-19 06:44:56.430402063 +0000 UTC m=+0.395320001 container start 6e733e568cd8fe321b104d8d426603090e8e17bbf95fb7a3fbd1f5c646137f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-f, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T06:44:56.842 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 06:44:56 smithi203 ceph-mds[65019]: -- 172.21.15.203:0/521085860 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559c1a215860 con 0x559c1a1f3400 2024-09-19T06:44:56.842 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 06:44:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-f[65015]: starting mds.f at 2024-09-19T06:44:56.842 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 06:44:56 smithi203 bash[65000]: 6e733e568cd8fe321b104d8d426603090e8e17bbf95fb7a3fbd1f5c646137f0b 2024-09-19T06:44:56.842 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 06:44:56 smithi203 systemd[1]: Started Ceph mds.f for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:44:56.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:56 smithi189 ceph-mon[34880]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:56.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:56 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1670205226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:57.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:57 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.203:6834/818128260,v1:172.21.15.203:6835/818128260] up:boot 2024-09-19T06:44:57.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:57 smithi203 ceph-mon[35473]: fsmap 6 up:standby 2024-09-19T06:44:57.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:44:57.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:57.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:57.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:57.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:57.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:57.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:57 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:57.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:57 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.203:6834/818128260,v1:172.21.15.203:6835/818128260] up:boot 2024-09-19T06:44:57.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:57 smithi189 ceph-mon[34880]: fsmap 6 up:standby 2024-09-19T06:44:57.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:44:57.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:57.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:57.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:57.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:57.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:57.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:57 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:57 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.203:6834/818128260,v1:172.21.15.203:6835/818128260] up:boot 2024-09-19T06:44:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:57 smithi159 ceph-mon[30935]: fsmap 6 up:standby 2024-09-19T06:44:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:44:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:44:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:44:57.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:57 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:58.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:58 smithi203 ceph-mon[35473]: Deploying daemon mds.c on smithi203 2024-09-19T06:44:58.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:44:58 smithi203 ceph-mon[35473]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:58.592 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 06:44:58 smithi203 systemd[1]: Starting Ceph mds.c for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:44:58.747 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:44:58.776 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:58 smithi159 ceph-mon[30935]: Deploying daemon mds.c on smithi203 2024-09-19T06:44:58.776 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:44:58 smithi159 ceph-mon[30935]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:58.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:58 smithi189 ceph-mon[34880]: Deploying daemon mds.c on smithi203 2024-09-19T06:44:58.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:44:58 smithi189 ceph-mon[34880]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:44:59.008 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:59.041 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 06:44:58 smithi203 podman[65302]: 2024-09-19 06:44:58.619296077 +0000 UTC m=+0.016262070 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:44:59.041 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 06:44:58 smithi203 podman[65302]: 2024-09-19 06:44:58.754634061 +0000 UTC m=+0.151600041 container create a5d9e09df2d070224c7451677ab965753e65b78746cd1f8aa4578553db32639a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:44:59.042 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 06:44:59 smithi203 podman[65302]: 2024-09-19 06:44:59.041017893 +0000 UTC m=+0.437983875 container init a5d9e09df2d070224c7451677ab965753e65b78746cd1f8aa4578553db32639a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T06:44:59.341 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 06:44:59 smithi203 podman[65302]: 2024-09-19 06:44:59.043990462 +0000 UTC m=+0.440956445 container start a5d9e09df2d070224c7451677ab965753e65b78746cd1f8aa4578553db32639a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T06:44:59.407 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 06:44:59 smithi203 ceph-mds[65321]: -- 172.21.15.203:0/1522960631 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619ef8f7860 con 0x5619ef8d5400 2024-09-19T06:44:59.408 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 06:44:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-c[65317]: starting mds.c at 2024-09-19T06:44:59.408 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 06:44:59 smithi203 bash[65302]: a5d9e09df2d070224c7451677ab965753e65b78746cd1f8aa4578553db32639a 2024-09-19T06:44:59.408 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 06:44:59 smithi203 systemd[1]: Started Ceph mds.c for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:44:59.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.495+0000 7fa7ceffe640 1 -- 172.21.15.159:0/2647602810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8100e20 msgr2=0x7fa7c8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:59.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.495+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/2647602810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8100e20 0x7fa7c8101200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009900 tx=0x7fa7bc02a480 comp rx=0 tx=0).stop 2024-09-19T06:44:59.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.495+0000 7fa7ceffe640 1 -- 172.21.15.159:0/2647602810 shutdown_connections 2024-09-19T06:44:59.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.495+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/2647602810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c8102ef0 0x7fa7c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:59.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.495+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/2647602810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c8102570 0x7fa7c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:59.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.495+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/2647602810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8100e20 0x7fa7c8101200 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:59.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.495+0000 7fa7ceffe640 1 -- 172.21.15.159:0/2647602810 >> 172.21.15.159:0/2647602810 conn(0x7fa7c80fc7d0 msgr2=0x7fa7c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:59.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.495+0000 7fa7ceffe640 1 -- 172.21.15.159:0/2647602810 shutdown_connections 2024-09-19T06:44:59.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.495+0000 7fa7ceffe640 1 -- 172.21.15.159:0/2647602810 wait complete. 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7ceffe640 1 Processor -- start 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7ceffe640 1 -- start start 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7ceffe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c8100e20 0x7fa7c8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7ceffe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8102570 0x7fa7c8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7ceffe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c8102ef0 0x7fa7c819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7ceffe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c8110f80 con 0x7fa7c8102570 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7ceffe640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c8110e00 con 0x7fa7c8102ef0 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7ceffe640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c8111100 con 0x7fa7c8100e20 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7c7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8102570 0x7fa7c8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7c7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8102570 0x7fa7c8198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60812/0 (socket says 172.21.15.159:60812) 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7c7fff640 1 -- 172.21.15.159:0/4258174022 learned_addr learned my addr 172.21.15.159:0/4258174022 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7cd59b640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c8102ef0 0x7fa7c819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:59.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.496+0000 7fa7ccd9a640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c8100e20 0x7fa7c8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7c7fff640 1 -- 172.21.15.159:0/4258174022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c8100e20 msgr2=0x7fa7c8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7c7fff640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c8100e20 0x7fa7c8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7c7fff640 1 -- 172.21.15.159:0/4258174022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c8102ef0 msgr2=0x7fa7c819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7c7fff640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c8102ef0 0x7fa7c819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7c7fff640 1 -- 172.21.15.159:0/4258174022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c819d4b0 con 0x7fa7c8102570 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7ccd9a640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c8100e20 0x7fa7c8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7c7fff640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8102570 0x7fa7c8198a40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400d950 tx=0x7fa7b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7c5ffb640 1 -- 172.21.15.159:0/4258174022 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4017030 con 0x7fa7c8102570 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7c5ffb640 1 -- 172.21.15.159:0/4258174022 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b4004020 con 0x7fa7c8102570 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c819d7a0 con 0x7fa7c8102570 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7c5ffb640 1 -- 172.21.15.159:0/4258174022 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40047a0 con 0x7fa7c8102570 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.497+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c81a5080 con 0x7fa7c8102570 2024-09-19T06:44:59.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.498+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c8101200 con 0x7fa7c8102570 2024-09-19T06:44:59.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.499+0000 7fa7c5ffb640 1 -- 172.21.15.159:0/4258174022 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa7b40041d0 con 0x7fa7c8102570 2024-09-19T06:44:59.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.500+0000 7fa7c5ffb640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa7b80a32c0 0x7fa7b80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:59.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.500+0000 7fa7ccd9a640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa7b80a32c0 0x7fa7b80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:59.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.500+0000 7fa7c5ffb640 1 -- 172.21.15.159:0/4258174022 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa7b40cee60 con 0x7fa7c8102570 2024-09-19T06:44:59.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.500+0000 7fa7ccd9a640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa7b80a32c0 0x7fa7b80a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc005ab0 tx=0x7fa7bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:59.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.504+0000 7fa7c5ffb640 1 -- 172.21.15.159:0/4258174022 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7b409c020 con 0x7fa7c8102570 2024-09-19T06:44:59.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.705+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7c810a0d0 con 0x7fa7c8102570 2024-09-19T06:44:59.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.705+0000 7fa7c5ffb640 1 -- 172.21.15.159:0/4258174022 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6403 (secure 0 0 0) 0x7fa7b409b920 con 0x7fa7c8102570 2024-09-19T06:44:59.707 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:44:59.707 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":8,"btime":"2024-09-19T06:44:59:476310+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T06:44:59.708 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 8 2024-09-19T06:44:59.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa7b80a32c0 msgr2=0x7fa7b80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:59.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa7b80a32c0 0x7fa7b80a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc005ab0 tx=0x7fa7bc005a20 comp rx=0 tx=0).stop 2024-09-19T06:44:59.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8102570 msgr2=0x7fa7c8198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:59.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8102570 0x7fa7c8198a40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400d950 tx=0x7fa7b400de10 comp rx=0 tx=0).stop 2024-09-19T06:44:59.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 shutdown_connections 2024-09-19T06:44:59.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa7b80a32c0 0x7fa7b80a5780 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:59.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c8102ef0 0x7fa7c819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:59.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7c8102570 0x7fa7c8198a40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:59.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 --2- 172.21.15.159:0/4258174022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c8100e20 0x7fa7c8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:59.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 >> 172.21.15.159:0/4258174022 conn(0x7fa7c80fc7d0 msgr2=0x7fa7c806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:59.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 shutdown_connections 2024-09-19T06:44:59.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:44:59.708+0000 7fa7ceffe640 1 -- 172.21.15.159:0/4258174022 wait complete. 2024-09-19T06:45:00.279 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: Deploying daemon mds.h on smithi189 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.203:6836/1596598644,v1:172.21.15.203:6837/1596598644] up:boot 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: fsmap 7 up:standby 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:45:00.280 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:00 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/4258174022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:00.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: Deploying daemon mds.h on smithi189 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.203:6836/1596598644,v1:172.21.15.203:6837/1596598644] up:boot 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: fsmap 7 up:standby 2024-09-19T06:45:00.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:45:00.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:00 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/4258174022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: Deploying daemon mds.h on smithi189 2024-09-19T06:45:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:00.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.203:6836/1596598644,v1:172.21.15.203:6837/1596598644] up:boot 2024-09-19T06:45:00.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: fsmap 7 up:standby 2024-09-19T06:45:00.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:45:00.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:00 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/4258174022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:01.388 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 06:45:01 smithi189 systemd[1]: Starting Ceph mds.h for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:45:01.769 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 06:45:01 smithi189 podman[64800]: 2024-09-19 06:45:01.368924444 +0000 UTC m=+0.016062918 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:45:01.769 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 06:45:01 smithi189 podman[64800]: 2024-09-19 06:45:01.499084973 +0000 UTC m=+0.146223438 container create fae9a2299096db957639135a94bb0538b59c38bfa3dfb8803bc4812ea23f3fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T06:45:01.769 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 06:45:01 smithi189 podman[64800]: 2024-09-19 06:45:01.768667875 +0000 UTC m=+0.415806349 container init fae9a2299096db957639135a94bb0538b59c38bfa3dfb8803bc4812ea23f3fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:45:02.138 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 06:45:01 smithi189 podman[64800]: 2024-09-19 06:45:01.771749664 +0000 UTC m=+0.418888145 container start fae9a2299096db957639135a94bb0538b59c38bfa3dfb8803bc4812ea23f3fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T06:45:02.138 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 06:45:01 smithi189 ceph-mds[64819]: -- 172.21.15.189:0/75618518 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5613f87d9860 con 0x5613f87b6800 2024-09-19T06:45:02.138 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 06:45:01 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-h[64815]: starting mds.h at 2024-09-19T06:45:02.138 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 06:45:01 smithi189 bash[64800]: fae9a2299096db957639135a94bb0538b59c38bfa3dfb8803bc4812ea23f3fef 2024-09-19T06:45:02.138 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 06:45:01 smithi189 systemd[1]: Started Ceph mds.h for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:45:02.307 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:45:02.571 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:02.620 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:02 smithi203 ceph-mon[35473]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:02.620 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:02.620 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:02.620 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:02.620 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:02.621 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:02.621 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:02 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:02.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:02 smithi159 ceph-mon[30935]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:02.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:02.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:02.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:02.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:02.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:02.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:02 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:02 smithi189 ceph-mon[34880]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:02 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:03.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 -- 172.21.15.159:0/3060089940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94106a80 msgr2=0x7eff94106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/3060089940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94106a80 0x7eff94106e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff88009900 tx=0x7eff8802a410 comp rx=0 tx=0).stop 2024-09-19T06:45:03.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 -- 172.21.15.159:0/3060089940 shutdown_connections 2024-09-19T06:45:03.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/3060089940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff94101420 0x7eff9410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/3060089940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff94100a80 0x7eff94100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/3060089940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94106a80 0x7eff94106e60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 -- 172.21.15.159:0/3060089940 >> 172.21.15.159:0/3060089940 conn(0x7eff940fc7a0 msgr2=0x7eff940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:03.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 -- 172.21.15.159:0/3060089940 shutdown_connections 2024-09-19T06:45:03.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 -- 172.21.15.159:0/3060089940 wait complete. 2024-09-19T06:45:03.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.048+0000 7eff9ae8c640 1 Processor -- start 2024-09-19T06:45:03.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff9ae8c640 1 -- start start 2024-09-19T06:45:03.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff9ae8c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff94100a80 0x7eff94199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:03.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff9ae8c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff94101420 0x7eff941997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:03.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff9ae8c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94106a80 0x7eff941a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff9ae8c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7eff94110e80 con 0x7eff94101420 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff9ae8c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7eff94110d00 con 0x7eff94106a80 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff9ae8c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7eff94111000 con 0x7eff94100a80 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff93fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff94101420 0x7eff941997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff93fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff94101420 0x7eff941997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60836/0 (socket says 172.21.15.159:60836) 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff93fff640 1 -- 172.21.15.159:0/1605934135 learned_addr learned my addr 172.21.15.159:0/1605934135 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff98c28640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff94100a80 0x7eff94199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff99429640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94106a80 0x7eff941a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff93fff640 1 -- 172.21.15.159:0/1605934135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff94100a80 msgr2=0x7eff94199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff93fff640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff94100a80 0x7eff94199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff93fff640 1 -- 172.21.15.159:0/1605934135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94106a80 msgr2=0x7eff941a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff93fff640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94106a80 0x7eff941a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff93fff640 1 -- 172.21.15.159:0/1605934135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff941a4830 con 0x7eff94101420 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.049+0000 7eff93fff640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff94101420 0x7eff941997b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff8000ea60 tx=0x7eff8000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.050+0000 7eff91ffb640 1 -- 172.21.15.159:0/1605934135 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8000cde0 con 0x7eff94101420 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.050+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff941a4a00 con 0x7eff94101420 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.050+0000 7eff91ffb640 1 -- 172.21.15.159:0/1605934135 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff800035f0 con 0x7eff94101420 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.050+0000 7eff91ffb640 1 -- 172.21.15.159:0/1605934135 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80010670 con 0x7eff94101420 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.050+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff941a4f40 con 0x7eff94101420 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.051+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff94100ee0 con 0x7eff94101420 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.052+0000 7eff91ffb640 1 -- 172.21.15.159:0/1605934135 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7eff800037a0 con 0x7eff94101420 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.052+0000 7eff91ffb640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff840a3240 0x7eff840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:03.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.052+0000 7eff91ffb640 1 -- 172.21.15.159:0/1605934135 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7eff800cf830 con 0x7eff94101420 2024-09-19T06:45:03.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.052+0000 7eff98c28640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff840a3240 0x7eff840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:03.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.053+0000 7eff98c28640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff840a3240 0x7eff840a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7eff88005ab0 tx=0x7eff88005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:03.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.056+0000 7eff91ffb640 1 -- 172.21.15.159:0/1605934135 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7eff8009c9f0 con 0x7eff94101420 2024-09-19T06:45:03.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.259+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff94108ff0 con 0x7eff94101420 2024-09-19T06:45:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.259+0000 7eff91ffb640 1 -- 172.21.15.159:0/1605934135 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7231 (secure 0 0 0) 0x7eff8009c2f0 con 0x7eff94101420 2024-09-19T06:45:03.261 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:03.261 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":9,"btime":"2024-09-19T06:45:02:456308+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T06:45:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 9 2024-09-19T06:45:03.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff840a3240 msgr2=0x7eff840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff840a3240 0x7eff840a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7eff88005ab0 tx=0x7eff88005a20 comp rx=0 tx=0).stop 2024-09-19T06:45:03.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff94101420 msgr2=0x7eff941997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff94101420 0x7eff941997b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff8000ea60 tx=0x7eff8000ef20 comp rx=0 tx=0).stop 2024-09-19T06:45:03.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 shutdown_connections 2024-09-19T06:45:03.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff840a3240 0x7eff840a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94106a80 0x7eff941a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff94101420 0x7eff941997b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 --2- 172.21.15.159:0/1605934135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff94100a80 0x7eff94199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 >> 172.21.15.159:0/1605934135 conn(0x7eff940fc7a0 msgr2=0x7eff940fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:03.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 shutdown_connections 2024-09-19T06:45:03.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:03.262+0000 7eff9ae8c640 1 -- 172.21.15.159:0/1605934135 wait complete. 2024-09-19T06:45:03.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:03 smithi159 ceph-mon[30935]: Deploying daemon mds.i on smithi203 2024-09-19T06:45:03.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:03 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.189:6836/1888227213,v1:172.21.15.189:6837/1888227213] up:boot 2024-09-19T06:45:03.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:03 smithi159 ceph-mon[30935]: fsmap 8 up:standby 2024-09-19T06:45:03.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:03 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:45:03.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:03 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1605934135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:03.707 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:03 smithi203 ceph-mon[35473]: Deploying daemon mds.i on smithi203 2024-09-19T06:45:03.707 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:03 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.189:6836/1888227213,v1:172.21.15.189:6837/1888227213] up:boot 2024-09-19T06:45:03.707 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:03 smithi203 ceph-mon[35473]: fsmap 8 up:standby 2024-09-19T06:45:03.707 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:03 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:45:03.708 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:03 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1605934135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:03 smithi189 ceph-mon[34880]: Deploying daemon mds.i on smithi203 2024-09-19T06:45:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:03 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.189:6836/1888227213,v1:172.21.15.189:6837/1888227213] up:boot 2024-09-19T06:45:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:03 smithi189 ceph-mon[34880]: fsmap 8 up:standby 2024-09-19T06:45:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:03 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:45:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:03 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1605934135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:04.091 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:03 smithi203 systemd[1]: Starting Ceph mds.i for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:45:04.389 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:04 smithi203 podman[65601]: 2024-09-19 06:45:04.006383055 +0000 UTC m=+0.016451624 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:45:04.389 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:04 smithi203 podman[65601]: 2024-09-19 06:45:04.11856157 +0000 UTC m=+0.128630131 container create d8bd847cff05b60ead06d529b9d66c5bcaf3709090dd7000043893fea4eff3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:45:04.389 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:04 smithi203 podman[65601]: 2024-09-19 06:45:04.38845795 +0000 UTC m=+0.398526508 container init d8bd847cff05b60ead06d529b9d66c5bcaf3709090dd7000043893fea4eff3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T06:45:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:04 smithi203 ceph-mon[35473]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:04.842 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:04 smithi203 podman[65601]: 2024-09-19 06:45:04.391325661 +0000 UTC m=+0.401394221 container start d8bd847cff05b60ead06d529b9d66c5bcaf3709090dd7000043893fea4eff3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T06:45:04.842 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:04 smithi203 ceph-mds[65620]: -- 172.21.15.203:0/4132864890 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55768f4b1860 con 0x55768f48f400 2024-09-19T06:45:04.842 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:04 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i[65616]: starting mds.i at 2024-09-19T06:45:04.842 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:04 smithi203 bash[65601]: d8bd847cff05b60ead06d529b9d66c5bcaf3709090dd7000043893fea4eff3b5 2024-09-19T06:45:04.842 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:04 smithi203 systemd[1]: Started Ceph mds.i for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:45:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:04 smithi189 ceph-mon[34880]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:04.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:04 smithi159 ceph-mon[30935]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] up:boot 2024-09-19T06:45:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: fsmap 9 up:standby 2024-09-19T06:45:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:45:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:05.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:05.649 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:05 smithi159 ceph-mon[30935]: Deploying daemon mds.g on smithi159 2024-09-19T06:45:05.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] up:boot 2024-09-19T06:45:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: fsmap 9 up:standby 2024-09-19T06:45:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:45:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:05 smithi203 ceph-mon[35473]: Deploying daemon mds.g on smithi159 2024-09-19T06:45:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] up:boot 2024-09-19T06:45:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: fsmap 9 up:standby 2024-09-19T06:45:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:45:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:05 smithi189 ceph-mon[34880]: Deploying daemon mds.g on smithi159 2024-09-19T06:45:05.933 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:45:06.202 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:06.638 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:06 smithi159 ceph-mon[30935]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:06.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.717+0000 7f6ad1536640 1 -- 172.21.15.159:0/2151254120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc101de0 msgr2=0x7f6acc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.717+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2151254120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc101de0 0x7f6acc1021c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009900 tx=0x7f6abc02a410 comp rx=0 tx=0).stop 2024-09-19T06:45:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.717+0000 7f6ad1536640 1 -- 172.21.15.159:0/2151254120 shutdown_connections 2024-09-19T06:45:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.717+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2151254120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6acc106f10 0x7f6acc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.717+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2151254120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6acc102790 0x7f6acc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.717+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2151254120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc101de0 0x7f6acc1021c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.717+0000 7f6ad1536640 1 -- 172.21.15.159:0/2151254120 >> 172.21.15.159:0/2151254120 conn(0x7f6acc0fd8c0 msgr2=0x7f6acc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.717+0000 7f6ad1536640 1 -- 172.21.15.159:0/2151254120 shutdown_connections 2024-09-19T06:45:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.717+0000 7f6ad1536640 1 -- 172.21.15.159:0/2151254120 wait complete. 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6ad1536640 1 Processor -- start 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6ad1536640 1 -- start start 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6ad1536640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6acc101de0 0x7f6acc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6ad1536640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc102790 0x7f6acc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6ad1536640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6acc106f10 0x7f6acc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6ad1536640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc111f70 con 0x7f6acc102790 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6ad1536640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc111df0 con 0x7f6acc101de0 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6ad1536640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1120f0 con 0x7f6acc106f10 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6aca7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc102790 0x7f6acc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6aca7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc102790 0x7f6acc198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60862/0 (socket says 172.21.15.159:60862) 2024-09-19T06:45:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6aca7fc640 1 -- 172.21.15.159:0/2575212375 learned_addr learned my addr 172.21.15.159:0/2575212375 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6acaffd640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6acc101de0 0x7f6acc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.718+0000 7f6acb7fe640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6acc106f10 0x7f6acc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6aca7fc640 1 -- 172.21.15.159:0/2575212375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6acc106f10 msgr2=0x7f6acc19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6aca7fc640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6acc106f10 0x7f6acc19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6aca7fc640 1 -- 172.21.15.159:0/2575212375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6acc101de0 msgr2=0x7f6acc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6aca7fc640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6acc101de0 0x7f6acc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6aca7fc640 1 -- 172.21.15.159:0/2575212375 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc19d400 con 0x7f6acc102790 2024-09-19T06:45:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6aca7fc640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc102790 0x7f6acc198990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d950 tx=0x7f6ac000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6ab3fff640 1 -- 172.21.15.159:0/2575212375 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0017070 con 0x7f6acc102790 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6ab3fff640 1 -- 172.21.15.159:0/2575212375 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ac0009c30 con 0x7f6acc102790 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6ab3fff640 1 -- 172.21.15.159:0/2575212375 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac000f6b0 con 0x7f6acc102790 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc19d6f0 con 0x7f6acc102790 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.719+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6acc1a4fd0 con 0x7f6acc102790 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.720+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6acc1021c0 con 0x7f6acc102790 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.721+0000 7f6ab3fff640 1 -- 172.21.15.159:0/2575212375 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f6ac00109d0 con 0x7f6acc102790 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.722+0000 7f6ab3fff640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6ab40a32c0 0x7f6ab40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.722+0000 7f6acaffd640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6ab40a32c0 0x7f6ab40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.722+0000 7f6ab3fff640 1 -- 172.21.15.159:0/2575212375 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f6ac00cf110 con 0x7f6acc102790 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.722+0000 7f6acaffd640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6ab40a32c0 0x7f6ab40a5780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6abc005ab0 tx=0x7f6abc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.726+0000 7f6ab3fff640 1 -- 172.21.15.159:0/2575212375 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ac0009de0 con 0x7f6acc102790 2024-09-19T06:45:06.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:06 smithi203 ceph-mon[35473]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:06 smithi189 ceph-mon[34880]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:06.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.948+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6acc10a150 con 0x7f6acc102790 2024-09-19T06:45:06.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.949+0000 7f6ab3fff640 1 -- 172.21.15.159:0/2575212375 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8061 (secure 0 0 0) 0x7f6ac009c2d0 con 0x7f6acc102790 2024-09-19T06:45:06.951 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:06.951 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":10,"btime":"2024-09-19T06:45:04:466290+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:45:06.951 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 10 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6ab40a32c0 msgr2=0x7f6ab40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6ab40a32c0 0x7f6ab40a5780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6abc005ab0 tx=0x7f6abc005a20 comp rx=0 tx=0).stop 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc102790 msgr2=0x7f6acc198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc102790 0x7f6acc198990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d950 tx=0x7f6ac000de10 comp rx=0 tx=0).stop 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 shutdown_connections 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f6ab40a32c0 0x7f6ab40a5780 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6acc106f10 0x7f6acc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6acc102790 0x7f6acc198990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 --2- 172.21.15.159:0/2575212375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6acc101de0 0x7f6acc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 >> 172.21.15.159:0/2575212375 conn(0x7f6acc0fd8c0 msgr2=0x7f6acc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 shutdown_connections 2024-09-19T06:45:06.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:06.951+0000 7f6ad1536640 1 -- 172.21.15.159:0/2575212375 wait complete. 2024-09-19T06:45:07.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:07 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2575212375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:07.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:07 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:07.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:07 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:07.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:07 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:07.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:07 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:07.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:07 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:07.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:07 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:07.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:07 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2575212375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:07.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:07 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:07.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:07 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:07.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:07 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:07.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:07 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:07.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:07 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:07.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:07 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:07.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:07 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2575212375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:07.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:07 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:07.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:07 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:07.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:07 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:07.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:07 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:07.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:07 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:07.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:07 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:08.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:08 smithi203 ceph-mon[35473]: Deploying daemon mds.a on smithi159 2024-09-19T06:45:08.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:08 smithi203 ceph-mon[35473]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:08.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:08 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.159:6838/3807456889,v1:172.21.15.159:6839/3807456889] up:boot 2024-09-19T06:45:08.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:08 smithi203 ceph-mon[35473]: fsmap 10 up:standby 2024-09-19T06:45:08.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:08 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:45:08.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:08 smithi189 ceph-mon[34880]: Deploying daemon mds.a on smithi159 2024-09-19T06:45:08.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:08 smithi189 ceph-mon[34880]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:08.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:08 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.159:6838/3807456889,v1:172.21.15.159:6839/3807456889] up:boot 2024-09-19T06:45:08.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:08 smithi189 ceph-mon[34880]: fsmap 10 up:standby 2024-09-19T06:45:08.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:08 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:45:08.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:08 smithi159 ceph-mon[30935]: Deploying daemon mds.a on smithi159 2024-09-19T06:45:08.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:08 smithi159 ceph-mon[30935]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:08.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:08 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.159:6838/3807456889,v1:172.21.15.159:6839/3807456889] up:boot 2024-09-19T06:45:08.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:08 smithi159 ceph-mon[30935]: fsmap 10 up:standby 2024-09-19T06:45:08.901 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:08 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:45:09.898 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:45:09 smithi159 systemd[1]: Starting Ceph mds.a for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:45:10.034 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:45:10.229 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:45:09 smithi159 podman[72350]: 2024-09-19 06:45:09.869385456 +0000 UTC m=+0.016162299 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:45:10.229 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:45:09 smithi159 podman[72350]: 2024-09-19 06:45:09.975055343 +0000 UTC m=+0.121832217 container create 30fab5e7f69be8c0db31e85e44c091d59e4e47ae401074d08ee3c994769fef71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T06:45:10.229 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:45:10 smithi159 podman[72350]: 2024-09-19 06:45:10.228188405 +0000 UTC m=+0.374965250 container init 30fab5e7f69be8c0db31e85e44c091d59e4e47ae401074d08ee3c994769fef71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:45:10.387 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:10.511 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:45:10 smithi159 podman[72350]: 2024-09-19 06:45:10.232448395 +0000 UTC m=+0.379225223 container start 30fab5e7f69be8c0db31e85e44c091d59e4e47ae401074d08ee3c994769fef71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T06:45:10.512 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:45:10 smithi159 ceph-mds[72398]: -- 172.21.15.159:0/2841982864 <== mon.0 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ed9b329860 con 0x55ed9b306800 2024-09-19T06:45:10.512 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:45:10 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-a[72383]: starting mds.a at 2024-09-19T06:45:10.512 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:45:10 smithi159 bash[72350]: 30fab5e7f69be8c0db31e85e44c091d59e4e47ae401074d08ee3c994769fef71 2024-09-19T06:45:10.512 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:45:10 smithi159 systemd[1]: Started Ceph mds.a for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:45:10.791 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:10 smithi159 ceph-mon[30935]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:10.791 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:10.791 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:10.791 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:10.791 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:10.792 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:10.792 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:10 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:10.833 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:10 smithi189 ceph-mon[34880]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:10.833 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:10.833 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:10.833 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:10.833 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:10.834 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:10.834 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:10 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:10 smithi203 ceph-mon[35473]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:45:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:45:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:10 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:10.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.870+0000 7f7d9afa7640 1 -- 172.21.15.159:0/2975191109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94102790 msgr2=0x7f7d941067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.870+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/2975191109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94102790 0x7f7d941067e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009900 tx=0x7f7d8402a410 comp rx=0 tx=0).stop 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.870+0000 7f7d9afa7640 1 -- 172.21.15.159:0/2975191109 shutdown_connections 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.870+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/2975191109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d94106f10 0x7f7d9410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.870+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/2975191109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94102790 0x7f7d941067e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.870+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/2975191109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94101de0 0x7f7d941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.870+0000 7f7d9afa7640 1 -- 172.21.15.159:0/2975191109 >> 172.21.15.159:0/2975191109 conn(0x7f7d940fd8c0 msgr2=0x7f7d940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.870+0000 7f7d9afa7640 1 -- 172.21.15.159:0/2975191109 shutdown_connections 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.870+0000 7f7d9afa7640 1 -- 172.21.15.159:0/2975191109 wait complete. 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d9afa7640 1 Processor -- start 2024-09-19T06:45:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d9afa7640 1 -- start start 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d9afa7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94101de0 0x7f7d940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d9afa7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d94102790 0x7f7d94074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d9afa7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94106f10 0x7f7d94074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d9afa7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94111f30 con 0x7f7d94101de0 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d9afa7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94111db0 con 0x7f7d94102790 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d9afa7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d941120b0 con 0x7f7d94106f10 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d98d43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94101de0 0x7f7d940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d98d43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94101de0 0x7f7d940744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57222/0 (socket says 172.21.15.159:57222) 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.871+0000 7f7d98d43640 1 -- 172.21.15.159:0/4131048749 learned_addr learned my addr 172.21.15.159:0/4131048749 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d8bfff640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d94102790 0x7f7d94074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d99544640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94106f10 0x7f7d94074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d98d43640 1 -- 172.21.15.159:0/4131048749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94106f10 msgr2=0x7f7d94074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d98d43640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94106f10 0x7f7d94074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d98d43640 1 -- 172.21.15.159:0/4131048749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d94102790 msgr2=0x7f7d94074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d98d43640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d94102790 0x7f7d94074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d98d43640 1 -- 172.21.15.159:0/4131048749 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d941a6870 con 0x7f7d94101de0 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d8bfff640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d94102790 0x7f7d94074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d98d43640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94101de0 0x7f7d940744f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c920 tx=0x7f7d9000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d89ffb640 1 -- 172.21.15.159:0/4131048749 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90007c70 con 0x7f7d94101de0 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d89ffb640 1 -- 172.21.15.159:0/4131048749 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d90007e10 con 0x7f7d94101de0 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d941a6b60 con 0x7f7d94101de0 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d89ffb640 1 -- 172.21.15.159:0/4131048749 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90018890 con 0x7f7d94101de0 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.872+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d941a70a0 con 0x7f7d94101de0 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.873+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d941021c0 con 0x7f7d94101de0 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.874+0000 7f7d89ffb640 1 -- 172.21.15.159:0/4131048749 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f7d90018a70 con 0x7f7d94101de0 2024-09-19T06:45:10.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.875+0000 7f7d89ffb640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d7c0a3240 0x7f7d7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.875+0000 7f7d8bfff640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d7c0a3240 0x7f7d7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.875+0000 7f7d89ffb640 1 -- 172.21.15.159:0/4131048749 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f7d900cf670 con 0x7f7d94101de0 2024-09-19T06:45:10.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.875+0000 7f7d8bfff640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d7c0a3240 0x7f7d7c0a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7d84000c00 tx=0x7f7d84032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:10.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:10.880+0000 7f7d89ffb640 1 -- 172.21.15.159:0/4131048749 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d90014030 con 0x7f7d94101de0 2024-09-19T06:45:11.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.086+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d94075a20 con 0x7f7d94101de0 2024-09-19T06:45:11.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.086+0000 7f7d89ffb640 1 -- 172.21.15.159:0/4131048749 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9719 (secure 0 0 0) 0x7f7d9000de20 con 0x7f7d94101de0 2024-09-19T06:45:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:11.088 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":12,"btime":"2024-09-19T06:45:10:559417+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:45:11.088 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 12 2024-09-19T06:45:11.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d7c0a3240 msgr2=0x7f7d7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d7c0a3240 0x7f7d7c0a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7d84000c00 tx=0x7f7d84032c70 comp rx=0 tx=0).stop 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94101de0 msgr2=0x7f7d940744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94101de0 0x7f7d940744f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c920 tx=0x7f7d9000cde0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 shutdown_connections 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f7d7c0a3240 0x7f7d7c0a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94106f10 0x7f7d94074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d94102790 0x7f7d94074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 --2- 172.21.15.159:0/4131048749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d94101de0 0x7f7d940744f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 >> 172.21.15.159:0/4131048749 conn(0x7f7d940fd8c0 msgr2=0x7f7d940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 shutdown_connections 2024-09-19T06:45:11.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:11.089+0000 7f7d9afa7640 1 -- 172.21.15.159:0/4131048749 wait complete. 2024-09-19T06:45:11.705 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:11 smithi159 ceph-mon[30935]: Deploying daemon mds.b on smithi189 2024-09-19T06:45:11.705 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:11 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.159:6840/2821417176,v1:172.21.15.159:6841/2821417176] up:boot 2024-09-19T06:45:11.705 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:11 smithi159 ceph-mon[30935]: fsmap 11 up:standby 2024-09-19T06:45:11.705 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:11 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:45:11.706 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:11 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/4131048749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:11 smithi203 ceph-mon[35473]: Deploying daemon mds.b on smithi189 2024-09-19T06:45:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:11 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.159:6840/2821417176,v1:172.21.15.159:6841/2821417176] up:boot 2024-09-19T06:45:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:11 smithi203 ceph-mon[35473]: fsmap 11 up:standby 2024-09-19T06:45:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:11 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:45:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:11 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/4131048749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:11.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:11 smithi189 ceph-mon[34880]: Deploying daemon mds.b on smithi189 2024-09-19T06:45:11.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:11 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.159:6840/2821417176,v1:172.21.15.159:6841/2821417176] up:boot 2024-09-19T06:45:11.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:11 smithi189 ceph-mon[34880]: fsmap 11 up:standby 2024-09-19T06:45:11.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:11 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:45:11.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:11 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/4131048749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:12.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:12 smithi203 ceph-mon[35473]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:12 smithi189 ceph-mon[34880]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:12.889 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:45:12 smithi189 podman[65100]: 2024-09-19 06:45:12.747032153 +0000 UTC m=+0.140220461 container create 1930efd25bf7095010e1c5758f50722fcb53c094f92378992a210708524162f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:45:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:12 smithi159 ceph-mon[30935]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:13.154 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:45:13 smithi189 podman[65100]: 2024-09-19 06:45:13.041874422 +0000 UTC m=+0.435062734 container init 1930efd25bf7095010e1c5758f50722fcb53c094f92378992a210708524162f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T06:45:13.154 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:45:13 smithi189 podman[65100]: 2024-09-19 06:45:13.044939393 +0000 UTC m=+0.438127702 container start 1930efd25bf7095010e1c5758f50722fcb53c094f92378992a210708524162f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T06:45:13.154 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:45:13 smithi189 ceph-mds[65119]: -- 172.21.15.189:0/3863738721 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562aa83bbc20 con 0x562aa8398800 2024-09-19T06:45:13.154 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:45:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[65115]: starting mds.b at 2024-09-19T06:45:13.154 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:45:13 smithi189 bash[65100]: 1930efd25bf7095010e1c5758f50722fcb53c094f92378992a210708524162f5 2024-09-19T06:45:13.421 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:45:13 smithi189 systemd[1]: Started Ceph mds.b for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:45:13.733 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:45:14.225 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.189:6838/1818858628,v1:172.21.15.189:6839/1818858628] up:boot 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: fsmap 12 up:standby 2024-09-19T06:45:14.226 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:14 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:45:14.380 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.189:6838/1818858628,v1:172.21.15.189:6839/1818858628] up:boot 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: fsmap 12 up:standby 2024-09-19T06:45:14.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:14 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.189:6838/1818858628,v1:172.21.15.189:6839/1818858628] up:boot 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: fsmap 12 up:standby 2024-09-19T06:45:14.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:14 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:45:14.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.863+0000 7f6468b55640 1 -- 172.21.15.159:0/1716399630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464106a80 msgr2=0x7f6464106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:14.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.863+0000 7f6468b55640 1 --2- 172.21.15.159:0/1716399630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464106a80 0x7f6464106e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6454009930 tx=0x7f645402a420 comp rx=0 tx=0).stop 2024-09-19T06:45:14.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.863+0000 7f6468b55640 1 -- 172.21.15.159:0/1716399630 shutdown_connections 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.863+0000 7f6468b55640 1 --2- 172.21.15.159:0/1716399630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6464101420 0x7f646410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.863+0000 7f6468b55640 1 --2- 172.21.15.159:0/1716399630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464100a80 0x7f6464100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.863+0000 7f6468b55640 1 --2- 172.21.15.159:0/1716399630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464106a80 0x7f6464106e60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.863+0000 7f6468b55640 1 -- 172.21.15.159:0/1716399630 >> 172.21.15.159:0/1716399630 conn(0x7f64640fc7a0 msgr2=0x7f64640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.863+0000 7f6468b55640 1 -- 172.21.15.159:0/1716399630 shutdown_connections 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.863+0000 7f6468b55640 1 -- 172.21.15.159:0/1716399630 wait complete. 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6468b55640 1 Processor -- start 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6468b55640 1 -- start start 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6468b55640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464100a80 0x7f64640fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6468b55640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6464101420 0x7f64640fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6468b55640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464106a80 0x7f64640fd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:14.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6468b55640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6464110e80 con 0x7f6464100a80 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6468b55640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6464110d00 con 0x7f6464101420 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6468b55640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6464111000 con 0x7f6464106a80 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f646259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464100a80 0x7f64640fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f646259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464100a80 0x7f64640fcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57236/0 (socket says 172.21.15.159:57236) 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f646259c640 1 -- 172.21.15.159:0/279016700 learned_addr learned my addr 172.21.15.159:0/279016700 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6462d9d640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464106a80 0x7f64640fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.864+0000 7f6461d9b640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6464101420 0x7f64640fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f646259c640 1 -- 172.21.15.159:0/279016700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464106a80 msgr2=0x7f64640fd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f646259c640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464106a80 0x7f64640fd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f646259c640 1 -- 172.21.15.159:0/279016700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6464101420 msgr2=0x7f64640fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f646259c640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6464101420 0x7f64640fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f646259c640 1 -- 172.21.15.159:0/279016700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64641a6930 con 0x7f6464100a80 2024-09-19T06:45:14.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f6462d9d640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464106a80 0x7f64640fd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f6461d9b640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6464101420 0x7f64640fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f646259c640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464100a80 0x7f64640fcd80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6454009230 tx=0x7f6454004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f64537fe640 1 -- 172.21.15.159:0/279016700 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645403f030 con 0x7f6464100a80 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64641a6bc0 con 0x7f6464100a80 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f64537fe640 1 -- 172.21.15.159:0/279016700 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6454003ad0 con 0x7f6464100a80 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f64537fe640 1 -- 172.21.15.159:0/279016700 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454035070 con 0x7f6464100a80 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.865+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64641a70a0 con 0x7f6464100a80 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.866+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6464100ee0 con 0x7f6464100a80 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.867+0000 7f64537fe640 1 -- 172.21.15.159:0/279016700 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f6454042030 con 0x7f6464100a80 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.868+0000 7f64537fe640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f644c0a32c0 0x7f644c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.868+0000 7f6461d9b640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f644c0a32c0 0x7f644c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.868+0000 7f64537fe640 1 -- 172.21.15.159:0/279016700 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f64540efdd0 con 0x7f6464100a80 2024-09-19T06:45:14.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.868+0000 7f6461d9b640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f644c0a32c0 0x7f644c0a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f64580058c0 tx=0x7f6458005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:14.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:14.871+0000 7f64537fe640 1 -- 172.21.15.159:0/279016700 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f64540bcef0 con 0x7f6464100a80 2024-09-19T06:45:15.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.093+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f646410a000 con 0x7f6464100a80 2024-09-19T06:45:15.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.094+0000 7f64537fe640 1 -- 172.21.15.159:0/279016700 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10548 (secure 0 0 0) 0x7f64540bc7f0 con 0x7f6464100a80 2024-09-19T06:45:15.095 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:15.096 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":13,"btime":"2024-09-19T06:45:13:572456+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:45:15.096 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 13 2024-09-19T06:45:15.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f644c0a32c0 msgr2=0x7f644c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f644c0a32c0 0x7f644c0a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f64580058c0 tx=0x7f6458005850 comp rx=0 tx=0).stop 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464100a80 msgr2=0x7f64640fcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464100a80 0x7f64640fcd80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6454009230 tx=0x7f6454004270 comp rx=0 tx=0).stop 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 shutdown_connections 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f644c0a32c0 0x7f644c0a5780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6464106a80 0x7f64640fd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6464101420 0x7f64640fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 --2- 172.21.15.159:0/279016700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6464100a80 0x7f64640fcd80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 >> 172.21.15.159:0/279016700 conn(0x7f64640fc7a0 msgr2=0x7f646406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 shutdown_connections 2024-09-19T06:45:15.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:15.097+0000 7f6468b55640 1 -- 172.21.15.159:0/279016700 wait complete. 2024-09-19T06:45:15.807 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T06:45:16.085 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:16.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:15 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:15 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:15 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:15 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:15 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/279016700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:16.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:15 smithi203 ceph-mon[35473]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:16.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:15 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:15 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/279016700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:16.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:15 smithi189 ceph-mon[34880]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:16.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:15 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:15 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:15 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:15 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:16.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:15 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/279016700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:16.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:15 smithi159 ceph-mon[30935]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:16.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.770+0000 7f9cb7e40640 1 -- 172.21.15.159:0/318025261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 msgr2=0x7f9cb01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.770+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/318025261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 0x7f9cb01029b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009900 tx=0x7f9ca002a480 comp rx=0 tx=0).stop 2024-09-19T06:45:16.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.770+0000 7f9cb7e40640 1 -- 172.21.15.159:0/318025261 shutdown_connections 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.770+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/318025261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb0102ef0 0x7f9cb010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.770+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/318025261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 0x7f9cb01029b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.770+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/318025261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cb0100e20 0x7f9cb0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.770+0000 7f9cb7e40640 1 -- 172.21.15.159:0/318025261 >> 172.21.15.159:0/318025261 conn(0x7f9cb00fc7d0 msgr2=0x7f9cb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.770+0000 7f9cb7e40640 1 -- 172.21.15.159:0/318025261 shutdown_connections 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.770+0000 7f9cb7e40640 1 -- 172.21.15.159:0/318025261 wait complete. 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb7e40640 1 Processor -- start 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb7e40640 1 -- start start 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb7e40640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cb0100e20 0x7f9cb0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb7e40640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 0x7f9cb0199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb7e40640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb0102ef0 0x7f9cb01a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb7e40640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb0110f80 con 0x7f9cb0102570 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb7e40640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb0110e00 con 0x7f9cb0102ef0 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb7e40640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb0111100 con 0x7f9cb0100e20 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb53db640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 0x7f9cb0199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb53db640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 0x7f9cb0199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57262/0 (socket says 172.21.15.159:57262) 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb53db640 1 -- 172.21.15.159:0/2203399674 learned_addr learned my addr 172.21.15.159:0/2203399674 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb63dd640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb0102ef0 0x7f9cb01a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb5bdc640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cb0100e20 0x7f9cb0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb53db640 1 -- 172.21.15.159:0/2203399674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cb0100e20 msgr2=0x7f9cb0199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb53db640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cb0100e20 0x7f9cb0199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb53db640 1 -- 172.21.15.159:0/2203399674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb0102ef0 msgr2=0x7f9cb01a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb53db640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb0102ef0 0x7f9cb01a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb53db640 1 -- 172.21.15.159:0/2203399674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb01a48f0 con 0x7f9cb0102570 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb63dd640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb0102ef0 0x7f9cb01a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.771+0000 7f9cb53db640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 0x7f9cb0199870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0006010 tx=0x7f9ca0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.772+0000 7f9ca6ffd640 1 -- 172.21.15.159:0/2203399674 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca003f070 con 0x7f9cb0102570 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.772+0000 7f9ca6ffd640 1 -- 172.21.15.159:0/2203399674 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ca0031c30 con 0x7f9cb0102570 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.772+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb01a4ac0 con 0x7f9cb0102570 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.772+0000 7f9ca6ffd640 1 -- 172.21.15.159:0/2203399674 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0035030 con 0x7f9cb0102570 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.772+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb01a4f70 con 0x7f9cb0102570 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.773+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb0101200 con 0x7f9cb0102570 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.774+0000 7f9ca6ffd640 1 -- 172.21.15.159:0/2203399674 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f9ca0042070 con 0x7f9cb0102570 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.775+0000 7f9ca6ffd640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c9c0a3240 0x7f9c9c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.775+0000 7f9cb5bdc640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c9c0a3240 0x7f9c9c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.775+0000 7f9ca6ffd640 1 -- 172.21.15.159:0/2203399674 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f9ca00efad0 con 0x7f9cb0102570 2024-09-19T06:45:16.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.775+0000 7f9cb5bdc640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c9c0a3240 0x7f9c9c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009bd0 tx=0x7f9cac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:16.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.779+0000 7f9ca6ffd640 1 -- 172.21.15.159:0/2203399674 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ca0031de0 con 0x7f9cb0102570 2024-09-19T06:45:16.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.960+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9cb0109090 con 0x7f9cb0102570 2024-09-19T06:45:16.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.960+0000 7f9ca6ffd640 1 -- 172.21.15.159:0/2203399674 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f9ca00b8070 con 0x7f9cb0102570 2024-09-19T06:45:16.961 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:16.961 INFO:teuthology.orchestra.run.smithi159.stdout:[ 2024-09-19T06:45:16.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:45:16.962 INFO:teuthology.orchestra.run.smithi159.stdout: "poolnum": 1, 2024-09-19T06:45:16.962 INFO:teuthology.orchestra.run.smithi159.stdout: "poolname": ".mgr" 2024-09-19T06:45:16.962 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:45:16.962 INFO:teuthology.orchestra.run.smithi159.stdout:] 2024-09-19T06:45:16.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.962+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c9c0a3240 msgr2=0x7f9c9c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.962+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c9c0a3240 0x7f9c9c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009bd0 tx=0x7f9cac005f90 comp rx=0 tx=0).stop 2024-09-19T06:45:16.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.962+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 msgr2=0x7f9cb0199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.962+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 0x7f9cb0199870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0006010 tx=0x7f9ca0003c10 comp rx=0 tx=0).stop 2024-09-19T06:45:16.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.962+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 shutdown_connections 2024-09-19T06:45:16.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.963+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f9c9c0a3240 0x7f9c9c0a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.963+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb0102ef0 0x7f9cb01a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.963+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cb0102570 0x7f9cb0199870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.963+0000 7f9cb7e40640 1 --2- 172.21.15.159:0/2203399674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cb0100e20 0x7f9cb0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.963+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 >> 172.21.15.159:0/2203399674 conn(0x7f9cb00fc7d0 msgr2=0x7f9cb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:16.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.963+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 shutdown_connections 2024-09-19T06:45:16.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:16.963+0000 7f9cb7e40640 1 -- 172.21.15.159:0/2203399674 wait complete. 2024-09-19T06:45:17.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:17.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:17.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:17.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:17.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:17.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:17 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:17.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:17 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2203399674' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:45:17.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:17.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:17.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:17.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:17.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:17.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:17 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:17.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:17 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2203399674' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:45:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:17 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:17 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2203399674' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:45:18.334 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:18 smithi159 ceph-mon[30935]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:18.335 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:18 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.335 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:18 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.335 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:18 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.335 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:18 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.363 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T06:45:18.363 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T06:45:18.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:18 smithi189 ceph-mon[34880]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:18.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:18 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:18 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:18 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:18 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:18 smithi203 ceph-mon[35473]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:18.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:18 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:18 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:18 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:18 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:18.652 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:19.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.153+0000 7f4ccd59d640 1 -- 172.21.15.159:0/3744531898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8102ef0 msgr2=0x7f4cc810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:19.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.153+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/3744531898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8102ef0 0x7f4cc810da40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009900 tx=0x7f4cb802a480 comp rx=0 tx=0).stop 2024-09-19T06:45:19.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.153+0000 7f4ccd59d640 1 -- 172.21.15.159:0/3744531898 shutdown_connections 2024-09-19T06:45:19.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.153+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/3744531898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8102ef0 0x7f4cc810da40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:19.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.153+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/3744531898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cc8102570 0x7f4cc81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:19.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.153+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/3744531898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cc8100e20 0x7f4cc8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:19.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.153+0000 7f4ccd59d640 1 -- 172.21.15.159:0/3744531898 >> 172.21.15.159:0/3744531898 conn(0x7f4cc80fc7d0 msgr2=0x7f4cc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:19.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 -- 172.21.15.159:0/3744531898 shutdown_connections 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 -- 172.21.15.159:0/3744531898 wait complete. 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 Processor -- start 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 -- start start 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8100e20 0x7f4cc819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cc8102570 0x7f4cc819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cc8102ef0 0x7f4cc819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8110fa0 con 0x7f4cc8100e20 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8110e20 con 0x7f4cc8102570 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.154+0000 7f4ccd59d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8111120 con 0x7f4cc8102ef0 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8100e20 0x7f4cc819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8100e20 0x7f4cc819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40906/0 (socket says 172.21.15.159:40906) 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc6ffd640 1 -- 172.21.15.159:0/2653104400 learned_addr learned my addr 172.21.15.159:0/2653104400 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:19.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc67fc640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cc8102570 0x7f4cc819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc77fe640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cc8102ef0 0x7f4cc819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc6ffd640 1 -- 172.21.15.159:0/2653104400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cc8102ef0 msgr2=0x7f4cc819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc6ffd640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cc8102ef0 0x7f4cc819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc6ffd640 1 -- 172.21.15.159:0/2653104400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cc8102570 msgr2=0x7f4cc819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc6ffd640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cc8102570 0x7f4cc819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc6ffd640 1 -- 172.21.15.159:0/2653104400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc819f600 con 0x7f4cc8100e20 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc77fe640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cc8102ef0 0x7f4cc819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cc6ffd640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8100e20 0x7f4cc819a650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000cce0 tx=0x7f4cc000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cbffff640 1 -- 172.21.15.159:0/2653104400 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000f450 con 0x7f4cc8100e20 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc819f8f0 con 0x7f4cc8100e20 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cbffff640 1 -- 172.21.15.159:0/2653104400 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cc000fad0 con 0x7f4cc8100e20 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4cbffff640 1 -- 172.21.15.159:0/2653104400 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0018b80 con 0x7f4cc8100e20 2024-09-19T06:45:19.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.155+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc81a71d0 con 0x7f4cc8100e20 2024-09-19T06:45:19.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.156+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc8101200 con 0x7f4cc8100e20 2024-09-19T06:45:19.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.157+0000 7f4cbffff640 1 -- 172.21.15.159:0/2653104400 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f4cc000f5f0 con 0x7f4cc8100e20 2024-09-19T06:45:19.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.158+0000 7f4cbffff640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f4cb40a3240 0x7f4cb40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:19.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.158+0000 7f4cc67fc640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f4cb40a3240 0x7f4cb40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:19.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.158+0000 7f4cbffff640 1 -- 172.21.15.159:0/2653104400 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f4cc00cfac0 con 0x7f4cc8100e20 2024-09-19T06:45:19.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.159+0000 7f4cc67fc640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f4cb40a3240 0x7f4cb40a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80ff060 tx=0x7f4cb0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:19.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.162+0000 7f4cbffff640 1 -- 172.21.15.159:0/2653104400 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cc0014030 con 0x7f4cc8100e20 2024-09-19T06:45:19.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.329+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4cc81a7460 con 0x7f4cc8100e20 2024-09-19T06:45:19.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.740+0000 7f4cbffff640 1 -- 172.21.15.159:0/2653104400 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7f4cc009cc80 con 0x7f4cc8100e20 2024-09-19T06:45:19.742 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_metadata' created 2024-09-19T06:45:19.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f4cb40a3240 msgr2=0x7f4cb40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:19.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f4cb40a3240 0x7f4cb40a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80ff060 tx=0x7f4cb0009110 comp rx=0 tx=0).stop 2024-09-19T06:45:19.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8100e20 msgr2=0x7f4cc819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:19.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8100e20 0x7f4cc819a650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000cce0 tx=0x7f4cc000a620 comp rx=0 tx=0).stop 2024-09-19T06:45:19.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 shutdown_connections 2024-09-19T06:45:19.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f4cb40a3240 0x7f4cb40a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:19.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cc8102ef0 0x7f4cc819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:19.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cc8102570 0x7f4cc819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:19.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 --2- 172.21.15.159:0/2653104400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc8100e20 0x7f4cc819a650 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:19.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 >> 172.21.15.159:0/2653104400 conn(0x7f4cc80fc7d0 msgr2=0x7f4cc8069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:19.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 shutdown_connections 2024-09-19T06:45:19.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:19.743+0000 7f4ccd59d640 1 -- 172.21.15.159:0/2653104400 wait complete. 2024-09-19T06:45:20.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:20.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:20.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:20.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:20.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:20.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:19 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2653104400' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:45:20.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:19 smithi203 ceph-mon[35473]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:20.101 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:20.101 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:20.101 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:20.101 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:20.102 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:20.102 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:19 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2653104400' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:45:20.102 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:19 smithi159 ceph-mon[30935]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:20.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:20.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:45:20.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:19 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2653104400' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:45:20.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:19 smithi189 ceph-mon[34880]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:20.422 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T06:45:20.669 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:20 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2653104400' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:45:21.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:20 smithi203 ceph-mon[35473]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:45:21.097 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:20 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2653104400' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:45:21.097 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:20 smithi159 ceph-mon[30935]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:45:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:20 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2653104400' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:45:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:20 smithi189 ceph-mon[34880]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:45:21.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.182+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/2589854498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38101de0 msgr2=0x7f2e381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.182+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/2589854498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38101de0 0x7f2e381021c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009900 tx=0x7f2e2802a410 comp rx=0 tx=0).stop 2024-09-19T06:45:21.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.182+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/2589854498 shutdown_connections 2024-09-19T06:45:21.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.182+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/2589854498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e38106f10 0x7f2e3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.182+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/2589854498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e38102790 0x7f2e381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.182+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/2589854498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38101de0 0x7f2e381021c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.182+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/2589854498 >> 172.21.15.159:0/2589854498 conn(0x7f2e380fd8c0 msgr2=0x7f2e380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:21.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.182+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/2589854498 shutdown_connections 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.182+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/2589854498 wait complete. 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3fcb7640 1 Processor -- start 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3fcb7640 1 -- start start 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3fcb7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e38101de0 0x7f2e38198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3fcb7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38102790 0x7f2e38198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3fcb7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e38106f10 0x7f2e3819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3fcb7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2e38112010 con 0x7f2e38102790 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3fcb7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2e38111e90 con 0x7f2e38101de0 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3fcb7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e38112190 con 0x7f2e38106f10 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3d252640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38102790 0x7f2e38198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3d252640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38102790 0x7f2e38198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40922/0 (socket says 172.21.15.159:40922) 2024-09-19T06:45:21.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.183+0000 7f2e3d252640 1 -- 172.21.15.159:0/1859536384 learned_addr learned my addr 172.21.15.159:0/1859536384 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:21.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3e254640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e38106f10 0x7f2e3819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3da53640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e38101de0 0x7f2e38198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3d252640 1 -- 172.21.15.159:0/1859536384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e38106f10 msgr2=0x7f2e3819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3d252640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e38106f10 0x7f2e3819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3d252640 1 -- 172.21.15.159:0/1859536384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e38101de0 msgr2=0x7f2e38198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3d252640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e38101de0 0x7f2e38198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3d252640 1 -- 172.21.15.159:0/1859536384 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3819d540 con 0x7f2e38102790 2024-09-19T06:45:21.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3d252640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38102790 0x7f2e38198ad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400b4a0 tx=0x7f2e3400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e2effd640 1 -- 172.21.15.159:0/1859536384 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34014070 con 0x7f2e38102790 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e2effd640 1 -- 172.21.15.159:0/1859536384 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e34010af0 con 0x7f2e38102790 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3819d830 con 0x7f2e38102790 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e2effd640 1 -- 172.21.15.159:0/1859536384 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34017d10 con 0x7f2e38102790 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.184+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e381a5110 con 0x7f2e38102790 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.185+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e38102240 con 0x7f2e38102790 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.186+0000 7f2e2effd640 1 -- 172.21.15.159:0/1859536384 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f2e34017070 con 0x7f2e38102790 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.187+0000 7f2e2effd640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e240a3240 0x7f2e240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.187+0000 7f2e3da53640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e240a3240 0x7f2e240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.187+0000 7f2e2effd640 1 -- 172.21.15.159:0/1859536384 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7f2e340cee90 con 0x7f2e38102790 2024-09-19T06:45:21.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.187+0000 7f2e3da53640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e240a3240 0x7f2e240a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2e280096c0 tx=0x7f2e28000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:21.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.190+0000 7f2e2effd640 1 -- 172.21.15.159:0/1859536384 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e3409bec0 con 0x7f2e38102790 2024-09-19T06:45:21.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.361+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2e381998f0 con 0x7f2e38102790 2024-09-19T06:45:21.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.752+0000 7f2e2effd640 1 -- 172.21.15.159:0/1859536384 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7f2e381998f0 con 0x7f2e38102790 2024-09-19T06:45:21.754 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_data' created 2024-09-19T06:45:21.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e240a3240 msgr2=0x7f2e240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e240a3240 0x7f2e240a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2e280096c0 tx=0x7f2e28000bc0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38102790 msgr2=0x7f2e38198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38102790 0x7f2e38198ad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400b4a0 tx=0x7f2e3400b960 comp rx=0 tx=0).stop 2024-09-19T06:45:21.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 shutdown_connections 2024-09-19T06:45:21.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e240a3240 0x7f2e240a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e38106f10 0x7f2e3819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e38102790 0x7f2e38198ad0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 --2- 172.21.15.159:0/1859536384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e38101de0 0x7f2e38198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 >> 172.21.15.159:0/1859536384 conn(0x7f2e380fd8c0 msgr2=0x7f2e380fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:21.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 shutdown_connections 2024-09-19T06:45:21.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:21.756+0000 7f2e3fcb7640 1 -- 172.21.15.159:0/1859536384 wait complete. 2024-09-19T06:45:22.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:21 smithi203 ceph-mon[35473]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:45:22.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:21 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1859536384' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:45:22.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:21 smithi203 ceph-mon[35473]: pgmap v270: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:22.118 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:21 smithi159 ceph-mon[30935]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:45:22.119 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:21 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1859536384' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:45:22.119 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:21 smithi159 ceph-mon[30935]: pgmap v270: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:22.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:21 smithi189 ceph-mon[34880]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:45:22.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:21 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1859536384' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:45:22.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:21 smithi189 ceph-mon[34880]: pgmap v270: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:22.464 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T06:45:22.714 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:23.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:22 smithi203 ceph-mon[35473]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:45:23.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:22 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1859536384' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:45:23.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:22 smithi203 ceph-mon[35473]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:45:23.107 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:22 smithi159 ceph-mon[30935]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:45:23.107 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:22 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1859536384' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:45:23.107 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:22 smithi159 ceph-mon[30935]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:45:23.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:22 smithi189 ceph-mon[34880]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:45:23.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:22 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1859536384' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:45:23.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:22 smithi189 ceph-mon[34880]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:45:23.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.187+0000 7f19a6c46640 1 -- 172.21.15.159:0/155380207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0100e20 msgr2=0x7f19a0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:23.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.187+0000 7f19a6c46640 1 --2- 172.21.15.159:0/155380207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0100e20 0x7f19a0101200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1990009900 tx=0x7f199002a480 comp rx=0 tx=0).stop 2024-09-19T06:45:23.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.187+0000 7f19a6c46640 1 -- 172.21.15.159:0/155380207 shutdown_connections 2024-09-19T06:45:23.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.187+0000 7f19a6c46640 1 --2- 172.21.15.159:0/155380207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19a0102ef0 0x7f19a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:23.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.187+0000 7f19a6c46640 1 --2- 172.21.15.159:0/155380207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a0102570 0x7f19a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:23.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.187+0000 7f19a6c46640 1 --2- 172.21.15.159:0/155380207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0100e20 0x7f19a0101200 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:23.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.187+0000 7f19a6c46640 1 -- 172.21.15.159:0/155380207 >> 172.21.15.159:0/155380207 conn(0x7f19a00fc7d0 msgr2=0x7f19a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:23.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.187+0000 7f19a6c46640 1 -- 172.21.15.159:0/155380207 shutdown_connections 2024-09-19T06:45:23.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.187+0000 7f19a6c46640 1 -- 172.21.15.159:0/155380207 wait complete. 2024-09-19T06:45:23.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f19a6c46640 1 Processor -- start 2024-09-19T06:45:23.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f19a6c46640 1 -- start start 2024-09-19T06:45:23.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f19a6c46640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a0100e20 0x7f19a00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:23.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f19a6c46640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0102570 0x7f19a00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:23.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f19a6c46640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19a0102ef0 0x7f19a00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:23.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f19a6c46640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f19a0110fa0 con 0x7f19a0102570 2024-09-19T06:45:23.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f19a6c46640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19a0110e20 con 0x7f19a0102ef0 2024-09-19T06:45:23.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f19a6c46640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19a0111120 con 0x7f19a0100e20 2024-09-19T06:45:23.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f199ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0102570 0x7f19a00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:23.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f199ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0102570 0x7f19a00fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40938/0 (socket says 172.21.15.159:40938) 2024-09-19T06:45:23.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f199ffff640 1 -- 172.21.15.159:0/3901790401 learned_addr learned my addr 172.21.15.159:0/3901790401 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:23.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f19a49e2640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a0100e20 0x7f19a00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:23.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f199ffff640 1 -- 172.21.15.159:0/3901790401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a0100e20 msgr2=0x7f19a00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:23.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f199ffff640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a0100e20 0x7f19a00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:23.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f199ffff640 1 -- 172.21.15.159:0/3901790401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19a0102ef0 msgr2=0x7f19a00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:23.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f199ffff640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19a0102ef0 0x7f19a00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:23.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f199ffff640 1 -- 172.21.15.159:0/3901790401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a01a69f0 con 0x7f19a0102570 2024-09-19T06:45:23.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.188+0000 7f199ffff640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0102570 0x7f19a00fd1c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f199400b4a0 tx=0x7f199400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:23.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.189+0000 7f199dffb640 1 -- 172.21.15.159:0/3901790401 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994014070 con 0x7f19a0102570 2024-09-19T06:45:23.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.189+0000 7f199dffb640 1 -- 172.21.15.159:0/3901790401 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1994010af0 con 0x7f19a0102570 2024-09-19T06:45:23.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.189+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a01a6ce0 con 0x7f19a0102570 2024-09-19T06:45:23.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.189+0000 7f199dffb640 1 -- 172.21.15.159:0/3901790401 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994017d10 con 0x7f19a0102570 2024-09-19T06:45:23.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.189+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a01a7170 con 0x7f19a0102570 2024-09-19T06:45:23.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.190+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a0101200 con 0x7f19a0102570 2024-09-19T06:45:23.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.191+0000 7f199dffb640 1 -- 172.21.15.159:0/3901790401 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f1994017070 con 0x7f19a0102570 2024-09-19T06:45:23.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.191+0000 7f199dffb640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19880a3240 0x7f19880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:23.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.192+0000 7f19a49e2640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19880a3240 0x7f19880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:23.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.192+0000 7f199dffb640 1 -- 172.21.15.159:0/3901790401 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7f19940cec80 con 0x7f19a0102570 2024-09-19T06:45:23.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.192+0000 7f19a49e2640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19880a3240 0x7f19880a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1990005ab0 tx=0x7f1990005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:23.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.196+0000 7f199dffb640 1 -- 172.21.15.159:0/3901790401 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f199409bab0 con 0x7f19a0102570 2024-09-19T06:45:23.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.400+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f19a0109b10 con 0x7f19a0102570 2024-09-19T06:45:23.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.769+0000 7f199dffb640 1 -- 172.21.15.159:0/3901790401 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f199409b3b0 con 0x7f19a0102570 2024-09-19T06:45:23.771 INFO:teuthology.orchestra.run.smithi159.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19880a3240 msgr2=0x7f19880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19880a3240 0x7f19880a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1990005ab0 tx=0x7f1990005a20 comp rx=0 tx=0).stop 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0102570 msgr2=0x7f19a00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0102570 0x7f19a00fd1c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f199400b4a0 tx=0x7f199400b960 comp rx=0 tx=0).stop 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 shutdown_connections 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19880a3240 0x7f19880a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19a0102ef0 0x7f19a00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19a0102570 0x7f19a00fd1c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 --2- 172.21.15.159:0/3901790401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a0100e20 0x7f19a00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.771+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 >> 172.21.15.159:0/3901790401 conn(0x7f19a00fc7d0 msgr2=0x7f19a006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.772+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 shutdown_connections 2024-09-19T06:45:23.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:23.772+0000 7f19a6c46640 1 -- 172.21.15.159:0/3901790401 wait complete. 2024-09-19T06:45:24.076 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:23 smithi203 ceph-mon[35473]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:45:24.077 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:23 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3901790401' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:45:24.077 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:23 smithi203 ceph-mon[35473]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T06:45:24.077 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:23 smithi203 ceph-mon[35473]: pgmap v273: 97 pgs: 12 creating+peering, 51 unknown, 34 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:24.095 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:23 smithi159 ceph-mon[30935]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:45:24.095 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:23 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3901790401' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:45:24.095 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:23 smithi159 ceph-mon[30935]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T06:45:24.095 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:23 smithi159 ceph-mon[30935]: pgmap v273: 97 pgs: 12 creating+peering, 51 unknown, 34 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:24.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:23 smithi189 ceph-mon[34880]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:45:24.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:23 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3901790401' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:45:24.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:23 smithi189 ceph-mon[34880]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T06:45:24.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:23 smithi189 ceph-mon[34880]: pgmap v273: 97 pgs: 12 creating+peering, 51 unknown, 34 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:45:24.491 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:45:24.742 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:25.044 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:24 smithi159 ceph-mon[30935]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:45:25.045 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:24 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3901790401' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:45:25.045 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:24 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T06:45:25.045 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:24 smithi159 ceph-mon[30935]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T06:45:25.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:24 smithi203 ceph-mon[35473]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:45:25.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:24 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3901790401' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:45:25.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:24 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T06:45:25.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:24 smithi203 ceph-mon[35473]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T06:45:25.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:24 smithi189 ceph-mon[34880]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:45:25.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:24 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3901790401' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:45:25.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:24 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T06:45:25.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:24 smithi189 ceph-mon[34880]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T06:45:25.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.229+0000 7fc91c41b640 1 -- 172.21.15.159:0/2614350366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 msgr2=0x7fc91410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:25.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.229+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2614350366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 0x7fc91410ec40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009cd0 tx=0x7fc90c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.229+0000 7fc91c41b640 1 -- 172.21.15.159:0/2614350366 shutdown_connections 2024-09-19T06:45:25.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.229+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2614350366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 0x7fc91410ec40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.229+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2614350366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9141036e0 0x7fc914107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.229+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2614350366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc914102d30 0x7fc914103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.229+0000 7fc91c41b640 1 -- 172.21.15.159:0/2614350366 >> 172.21.15.159:0/2614350366 conn(0x7fc9140fc7d0 msgr2=0x7fc9140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.229+0000 7fc91c41b640 1 -- 172.21.15.159:0/2614350366 shutdown_connections 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.229+0000 7fc91c41b640 1 -- 172.21.15.159:0/2614350366 wait complete. 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91c41b640 1 Processor -- start 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91c41b640 1 -- start start 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91c41b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc914102d30 0x7fc914198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91c41b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9141036e0 0x7fc914198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91c41b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 0x7fc91419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91c41b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc9141120a0 con 0x7fc9141082a0 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91c41b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc914111f20 con 0x7fc914102d30 2024-09-19T06:45:25.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91c41b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc914112220 con 0x7fc9141036e0 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91a9b8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 0x7fc91419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91a9b8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 0x7fc91419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40958/0 (socket says 172.21.15.159:40958) 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91a9b8640 1 -- 172.21.15.159:0/2359013171 learned_addr learned my addr 172.21.15.159:0/2359013171 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc9199b6640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9141036e0 0x7fc914198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.230+0000 7fc91a1b7640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc914102d30 0x7fc914198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc91a9b8640 1 -- 172.21.15.159:0/2359013171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9141036e0 msgr2=0x7fc914198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc91a9b8640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9141036e0 0x7fc914198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc91a9b8640 1 -- 172.21.15.159:0/2359013171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc914102d30 msgr2=0x7fc914198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc91a9b8640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc914102d30 0x7fc914198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc91a9b8640 1 -- 172.21.15.159:0/2359013171 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91419d520 con 0x7fc9141082a0 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc91a9b8640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 0x7fc91419ce40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc90c005cc0 tx=0x7fc90c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc90b7fe640 1 -- 172.21.15.159:0/2359013171 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c004040 con 0x7fc9141082a0 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc90b7fe640 1 -- 172.21.15.159:0/2359013171 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc90c0046c0 con 0x7fc9141082a0 2024-09-19T06:45:25.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91419d7b0 con 0x7fc9141082a0 2024-09-19T06:45:25.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc90b7fe640 1 -- 172.21.15.159:0/2359013171 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c046480 con 0x7fc9141082a0 2024-09-19T06:45:25.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.231+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9141a50f0 con 0x7fc9141082a0 2024-09-19T06:45:25.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.232+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc914103110 con 0x7fc9141082a0 2024-09-19T06:45:25.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.234+0000 7fc90b7fe640 1 -- 172.21.15.159:0/2359013171 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fc90c0305a0 con 0x7fc9141082a0 2024-09-19T06:45:25.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.235+0000 7fc90b7fe640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc9000a32c0 0x7fc9000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:25.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.235+0000 7fc91a1b7640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc9000a32c0 0x7fc9000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:25.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.235+0000 7fc90b7fe640 1 -- 172.21.15.159:0/2359013171 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fc90c02e030 con 0x7fc9141082a0 2024-09-19T06:45:25.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.235+0000 7fc91a1b7640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc9000a32c0 0x7fc9000a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc910005fd0 tx=0x7fc91000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:25.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.243+0000 7fc90b7fe640 1 -- 172.21.15.159:0/2359013171 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc90c0f5070 con 0x7fc9141082a0 2024-09-19T06:45:25.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.418+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc91410a2b0 con 0x7fc9141082a0 2024-09-19T06:45:25.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.419+0000 7fc90b7fe640 1 -- 172.21.15.159:0/2359013171 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22337 (secure 0 0 0) 0x7fc90c04b060 con 0x7fc9141082a0 2024-09-19T06:45:25.422 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:25.422 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":79,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:45:23.401594+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:45:25.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.421+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc9000a32c0 msgr2=0x7fc9000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:25.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.421+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc9000a32c0 0x7fc9000a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc910005fd0 tx=0x7fc91000b390 comp rx=0 tx=0).stop 2024-09-19T06:45:25.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.421+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 msgr2=0x7fc91419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:25.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.421+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 0x7fc91419ce40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc90c005cc0 tx=0x7fc90c003970 comp rx=0 tx=0).stop 2024-09-19T06:45:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.422+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 shutdown_connections 2024-09-19T06:45:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.422+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc9000a32c0 0x7fc9000a5780 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.422+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9141082a0 0x7fc91419ce40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.422+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9141036e0 0x7fc914198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.422+0000 7fc91c41b640 1 --2- 172.21.15.159:0/2359013171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc914102d30 0x7fc914198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.422+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 >> 172.21.15.159:0/2359013171 conn(0x7fc9140fc7d0 msgr2=0x7fc914105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.422+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 shutdown_connections 2024-09-19T06:45:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:25.422+0000 7fc91c41b640 1 -- 172.21.15.159:0/2359013171 wait complete. 2024-09-19T06:45:26.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:25 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] up:active 2024-09-19T06:45:26.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:25 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:26.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:25 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:26.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:25 smithi203 ceph-mon[35473]: pgmap v275: 97 pgs: 12 creating+peering, 23 unknown, 62 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s wr, 2 op/s 2024-09-19T06:45:26.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:25 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2359013171' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:26.123 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:25 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] up:active 2024-09-19T06:45:26.124 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:25 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:26.124 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:25 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:26.124 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:25 smithi159 ceph-mon[30935]: pgmap v275: 97 pgs: 12 creating+peering, 23 unknown, 62 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s wr, 2 op/s 2024-09-19T06:45:26.124 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:25 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2359013171' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:26.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:25 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] up:active 2024-09-19T06:45:26.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:25 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:26.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:25 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:26.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:25 smithi189 ceph-mon[34880]: pgmap v275: 97 pgs: 12 creating+peering, 23 unknown, 62 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s wr, 2 op/s 2024-09-19T06:45:26.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:25 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2359013171' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:26.153 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:45:26.405 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 -- 172.21.15.159:0/3265282769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db8106f50 msgr2=0x7f2db810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/3265282769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db8106f50 0x7f2db810eaf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009cd0 tx=0x7f2db002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 -- 172.21.15.159:0/3265282769 shutdown_connections 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/3265282769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db8106f50 0x7f2db810eaf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/3265282769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2db8100ca0 0x7f2db8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/3265282769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db81002f0 0x7f2db81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 -- 172.21.15.159:0/3265282769 >> 172.21.15.159:0/3265282769 conn(0x7f2db8077210 msgr2=0x7f2db80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 -- 172.21.15.159:0/3265282769 shutdown_connections 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 -- 172.21.15.159:0/3265282769 wait complete. 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.893+0000 7f2dbd81a640 1 Processor -- start 2024-09-19T06:45:26.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2dbd81a640 1 -- start start 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2dbd81a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db81002f0 0x7f2db8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2dbd81a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db8100ca0 0x7f2db8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2dbd81a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2db8106f50 0x7f2db819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2dbd81a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2db8112000 con 0x7f2db81002f0 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2dbd81a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2db8111e80 con 0x7f2db8100ca0 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2dbd81a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2db8112180 con 0x7f2db8106f50 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db81002f0 0x7f2db8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db81002f0 0x7f2db8198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40980/0 (socket says 172.21.15.159:40980) 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db6ffd640 1 -- 172.21.15.159:0/1198823539 learned_addr learned my addr 172.21.15.159:0/1198823539 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db67fc640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db8100ca0 0x7f2db8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db6ffd640 1 -- 172.21.15.159:0/1198823539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2db8106f50 msgr2=0x7f2db819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db6ffd640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2db8106f50 0x7f2db819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db6ffd640 1 -- 172.21.15.159:0/1198823539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db8100ca0 msgr2=0x7f2db8198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:26.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db6ffd640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db8100ca0 0x7f2db8198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db6ffd640 1 -- 172.21.15.159:0/1198823539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db819d3c0 con 0x7f2db81002f0 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db67fc640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db8100ca0 0x7f2db8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.894+0000 7f2db6ffd640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db81002f0 0x7f2db8198410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c920 tx=0x7f2da800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.895+0000 7f2dbc818640 1 -- 172.21.15.159:0/1198823539 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8007c70 con 0x7f2db81002f0 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.895+0000 7f2dbc818640 1 -- 172.21.15.159:0/1198823539 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2da8007e10 con 0x7f2db81002f0 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.895+0000 7f2dbc818640 1 -- 172.21.15.159:0/1198823539 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8018890 con 0x7f2db81002f0 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.895+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db819d6b0 con 0x7f2db81002f0 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.895+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db81a4f90 con 0x7f2db81002f0 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.896+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db81006d0 con 0x7f2db81002f0 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.897+0000 7f2dbc818640 1 -- 172.21.15.159:0/1198823539 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f2da8018a70 con 0x7f2db81002f0 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.897+0000 7f2dbc818640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2da00a3240 0x7f2da00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:26.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.897+0000 7f2db67fc640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2da00a3240 0x7f2da00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:26.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.897+0000 7f2dbc818640 1 -- 172.21.15.159:0/1198823539 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f2da80cf9c0 con 0x7f2db81002f0 2024-09-19T06:45:26.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.898+0000 7f2db67fc640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2da00a3240 0x7f2da00a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2dac006fd0 tx=0x7f2dac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:26.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:26.902+0000 7f2dbc818640 1 -- 172.21.15.159:0/1198823539 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2da80d1e20 con 0x7f2db81002f0 2024-09-19T06:45:27.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.078+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2db8109bb0 con 0x7f2db81002f0 2024-09-19T06:45:27.080 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:26 smithi159 ceph-mon[30935]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:45:27.080 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:26 smithi159 ceph-mon[30935]: Cluster is now healthy 2024-09-19T06:45:27.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.080+0000 7f2dbc818640 1 -- 172.21.15.159:0/1198823539 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22337 (secure 0 0 0) 0x7f2da8014030 con 0x7f2db81002f0 2024-09-19T06:45:27.081 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:27.081 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":79,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:45:23.401594+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:45:27.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2da00a3240 msgr2=0x7f2da00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:27.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2da00a3240 0x7f2da00a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2dac006fd0 tx=0x7f2dac008040 comp rx=0 tx=0).stop 2024-09-19T06:45:27.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db81002f0 msgr2=0x7f2db8198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:27.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db81002f0 0x7f2db8198410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c920 tx=0x7f2da800cde0 comp rx=0 tx=0).stop 2024-09-19T06:45:27.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 shutdown_connections 2024-09-19T06:45:27.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2da00a3240 0x7f2da00a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:27.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2db8106f50 0x7f2db819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:27.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2db8100ca0 0x7f2db8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:27.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 --2- 172.21.15.159:0/1198823539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2db81002f0 0x7f2db8198410 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:27.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 >> 172.21.15.159:0/1198823539 conn(0x7f2db8077210 msgr2=0x7f2db81057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:27.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 shutdown_connections 2024-09-19T06:45:27.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:27.082+0000 7f2dbd81a640 1 -- 172.21.15.159:0/1198823539 wait complete. 2024-09-19T06:45:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:26 smithi203 ceph-mon[35473]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:45:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:26 smithi203 ceph-mon[35473]: Cluster is now healthy 2024-09-19T06:45:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:26 smithi189 ceph-mon[34880]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:45:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:26 smithi189 ceph-mon[34880]: Cluster is now healthy 2024-09-19T06:45:27.721 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T06:45:27.972 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:27 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1198823539' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:27 smithi203 ceph-mon[35473]: pgmap v276: 97 pgs: 12 creating+peering, 85 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 2 op/s 2024-09-19T06:45:28.092 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:27 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1198823539' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:28.092 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:27 smithi159 ceph-mon[30935]: pgmap v276: 97 pgs: 12 creating+peering, 85 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 2 op/s 2024-09-19T06:45:28.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:27 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1198823539' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:28.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:27 smithi189 ceph-mon[34880]: pgmap v276: 97 pgs: 12 creating+peering, 85 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 2 op/s 2024-09-19T06:45:28.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.461+0000 7f74d0863640 1 -- 172.21.15.159:0/2818780462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc101420 msgr2=0x7f74cc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:28.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.461+0000 7f74d0863640 1 --2- 172.21.15.159:0/2818780462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc101420 0x7f74cc10d950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009cd0 tx=0x7f74c402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.461+0000 7f74d0863640 1 -- 172.21.15.159:0/2818780462 shutdown_connections 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.461+0000 7f74d0863640 1 --2- 172.21.15.159:0/2818780462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc101420 0x7f74cc10d950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.461+0000 7f74d0863640 1 --2- 172.21.15.159:0/2818780462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74cc100a80 0x7f74cc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.461+0000 7f74d0863640 1 --2- 172.21.15.159:0/2818780462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74cc106a80 0x7f74cc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.461+0000 7f74d0863640 1 -- 172.21.15.159:0/2818780462 >> 172.21.15.159:0/2818780462 conn(0x7f74cc0fc7a0 msgr2=0x7f74cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.461+0000 7f74d0863640 1 -- 172.21.15.159:0/2818780462 shutdown_connections 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.461+0000 7f74d0863640 1 -- 172.21.15.159:0/2818780462 wait complete. 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.462+0000 7f74d0863640 1 Processor -- start 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.462+0000 7f74d0863640 1 -- start start 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74d0863640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74cc100a80 0x7f74cc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74d0863640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74cc101420 0x7f74cc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74d0863640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc106a80 0x7f74cc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:28.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74d0863640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc111fa0 con 0x7f74cc106a80 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74d0863640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc111e20 con 0x7f74cc101420 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74d0863640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc112120 con 0x7f74cc100a80 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74cad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc106a80 0x7f74cc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74cad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc106a80 0x7f74cc19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40998/0 (socket says 172.21.15.159:40998) 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74cad9d640 1 -- 172.21.15.159:0/608737884 learned_addr learned my addr 172.21.15.159:0/608737884 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74c3fff640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74cc101420 0x7f74cc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74ca59c640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74cc100a80 0x7f74cc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74cad9d640 1 -- 172.21.15.159:0/608737884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74cc100a80 msgr2=0x7f74cc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74cad9d640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74cc100a80 0x7f74cc198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74cad9d640 1 -- 172.21.15.159:0/608737884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74cc101420 msgr2=0x7f74cc198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74cad9d640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74cc101420 0x7f74cc198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74cad9d640 1 -- 172.21.15.159:0/608737884 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74cc19d3d0 con 0x7f74cc106a80 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74c3fff640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74cc101420 0x7f74cc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74cad9d640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc106a80 0x7f74cc19ccf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f74c4005cc0 tx=0x7f74c4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74c37fe640 1 -- 172.21.15.159:0/608737884 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4004040 con 0x7f74cc106a80 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74c37fe640 1 -- 172.21.15.159:0/608737884 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74c40046c0 con 0x7f74cc106a80 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74cc19d660 con 0x7f74cc106a80 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74c37fe640 1 -- 172.21.15.159:0/608737884 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4046480 con 0x7f74cc106a80 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.463+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74cc1a4fa0 con 0x7f74cc106a80 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.465+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74cc100ee0 con 0x7f74cc106a80 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.465+0000 7f74c37fe640 1 -- 172.21.15.159:0/608737884 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f74c40305a0 con 0x7f74cc106a80 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.466+0000 7f74c37fe640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74b80a3240 0x7f74b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.466+0000 7f74ca59c640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74b80a3240 0x7f74b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.466+0000 7f74c37fe640 1 -- 172.21.15.159:0/608737884 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f74c402e030 con 0x7f74cc106a80 2024-09-19T06:45:28.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.467+0000 7f74ca59c640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74b80a3240 0x7f74b80a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0058c0 tx=0x7f74bc005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:28.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.470+0000 7f74c37fe640 1 -- 172.21.15.159:0/608737884 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f74c404b060 con 0x7f74cc106a80 2024-09-19T06:45:28.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.674+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f74cc109010 con 0x7f74cc106a80 2024-09-19T06:45:28.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.800+0000 7f74c37fe640 1 -- 172.21.15.159:0/608737884 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f74c40bdf00 con 0x7f74cc106a80 2024-09-19T06:45:28.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.802+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74b80a3240 msgr2=0x7f74b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:28.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.802+0000 7f74d0863640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74b80a3240 0x7f74b80a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0058c0 tx=0x7f74bc005be0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.802+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc106a80 msgr2=0x7f74cc19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:28.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.802+0000 7f74d0863640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc106a80 0x7f74cc19ccf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f74c4005cc0 tx=0x7f74c4003970 comp rx=0 tx=0).stop 2024-09-19T06:45:28.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.803+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 shutdown_connections 2024-09-19T06:45:28.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.803+0000 7f74d0863640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f74b80a3240 0x7f74b80a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.803+0000 7f74d0863640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74cc106a80 0x7f74cc19ccf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.803+0000 7f74d0863640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74cc101420 0x7f74cc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.803+0000 7f74d0863640 1 --2- 172.21.15.159:0/608737884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74cc100a80 0x7f74cc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:28.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.803+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 >> 172.21.15.159:0/608737884 conn(0x7f74cc0fc7a0 msgr2=0x7f74cc0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:28.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.803+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 shutdown_connections 2024-09-19T06:45:28.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:28.803+0000 7f74d0863640 1 -- 172.21.15.159:0/608737884 wait complete. 2024-09-19T06:45:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:28 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/608737884' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:45:29.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:28 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/608737884' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:45:29.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:28 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/608737884' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:45:29.538 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T06:45:29.538 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T06:45:29.787 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:29.807 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:45:29 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i[65616]: 2024-09-19T06:45:29.474+0000 7f6fdaf9b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:45:30.071 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:29 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/608737884' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:45:30.072 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:29 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:30.072 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:29 smithi159 ceph-mon[30935]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T06:45:30.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:29 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/608737884' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:45:30.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:29 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:30.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:29 smithi203 ceph-mon[35473]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T06:45:30.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:29 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/608737884' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:45:30.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:29 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:30.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:29 smithi189 ceph-mon[34880]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T06:45:30.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.296+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/4157649005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34102790 msgr2=0x7f2e341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.296+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/4157649005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34102790 0x7f2e341067e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009900 tx=0x7f2e2402a410 comp rx=0 tx=0).stop 2024-09-19T06:45:30.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/4157649005 shutdown_connections 2024-09-19T06:45:30.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/4157649005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e34106f10 0x7f2e3410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/4157649005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34102790 0x7f2e341067e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/4157649005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e34101de0 0x7f2e341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/4157649005 >> 172.21.15.159:0/4157649005 conn(0x7f2e340fd8c0 msgr2=0x7f2e340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/4157649005 shutdown_connections 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/4157649005 wait complete. 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 Processor -- start 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 -- start start 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34101de0 0x7f2e341983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e34102790 0x7f2e341988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e34106f10 0x7f2e3419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34111f70 con 0x7f2e34101de0 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34111df0 con 0x7f2e34106f10 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e3c0c8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341120f0 con 0x7f2e34102790 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.297+0000 7f2e39e64640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34101de0 0x7f2e341983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:30.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e39e64640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34101de0 0x7f2e341983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41084/0 (socket says 172.21.15.159:41084) 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e39e64640 1 -- 172.21.15.159:0/3618994791 learned_addr learned my addr 172.21.15.159:0/3618994791 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e39663640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e34102790 0x7f2e341988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e3a665640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e34106f10 0x7f2e3419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e39e64640 1 -- 172.21.15.159:0/3618994791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e34102790 msgr2=0x7f2e341988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e39e64640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e34102790 0x7f2e341988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e39e64640 1 -- 172.21.15.159:0/3618994791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e34106f10 msgr2=0x7f2e3419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e39e64640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e34106f10 0x7f2e3419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e39e64640 1 -- 172.21.15.159:0/3618994791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3419d360 con 0x7f2e34101de0 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e3a665640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e34106f10 0x7f2e3419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e39e64640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34101de0 0x7f2e341983b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000d950 tx=0x7f2e3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e2affd640 1 -- 172.21.15.159:0/3618994791 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30017070 con 0x7f2e34101de0 2024-09-19T06:45:30.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3419d650 con 0x7f2e34101de0 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e2affd640 1 -- 172.21.15.159:0/3618994791 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e30009c30 con 0x7f2e34101de0 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e2affd640 1 -- 172.21.15.159:0/3618994791 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3000f6b0 con 0x7f2e34101de0 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.298+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e341a4f30 con 0x7f2e34101de0 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.299+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e341021c0 con 0x7f2e34101de0 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.300+0000 7f2e2affd640 1 -- 172.21.15.159:0/3618994791 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f2e300109d0 con 0x7f2e34101de0 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.301+0000 7f2e2affd640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e200a3240 0x7f2e200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.301+0000 7f2e39663640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e200a3240 0x7f2e200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.301+0000 7f2e2affd640 1 -- 172.21.15.159:0/3618994791 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f2e300cf4c0 con 0x7f2e34101de0 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.301+0000 7f2e39663640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e200a3240 0x7f2e200a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2e341088e0 tx=0x7f2e24005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.305+0000 7f2e2affd640 1 -- 172.21.15.159:0/3618994791 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e30009de0 con 0x7f2e34101de0 2024-09-19T06:45:30.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.508+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f2e3402d7c0 con 0x7f2e34101de0 2024-09-19T06:45:30.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.813+0000 7f2e2affd640 1 -- 172.21.15.159:0/3618994791 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f2e3009c330 con 0x7f2e34101de0 2024-09-19T06:45:30.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e200a3240 msgr2=0x7f2e200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e200a3240 0x7f2e200a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2e341088e0 tx=0x7f2e24005a20 comp rx=0 tx=0).stop 2024-09-19T06:45:30.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34101de0 msgr2=0x7f2e341983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34101de0 0x7f2e341983b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000d950 tx=0x7f2e3000de10 comp rx=0 tx=0).stop 2024-09-19T06:45:30.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 shutdown_connections 2024-09-19T06:45:30.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f2e200a3240 0x7f2e200a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e34106f10 0x7f2e3419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e34102790 0x7f2e341988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 --2- 172.21.15.159:0/3618994791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e34101de0 0x7f2e341983b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.815+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 >> 172.21.15.159:0/3618994791 conn(0x7f2e340fd8c0 msgr2=0x7f2e340fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:30.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.816+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 shutdown_connections 2024-09-19T06:45:30.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:30.816+0000 7f2e3c0c8640 1 -- 172.21.15.159:0/3618994791 wait complete. 2024-09-19T06:45:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:30 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3618994791' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:45:31.128 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:30 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3618994791' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:45:31.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:30 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3618994791' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:45:31.492 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T06:45:31.740 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:32.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:31 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3618994791' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:45:32.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:31 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:32.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:31 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:45:32.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:31 smithi203 ceph-mon[35473]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T06:45:32.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:31 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3618994791' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:45:32.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:31 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:32.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:31 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:45:32.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:31 smithi189 ceph-mon[34880]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T06:45:32.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:31 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3618994791' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:45:32.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:31 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:45:32.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:31 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:45:32.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:31 smithi159 ceph-mon[30935]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T06:45:32.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.232+0000 7f631c3cc640 1 -- 172.21.15.159:0/3077582471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314102ef0 msgr2=0x7f631410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.232+0000 7f631c3cc640 1 --2- 172.21.15.159:0/3077582471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314102ef0 0x7f631410da40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f630c009ca0 tx=0x7f630c02a950 comp rx=0 tx=0).stop 2024-09-19T06:45:32.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.232+0000 7f631c3cc640 1 -- 172.21.15.159:0/3077582471 shutdown_connections 2024-09-19T06:45:32.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.232+0000 7f631c3cc640 1 --2- 172.21.15.159:0/3077582471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314102ef0 0x7f631410da40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.232+0000 7f631c3cc640 1 --2- 172.21.15.159:0/3077582471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6314102570 0x7f63141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.232+0000 7f631c3cc640 1 --2- 172.21.15.159:0/3077582471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6314100e20 0x7f6314101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.232+0000 7f631c3cc640 1 -- 172.21.15.159:0/3077582471 >> 172.21.15.159:0/3077582471 conn(0x7f63140fc7d0 msgr2=0x7f63140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:32.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.232+0000 7f631c3cc640 1 -- 172.21.15.159:0/3077582471 shutdown_connections 2024-09-19T06:45:32.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.232+0000 7f631c3cc640 1 -- 172.21.15.159:0/3077582471 wait complete. 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631c3cc640 1 Processor -- start 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631c3cc640 1 -- start start 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631c3cc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314100e20 0x7f63141985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631c3cc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6314102570 0x7f6314198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631c3cc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6314102ef0 0x7f631419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631c3cc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6314112120 con 0x7f6314100e20 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631c3cc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6314111fa0 con 0x7f6314102570 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631c3cc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f63141122a0 con 0x7f6314102ef0 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631a168640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314100e20 0x7f63141985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631a168640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314100e20 0x7f63141985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41100/0 (socket says 172.21.15.159:41100) 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631a168640 1 -- 172.21.15.159:0/262739866 learned_addr learned my addr 172.21.15.159:0/262739866 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:32.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.233+0000 7f631a969640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6314102ef0 0x7f631419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f6319967640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6314102570 0x7f6314198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f631a168640 1 -- 172.21.15.159:0/262739866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6314102ef0 msgr2=0x7f631419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f631a168640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6314102ef0 0x7f631419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f631a168640 1 -- 172.21.15.159:0/262739866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6314102570 msgr2=0x7f6314198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f631a168640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6314102570 0x7f6314198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f631a168640 1 -- 172.21.15.159:0/262739866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631419d590 con 0x7f6314100e20 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f631a969640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6314102ef0 0x7f631419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f631a168640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314100e20 0x7f63141985e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f631000b4a0 tx=0x7f631000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f630b7fe640 1 -- 172.21.15.159:0/262739866 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310014070 con 0x7f6314100e20 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f630b7fe640 1 -- 172.21.15.159:0/262739866 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6310010af0 con 0x7f6314100e20 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631419d880 con 0x7f6314100e20 2024-09-19T06:45:32.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f630b7fe640 1 -- 172.21.15.159:0/262739866 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310017d10 con 0x7f6314100e20 2024-09-19T06:45:32.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.234+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63141a5160 con 0x7f6314100e20 2024-09-19T06:45:32.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.235+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6314101280 con 0x7f6314100e20 2024-09-19T06:45:32.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.236+0000 7f630b7fe640 1 -- 172.21.15.159:0/262739866 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f6310017070 con 0x7f6314100e20 2024-09-19T06:45:32.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.237+0000 7f630b7fe640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63000a3240 0x7f63000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.237+0000 7f6319967640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63000a3240 0x7f63000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.237+0000 7f630b7fe640 1 -- 172.21.15.159:0/262739866 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f63100ceff0 con 0x7f6314100e20 2024-09-19T06:45:32.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.237+0000 7f6319967640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63000a3240 0x7f63000a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63140ffe50 tx=0x7f6304008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:32.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.240+0000 7f630b7fe640 1 -- 172.21.15.159:0/262739866 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f631009be40 con 0x7f6314100e20 2024-09-19T06:45:32.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.441+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f6314109090 con 0x7f6314100e20 2024-09-19T06:45:32.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.825+0000 7f630b7fe640 1 -- 172.21.15.159:0/262739866 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f631009b740 con 0x7f6314100e20 2024-09-19T06:45:32.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63000a3240 msgr2=0x7f63000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63000a3240 0x7f63000a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63140ffe50 tx=0x7f6304008040 comp rx=0 tx=0).stop 2024-09-19T06:45:32.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314100e20 msgr2=0x7f63141985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314100e20 0x7f63141985e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f631000b4a0 tx=0x7f631000b960 comp rx=0 tx=0).stop 2024-09-19T06:45:32.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 shutdown_connections 2024-09-19T06:45:32.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63000a3240 0x7f63000a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6314102ef0 0x7f631419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6314102570 0x7f6314198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 --2- 172.21.15.159:0/262739866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6314100e20 0x7f63141985e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 >> 172.21.15.159:0/262739866 conn(0x7f63140fc7d0 msgr2=0x7f63140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:32.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 shutdown_connections 2024-09-19T06:45:32.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:32.828+0000 7f631c3cc640 1 -- 172.21.15.159:0/262739866 wait complete. 2024-09-19T06:45:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:32 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/262739866' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:45:33.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:32 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/262739866' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:45:33.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:32 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/262739866' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:45:33.543 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T06:45:33.543 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T06:45:33.794 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/262739866' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-09-19T06:45:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]: dispatch 2024-09-19T06:45:34.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T06:45:34.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:33 smithi203 ceph-mon[35473]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-19T06:45:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/262739866' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:45:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:45:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T06:45:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T06:45:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-19T06:45:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:45:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T06:45:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2024-09-19T06:45:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T06:45:34.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-09-19T06:45:34.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]: dispatch 2024-09-19T06:45:34.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T06:45:34.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:33 smithi189 ceph-mon[34880]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/262739866' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]: dispatch 2024-09-19T06:45:34.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T06:45:34.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:33 smithi159 ceph-mon[30935]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-19T06:45:34.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.255+0000 7f64172d2640 1 -- 172.21.15.159:0/391387509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410106f10 msgr2=0x7f641010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.255+0000 7f64172d2640 1 --2- 172.21.15.159:0/391387509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410106f10 0x7f641010ea90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6408009ca0 tx=0x7f640802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.255+0000 7f64172d2640 1 -- 172.21.15.159:0/391387509 shutdown_connections 2024-09-19T06:45:34.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.255+0000 7f64172d2640 1 --2- 172.21.15.159:0/391387509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410106f10 0x7f641010ea90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.255+0000 7f64172d2640 1 --2- 172.21.15.159:0/391387509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6410102790 0x7f64101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.255+0000 7f64172d2640 1 --2- 172.21.15.159:0/391387509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6410101de0 0x7f64101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.255+0000 7f64172d2640 1 -- 172.21.15.159:0/391387509 >> 172.21.15.159:0/391387509 conn(0x7f64100fd8c0 msgr2=0x7f64100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.255+0000 7f64172d2640 1 -- 172.21.15.159:0/391387509 shutdown_connections 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.255+0000 7f64172d2640 1 -- 172.21.15.159:0/391387509 wait complete. 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f64172d2640 1 Processor -- start 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f64172d2640 1 -- start start 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f64172d2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6410101de0 0x7f64101983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f64172d2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410102790 0x7f6410198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f64172d2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6410106f10 0x7f641019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f64172d2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6410111f70 con 0x7f6410102790 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f64172d2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6410111df0 con 0x7f6410101de0 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f64172d2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f64101120f0 con 0x7f6410106f10 2024-09-19T06:45:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f641486d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410102790 0x7f6410198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f641486d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410102790 0x7f6410198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41130/0 (socket says 172.21.15.159:41130) 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f641486d640 1 -- 172.21.15.159:0/660189169 learned_addr learned my addr 172.21.15.159:0/660189169 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.256+0000 7f641586f640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6410106f10 0x7f641019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f641506e640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6410101de0 0x7f64101983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f641486d640 1 -- 172.21.15.159:0/660189169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6410106f10 msgr2=0x7f641019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f641486d640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6410106f10 0x7f641019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f641486d640 1 -- 172.21.15.159:0/660189169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6410101de0 msgr2=0x7f64101983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f641486d640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6410101de0 0x7f64101983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f641486d640 1 -- 172.21.15.159:0/660189169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641019d3a0 con 0x7f6410102790 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f641506e640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6410101de0 0x7f64101983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f641486d640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410102790 0x7f6410198930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f640000d770 tx=0x7f640000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f64067fc640 1 -- 172.21.15.159:0/660189169 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400017070 con 0x7f6410102790 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f64067fc640 1 -- 172.21.15.159:0/660189169 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6400005500 con 0x7f6410102790 2024-09-19T06:45:34.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641019d690 con 0x7f6410102790 2024-09-19T06:45:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f64067fc640 1 -- 172.21.15.159:0/660189169 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400004e00 con 0x7f6410102790 2024-09-19T06:45:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.257+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64101a4f70 con 0x7f6410102790 2024-09-19T06:45:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.258+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64101021c0 con 0x7f6410102790 2024-09-19T06:45:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.259+0000 7f64067fc640 1 -- 172.21.15.159:0/660189169 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f6400004fa0 con 0x7f6410102790 2024-09-19T06:45:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.260+0000 7f64067fc640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63fc0a3240 0x7f63fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.260+0000 7f641506e640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63fc0a3240 0x7f63fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.260+0000 7f64067fc640 1 -- 172.21.15.159:0/660189169 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f64000cf730 con 0x7f6410102790 2024-09-19T06:45:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.260+0000 7f641506e640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63fc0a3240 0x7f63fc0a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f640c0058c0 tx=0x7f640c005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.263+0000 7f64067fc640 1 -- 172.21.15.159:0/660189169 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f640009c430 con 0x7f6410102790 2024-09-19T06:45:34.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.452+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6410062630 con 0x7f63fc0a3240 2024-09-19T06:45:34.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.475+0000 7f64067fc640 1 -- 172.21.15.159:0/660189169 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6410062630 con 0x7f63fc0a3240 2024-09-19T06:45:34.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63fc0a3240 msgr2=0x7f63fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63fc0a3240 0x7f63fc0a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f640c0058c0 tx=0x7f640c005d30 comp rx=0 tx=0).stop 2024-09-19T06:45:34.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410102790 msgr2=0x7f6410198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410102790 0x7f6410198930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f640000d770 tx=0x7f640000dc30 comp rx=0 tx=0).stop 2024-09-19T06:45:34.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 shutdown_connections 2024-09-19T06:45:34.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63fc0a3240 0x7f63fc0a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6410106f10 0x7f641019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6410102790 0x7f6410198930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 --2- 172.21.15.159:0/660189169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6410101de0 0x7f64101983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 >> 172.21.15.159:0/660189169 conn(0x7f64100fd8c0 msgr2=0x7f64100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 shutdown_connections 2024-09-19T06:45:34.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:34.477+0000 7f64172d2640 1 -- 172.21.15.159:0/660189169 wait complete. 2024-09-19T06:45:34.841 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:45:34.458+0000 7f35ab8f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:45:34.841 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:45:34.458+0000 7f35ab8f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:45:34.841 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:45:34.458+0000 7f35ab8f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:45:34.842 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:45:34.458+0000 7f35ab8f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:45:34.842 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:45:34.458+0000 7f35ab8f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:45:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T06:45:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T06:45:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-19T06:45:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:45:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T06:45:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-19T06:45:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T06:45:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-19T06:45:35.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]': finished 2024-09-19T06:45:35.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T06:45:35.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:45:35.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:34 smithi189 ceph-mon[34880]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:35.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T06:45:35.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]': finished 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:45:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:34 smithi159 ceph-mon[30935]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:35.193 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T06:45:35.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:45:35.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:34 smithi203 ceph-mon[35473]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:35.441 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:35.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.929+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2441325723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b01036c0 msgr2=0x7f92b010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:35.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.929+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2441325723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b01036c0 0x7f92b010bbb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009900 tx=0x7f92a402a480 comp rx=0 tx=0).stop 2024-09-19T06:45:35.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.929+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2441325723 shutdown_connections 2024-09-19T06:45:35.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.929+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2441325723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92b010c180 0x7f92b010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.929+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2441325723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b01036c0 0x7f92b010bbb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.929+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2441325723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92b0102da0 0x7f92b0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.929+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2441325723 >> 172.21.15.159:0/2441325723 conn(0x7f92b00fc7a0 msgr2=0x7f92b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:35.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.929+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2441325723 shutdown_connections 2024-09-19T06:45:35.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.929+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2441325723 wait complete. 2024-09-19T06:45:35.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.930+0000 7f92b5ef4640 1 Processor -- start 2024-09-19T06:45:35.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.930+0000 7f92b5ef4640 1 -- start start 2024-09-19T06:45:35.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.930+0000 7f92b5ef4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92b0102da0 0x7f92b0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:35.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.930+0000 7f92b5ef4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92b01036c0 0x7f92b01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:35.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.930+0000 7f92b5ef4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b010c180 0x7f92b019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:35.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.930+0000 7f92b5ef4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f92b0111f60 con 0x7f92b010c180 2024-09-19T06:45:35.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.930+0000 7f92b5ef4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92b0111de0 con 0x7f92b0102da0 2024-09-19T06:45:35.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.930+0000 7f92b5ef4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92b01120e0 con 0x7f92b01036c0 2024-09-19T06:45:35.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.930+0000 7f92affff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b010c180 0x7f92b019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:35.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92affff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b010c180 0x7f92b019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41180/0 (socket says 172.21.15.159:41180) 2024-09-19T06:45:35.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92affff640 1 -- 172.21.15.159:0/2526208731 learned_addr learned my addr 172.21.15.159:0/2526208731 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:35.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92af7fe640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92b0102da0 0x7f92b0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:35.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92aeffd640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92b01036c0 0x7f92b01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:35.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92affff640 1 -- 172.21.15.159:0/2526208731 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92b01036c0 msgr2=0x7f92b01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:35.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92affff640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92b01036c0 0x7f92b01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92affff640 1 -- 172.21.15.159:0/2526208731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92b0102da0 msgr2=0x7f92b0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92affff640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92b0102da0 0x7f92b0198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92affff640 1 -- 172.21.15.159:0/2526208731 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b019d430 con 0x7f92b010c180 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92affff640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b010c180 0x7f92b019cd50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f92a8009fd0 tx=0x7f92a800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92acff9640 1 -- 172.21.15.159:0/2526208731 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8017070 con 0x7f92b010c180 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b019d720 con 0x7f92b010c180 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92acff9640 1 -- 172.21.15.159:0/2526208731 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92a8003e50 con 0x7f92b010c180 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92acff9640 1 -- 172.21.15.159:0/2526208731 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a80106c0 con 0x7f92b010c180 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.931+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b01a5000 con 0x7f92b010c180 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.932+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b0103180 con 0x7f92b010c180 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.933+0000 7f92acff9640 1 -- 172.21.15.159:0/2526208731 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f92a8003970 con 0x7f92b010c180 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.934+0000 7f92acff9640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f92980a32d0 0x7f92980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:35.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.934+0000 7f92af7fe640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f92980a32d0 0x7f92980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:35.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.934+0000 7f92acff9640 1 -- 172.21.15.159:0/2526208731 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f92a80cf830 con 0x7f92b010c180 2024-09-19T06:45:35.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.935+0000 7f92af7fe640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f92980a32d0 0x7f92980a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f92a000bbe0 tx=0x7f92a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:35.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:35.938+0000 7f92acff9640 1 -- 172.21.15.159:0/2526208731 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f92a809c3d0 con 0x7f92b010c180 2024-09-19T06:45:36.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.129+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f92b0062630 con 0x7f92980a32d0 2024-09-19T06:45:36.131 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:35 smithi159 ceph-mon[30935]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:45:36.131 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:35 smithi159 ceph-mon[30935]: pgmap v282: 97 pgs: 4 peering, 93 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T06:45:36.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:35 smithi189 ceph-mon[34880]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:45:36.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:35 smithi189 ceph-mon[34880]: pgmap v282: 97 pgs: 4 peering, 93 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T06:45:36.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.153+0000 7f92acff9640 1 -- 172.21.15.159:0/2526208731 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f92b0062630 con 0x7f92980a32d0 2024-09-19T06:45:36.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f92980a32d0 msgr2=0x7f92980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:36.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f92980a32d0 0x7f92980a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f92a000bbe0 tx=0x7f92a000b390 comp rx=0 tx=0).stop 2024-09-19T06:45:36.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b010c180 msgr2=0x7f92b019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:36.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b010c180 0x7f92b019cd50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f92a8009fd0 tx=0x7f92a800b260 comp rx=0 tx=0).stop 2024-09-19T06:45:36.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 shutdown_connections 2024-09-19T06:45:36.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f92980a32d0 0x7f92980a5790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:36.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92b010c180 0x7f92b019cd50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:36.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92b01036c0 0x7f92b01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:36.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 --2- 172.21.15.159:0/2526208731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92b0102da0 0x7f92b0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:36.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.155+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 >> 172.21.15.159:0/2526208731 conn(0x7f92b00fc7a0 msgr2=0x7f92b00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:36.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.156+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 shutdown_connections 2024-09-19T06:45:36.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:36.156+0000 7f92b5ef4640 1 -- 172.21.15.159:0/2526208731 wait complete. 2024-09-19T06:45:36.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:35 smithi203 ceph-mon[35473]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:45:36.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:35 smithi203 ceph-mon[35473]: pgmap v282: 97 pgs: 4 peering, 93 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T06:45:36.927 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T06:45:37.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:36 smithi189 ceph-mon[34880]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:45:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:36 smithi189 ceph-mon[34880]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:37.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:36 smithi159 ceph-mon[30935]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:45:37.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:36 smithi159 ceph-mon[30935]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:37.173 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:37.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:36 smithi203 ceph-mon[35473]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:45:37.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:36 smithi203 ceph-mon[35473]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:37.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.662+0000 7f94cd759640 1 -- 172.21.15.159:0/682536646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8105ad0 msgr2=0x7f94c8105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:37.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.662+0000 7f94cd759640 1 --2- 172.21.15.159:0/682536646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8105ad0 0x7f94c8105eb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009ca0 tx=0x7f94b802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.662+0000 7f94cd759640 1 -- 172.21.15.159:0/682536646 shutdown_connections 2024-09-19T06:45:37.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.662+0000 7f94cd759640 1 --2- 172.21.15.159:0/682536646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94c8101ba0 0x7f94c810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.662+0000 7f94cd759640 1 --2- 172.21.15.159:0/682536646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94c8101200 0x7f94c8101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.662+0000 7f94cd759640 1 --2- 172.21.15.159:0/682536646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8105ad0 0x7f94c8105eb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.662+0000 7f94cd759640 1 -- 172.21.15.159:0/682536646 >> 172.21.15.159:0/682536646 conn(0x7f94c8077210 msgr2=0x7f94c80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.662+0000 7f94cd759640 1 -- 172.21.15.159:0/682536646 shutdown_connections 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.662+0000 7f94cd759640 1 -- 172.21.15.159:0/682536646 wait complete. 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94cd759640 1 Processor -- start 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94cd759640 1 -- start start 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94cd759640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94c8101200 0x7f94c8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94cd759640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8101ba0 0x7f94c81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94cd759640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94c8105ad0 0x7f94c819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94cd759640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8110ef0 con 0x7f94c8101ba0 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94cd759640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8110d70 con 0x7f94c8105ad0 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94cd759640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8111070 con 0x7f94c8101200 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94c67fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8101ba0 0x7f94c81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:37.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94c67fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8101ba0 0x7f94c81989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41188/0 (socket says 172.21.15.159:41188) 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94c67fc640 1 -- 172.21.15.159:0/2043179545 learned_addr learned my addr 172.21.15.159:0/2043179545 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.663+0000 7f94c6ffd640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94c8101200 0x7f94c8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94c77fe640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94c8105ad0 0x7f94c819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94c67fc640 1 -- 172.21.15.159:0/2043179545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94c8101200 msgr2=0x7f94c8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94c67fc640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94c8101200 0x7f94c8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94c67fc640 1 -- 172.21.15.159:0/2043179545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94c8105ad0 msgr2=0x7f94c819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94c67fc640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94c8105ad0 0x7f94c819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94c67fc640 1 -- 172.21.15.159:0/2043179545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c819d410 con 0x7f94c8101ba0 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94c67fc640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8101ba0 0x7f94c81989a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94b000b4a0 tx=0x7f94b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94bffff640 1 -- 172.21.15.159:0/2043179545 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0014070 con 0x7f94c8101ba0 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94bffff640 1 -- 172.21.15.159:0/2043179545 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94b0010af0 con 0x7f94c8101ba0 2024-09-19T06:45:37.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c819d700 con 0x7f94c8101ba0 2024-09-19T06:45:37.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94bffff640 1 -- 172.21.15.159:0/2043179545 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0017d10 con 0x7f94c8101ba0 2024-09-19T06:45:37.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.664+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c81a4fe0 con 0x7f94c8101ba0 2024-09-19T06:45:37.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.665+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c8101660 con 0x7f94c8101ba0 2024-09-19T06:45:37.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.666+0000 7f94bffff640 1 -- 172.21.15.159:0/2043179545 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f94b0017070 con 0x7f94c8101ba0 2024-09-19T06:45:37.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.667+0000 7f94bffff640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f94b40a32d0 0x7f94b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:37.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.667+0000 7f94c6ffd640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f94b40a32d0 0x7f94b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:37.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.667+0000 7f94bffff640 1 -- 172.21.15.159:0/2043179545 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f94b00cec70 con 0x7f94c8101ba0 2024-09-19T06:45:37.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.667+0000 7f94c6ffd640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f94b40a32d0 0x7f94b40a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005e30 tx=0x7f94b8031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:37.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.671+0000 7f94bffff640 1 -- 172.21.15.159:0/2043179545 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f94b009b2d0 con 0x7f94c8101ba0 2024-09-19T06:45:37.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.865+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f94c8100940 con 0x7f94b40a32d0 2024-09-19T06:45:37.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.870+0000 7f94bffff640 1 -- 172.21.15.159:0/2043179545 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f94c8100940 con 0x7f94b40a32d0 2024-09-19T06:45:37.871 INFO:teuthology.orchestra.run.smithi159.stdout:/volumes/qa/sv_0/d62c2a57-c9a9-4997-a867-575d22b681e9 2024-09-19T06:45:37.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f94b40a32d0 msgr2=0x7f94b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f94b40a32d0 0x7f94b40a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005e30 tx=0x7f94b8031000 comp rx=0 tx=0).stop 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8101ba0 msgr2=0x7f94c81989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8101ba0 0x7f94c81989a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94b000b4a0 tx=0x7f94b000b960 comp rx=0 tx=0).stop 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 shutdown_connections 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f94b40a32d0 0x7f94b40a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94c8105ad0 0x7f94c819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94c8101ba0 0x7f94c81989a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 --2- 172.21.15.159:0/2043179545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94c8101200 0x7f94c8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 >> 172.21.15.159:0/2043179545 conn(0x7f94c8077210 msgr2=0x7f94c8100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 shutdown_connections 2024-09-19T06:45:37.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:37.872+0000 7f94cd759640 1 -- 172.21.15.159:0/2043179545 wait complete. 2024-09-19T06:45:38.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:37 smithi189 ceph-mon[34880]: pgmap v283: 97 pgs: 4 peering, 93 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-19T06:45:38.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:37 smithi159 ceph-mon[30935]: pgmap v283: 97 pgs: 4 peering, 93 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-19T06:45:38.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:37 smithi203 ceph-mon[35473]: pgmap v283: 97 pgs: 4 peering, 93 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-19T06:45:38.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T06:45:38.747 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:39.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:38 smithi189 ceph-mon[34880]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:39.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:38 smithi159 ceph-mon[30935]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:39.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.258+0000 7f3ed40a2640 1 -- 172.21.15.159:0/249835773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc106f10 msgr2=0x7f3ecc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:39.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.258+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/249835773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc106f10 0x7f3ecc10ea90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009ca0 tx=0x7f3ec402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.258+0000 7f3ed40a2640 1 -- 172.21.15.159:0/249835773 shutdown_connections 2024-09-19T06:45:39.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.258+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/249835773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc106f10 0x7f3ecc10ea90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.258+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/249835773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ecc102790 0x7f3ecc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.258+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/249835773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ecc101de0 0x7f3ecc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.258+0000 7f3ed40a2640 1 -- 172.21.15.159:0/249835773 >> 172.21.15.159:0/249835773 conn(0x7f3ecc0fd8c0 msgr2=0x7f3ecc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:39.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.258+0000 7f3ed40a2640 1 -- 172.21.15.159:0/249835773 shutdown_connections 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.258+0000 7f3ed40a2640 1 -- 172.21.15.159:0/249835773 wait complete. 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed40a2640 1 Processor -- start 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed40a2640 1 -- start start 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed40a2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc101de0 0x7f3ecc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed40a2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ecc102790 0x7f3ecc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed40a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ecc106f10 0x7f3ecc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed40a2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc111f70 con 0x7f3ecc101de0 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed40a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc111df0 con 0x7f3ecc106f10 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed40a2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc1120f0 con 0x7f3ecc102790 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed1e3e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc101de0 0x7f3ecc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed1e3e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc101de0 0x7f3ecc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58222/0 (socket says 172.21.15.159:58222) 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed1e3e640 1 -- 172.21.15.159:0/424035596 learned_addr learned my addr 172.21.15.159:0/424035596 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:39.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed163d640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ecc102790 0x7f3ecc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.259+0000 7f3ed263f640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ecc106f10 0x7f3ecc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed1e3e640 1 -- 172.21.15.159:0/424035596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ecc102790 msgr2=0x7f3ecc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed1e3e640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ecc102790 0x7f3ecc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed1e3e640 1 -- 172.21.15.159:0/424035596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ecc106f10 msgr2=0x7f3ecc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed1e3e640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ecc106f10 0x7f3ecc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed1e3e640 1 -- 172.21.15.159:0/424035596 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc1a67f0 con 0x7f3ecc101de0 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed263f640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ecc106f10 0x7f3ecc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed163d640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ecc102790 0x7f3ecc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed1e3e640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc101de0 0x7f3ecc0744f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c920 tx=0x7f3ec800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ec2ffd640 1 -- 172.21.15.159:0/424035596 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8007c70 con 0x7f3ecc101de0 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ec2ffd640 1 -- 172.21.15.159:0/424035596 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec8007e10 con 0x7f3ecc101de0 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc1a6ae0 con 0x7f3ecc101de0 2024-09-19T06:45:39.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ec2ffd640 1 -- 172.21.15.159:0/424035596 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8018890 con 0x7f3ecc101de0 2024-09-19T06:45:39.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.260+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ecc1a7020 con 0x7f3ecc101de0 2024-09-19T06:45:39.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.261+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ecc1021c0 con 0x7f3ecc101de0 2024-09-19T06:45:39.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.262+0000 7f3ec2ffd640 1 -- 172.21.15.159:0/424035596 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3ec8018a70 con 0x7f3ecc101de0 2024-09-19T06:45:39.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.263+0000 7f3ec2ffd640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3eb80a32d0 0x7f3eb80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:39.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.263+0000 7f3ed163d640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3eb80a32d0 0x7f3eb80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:39.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.263+0000 7f3ec2ffd640 1 -- 172.21.15.159:0/424035596 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3ec80cfcc0 con 0x7f3ecc101de0 2024-09-19T06:45:39.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.263+0000 7f3ed163d640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3eb80a32d0 0x7f3eb80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc005d90 tx=0x7f3ebc005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:39.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.267+0000 7f3ec2ffd640 1 -- 172.21.15.159:0/424035596 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ec8014030 con 0x7f3ecc101de0 2024-09-19T06:45:39.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:38 smithi203 ceph-mon[35473]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:39.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.457+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3ecc062630 con 0x7f3eb80a32d0 2024-09-19T06:45:39.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.481+0000 7f3ec2ffd640 1 -- 172.21.15.159:0/424035596 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3ecc062630 con 0x7f3eb80a32d0 2024-09-19T06:45:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3eb80a32d0 msgr2=0x7f3eb80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3eb80a32d0 0x7f3eb80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc005d90 tx=0x7f3ebc005d20 comp rx=0 tx=0).stop 2024-09-19T06:45:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc101de0 msgr2=0x7f3ecc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc101de0 0x7f3ecc0744f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c920 tx=0x7f3ec800cde0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 shutdown_connections 2024-09-19T06:45:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3eb80a32d0 0x7f3eb80a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ecc106f10 0x7f3ecc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ecc102790 0x7f3ecc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 --2- 172.21.15.159:0/424035596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ecc101de0 0x7f3ecc0744f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:39.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 >> 172.21.15.159:0/424035596 conn(0x7f3ecc0fd8c0 msgr2=0x7f3ecc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:39.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 shutdown_connections 2024-09-19T06:45:39.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:39.483+0000 7f3ed40a2640 1 -- 172.21.15.159:0/424035596 wait complete. 2024-09-19T06:45:40.076 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:39 smithi159 ceph-mon[30935]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-19T06:45:40.076 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:39 smithi159 ceph-mon[30935]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:40.102 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T06:45:40.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:39 smithi189 ceph-mon[34880]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-19T06:45:40.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:39 smithi189 ceph-mon[34880]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:40.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:39 smithi203 ceph-mon[35473]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-19T06:45:40.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:39 smithi203 ceph-mon[35473]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:40.348 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:40.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 -- 172.21.15.159:0/3463954407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48301036e0 msgr2=0x7f4830107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:40.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 --2- 172.21.15.159:0/3463954407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48301036e0 0x7f4830107b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4824009930 tx=0x7f482402a420 comp rx=0 tx=0).stop 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 -- 172.21.15.159:0/3463954407 shutdown_connections 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 --2- 172.21.15.159:0/3463954407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48301082a0 0x7f483010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 --2- 172.21.15.159:0/3463954407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48301036e0 0x7f4830107b90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 --2- 172.21.15.159:0/3463954407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4830102d30 0x7f4830103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 -- 172.21.15.159:0/3463954407 >> 172.21.15.159:0/3463954407 conn(0x7f48300fc7d0 msgr2=0x7f48300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 -- 172.21.15.159:0/3463954407 shutdown_connections 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 -- 172.21.15.159:0/3463954407 wait complete. 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.830+0000 7f48383a5640 1 Processor -- start 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f48383a5640 1 -- start start 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f48383a5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4830102d30 0x7f4830198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:40.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f48383a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48301036e0 0x7f4830198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f48383a5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48301082a0 0x7f483019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f48383a5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4830112060 con 0x7f4830102d30 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f48383a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4830111ee0 con 0x7f48301036e0 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f48383a5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48301121e0 con 0x7f48301082a0 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4836141640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4830102d30 0x7f4830198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4836141640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4830102d30 0x7f4830198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58252/0 (socket says 172.21.15.159:58252) 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4836141640 1 -- 172.21.15.159:0/936432639 learned_addr learned my addr 172.21.15.159:0/936432639 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4835940640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48301036e0 0x7f4830198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4836942640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48301082a0 0x7f483019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4836141640 1 -- 172.21.15.159:0/936432639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48301082a0 msgr2=0x7f483019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4836141640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48301082a0 0x7f483019ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:40.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4836141640 1 -- 172.21.15.159:0/936432639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48301036e0 msgr2=0x7f4830198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4836141640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48301036e0 0x7f4830198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.831+0000 7f4836141640 1 -- 172.21.15.159:0/936432639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483019d5b0 con 0x7f4830102d30 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.832+0000 7f4836141640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4830102d30 0x7f4830198600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f482000eab0 tx=0x7f482000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.832+0000 7f482f7fe640 1 -- 172.21.15.159:0/936432639 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482000ce40 con 0x7f4830102d30 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.832+0000 7f482f7fe640 1 -- 172.21.15.159:0/936432639 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4820011950 con 0x7f4830102d30 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.832+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483019d8a0 con 0x7f4830102d30 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.832+0000 7f482f7fe640 1 -- 172.21.15.159:0/936432639 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820010ae0 con 0x7f4830102d30 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.832+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48301a5180 con 0x7f4830102d30 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.833+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4830103110 con 0x7f4830102d30 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.834+0000 7f482f7fe640 1 -- 172.21.15.159:0/936432639 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4820011b00 con 0x7f4830102d30 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.834+0000 7f482f7fe640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48180a3350 0x7f48180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.835+0000 7f4835940640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48180a3350 0x7f48180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.835+0000 7f482f7fe640 1 -- 172.21.15.159:0/936432639 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f48200d0130 con 0x7f4830102d30 2024-09-19T06:45:40.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.835+0000 7f4835940640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48180a3350 0x7f48180a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4824005940 tx=0x7f48240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:40.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:40.839+0000 7f482f7fe640 1 -- 172.21.15.159:0/936432639 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4820016030 con 0x7f4830102d30 2024-09-19T06:45:41.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.029+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f4830062630 con 0x7f48180a3350 2024-09-19T06:45:41.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.034+0000 7f482f7fe640 1 -- 172.21.15.159:0/936432639 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4830062630 con 0x7f48180a3350 2024-09-19T06:45:41.037 INFO:teuthology.orchestra.run.smithi159.stdout:/volumes/qa/sv_1/31b323c4-b4da-472c-b034-46b31af8d345 2024-09-19T06:45:41.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48180a3350 msgr2=0x7f48180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:41.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48180a3350 0x7f48180a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4824005940 tx=0x7f48240058d0 comp rx=0 tx=0).stop 2024-09-19T06:45:41.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4830102d30 msgr2=0x7f4830198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:41.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4830102d30 0x7f4830198600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f482000eab0 tx=0x7f482000ef70 comp rx=0 tx=0).stop 2024-09-19T06:45:41.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 shutdown_connections 2024-09-19T06:45:41.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48180a3350 0x7f48180a5810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:41.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48301082a0 0x7f483019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:41.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48301036e0 0x7f4830198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:41.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 --2- 172.21.15.159:0/936432639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4830102d30 0x7f4830198600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:41.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 >> 172.21.15.159:0/936432639 conn(0x7f48300fc7d0 msgr2=0x7f4830105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:41.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 shutdown_connections 2024-09-19T06:45:41.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:41.036+0000 7f48383a5640 1 -- 172.21.15.159:0/936432639 wait complete. 2024-09-19T06:45:41.712 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:45:41.963 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.445+0000 7f677dda7640 1 -- 172.21.15.159:0/95787195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778101de0 msgr2=0x7f67781021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.445+0000 7f677dda7640 1 --2- 172.21.15.159:0/95787195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778101de0 0x7f67781021c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6768009900 tx=0x7f676802a410 comp rx=0 tx=0).stop 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.445+0000 7f677dda7640 1 -- 172.21.15.159:0/95787195 shutdown_connections 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.445+0000 7f677dda7640 1 --2- 172.21.15.159:0/95787195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6778106f10 0x7f677810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.445+0000 7f677dda7640 1 --2- 172.21.15.159:0/95787195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6778102790 0x7f67781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.445+0000 7f677dda7640 1 --2- 172.21.15.159:0/95787195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778101de0 0x7f67781021c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.445+0000 7f677dda7640 1 -- 172.21.15.159:0/95787195 >> 172.21.15.159:0/95787195 conn(0x7f67780fd8c0 msgr2=0x7f67780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.445+0000 7f677dda7640 1 -- 172.21.15.159:0/95787195 shutdown_connections 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.445+0000 7f677dda7640 1 -- 172.21.15.159:0/95787195 wait complete. 2024-09-19T06:45:42.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f677dda7640 1 Processor -- start 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f677dda7640 1 -- start start 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f677dda7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6778101de0 0x7f67781983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f677dda7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6778102790 0x7f6778198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f677dda7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778106f10 0x7f677819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f677dda7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6778111f70 con 0x7f6778106f10 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f677dda7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6778111df0 con 0x7f6778102790 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f677dda7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67781120f0 con 0x7f6778101de0 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f6777fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778106f10 0x7f677819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f6777fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778106f10 0x7f677819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58272/0 (socket says 172.21.15.159:58272) 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f6777fff640 1 -- 172.21.15.159:0/3879432523 learned_addr learned my addr 172.21.15.159:0/3879432523 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f6776ffd640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6778102790 0x7f6778198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.446+0000 7f67777fe640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6778101de0 0x7f67781983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:42.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f6777fff640 1 -- 172.21.15.159:0/3879432523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6778101de0 msgr2=0x7f67781983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f6777fff640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6778101de0 0x7f67781983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f6777fff640 1 -- 172.21.15.159:0/3879432523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6778102790 msgr2=0x7f6778198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f6777fff640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6778102790 0x7f6778198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f6777fff640 1 -- 172.21.15.159:0/3879432523 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677819d380 con 0x7f6778106f10 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f6777fff640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778106f10 0x7f677819cca0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f677000cce0 tx=0x7f677000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f6774ff9640 1 -- 172.21.15.159:0/3879432523 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677000f450 con 0x7f6778106f10 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f6774ff9640 1 -- 172.21.15.159:0/3879432523 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f677000fad0 con 0x7f6778106f10 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677819d670 con 0x7f6778106f10 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f6774ff9640 1 -- 172.21.15.159:0/3879432523 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770018c10 con 0x7f6778106f10 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.447+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67781a4f50 con 0x7f6778106f10 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.448+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67781021c0 con 0x7f6778106f10 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.449+0000 7f6774ff9640 1 -- 172.21.15.159:0/3879432523 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f677000f5f0 con 0x7f6778106f10 2024-09-19T06:45:42.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.450+0000 7f6774ff9640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67600a3350 0x7f67600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:42.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.450+0000 7f67777fe640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67600a3350 0x7f67600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:42.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.450+0000 7f6774ff9640 1 -- 172.21.15.159:0/3879432523 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f67700cffe0 con 0x7f6778106f10 2024-09-19T06:45:42.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.450+0000 7f67777fe640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67600a3350 0x7f67600a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6768009230 tx=0x7f67680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:42.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.454+0000 7f6774ff9640 1 -- 172.21.15.159:0/3879432523 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6770014030 con 0x7f6778106f10 2024-09-19T06:45:42.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:42 smithi159 ceph-mon[30935]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:42.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:42 smithi159 ceph-mon[30935]: pgmap v285: 97 pgs: 97 active+clean; 614 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5.1 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:42.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.656+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f677802d7c0 con 0x7f6778106f10 2024-09-19T06:45:42.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.657+0000 7f6774ff9640 1 -- 172.21.15.159:0/3879432523 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f677009cb80 con 0x7f6778106f10 2024-09-19T06:45:42.658 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:42.658 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:45:42.658 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:45:42.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67600a3350 msgr2=0x7f67600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:42.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67600a3350 0x7f67600a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6768009230 tx=0x7f67680058d0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778106f10 msgr2=0x7f677819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:42.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778106f10 0x7f677819cca0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f677000cce0 tx=0x7f677000a620 comp rx=0 tx=0).stop 2024-09-19T06:45:42.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 shutdown_connections 2024-09-19T06:45:42.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67600a3350 0x7f67600a5810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6778106f10 0x7f677819cca0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6778102790 0x7f6778198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 --2- 172.21.15.159:0/3879432523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6778101de0 0x7f67781983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:42.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 >> 172.21.15.159:0/3879432523 conn(0x7f67780fd8c0 msgr2=0x7f67780febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:42.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 shutdown_connections 2024-09-19T06:45:42.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:42.659+0000 7f677dda7640 1 -- 172.21.15.159:0/3879432523 wait complete. 2024-09-19T06:45:42.841 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:42 smithi189 ceph-mon[34880]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:42.841 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:42 smithi189 ceph-mon[34880]: pgmap v285: 97 pgs: 97 active+clean; 614 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5.1 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:42.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:42 smithi203 ceph-mon[35473]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:42 smithi203 ceph-mon[35473]: pgmap v285: 97 pgs: 97 active+clean; 614 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5.1 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:43.419 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:45:43.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:43 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3879432523' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:43.671 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:43.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:43 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3879432523' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:43.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:43 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3879432523' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:44.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.139+0000 7fc87b5b2640 1 -- 172.21.15.159:0/2878384541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 msgr2=0x7fc874106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.139+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/2878384541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 0x7fc874106690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc870009930 tx=0x7fc87002a420 comp rx=0 tx=0).stop 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.139+0000 7fc87b5b2640 1 -- 172.21.15.159:0/2878384541 shutdown_connections 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.139+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/2878384541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc874100c00 0x7fc87410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.139+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/2878384541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8741002a0 0x7fc8741006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.139+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/2878384541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 0x7fc874106690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.139+0000 7fc87b5b2640 1 -- 172.21.15.159:0/2878384541 >> 172.21.15.159:0/2878384541 conn(0x7fc8740fc5c0 msgr2=0x7fc8740fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.139+0000 7fc87b5b2640 1 -- 172.21.15.159:0/2878384541 shutdown_connections 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.139+0000 7fc87b5b2640 1 -- 172.21.15.159:0/2878384541 wait complete. 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc87b5b2640 1 Processor -- start 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc87b5b2640 1 -- start start 2024-09-19T06:45:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc87b5b2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8741002a0 0x7fc8741984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc87b5b2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc874100c00 0x7fc874198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc87b5b2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 0x7fc87419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc87b5b2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc874110630 con 0x7fc8741062b0 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc87b5b2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8741104b0 con 0x7fc874100c00 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc87b5b2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8741107b0 con 0x7fc8741002a0 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc879b4f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 0x7fc87419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc879b4f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 0x7fc87419cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58286/0 (socket says 172.21.15.159:58286) 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc879b4f640 1 -- 172.21.15.159:0/363843855 learned_addr learned my addr 172.21.15.159:0/363843855 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc878b4d640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc874100c00 0x7fc874198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.140+0000 7fc87934e640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8741002a0 0x7fc8741984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc879b4f640 1 -- 172.21.15.159:0/363843855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8741002a0 msgr2=0x7fc8741984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:44.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc879b4f640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8741002a0 0x7fc8741984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc879b4f640 1 -- 172.21.15.159:0/363843855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc874100c00 msgr2=0x7fc874198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc879b4f640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc874100c00 0x7fc874198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc879b4f640 1 -- 172.21.15.159:0/363843855 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87419d470 con 0x7fc8741062b0 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc879b4f640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 0x7fc87419cd90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00cce0 tx=0x7fc86c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc86a7fc640 1 -- 172.21.15.159:0/363843855 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f450 con 0x7fc8741062b0 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc86a7fc640 1 -- 172.21.15.159:0/363843855 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc86c00fad0 con 0x7fc8741062b0 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc86a7fc640 1 -- 172.21.15.159:0/363843855 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c018b60 con 0x7fc8741062b0 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87419d760 con 0x7fc8741062b0 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.141+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8741a5040 con 0x7fc8741062b0 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.142+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8741006c0 con 0x7fc8741062b0 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.144+0000 7fc86a7fc640 1 -- 172.21.15.159:0/363843855 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc86c00fc80 con 0x7fc8741062b0 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.144+0000 7fc86a7fc640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc8600a3350 0x7fc8600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.144+0000 7fc87934e640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc8600a3350 0x7fc8600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.144+0000 7fc86a7fc640 1 -- 172.21.15.159:0/363843855 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc86c0d0250 con 0x7fc8741062b0 2024-09-19T06:45:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.145+0000 7fc87934e640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc8600a3350 0x7fc8600a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc870009900 tx=0x7fc8700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.148+0000 7fc86a7fc640 1 -- 172.21.15.159:0/363843855 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc86c014030 con 0x7fc8741062b0 2024-09-19T06:45:44.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.317+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc874199820 con 0x7fc8741062b0 2024-09-19T06:45:44.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.319+0000 7fc86a7fc640 1 -- 172.21.15.159:0/363843855 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22865 (secure 0 0 0) 0x7fc874199820 con 0x7fc8741062b0 2024-09-19T06:45:44.321 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:44.321 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":81,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:45:34.831866+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:45:44.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc8600a3350 msgr2=0x7fc8600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:44.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc8600a3350 0x7fc8600a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc870009900 tx=0x7fc8700058d0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 msgr2=0x7fc87419cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:44.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 0x7fc87419cd90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00cce0 tx=0x7fc86c00a620 comp rx=0 tx=0).stop 2024-09-19T06:45:44.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 shutdown_connections 2024-09-19T06:45:44.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc8600a3350 0x7fc8600a5810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8741062b0 0x7fc87419cd90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc874100c00 0x7fc874198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 --2- 172.21.15.159:0/363843855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8741002a0 0x7fc8741984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:44.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.321+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 >> 172.21.15.159:0/363843855 conn(0x7fc8740fc5c0 msgr2=0x7fc874104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:44.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.322+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 shutdown_connections 2024-09-19T06:45:44.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:44.322+0000 7fc87b5b2640 1 -- 172.21.15.159:0/363843855 wait complete. 2024-09-19T06:45:44.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:44 smithi159 ceph-mon[30935]: pgmap v286: 97 pgs: 97 active+clean; 614 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:44.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:44 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/363843855' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:44.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:44 smithi203 ceph-mon[35473]: pgmap v286: 97 pgs: 97 active+clean; 614 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:44.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:44 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/363843855' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:44.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:44 smithi189 ceph-mon[34880]: pgmap v286: 97 pgs: 97 active+clean; 614 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:44 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/363843855' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:45.136 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:45:45.137 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:45:45.388 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.863+0000 7f5d39741640 1 -- 172.21.15.159:0/666510041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 msgr2=0x7f5d3410e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.863+0000 7f5d39741640 1 --2- 172.21.15.159:0/666510041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 0x7f5d3410e790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009ca0 tx=0x7f5d2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.863+0000 7f5d39741640 1 -- 172.21.15.159:0/666510041 shutdown_connections 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.863+0000 7f5d39741640 1 --2- 172.21.15.159:0/666510041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 0x7f5d3410e790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.863+0000 7f5d39741640 1 --2- 172.21.15.159:0/666510041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d341037a0 0x7f5d3410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.863+0000 7f5d39741640 1 --2- 172.21.15.159:0/666510041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34102df0 0x7f5d341031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.863+0000 7f5d39741640 1 -- 172.21.15.159:0/666510041 >> 172.21.15.159:0/666510041 conn(0x7f5d340fc7d0 msgr2=0x7f5d340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.863+0000 7f5d39741640 1 -- 172.21.15.159:0/666510041 shutdown_connections 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.863+0000 7f5d39741640 1 -- 172.21.15.159:0/666510041 wait complete. 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d39741640 1 Processor -- start 2024-09-19T06:45:45.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d39741640 1 -- start start 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d39741640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34102df0 0x7f5d341985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d39741640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d341037a0 0x7f5d34198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d39741640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 0x7f5d3419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d39741640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5d34112110 con 0x7f5d3410c2f0 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d39741640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d34111f90 con 0x7f5d34102df0 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d39741640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d34112290 con 0x7f5d341037a0 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 0x7f5d3419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 0x7f5d3419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58312/0 (socket says 172.21.15.159:58312) 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.864+0000 7f5d337fe640 1 -- 172.21.15.159:0/3864780621 learned_addr learned my addr 172.21.15.159:0/3864780621 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d327fc640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d341037a0 0x7f5d34198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d32ffd640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34102df0 0x7f5d341985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d337fe640 1 -- 172.21.15.159:0/3864780621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d341037a0 msgr2=0x7f5d34198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d337fe640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d341037a0 0x7f5d34198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:45.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d337fe640 1 -- 172.21.15.159:0/3864780621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34102df0 msgr2=0x7f5d341985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d337fe640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34102df0 0x7f5d341985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d337fe640 1 -- 172.21.15.159:0/3864780621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3419d580 con 0x7f5d3410c2f0 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d327fc640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d341037a0 0x7f5d34198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d337fe640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 0x7f5d3419cea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c031a20 tx=0x7f5d2c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d2bfff640 1 -- 172.21.15.159:0/3864780621 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c003c30 con 0x7f5d3410c2f0 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d2bfff640 1 -- 172.21.15.159:0/3864780621 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d2c003dd0 con 0x7f5d3410c2f0 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3419d810 con 0x7f5d3410c2f0 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d2bfff640 1 -- 172.21.15.159:0/3864780621 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c02fcf0 con 0x7f5d3410c2f0 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.865+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d341a5150 con 0x7f5d3410c2f0 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.866+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d341031d0 con 0x7f5d3410c2f0 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.867+0000 7f5d2bfff640 1 -- 172.21.15.159:0/3864780621 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5d2c004050 con 0x7f5d3410c2f0 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.868+0000 7f5d2bfff640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f5d200a3350 0x7f5d200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:45.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.868+0000 7f5d32ffd640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f5d200a3350 0x7f5d200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:45.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.868+0000 7f5d2bfff640 1 -- 172.21.15.159:0/3864780621 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f5d2c0f0d80 con 0x7f5d3410c2f0 2024-09-19T06:45:45.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.868+0000 7f5d32ffd640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f5d200a3350 0x7f5d200a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c005fd0 tx=0x7f5d1c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:45.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:45.872+0000 7f5d2bfff640 1 -- 172.21.15.159:0/3864780621 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d2c0bdac0 con 0x7f5d3410c2f0 2024-09-19T06:45:46.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.036+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d34062630 con 0x7f5d200a3350 2024-09-19T06:45:46.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.044+0000 7f5d2bfff640 1 -- 172.21.15.159:0/3864780621 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258909 (secure 0 0 0) 0x7f5d34062630 con 0x7f5d200a3350 2024-09-19T06:45:46.048 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:46.049 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:45:46.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f5d200a3350 msgr2=0x7f5d200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:46.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f5d200a3350 0x7f5d200a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c005fd0 tx=0x7f5d1c005850 comp rx=0 tx=0).stop 2024-09-19T06:45:46.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 msgr2=0x7f5d3419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:46.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 0x7f5d3419cea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c031a20 tx=0x7f5d2c031a50 comp rx=0 tx=0).stop 2024-09-19T06:45:46.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 shutdown_connections 2024-09-19T06:45:46.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f5d200a3350 0x7f5d200a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:46.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3410c2f0 0x7f5d3419cea0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:46.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d341037a0 0x7f5d34198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:46.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 --2- 172.21.15.159:0/3864780621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34102df0 0x7f5d341985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:46.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 >> 172.21.15.159:0/3864780621 conn(0x7f5d340fc7d0 msgr2=0x7f5d340fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:46.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 shutdown_connections 2024-09-19T06:45:46.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:46.047+0000 7f5d39741640 1 -- 172.21.15.159:0/3864780621 wait complete. 2024-09-19T06:45:46.776 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:46 smithi159 ceph-mon[30935]: pgmap v287: 97 pgs: 97 active+clean; 634 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.5 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:46.806 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-19T06:45:45.413991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648824,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":175,"num_read_kb":181,"num_write":257,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364076,"kb_used_data":10644,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577748,"statfs":{"total":1151940427776,"available":1151567613952,"internally_reserved":0,"allocated":10899456,"data_stored":7080543,"data_compressed":176433,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49444,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":-1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":50,"num_write":28,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.580263"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838543+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:45:34.838543+0000","last_peered":"2024-09-19T06:45:34.838543+0000","last_clean":"2024-09-19T06:45:34.838543+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:45:34.838543+0000","last_undegraded":"2024-09-19T06:45:34.838543+0000","last_fullsized":"2024-09-19T06:45:34.838543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836449+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:45:34.836449+0000","last_peered":"2024-09-19T06:45:34.836449+0000","last_clean":"2024-09-19T06:45:34.836449+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:45:34.836449+0000","last_undegraded":"2024-09-19T06:45:34.836449+0000","last_fullsized":"2024-09-19T06:45:34.836449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836354+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:45:34.836354+0000","last_peered":"2024-09-19T06:45:34.836354+0000","last_clean":"2024-09-19T06:45:34.836354+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:45:34.836354+0000","last_undegraded":"2024-09-19T06:45:34.836354+0000","last_fullsized":"2024-09-19T06:45:34.836354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838457+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:45:34.838457+0000","last_peered":"2024-09-19T06:45:34.838457+0000","last_clean":"2024-09-19T06:45:34.838457+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:45:34.838457+0000","last_undegraded":"2024-09-19T06:45:34.838457+0000","last_fullsized":"2024-09-19T06:45:34.838457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841913+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:45:34.841913+0000","last_peered":"2024-09-19T06:45:34.841913+0000","last_clean":"2024-09-19T06:45:34.841913+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:45:34.841913+0000","last_undegraded":"2024-09-19T06:45:34.841913+0000","last_fullsized":"2024-09-19T06:45:34.841913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971761+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:45:34.971761+0000","last_peered":"2024-09-19T06:45:34.971761+0000","last_clean":"2024-09-19T06:45:34.971761+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:45:34.971761+0000","last_undegraded":"2024-09-19T06:45:34.971761+0000","last_fullsized":"2024-09-19T06:45:34.971761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843804+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:45:34.843804+0000","last_peered":"2024-09-19T06:45:34.843804+0000","last_clean":"2024-09-19T06:45:34.843804+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:45:34.843804+0000","last_undegraded":"2024-09-19T06:45:34.843804+0000","last_fullsized":"2024-09-19T06:45:34.843804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971412+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:45:34.971412+0000","last_peered":"2024-09-19T06:45:34.971412+0000","last_clean":"2024-09-19T06:45:34.971412+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:45:34.971412+0000","last_undegraded":"2024-09-19T06:45:34.971412+0000","last_fullsized":"2024-09-19T06:45:34.971412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842122+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:45:34.842122+0000","last_peered":"2024-09-19T06:45:34.842122+0000","last_clean":"2024-09-19T06:45:34.842122+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:45:34.842122+0000","last_undegraded":"2024-09-19T06:45:34.842122+0000","last_fullsized":"2024-09-19T06:45:34.842122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972290+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:45:34.972290+0000","last_peered":"2024-09-19T06:45:34.972290+0000","last_clean":"2024-09-19T06:45:34.972290+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:45:34.972290+0000","last_undegraded":"2024-09-19T06:45:34.972290+0000","last_fullsized":"2024-09-19T06:45:34.972290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844423+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:45:34.844423+0000","last_peered":"2024-09-19T06:45:34.844423+0000","last_clean":"2024-09-19T06:45:34.844423+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:45:34.844423+0000","last_undegraded":"2024-09-19T06:45:34.844423+0000","last_fullsized":"2024-09-19T06:45:34.844423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.973287+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:45:34.973287+0000","last_peered":"2024-09-19T06:45:34.973287+0000","last_clean":"2024-09-19T06:45:34.973287+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:45:34.973287+0000","last_undegraded":"2024-09-19T06:45:34.973287+0000","last_fullsized":"2024-09-19T06:45:34.973287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834791+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:45:34.834791+0000","last_peered":"2024-09-19T06:45:34.834791+0000","last_clean":"2024-09-19T06:45:34.834791+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:45:34.834791+0000","last_undegraded":"2024-09-19T06:45:34.834791+0000","last_fullsized":"2024-09-19T06:45:34.834791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836158+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:45:34.836158+0000","last_peered":"2024-09-19T06:45:34.836158+0000","last_clean":"2024-09-19T06:45:34.836158+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:45:34.836158+0000","last_undegraded":"2024-09-19T06:45:34.836158+0000","last_fullsized":"2024-09-19T06:45:34.836158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836159+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:45:34.836159+0000","last_peered":"2024-09-19T06:45:34.836159+0000","last_clean":"2024-09-19T06:45:34.836159+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:45:34.836159+0000","last_undegraded":"2024-09-19T06:45:34.836159+0000","last_fullsized":"2024-09-19T06:45:34.836159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841633+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:45:34.841633+0000","last_peered":"2024-09-19T06:45:34.841633+0000","last_clean":"2024-09-19T06:45:34.841633+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:45:34.841633+0000","last_undegraded":"2024-09-19T06:45:34.841633+0000","last_fullsized":"2024-09-19T06:45:34.841633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838658+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:45:34.838658+0000","last_peered":"2024-09-19T06:45:34.838658+0000","last_clean":"2024-09-19T06:45:34.838658+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:45:34.838658+0000","last_undegraded":"2024-09-19T06:45:34.838658+0000","last_fullsized":"2024-09-19T06:45:34.838658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838728+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:45:34.838728+0000","last_peered":"2024-09-19T06:45:34.838728+0000","last_clean":"2024-09-19T06:45:34.838728+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:45:34.838728+0000","last_undegraded":"2024-09-19T06:45:34.838728+0000","last_fullsized":"2024-09-19T06:45:34.838728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836019+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:45:34.836019+0000","last_peered":"2024-09-19T06:45:34.836019+0000","last_clean":"2024-09-19T06:45:34.836019+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:45:34.836019+0000","last_undegraded":"2024-09-19T06:45:34.836019+0000","last_fullsized":"2024-09-19T06:45:34.836019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.837959+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:45:34.837959+0000","last_peered":"2024-09-19T06:45:34.837959+0000","last_clean":"2024-09-19T06:45:34.837959+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:45:34.837959+0000","last_undegraded":"2024-09-19T06:45:34.837959+0000","last_fullsized":"2024-09-19T06:45:34.837959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834879+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:45:34.834879+0000","last_peered":"2024-09-19T06:45:34.834879+0000","last_clean":"2024-09-19T06:45:34.834879+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:45:34.834879+0000","last_undegraded":"2024-09-19T06:45:34.834879+0000","last_fullsized":"2024-09-19T06:45:34.834879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841800+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:45:34.841800+0000","last_peered":"2024-09-19T06:45:34.841800+0000","last_clean":"2024-09-19T06:45:34.841800+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:45:34.841800+0000","last_undegraded":"2024-09-19T06:45:34.841800+0000","last_fullsized":"2024-09-19T06:45:34.841800+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971330+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:45:34.971330+0000","last_peered":"2024-09-19T06:45:34.971330+0000","last_clean":"2024-09-19T06:45:34.971330+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:45:34.971330+0000","last_undegraded":"2024-09-19T06:45:34.971330+0000","last_fullsized":"2024-09-19T06:45:34.971330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843683+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:45:34.843683+0000","last_peered":"2024-09-19T06:45:34.843683+0000","last_clean":"2024-09-19T06:45:34.843683+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:45:34.843683+0000","last_undegraded":"2024-09-19T06:45:34.843683+0000","last_fullsized":"2024-09-19T06:45:34.843683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971688+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:45:34.971688+0000","last_peered":"2024-09-19T06:45:34.971688+0000","last_clean":"2024-09-19T06:45:34.971688+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:45:34.971688+0000","last_undegraded":"2024-09-19T06:45:34.971688+0000","last_fullsized":"2024-09-19T06:45:34.971688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836151+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:45:34.836151+0000","last_peered":"2024-09-19T06:45:34.836151+0000","last_clean":"2024-09-19T06:45:34.836151+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:45:34.836151+0000","last_undegraded":"2024-09-19T06:45:34.836151+0000","last_fullsized":"2024-09-19T06:45:34.836151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.837958+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:45:34.837958+0000","last_peered":"2024-09-19T06:45:34.837958+0000","last_clean":"2024-09-19T06:45:34.837958+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:45:34.837958+0000","last_undegraded":"2024-09-19T06:45:34.837958+0000","last_fullsized":"2024-09-19T06:45:34.837958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834831+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:45:34.834831+0000","last_peered":"2024-09-19T06:45:34.834831+0000","last_clean":"2024-09-19T06:45:34.834831+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:45:34.834831+0000","last_undegraded":"2024-09-19T06:45:34.834831+0000","last_fullsized":"2024-09-19T06:45:34.834831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843370+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:45:34.843370+0000","last_peered":"2024-09-19T06:45:34.843370+0000","last_clean":"2024-09-19T06:45:34.843370+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:45:34.843370+0000","last_undegraded":"2024-09-19T06:45:34.843370+0000","last_fullsized":"2024-09-19T06:45:34.843370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.835760+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:45:34.835760+0000","last_peered":"2024-09-19T06:45:34.835760+0000","last_clean":"2024-09-19T06:45:34.835760+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:45:34.835760+0000","last_undegraded":"2024-09-19T06:45:34.835760+0000","last_fullsized":"2024-09-19T06:45:34.835760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.835752+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:45:34.835752+0000","last_peered":"2024-09-19T06:45:34.835752+0000","last_clean":"2024-09-19T06:45:34.835752+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:45:34.835752+0000","last_undegraded":"2024-09-19T06:45:34.835752+0000","last_fullsized":"2024-09-19T06:45:34.835752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841201+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:45:34.841201+0000","last_peered":"2024-09-19T06:45:34.841201+0000","last_clean":"2024-09-19T06:45:34.841201+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:45:34.841201+0000","last_undegraded":"2024-09-19T06:45:34.841201+0000","last_fullsized":"2024-09-19T06:45:34.841201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841011+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:45:34.841011+0000","last_peered":"2024-09-19T06:45:34.841011+0000","last_clean":"2024-09-19T06:45:34.841011+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:45:34.841011+0000","last_undegraded":"2024-09-19T06:45:34.841011+0000","last_fullsized":"2024-09-19T06:45:34.841011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.846845+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:45:34.846845+0000","last_peered":"2024-09-19T06:45:34.846845+0000","last_clean":"2024-09-19T06:45:34.846845+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:45:34.846845+0000","last_undegraded":"2024-09-19T06:45:34.846845+0000","last_fullsized":"2024-09-19T06:45:34.846845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839526+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:45:34.839526+0000","last_peered":"2024-09-19T06:45:34.839526+0000","last_clean":"2024-09-19T06:45:34.839526+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:45:34.839526+0000","last_undegraded":"2024-09-19T06:45:34.839526+0000","last_fullsized":"2024-09-19T06:45:34.839526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971775+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:45:34.971775+0000","last_peered":"2024-09-19T06:45:34.971775+0000","last_clean":"2024-09-19T06:45:34.971775+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:45:34.971775+0000","last_undegraded":"2024-09-19T06:45:34.971775+0000","last_fullsized":"2024-09-19T06:45:34.971775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834620+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:45:34.834620+0000","last_peered":"2024-09-19T06:45:34.834620+0000","last_clean":"2024-09-19T06:45:34.834620+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:45:34.834620+0000","last_undegraded":"2024-09-19T06:45:34.834620+0000","last_fullsized":"2024-09-19T06:45:34.834620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971516+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:45:34.971516+0000","last_peered":"2024-09-19T06:45:34.971516+0000","last_clean":"2024-09-19T06:45:34.971516+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:45:34.971516+0000","last_undegraded":"2024-09-19T06:45:34.971516+0000","last_fullsized":"2024-09-19T06:45:34.971516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839090+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:45:34.839090+0000","last_peered":"2024-09-19T06:45:34.839090+0000","last_clean":"2024-09-19T06:45:34.839090+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:45:34.839090+0000","last_undegraded":"2024-09-19T06:45:34.839090+0000","last_fullsized":"2024-09-19T06:45:34.839090+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838500+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:45:34.838500+0000","last_peered":"2024-09-19T06:45:34.838500+0000","last_clean":"2024-09-19T06:45:34.838500+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:45:34.838500+0000","last_undegraded":"2024-09-19T06:45:34.838500+0000","last_fullsized":"2024-09-19T06:45:34.838500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972242+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:45:34.972242+0000","last_peered":"2024-09-19T06:45:34.972242+0000","last_clean":"2024-09-19T06:45:34.972242+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:45:34.972242+0000","last_undegraded":"2024-09-19T06:45:34.972242+0000","last_fullsized":"2024-09-19T06:45:34.972242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841937+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:45:34.841937+0000","last_peered":"2024-09-19T06:45:34.841937+0000","last_clean":"2024-09-19T06:45:34.841937+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:45:34.841937+0000","last_undegraded":"2024-09-19T06:45:34.841937+0000","last_fullsized":"2024-09-19T06:45:34.841937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843676+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:45:34.843676+0000","last_peered":"2024-09-19T06:45:34.843676+0000","last_clean":"2024-09-19T06:45:34.843676+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:45:34.843676+0000","last_undegraded":"2024-09-19T06:45:34.843676+0000","last_fullsized":"2024-09-19T06:45:34.843676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.847063+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:45:34.847063+0000","last_peered":"2024-09-19T06:45:34.847063+0000","last_clean":"2024-09-19T06:45:34.847063+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:45:34.847063+0000","last_undegraded":"2024-09-19T06:45:34.847063+0000","last_fullsized":"2024-09-19T06:45:34.847063+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839212+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:45:34.839212+0000","last_peered":"2024-09-19T06:45:34.839212+0000","last_clean":"2024-09-19T06:45:34.839212+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:45:34.839212+0000","last_undegraded":"2024-09-19T06:45:34.839212+0000","last_fullsized":"2024-09-19T06:45:34.839212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841822+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:45:34.841822+0000","last_peered":"2024-09-19T06:45:34.841822+0000","last_clean":"2024-09-19T06:45:34.841822+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:45:34.841822+0000","last_undegraded":"2024-09-19T06:45:34.841822+0000","last_fullsized":"2024-09-19T06:45:34.841822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:44.425711+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:45:44.425711+0000","last_peered":"2024-09-19T06:45:44.425711+0000","last_clean":"2024-09-19T06:45:44.425711+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:45:44.425711+0000","last_undegraded":"2024-09-19T06:45:44.425711+0000","last_fullsized":"2024-09-19T06:45:44.425711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57424,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":56,"num_write":25,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841524+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:45:34.841524+0000","last_peered":"2024-09-19T06:45:34.841524+0000","last_clean":"2024-09-19T06:45:34.841524+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:45:34.841524+0000","last_undegraded":"2024-09-19T06:45:34.841524+0000","last_fullsized":"2024-09-19T06:45:34.841524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836029+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:45:34.836029+0000","last_peered":"2024-09-19T06:45:34.836029+0000","last_clean":"2024-09-19T06:45:34.836029+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:45:34.836029+0000","last_undegraded":"2024-09-19T06:45:34.836029+0000","last_fullsized":"2024-09-19T06:45:34.836029+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834657+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:45:34.834657+0000","last_peered":"2024-09-19T06:45:34.834657+0000","last_clean":"2024-09-19T06:45:34.834657+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:45:34.834657+0000","last_undegraded":"2024-09-19T06:45:34.834657+0000","last_fullsized":"2024-09-19T06:45:34.834657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838481+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:45:34.838481+0000","last_peered":"2024-09-19T06:45:34.838481+0000","last_clean":"2024-09-19T06:45:34.838481+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:45:34.838481+0000","last_undegraded":"2024-09-19T06:45:34.838481+0000","last_fullsized":"2024-09-19T06:45:34.838481+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844215+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:45:34.844215+0000","last_peered":"2024-09-19T06:45:34.844215+0000","last_clean":"2024-09-19T06:45:34.844215+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:45:34.844215+0000","last_undegraded":"2024-09-19T06:45:34.844215+0000","last_fullsized":"2024-09-19T06:45:34.844215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838328+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:45:34.838328+0000","last_peered":"2024-09-19T06:45:34.838328+0000","last_clean":"2024-09-19T06:45:34.838328+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:45:34.838328+0000","last_undegraded":"2024-09-19T06:45:34.838328+0000","last_fullsized":"2024-09-19T06:45:34.838328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.973152+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:45:34.973152+0000","last_peered":"2024-09-19T06:45:34.973152+0000","last_clean":"2024-09-19T06:45:34.973152+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:45:34.973152+0000","last_undegraded":"2024-09-19T06:45:34.973152+0000","last_fullsized":"2024-09-19T06:45:34.973152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842229+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:45:34.842229+0000","last_peered":"2024-09-19T06:45:34.842229+0000","last_clean":"2024-09-19T06:45:34.842229+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:45:34.842229+0000","last_undegraded":"2024-09-19T06:45:34.842229+0000","last_fullsized":"2024-09-19T06:45:34.842229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838241+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:45:34.838241+0000","last_peered":"2024-09-19T06:45:34.838241+0000","last_clean":"2024-09-19T06:45:34.838241+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:45:34.838241+0000","last_undegraded":"2024-09-19T06:45:34.838241+0000","last_fullsized":"2024-09-19T06:45:34.838241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841909+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:45:34.841909+0000","last_peered":"2024-09-19T06:45:34.841909+0000","last_clean":"2024-09-19T06:45:34.841909+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:45:34.841909+0000","last_undegraded":"2024-09-19T06:45:34.841909+0000","last_fullsized":"2024-09-19T06:45:34.841909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838064+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:45:34.838064+0000","last_peered":"2024-09-19T06:45:34.838064+0000","last_clean":"2024-09-19T06:45:34.838064+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:45:34.838064+0000","last_undegraded":"2024-09-19T06:45:34.838064+0000","last_fullsized":"2024-09-19T06:45:34.838064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834898+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:45:34.834898+0000","last_peered":"2024-09-19T06:45:34.834898+0000","last_clean":"2024-09-19T06:45:34.834898+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:45:34.834898+0000","last_undegraded":"2024-09-19T06:45:34.834898+0000","last_fullsized":"2024-09-19T06:45:34.834898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844431+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:45:34.844431+0000","last_peered":"2024-09-19T06:45:34.844431+0000","last_clean":"2024-09-19T06:45:34.844431+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:45:34.844431+0000","last_undegraded":"2024-09-19T06:45:34.844431+0000","last_fullsized":"2024-09-19T06:45:34.844431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839314+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:45:34.839314+0000","last_peered":"2024-09-19T06:45:34.839314+0000","last_clean":"2024-09-19T06:45:34.839314+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:45:34.839314+0000","last_undegraded":"2024-09-19T06:45:34.839314+0000","last_fullsized":"2024-09-19T06:45:34.839314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843610+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:45:34.843610+0000","last_peered":"2024-09-19T06:45:34.843610+0000","last_clean":"2024-09-19T06:45:34.843610+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:45:34.843610+0000","last_undegraded":"2024-09-19T06:45:34.843610+0000","last_fullsized":"2024-09-19T06:45:34.843610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836123+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:45:34.836123+0000","last_peered":"2024-09-19T06:45:34.836123+0000","last_clean":"2024-09-19T06:45:34.836123+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:45:34.836123+0000","last_undegraded":"2024-09-19T06:45:34.836123+0000","last_fullsized":"2024-09-19T06:45:34.836123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844519+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:45:34.844519+0000","last_peered":"2024-09-19T06:45:34.844519+0000","last_clean":"2024-09-19T06:45:34.844519+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:45:34.844519+0000","last_undegraded":"2024-09-19T06:45:34.844519+0000","last_fullsized":"2024-09-19T06:45:34.844519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":346,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843957+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:45:34.843957+0000","last_peered":"2024-09-19T06:45:34.843957+0000","last_clean":"2024-09-19T06:45:34.843957+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:45:34.843957+0000","last_undegraded":"2024-09-19T06:45:34.843957+0000","last_fullsized":"2024-09-19T06:45:34.843957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838447+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:45:34.838447+0000","last_peered":"2024-09-19T06:45:34.838447+0000","last_clean":"2024-09-19T06:45:34.838447+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:45:34.838447+0000","last_undegraded":"2024-09-19T06:45:34.838447+0000","last_fullsized":"2024-09-19T06:45:34.838447+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971505+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:45:34.971505+0000","last_peered":"2024-09-19T06:45:34.971505+0000","last_clean":"2024-09-19T06:45:34.971505+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:45:34.971505+0000","last_undegraded":"2024-09-19T06:45:34.971505+0000","last_fullsized":"2024-09-19T06:45:34.971505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844023+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:45:34.844023+0000","last_peered":"2024-09-19T06:45:34.844023+0000","last_clean":"2024-09-19T06:45:34.844023+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:45:34.844023+0000","last_undegraded":"2024-09-19T06:45:34.844023+0000","last_fullsized":"2024-09-19T06:45:34.844023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834590+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:45:34.834590+0000","last_peered":"2024-09-19T06:45:34.834590+0000","last_clean":"2024-09-19T06:45:34.834590+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:45:34.834590+0000","last_undegraded":"2024-09-19T06:45:34.834590+0000","last_fullsized":"2024-09-19T06:45:34.834590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834693+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:45:34.834693+0000","last_peered":"2024-09-19T06:45:34.834693+0000","last_clean":"2024-09-19T06:45:34.834693+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:45:34.834693+0000","last_undegraded":"2024-09-19T06:45:34.834693+0000","last_fullsized":"2024-09-19T06:45:34.834693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838558+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:45:34.838558+0000","last_peered":"2024-09-19T06:45:34.838558+0000","last_clean":"2024-09-19T06:45:34.838558+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:45:34.838558+0000","last_undegraded":"2024-09-19T06:45:34.838558+0000","last_fullsized":"2024-09-19T06:45:34.838558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844146+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:45:34.844146+0000","last_peered":"2024-09-19T06:45:34.844146+0000","last_clean":"2024-09-19T06:45:34.844146+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:45:34.844146+0000","last_undegraded":"2024-09-19T06:45:34.844146+0000","last_fullsized":"2024-09-19T06:45:34.844146+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971935+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:45:34.971935+0000","last_peered":"2024-09-19T06:45:34.971935+0000","last_clean":"2024-09-19T06:45:34.971935+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:45:34.971935+0000","last_undegraded":"2024-09-19T06:45:34.971935+0000","last_fullsized":"2024-09-19T06:45:34.971935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838632+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:45:34.838632+0000","last_peered":"2024-09-19T06:45:34.838632+0000","last_clean":"2024-09-19T06:45:34.838632+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:45:34.838632+0000","last_undegraded":"2024-09-19T06:45:34.838632+0000","last_fullsized":"2024-09-19T06:45:34.838632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972155+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:45:34.972155+0000","last_peered":"2024-09-19T06:45:34.972155+0000","last_clean":"2024-09-19T06:45:34.972155+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:45:34.972155+0000","last_undegraded":"2024-09-19T06:45:34.972155+0000","last_fullsized":"2024-09-19T06:45:34.972155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841771+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:45:34.841771+0000","last_peered":"2024-09-19T06:45:34.841771+0000","last_clean":"2024-09-19T06:45:34.841771+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:45:34.841771+0000","last_undegraded":"2024-09-19T06:45:34.841771+0000","last_fullsized":"2024-09-19T06:45:34.841771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834937+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:45:34.834937+0000","last_peered":"2024-09-19T06:45:34.834937+0000","last_clean":"2024-09-19T06:45:34.834937+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:45:34.834937+0000","last_undegraded":"2024-09-19T06:45:34.834937+0000","last_fullsized":"2024-09-19T06:45:34.834937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:41.780148+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:45:41.780148+0000","last_peered":"2024-09-19T06:45:41.780148+0000","last_clean":"2024-09-19T06:45:41.780148+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:45:41.780148+0000","last_undegraded":"2024-09-19T06:45:41.780148+0000","last_fullsized":"2024-09-19T06:45:41.780148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971798+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:45:34.971798+0000","last_peered":"2024-09-19T06:45:34.971798+0000","last_clean":"2024-09-19T06:45:34.971798+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:45:34.971798+0000","last_undegraded":"2024-09-19T06:45:34.971798+0000","last_fullsized":"2024-09-19T06:45:34.971798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838771+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:45:34.838771+0000","last_peered":"2024-09-19T06:45:34.838771+0000","last_clean":"2024-09-19T06:45:34.838771+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:45:34.838771+0000","last_undegraded":"2024-09-19T06:45:34.838771+0000","last_fullsized":"2024-09-19T06:45:34.838771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972922+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:45:34.972922+0000","last_peered":"2024-09-19T06:45:34.972922+0000","last_clean":"2024-09-19T06:45:34.972922+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:45:34.972922+0000","last_undegraded":"2024-09-19T06:45:34.972922+0000","last_fullsized":"2024-09-19T06:45:34.972922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841810+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:45:34.841810+0000","last_peered":"2024-09-19T06:45:34.841810+0000","last_clean":"2024-09-19T06:45:34.841810+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:45:34.841810+0000","last_undegraded":"2024-09-19T06:45:34.841810+0000","last_fullsized":"2024-09-19T06:45:34.841810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.840921+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:45:34.840921+0000","last_peered":"2024-09-19T06:45:34.840921+0000","last_clean":"2024-09-19T06:45:34.840921+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:45:34.840921+0000","last_undegraded":"2024-09-19T06:45:34.840921+0000","last_fullsized":"2024-09-19T06:45:34.840921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971446+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:45:34.971446+0000","last_peered":"2024-09-19T06:45:34.971446+0000","last_clean":"2024-09-19T06:45:34.971446+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:45:34.971446+0000","last_undegraded":"2024-09-19T06:45:34.971446+0000","last_fullsized":"2024-09-19T06:45:34.971446+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838320+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:45:34.838320+0000","last_peered":"2024-09-19T06:45:34.838320+0000","last_clean":"2024-09-19T06:45:34.838320+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:45:34.838320+0000","last_undegraded":"2024-09-19T06:45:34.838320+0000","last_fullsized":"2024-09-19T06:45:34.838320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972570+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:45:34.972570+0000","last_peered":"2024-09-19T06:45:34.972570+0000","last_clean":"2024-09-19T06:45:34.972570+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:45:34.972570+0000","last_undegraded":"2024-09-19T06:45:34.972570+0000","last_fullsized":"2024-09-19T06:45:34.972570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971518+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:45:34.971518+0000","last_peered":"2024-09-19T06:45:34.971518+0000","last_clean":"2024-09-19T06:45:34.971518+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:45:34.971518+0000","last_undegraded":"2024-09-19T06:45:34.971518+0000","last_fullsized":"2024-09-19T06:45:34.971518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842086+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:45:34.842086+0000","last_peered":"2024-09-19T06:45:34.842086+0000","last_clean":"2024-09-19T06:45:34.842086+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:45:34.842086+0000","last_undegraded":"2024-09-19T06:45:34.842086+0000","last_fullsized":"2024-09-19T06:45:34.842086+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844057+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:45:34.844057+0000","last_peered":"2024-09-19T06:45:34.844057+0000","last_clean":"2024-09-19T06:45:34.844057+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:45:34.844057+0000","last_undegraded":"2024-09-19T06:45:34.844057+0000","last_fullsized":"2024-09-19T06:45:34.844057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839054+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:45:34.839054+0000","last_peered":"2024-09-19T06:45:34.839054+0000","last_clean":"2024-09-19T06:45:34.839054+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:45:34.839054+0000","last_undegraded":"2024-09-19T06:45:34.839054+0000","last_fullsized":"2024-09-19T06:45:34.839054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.847185+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:45:34.847185+0000","last_peered":"2024-09-19T06:45:34.847185+0000","last_clean":"2024-09-19T06:45:34.847185+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:45:34.847185+0000","last_undegraded":"2024-09-19T06:45:34.847185+0000","last_fullsized":"2024-09-19T06:45:34.847185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841692+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:45:34.841692+0000","last_peered":"2024-09-19T06:45:34.841692+0000","last_clean":"2024-09-19T06:45:34.841692+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:45:34.841692+0000","last_undegraded":"2024-09-19T06:45:34.841692+0000","last_fullsized":"2024-09-19T06:45:34.841692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841638+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:45:34.841638+0000","last_peered":"2024-09-19T06:45:34.841638+0000","last_clean":"2024-09-19T06:45:34.841638+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:45:34.841638+0000","last_undegraded":"2024-09-19T06:45:34.841638+0000","last_fullsized":"2024-09-19T06:45:34.841638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836435+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:45:34.836435+0000","last_peered":"2024-09-19T06:45:34.836435+0000","last_clean":"2024-09-19T06:45:34.836435+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:45:34.836435+0000","last_undegraded":"2024-09-19T06:45:34.836435+0000","last_fullsized":"2024-09-19T06:45:34.836435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971775+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:45:34.971775+0000","last_peered":"2024-09-19T06:45:34.971775+0000","last_clean":"2024-09-19T06:45:34.971775+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:45:34.971775+0000","last_undegraded":"2024-09-19T06:45:34.971775+0000","last_fullsized":"2024-09-19T06:45:34.971775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971608+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:45:34.971608+0000","last_peered":"2024-09-19T06:45:34.971608+0000","last_clean":"2024-09-19T06:45:34.971608+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:45:34.971608+0000","last_undegraded":"2024-09-19T06:45:34.971608+0000","last_fullsized":"2024-09-19T06:45:34.971608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838849+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:45:34.838849+0000","last_peered":"2024-09-19T06:45:34.838849+0000","last_clean":"2024-09-19T06:45:34.838849+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:45:34.838849+0000","last_undegraded":"2024-09-19T06:45:34.838849+0000","last_fullsized":"2024-09-19T06:45:34.838849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58222,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":39,"num_read_kb":62,"num_write":74,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":141948,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281443,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612624,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":431929,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1063673,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":432511,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234015,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":432533,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1022996,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":432046,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855406,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":1022596,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":431951,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":432267,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476798,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":473028,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":472994,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":432019,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":41099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57618,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:45:46.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:45:46.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:46 smithi203 ceph-mon[35473]: pgmap v287: 97 pgs: 97 active+clean; 634 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.5 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:46 smithi189 ceph-mon[34880]: pgmap v287: 97 pgs: 97 active+clean; 634 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.5 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:47.058 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.525+0000 7f73aee97640 1 -- 172.21.15.159:0/2868489759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8100a80 msgr2=0x7f73a8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.525+0000 7f73aee97640 1 --2- 172.21.15.159:0/2868489759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8100a80 0x7f73a8100ee0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7394009930 tx=0x7f739402a420 comp rx=0 tx=0).stop 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.525+0000 7f73aee97640 1 -- 172.21.15.159:0/2868489759 shutdown_connections 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.525+0000 7f73aee97640 1 --2- 172.21.15.159:0/2868489759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73a8101420 0x7f73a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.525+0000 7f73aee97640 1 --2- 172.21.15.159:0/2868489759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8100a80 0x7f73a8100ee0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.525+0000 7f73aee97640 1 --2- 172.21.15.159:0/2868489759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73a8106a80 0x7f73a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.525+0000 7f73aee97640 1 -- 172.21.15.159:0/2868489759 >> 172.21.15.159:0/2868489759 conn(0x7f73a80fc7a0 msgr2=0x7f73a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.526+0000 7f73aee97640 1 -- 172.21.15.159:0/2868489759 shutdown_connections 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.526+0000 7f73aee97640 1 -- 172.21.15.159:0/2868489759 wait complete. 2024-09-19T06:45:47.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.526+0000 7f73aee97640 1 Processor -- start 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.526+0000 7f73aee97640 1 -- start start 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73aee97640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73a8100a80 0x7f73a8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73aee97640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73a8101420 0x7f73a8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73aee97640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8106a80 0x7f73a819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73aee97640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f73a8111fa0 con 0x7f73a8106a80 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73aee97640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73a8111e20 con 0x7f73a8101420 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73aee97640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f73a8112120 con 0x7f73a8100a80 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73ad434640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8106a80 0x7f73a819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73ad434640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8106a80 0x7f73a819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58344/0 (socket says 172.21.15.159:58344) 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73ad434640 1 -- 172.21.15.159:0/3126780241 learned_addr learned my addr 172.21.15.159:0/3126780241 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:47.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73a7fff640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73a8101420 0x7f73a8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73acc33640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73a8100a80 0x7f73a8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73ad434640 1 -- 172.21.15.159:0/3126780241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73a8100a80 msgr2=0x7f73a8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73ad434640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73a8100a80 0x7f73a8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73ad434640 1 -- 172.21.15.159:0/3126780241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73a8101420 msgr2=0x7f73a8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73ad434640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73a8101420 0x7f73a8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73ad434640 1 -- 172.21.15.159:0/3126780241 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a819d3f0 con 0x7f73a8106a80 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73ad434640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8106a80 0x7f73a819cd10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f73a000eaa0 tx=0x7f73a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73a5ffb640 1 -- 172.21.15.159:0/3126780241 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a000cdb0 con 0x7f73a8106a80 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a819d6e0 con 0x7f73a8106a80 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73a5ffb640 1 -- 172.21.15.159:0/3126780241 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73a0005020 con 0x7f73a8106a80 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.527+0000 7f73a5ffb640 1 -- 172.21.15.159:0/3126780241 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a00116b0 con 0x7f73a8106a80 2024-09-19T06:45:47.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.528+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a81a4fc0 con 0x7f73a8106a80 2024-09-19T06:45:47.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.529+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a8100ee0 con 0x7f73a8106a80 2024-09-19T06:45:47.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.529+0000 7f73a5ffb640 1 -- 172.21.15.159:0/3126780241 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f73a0005560 con 0x7f73a8106a80 2024-09-19T06:45:47.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.530+0000 7f73a5ffb640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f73980a32d0 0x7f73980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.530+0000 7f73acc33640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f73980a32d0 0x7f73980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.530+0000 7f73a5ffb640 1 -- 172.21.15.159:0/3126780241 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f73a00cfd10 con 0x7f73a8106a80 2024-09-19T06:45:47.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.530+0000 7f73acc33640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f73980a32d0 0x7f73980a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f739c005fd0 tx=0x7f739c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:47.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.534+0000 7f73a5ffb640 1 -- 172.21.15.159:0/3126780241 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f73a0016030 con 0x7f73a8106a80 2024-09-19T06:45:47.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.700+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73a8062630 con 0x7f73980a32d0 2024-09-19T06:45:47.701 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:47 smithi159 ceph-mon[30935]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:45:47.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.708+0000 7f73a5ffb640 1 -- 172.21.15.159:0/3126780241 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258931 (secure 0 0 0) 0x7f73a8062630 con 0x7f73980a32d0 2024-09-19T06:45:47.712 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:47.713 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f73980a32d0 msgr2=0x7f73980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f73980a32d0 0x7f73980a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f739c005fd0 tx=0x7f739c005850 comp rx=0 tx=0).stop 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8106a80 msgr2=0x7f73a819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8106a80 0x7f73a819cd10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f73a000eaa0 tx=0x7f73a000ef60 comp rx=0 tx=0).stop 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 shutdown_connections 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f73980a32d0 0x7f73980a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a8106a80 0x7f73a819cd10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73a8101420 0x7f73a8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 --2- 172.21.15.159:0/3126780241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73a8100a80 0x7f73a8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 >> 172.21.15.159:0/3126780241 conn(0x7f73a80fc7a0 msgr2=0x7f73a80fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 shutdown_connections 2024-09-19T06:45:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:47.712+0000 7f73aee97640 1 -- 172.21.15.159:0/3126780241 wait complete. 2024-09-19T06:45:47.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:47 smithi203 ceph-mon[35473]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:45:47.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:47 smithi189 ceph-mon[34880]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:45:48.447 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-19T06:45:47.414619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648824,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":175,"num_read_kb":181,"num_write":257,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364100,"kb_used_data":10668,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577724,"statfs":{"total":1151940427776,"available":1151567589376,"internally_reserved":0,"allocated":10924032,"data_stored":7113261,"data_compressed":180059,"data_compressed_allocated":241664,"data_compressed_original":1982464,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49444,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":-1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":50,"num_write":28,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003222"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838543+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:45:34.838543+0000","last_peered":"2024-09-19T06:45:34.838543+0000","last_clean":"2024-09-19T06:45:34.838543+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:45:34.838543+0000","last_undegraded":"2024-09-19T06:45:34.838543+0000","last_fullsized":"2024-09-19T06:45:34.838543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836449+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:45:34.836449+0000","last_peered":"2024-09-19T06:45:34.836449+0000","last_clean":"2024-09-19T06:45:34.836449+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:45:34.836449+0000","last_undegraded":"2024-09-19T06:45:34.836449+0000","last_fullsized":"2024-09-19T06:45:34.836449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836354+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:45:34.836354+0000","last_peered":"2024-09-19T06:45:34.836354+0000","last_clean":"2024-09-19T06:45:34.836354+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:45:34.836354+0000","last_undegraded":"2024-09-19T06:45:34.836354+0000","last_fullsized":"2024-09-19T06:45:34.836354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838457+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:45:34.838457+0000","last_peered":"2024-09-19T06:45:34.838457+0000","last_clean":"2024-09-19T06:45:34.838457+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:45:34.838457+0000","last_undegraded":"2024-09-19T06:45:34.838457+0000","last_fullsized":"2024-09-19T06:45:34.838457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841913+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:45:34.841913+0000","last_peered":"2024-09-19T06:45:34.841913+0000","last_clean":"2024-09-19T06:45:34.841913+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:45:34.841913+0000","last_undegraded":"2024-09-19T06:45:34.841913+0000","last_fullsized":"2024-09-19T06:45:34.841913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971761+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:45:34.971761+0000","last_peered":"2024-09-19T06:45:34.971761+0000","last_clean":"2024-09-19T06:45:34.971761+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:45:34.971761+0000","last_undegraded":"2024-09-19T06:45:34.971761+0000","last_fullsized":"2024-09-19T06:45:34.971761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843804+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:45:34.843804+0000","last_peered":"2024-09-19T06:45:34.843804+0000","last_clean":"2024-09-19T06:45:34.843804+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:45:34.843804+0000","last_undegraded":"2024-09-19T06:45:34.843804+0000","last_fullsized":"2024-09-19T06:45:34.843804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971412+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:45:34.971412+0000","last_peered":"2024-09-19T06:45:34.971412+0000","last_clean":"2024-09-19T06:45:34.971412+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:45:34.971412+0000","last_undegraded":"2024-09-19T06:45:34.971412+0000","last_fullsized":"2024-09-19T06:45:34.971412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842122+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:45:34.842122+0000","last_peered":"2024-09-19T06:45:34.842122+0000","last_clean":"2024-09-19T06:45:34.842122+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:45:34.842122+0000","last_undegraded":"2024-09-19T06:45:34.842122+0000","last_fullsized":"2024-09-19T06:45:34.842122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972290+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:45:34.972290+0000","last_peered":"2024-09-19T06:45:34.972290+0000","last_clean":"2024-09-19T06:45:34.972290+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:45:34.972290+0000","last_undegraded":"2024-09-19T06:45:34.972290+0000","last_fullsized":"2024-09-19T06:45:34.972290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844423+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:45:34.844423+0000","last_peered":"2024-09-19T06:45:34.844423+0000","last_clean":"2024-09-19T06:45:34.844423+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:45:34.844423+0000","last_undegraded":"2024-09-19T06:45:34.844423+0000","last_fullsized":"2024-09-19T06:45:34.844423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.973287+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:45:34.973287+0000","last_peered":"2024-09-19T06:45:34.973287+0000","last_clean":"2024-09-19T06:45:34.973287+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:45:34.973287+0000","last_undegraded":"2024-09-19T06:45:34.973287+0000","last_fullsized":"2024-09-19T06:45:34.973287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834791+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:45:34.834791+0000","last_peered":"2024-09-19T06:45:34.834791+0000","last_clean":"2024-09-19T06:45:34.834791+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:45:34.834791+0000","last_undegraded":"2024-09-19T06:45:34.834791+0000","last_fullsized":"2024-09-19T06:45:34.834791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836158+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:45:34.836158+0000","last_peered":"2024-09-19T06:45:34.836158+0000","last_clean":"2024-09-19T06:45:34.836158+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:45:34.836158+0000","last_undegraded":"2024-09-19T06:45:34.836158+0000","last_fullsized":"2024-09-19T06:45:34.836158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836159+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:45:34.836159+0000","last_peered":"2024-09-19T06:45:34.836159+0000","last_clean":"2024-09-19T06:45:34.836159+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:45:34.836159+0000","last_undegraded":"2024-09-19T06:45:34.836159+0000","last_fullsized":"2024-09-19T06:45:34.836159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841633+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:45:34.841633+0000","last_peered":"2024-09-19T06:45:34.841633+0000","last_clean":"2024-09-19T06:45:34.841633+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:45:34.841633+0000","last_undegraded":"2024-09-19T06:45:34.841633+0000","last_fullsized":"2024-09-19T06:45:34.841633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838658+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:45:34.838658+0000","last_peered":"2024-09-19T06:45:34.838658+0000","last_clean":"2024-09-19T06:45:34.838658+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:45:34.838658+0000","last_undegraded":"2024-09-19T06:45:34.838658+0000","last_fullsized":"2024-09-19T06:45:34.838658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838728+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:45:34.838728+0000","last_peered":"2024-09-19T06:45:34.838728+0000","last_clean":"2024-09-19T06:45:34.838728+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:45:34.838728+0000","last_undegraded":"2024-09-19T06:45:34.838728+0000","last_fullsized":"2024-09-19T06:45:34.838728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836019+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:45:34.836019+0000","last_peered":"2024-09-19T06:45:34.836019+0000","last_clean":"2024-09-19T06:45:34.836019+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:45:34.836019+0000","last_undegraded":"2024-09-19T06:45:34.836019+0000","last_fullsized":"2024-09-19T06:45:34.836019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.837959+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:45:34.837959+0000","last_peered":"2024-09-19T06:45:34.837959+0000","last_clean":"2024-09-19T06:45:34.837959+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:45:34.837959+0000","last_undegraded":"2024-09-19T06:45:34.837959+0000","last_fullsized":"2024-09-19T06:45:34.837959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834879+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:45:34.834879+0000","last_peered":"2024-09-19T06:45:34.834879+0000","last_clean":"2024-09-19T06:45:34.834879+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:45:34.834879+0000","last_undegraded":"2024-09-19T06:45:34.834879+0000","last_fullsized":"2024-09-19T06:45:34.834879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841800+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:45:34.841800+0000","last_peered":"2024-09-19T06:45:34.841800+0000","last_clean":"2024-09-19T06:45:34.841800+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:45:34.841800+0000","last_undegraded":"2024-09-19T06:45:34.841800+0000","last_fullsized":"2024-09-19T06:45:34.841800+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971330+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:45:34.971330+0000","last_peered":"2024-09-19T06:45:34.971330+0000","last_clean":"2024-09-19T06:45:34.971330+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:45:34.971330+0000","last_undegraded":"2024-09-19T06:45:34.971330+0000","last_fullsized":"2024-09-19T06:45:34.971330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843683+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:45:34.843683+0000","last_peered":"2024-09-19T06:45:34.843683+0000","last_clean":"2024-09-19T06:45:34.843683+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:45:34.843683+0000","last_undegraded":"2024-09-19T06:45:34.843683+0000","last_fullsized":"2024-09-19T06:45:34.843683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971688+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:45:34.971688+0000","last_peered":"2024-09-19T06:45:34.971688+0000","last_clean":"2024-09-19T06:45:34.971688+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:45:34.971688+0000","last_undegraded":"2024-09-19T06:45:34.971688+0000","last_fullsized":"2024-09-19T06:45:34.971688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836151+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:45:34.836151+0000","last_peered":"2024-09-19T06:45:34.836151+0000","last_clean":"2024-09-19T06:45:34.836151+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:45:34.836151+0000","last_undegraded":"2024-09-19T06:45:34.836151+0000","last_fullsized":"2024-09-19T06:45:34.836151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.837958+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:45:34.837958+0000","last_peered":"2024-09-19T06:45:34.837958+0000","last_clean":"2024-09-19T06:45:34.837958+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:45:34.837958+0000","last_undegraded":"2024-09-19T06:45:34.837958+0000","last_fullsized":"2024-09-19T06:45:34.837958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834831+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:45:34.834831+0000","last_peered":"2024-09-19T06:45:34.834831+0000","last_clean":"2024-09-19T06:45:34.834831+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:45:34.834831+0000","last_undegraded":"2024-09-19T06:45:34.834831+0000","last_fullsized":"2024-09-19T06:45:34.834831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843370+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:45:34.843370+0000","last_peered":"2024-09-19T06:45:34.843370+0000","last_clean":"2024-09-19T06:45:34.843370+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:45:34.843370+0000","last_undegraded":"2024-09-19T06:45:34.843370+0000","last_fullsized":"2024-09-19T06:45:34.843370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.835760+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:45:34.835760+0000","last_peered":"2024-09-19T06:45:34.835760+0000","last_clean":"2024-09-19T06:45:34.835760+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:45:34.835760+0000","last_undegraded":"2024-09-19T06:45:34.835760+0000","last_fullsized":"2024-09-19T06:45:34.835760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.835752+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:45:34.835752+0000","last_peered":"2024-09-19T06:45:34.835752+0000","last_clean":"2024-09-19T06:45:34.835752+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:45:34.835752+0000","last_undegraded":"2024-09-19T06:45:34.835752+0000","last_fullsized":"2024-09-19T06:45:34.835752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841201+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:45:34.841201+0000","last_peered":"2024-09-19T06:45:34.841201+0000","last_clean":"2024-09-19T06:45:34.841201+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:45:34.841201+0000","last_undegraded":"2024-09-19T06:45:34.841201+0000","last_fullsized":"2024-09-19T06:45:34.841201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841011+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:45:34.841011+0000","last_peered":"2024-09-19T06:45:34.841011+0000","last_clean":"2024-09-19T06:45:34.841011+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:45:34.841011+0000","last_undegraded":"2024-09-19T06:45:34.841011+0000","last_fullsized":"2024-09-19T06:45:34.841011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.846845+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:45:34.846845+0000","last_peered":"2024-09-19T06:45:34.846845+0000","last_clean":"2024-09-19T06:45:34.846845+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:45:34.846845+0000","last_undegraded":"2024-09-19T06:45:34.846845+0000","last_fullsized":"2024-09-19T06:45:34.846845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839526+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:45:34.839526+0000","last_peered":"2024-09-19T06:45:34.839526+0000","last_clean":"2024-09-19T06:45:34.839526+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:45:34.839526+0000","last_undegraded":"2024-09-19T06:45:34.839526+0000","last_fullsized":"2024-09-19T06:45:34.839526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971775+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:45:34.971775+0000","last_peered":"2024-09-19T06:45:34.971775+0000","last_clean":"2024-09-19T06:45:34.971775+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:45:34.971775+0000","last_undegraded":"2024-09-19T06:45:34.971775+0000","last_fullsized":"2024-09-19T06:45:34.971775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834620+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:45:34.834620+0000","last_peered":"2024-09-19T06:45:34.834620+0000","last_clean":"2024-09-19T06:45:34.834620+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:45:34.834620+0000","last_undegraded":"2024-09-19T06:45:34.834620+0000","last_fullsized":"2024-09-19T06:45:34.834620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971516+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:45:34.971516+0000","last_peered":"2024-09-19T06:45:34.971516+0000","last_clean":"2024-09-19T06:45:34.971516+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:45:34.971516+0000","last_undegraded":"2024-09-19T06:45:34.971516+0000","last_fullsized":"2024-09-19T06:45:34.971516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839090+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:45:34.839090+0000","last_peered":"2024-09-19T06:45:34.839090+0000","last_clean":"2024-09-19T06:45:34.839090+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:45:34.839090+0000","last_undegraded":"2024-09-19T06:45:34.839090+0000","last_fullsized":"2024-09-19T06:45:34.839090+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838500+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:45:34.838500+0000","last_peered":"2024-09-19T06:45:34.838500+0000","last_clean":"2024-09-19T06:45:34.838500+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:45:34.838500+0000","last_undegraded":"2024-09-19T06:45:34.838500+0000","last_fullsized":"2024-09-19T06:45:34.838500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972242+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:45:34.972242+0000","last_peered":"2024-09-19T06:45:34.972242+0000","last_clean":"2024-09-19T06:45:34.972242+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:45:34.972242+0000","last_undegraded":"2024-09-19T06:45:34.972242+0000","last_fullsized":"2024-09-19T06:45:34.972242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841937+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:45:34.841937+0000","last_peered":"2024-09-19T06:45:34.841937+0000","last_clean":"2024-09-19T06:45:34.841937+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:45:34.841937+0000","last_undegraded":"2024-09-19T06:45:34.841937+0000","last_fullsized":"2024-09-19T06:45:34.841937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843676+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:45:34.843676+0000","last_peered":"2024-09-19T06:45:34.843676+0000","last_clean":"2024-09-19T06:45:34.843676+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:45:34.843676+0000","last_undegraded":"2024-09-19T06:45:34.843676+0000","last_fullsized":"2024-09-19T06:45:34.843676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.847063+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:45:34.847063+0000","last_peered":"2024-09-19T06:45:34.847063+0000","last_clean":"2024-09-19T06:45:34.847063+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:45:34.847063+0000","last_undegraded":"2024-09-19T06:45:34.847063+0000","last_fullsized":"2024-09-19T06:45:34.847063+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839212+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:45:34.839212+0000","last_peered":"2024-09-19T06:45:34.839212+0000","last_clean":"2024-09-19T06:45:34.839212+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:45:34.839212+0000","last_undegraded":"2024-09-19T06:45:34.839212+0000","last_fullsized":"2024-09-19T06:45:34.839212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841822+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:45:34.841822+0000","last_peered":"2024-09-19T06:45:34.841822+0000","last_clean":"2024-09-19T06:45:34.841822+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:45:34.841822+0000","last_undegraded":"2024-09-19T06:45:34.841822+0000","last_fullsized":"2024-09-19T06:45:34.841822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:44.425711+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:45:44.425711+0000","last_peered":"2024-09-19T06:45:44.425711+0000","last_clean":"2024-09-19T06:45:44.425711+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:45:44.425711+0000","last_undegraded":"2024-09-19T06:45:44.425711+0000","last_fullsized":"2024-09-19T06:45:44.425711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57424,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":56,"num_write":25,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841524+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:45:34.841524+0000","last_peered":"2024-09-19T06:45:34.841524+0000","last_clean":"2024-09-19T06:45:34.841524+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:45:34.841524+0000","last_undegraded":"2024-09-19T06:45:34.841524+0000","last_fullsized":"2024-09-19T06:45:34.841524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836029+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:45:34.836029+0000","last_peered":"2024-09-19T06:45:34.836029+0000","last_clean":"2024-09-19T06:45:34.836029+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:45:34.836029+0000","last_undegraded":"2024-09-19T06:45:34.836029+0000","last_fullsized":"2024-09-19T06:45:34.836029+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834657+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:45:34.834657+0000","last_peered":"2024-09-19T06:45:34.834657+0000","last_clean":"2024-09-19T06:45:34.834657+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:45:34.834657+0000","last_undegraded":"2024-09-19T06:45:34.834657+0000","last_fullsized":"2024-09-19T06:45:34.834657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838481+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:45:34.838481+0000","last_peered":"2024-09-19T06:45:34.838481+0000","last_clean":"2024-09-19T06:45:34.838481+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:45:34.838481+0000","last_undegraded":"2024-09-19T06:45:34.838481+0000","last_fullsized":"2024-09-19T06:45:34.838481+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844215+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:45:34.844215+0000","last_peered":"2024-09-19T06:45:34.844215+0000","last_clean":"2024-09-19T06:45:34.844215+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:45:34.844215+0000","last_undegraded":"2024-09-19T06:45:34.844215+0000","last_fullsized":"2024-09-19T06:45:34.844215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838328+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:45:34.838328+0000","last_peered":"2024-09-19T06:45:34.838328+0000","last_clean":"2024-09-19T06:45:34.838328+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:45:34.838328+0000","last_undegraded":"2024-09-19T06:45:34.838328+0000","last_fullsized":"2024-09-19T06:45:34.838328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.973152+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:45:34.973152+0000","last_peered":"2024-09-19T06:45:34.973152+0000","last_clean":"2024-09-19T06:45:34.973152+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:45:34.973152+0000","last_undegraded":"2024-09-19T06:45:34.973152+0000","last_fullsized":"2024-09-19T06:45:34.973152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842229+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:45:34.842229+0000","last_peered":"2024-09-19T06:45:34.842229+0000","last_clean":"2024-09-19T06:45:34.842229+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:45:34.842229+0000","last_undegraded":"2024-09-19T06:45:34.842229+0000","last_fullsized":"2024-09-19T06:45:34.842229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838241+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:45:34.838241+0000","last_peered":"2024-09-19T06:45:34.838241+0000","last_clean":"2024-09-19T06:45:34.838241+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:45:34.838241+0000","last_undegraded":"2024-09-19T06:45:34.838241+0000","last_fullsized":"2024-09-19T06:45:34.838241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841909+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:45:34.841909+0000","last_peered":"2024-09-19T06:45:34.841909+0000","last_clean":"2024-09-19T06:45:34.841909+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:45:34.841909+0000","last_undegraded":"2024-09-19T06:45:34.841909+0000","last_fullsized":"2024-09-19T06:45:34.841909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838064+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:45:34.838064+0000","last_peered":"2024-09-19T06:45:34.838064+0000","last_clean":"2024-09-19T06:45:34.838064+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:45:34.838064+0000","last_undegraded":"2024-09-19T06:45:34.838064+0000","last_fullsized":"2024-09-19T06:45:34.838064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834898+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:45:34.834898+0000","last_peered":"2024-09-19T06:45:34.834898+0000","last_clean":"2024-09-19T06:45:34.834898+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:45:34.834898+0000","last_undegraded":"2024-09-19T06:45:34.834898+0000","last_fullsized":"2024-09-19T06:45:34.834898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844431+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:45:34.844431+0000","last_peered":"2024-09-19T06:45:34.844431+0000","last_clean":"2024-09-19T06:45:34.844431+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:45:34.844431+0000","last_undegraded":"2024-09-19T06:45:34.844431+0000","last_fullsized":"2024-09-19T06:45:34.844431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839314+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:45:34.839314+0000","last_peered":"2024-09-19T06:45:34.839314+0000","last_clean":"2024-09-19T06:45:34.839314+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:45:34.839314+0000","last_undegraded":"2024-09-19T06:45:34.839314+0000","last_fullsized":"2024-09-19T06:45:34.839314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843610+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:45:34.843610+0000","last_peered":"2024-09-19T06:45:34.843610+0000","last_clean":"2024-09-19T06:45:34.843610+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:45:34.843610+0000","last_undegraded":"2024-09-19T06:45:34.843610+0000","last_fullsized":"2024-09-19T06:45:34.843610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836123+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:45:34.836123+0000","last_peered":"2024-09-19T06:45:34.836123+0000","last_clean":"2024-09-19T06:45:34.836123+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:45:34.836123+0000","last_undegraded":"2024-09-19T06:45:34.836123+0000","last_fullsized":"2024-09-19T06:45:34.836123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844519+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:45:34.844519+0000","last_peered":"2024-09-19T06:45:34.844519+0000","last_clean":"2024-09-19T06:45:34.844519+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:45:34.844519+0000","last_undegraded":"2024-09-19T06:45:34.844519+0000","last_fullsized":"2024-09-19T06:45:34.844519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":346,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843957+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:45:34.843957+0000","last_peered":"2024-09-19T06:45:34.843957+0000","last_clean":"2024-09-19T06:45:34.843957+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:45:34.843957+0000","last_undegraded":"2024-09-19T06:45:34.843957+0000","last_fullsized":"2024-09-19T06:45:34.843957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838447+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:45:34.838447+0000","last_peered":"2024-09-19T06:45:34.838447+0000","last_clean":"2024-09-19T06:45:34.838447+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:45:34.838447+0000","last_undegraded":"2024-09-19T06:45:34.838447+0000","last_fullsized":"2024-09-19T06:45:34.838447+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971505+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:45:34.971505+0000","last_peered":"2024-09-19T06:45:34.971505+0000","last_clean":"2024-09-19T06:45:34.971505+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:45:34.971505+0000","last_undegraded":"2024-09-19T06:45:34.971505+0000","last_fullsized":"2024-09-19T06:45:34.971505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844023+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:45:34.844023+0000","last_peered":"2024-09-19T06:45:34.844023+0000","last_clean":"2024-09-19T06:45:34.844023+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:45:34.844023+0000","last_undegraded":"2024-09-19T06:45:34.844023+0000","last_fullsized":"2024-09-19T06:45:34.844023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834590+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:45:34.834590+0000","last_peered":"2024-09-19T06:45:34.834590+0000","last_clean":"2024-09-19T06:45:34.834590+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:45:34.834590+0000","last_undegraded":"2024-09-19T06:45:34.834590+0000","last_fullsized":"2024-09-19T06:45:34.834590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834693+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:45:34.834693+0000","last_peered":"2024-09-19T06:45:34.834693+0000","last_clean":"2024-09-19T06:45:34.834693+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:45:34.834693+0000","last_undegraded":"2024-09-19T06:45:34.834693+0000","last_fullsized":"2024-09-19T06:45:34.834693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838558+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:45:34.838558+0000","last_peered":"2024-09-19T06:45:34.838558+0000","last_clean":"2024-09-19T06:45:34.838558+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:45:34.838558+0000","last_undegraded":"2024-09-19T06:45:34.838558+0000","last_fullsized":"2024-09-19T06:45:34.838558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844146+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:45:34.844146+0000","last_peered":"2024-09-19T06:45:34.844146+0000","last_clean":"2024-09-19T06:45:34.844146+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:45:34.844146+0000","last_undegraded":"2024-09-19T06:45:34.844146+0000","last_fullsized":"2024-09-19T06:45:34.844146+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971935+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:45:34.971935+0000","last_peered":"2024-09-19T06:45:34.971935+0000","last_clean":"2024-09-19T06:45:34.971935+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:45:34.971935+0000","last_undegraded":"2024-09-19T06:45:34.971935+0000","last_fullsized":"2024-09-19T06:45:34.971935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838632+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:45:34.838632+0000","last_peered":"2024-09-19T06:45:34.838632+0000","last_clean":"2024-09-19T06:45:34.838632+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:45:34.838632+0000","last_undegraded":"2024-09-19T06:45:34.838632+0000","last_fullsized":"2024-09-19T06:45:34.838632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972155+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:45:34.972155+0000","last_peered":"2024-09-19T06:45:34.972155+0000","last_clean":"2024-09-19T06:45:34.972155+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:45:34.972155+0000","last_undegraded":"2024-09-19T06:45:34.972155+0000","last_fullsized":"2024-09-19T06:45:34.972155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841771+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:45:34.841771+0000","last_peered":"2024-09-19T06:45:34.841771+0000","last_clean":"2024-09-19T06:45:34.841771+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:45:34.841771+0000","last_undegraded":"2024-09-19T06:45:34.841771+0000","last_fullsized":"2024-09-19T06:45:34.841771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834937+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:45:34.834937+0000","last_peered":"2024-09-19T06:45:34.834937+0000","last_clean":"2024-09-19T06:45:34.834937+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:45:34.834937+0000","last_undegraded":"2024-09-19T06:45:34.834937+0000","last_fullsized":"2024-09-19T06:45:34.834937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:41.780148+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:45:41.780148+0000","last_peered":"2024-09-19T06:45:41.780148+0000","last_clean":"2024-09-19T06:45:41.780148+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:45:41.780148+0000","last_undegraded":"2024-09-19T06:45:41.780148+0000","last_fullsized":"2024-09-19T06:45:41.780148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971798+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:45:34.971798+0000","last_peered":"2024-09-19T06:45:34.971798+0000","last_clean":"2024-09-19T06:45:34.971798+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:45:34.971798+0000","last_undegraded":"2024-09-19T06:45:34.971798+0000","last_fullsized":"2024-09-19T06:45:34.971798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838771+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:45:34.838771+0000","last_peered":"2024-09-19T06:45:34.838771+0000","last_clean":"2024-09-19T06:45:34.838771+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:45:34.838771+0000","last_undegraded":"2024-09-19T06:45:34.838771+0000","last_fullsized":"2024-09-19T06:45:34.838771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972922+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:45:34.972922+0000","last_peered":"2024-09-19T06:45:34.972922+0000","last_clean":"2024-09-19T06:45:34.972922+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:45:34.972922+0000","last_undegraded":"2024-09-19T06:45:34.972922+0000","last_fullsized":"2024-09-19T06:45:34.972922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841810+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:45:34.841810+0000","last_peered":"2024-09-19T06:45:34.841810+0000","last_clean":"2024-09-19T06:45:34.841810+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:45:34.841810+0000","last_undegraded":"2024-09-19T06:45:34.841810+0000","last_fullsized":"2024-09-19T06:45:34.841810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.840921+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:45:34.840921+0000","last_peered":"2024-09-19T06:45:34.840921+0000","last_clean":"2024-09-19T06:45:34.840921+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:45:34.840921+0000","last_undegraded":"2024-09-19T06:45:34.840921+0000","last_fullsized":"2024-09-19T06:45:34.840921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971446+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:45:34.971446+0000","last_peered":"2024-09-19T06:45:34.971446+0000","last_clean":"2024-09-19T06:45:34.971446+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:45:34.971446+0000","last_undegraded":"2024-09-19T06:45:34.971446+0000","last_fullsized":"2024-09-19T06:45:34.971446+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838320+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:45:34.838320+0000","last_peered":"2024-09-19T06:45:34.838320+0000","last_clean":"2024-09-19T06:45:34.838320+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:45:34.838320+0000","last_undegraded":"2024-09-19T06:45:34.838320+0000","last_fullsized":"2024-09-19T06:45:34.838320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972570+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:45:34.972570+0000","last_peered":"2024-09-19T06:45:34.972570+0000","last_clean":"2024-09-19T06:45:34.972570+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:45:34.972570+0000","last_undegraded":"2024-09-19T06:45:34.972570+0000","last_fullsized":"2024-09-19T06:45:34.972570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971518+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:45:34.971518+0000","last_peered":"2024-09-19T06:45:34.971518+0000","last_clean":"2024-09-19T06:45:34.971518+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:45:34.971518+0000","last_undegraded":"2024-09-19T06:45:34.971518+0000","last_fullsized":"2024-09-19T06:45:34.971518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842086+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:45:34.842086+0000","last_peered":"2024-09-19T06:45:34.842086+0000","last_clean":"2024-09-19T06:45:34.842086+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:45:34.842086+0000","last_undegraded":"2024-09-19T06:45:34.842086+0000","last_fullsized":"2024-09-19T06:45:34.842086+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844057+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:45:34.844057+0000","last_peered":"2024-09-19T06:45:34.844057+0000","last_clean":"2024-09-19T06:45:34.844057+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:45:34.844057+0000","last_undegraded":"2024-09-19T06:45:34.844057+0000","last_fullsized":"2024-09-19T06:45:34.844057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839054+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:45:34.839054+0000","last_peered":"2024-09-19T06:45:34.839054+0000","last_clean":"2024-09-19T06:45:34.839054+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:45:34.839054+0000","last_undegraded":"2024-09-19T06:45:34.839054+0000","last_fullsized":"2024-09-19T06:45:34.839054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.847185+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:45:34.847185+0000","last_peered":"2024-09-19T06:45:34.847185+0000","last_clean":"2024-09-19T06:45:34.847185+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:45:34.847185+0000","last_undegraded":"2024-09-19T06:45:34.847185+0000","last_fullsized":"2024-09-19T06:45:34.847185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841692+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:45:34.841692+0000","last_peered":"2024-09-19T06:45:34.841692+0000","last_clean":"2024-09-19T06:45:34.841692+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:45:34.841692+0000","last_undegraded":"2024-09-19T06:45:34.841692+0000","last_fullsized":"2024-09-19T06:45:34.841692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841638+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:45:34.841638+0000","last_peered":"2024-09-19T06:45:34.841638+0000","last_clean":"2024-09-19T06:45:34.841638+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:45:34.841638+0000","last_undegraded":"2024-09-19T06:45:34.841638+0000","last_fullsized":"2024-09-19T06:45:34.841638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836435+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:45:34.836435+0000","last_peered":"2024-09-19T06:45:34.836435+0000","last_clean":"2024-09-19T06:45:34.836435+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:45:34.836435+0000","last_undegraded":"2024-09-19T06:45:34.836435+0000","last_fullsized":"2024-09-19T06:45:34.836435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971775+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:45:34.971775+0000","last_peered":"2024-09-19T06:45:34.971775+0000","last_clean":"2024-09-19T06:45:34.971775+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:45:34.971775+0000","last_undegraded":"2024-09-19T06:45:34.971775+0000","last_fullsized":"2024-09-19T06:45:34.971775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971608+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:45:34.971608+0000","last_peered":"2024-09-19T06:45:34.971608+0000","last_clean":"2024-09-19T06:45:34.971608+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:45:34.971608+0000","last_undegraded":"2024-09-19T06:45:34.971608+0000","last_fullsized":"2024-09-19T06:45:34.971608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838849+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:45:34.838849+0000","last_peered":"2024-09-19T06:45:34.838849+0000","last_clean":"2024-09-19T06:45:34.838849+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:45:34.838849+0000","last_undegraded":"2024-09-19T06:45:34.838849+0000","last_fullsized":"2024-09-19T06:45:34.838849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58222,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":39,"num_read_kb":62,"num_write":74,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":174666,"data_compressed":5439,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281443,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612624,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":431929,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1063673,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":432511,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234015,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":432533,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1022996,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":432046,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":1022596,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":431951,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":432267,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476799,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":489387,"data_compressed":7567,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607620,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":489353,"data_compressed":7567,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":432019,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":57424,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57458,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57618,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:45:48.451 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:45:48.452 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T06:45:48.452 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T06:45:48.698 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:48.819 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:48 smithi159 ceph-mon[30935]: pgmap v288: 97 pgs: 97 active+clean; 634 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:48.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:48 smithi203 ceph-mon[35473]: pgmap v288: 97 pgs: 97 active+clean; 634 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:48 smithi189 ceph-mon[34880]: pgmap v288: 97 pgs: 97 active+clean; 634 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:49.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 -- 172.21.15.159:0/4252845021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240102e00 msgr2=0x7f8240103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 --2- 172.21.15.159:0/4252845021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240102e00 0x7f8240103280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8228009900 tx=0x7f822802a410 comp rx=0 tx=0).stop 2024-09-19T06:45:49.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 -- 172.21.15.159:0/4252845021 shutdown_connections 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 --2- 172.21.15.159:0/4252845021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82401037c0 0x7f824010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 --2- 172.21.15.159:0/4252845021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240102e00 0x7f8240103280 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 --2- 172.21.15.159:0/4252845021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8240101c00 0x7f8240102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 -- 172.21.15.159:0/4252845021 >> 172.21.15.159:0/4252845021 conn(0x7f82400fd390 msgr2=0x7f82400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 -- 172.21.15.159:0/4252845021 shutdown_connections 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 -- 172.21.15.159:0/4252845021 wait complete. 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.202+0000 7f82450c5640 1 Processor -- start 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f82450c5640 1 -- start start 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f82450c5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240101c00 0x7f8240075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f82450c5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8240102e00 0x7f82400745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f82450c5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82401037c0 0x7f8240074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f82450c5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f824010d930 con 0x7f8240101c00 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f82450c5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f824010d7b0 con 0x7f8240102e00 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f82450c5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f824010dab0 con 0x7f82401037c0 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240101c00 0x7f8240075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240101c00 0x7f8240075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48554/0 (socket says 172.21.15.159:48554) 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823ed9d640 1 -- 172.21.15.159:0/2252733114 learned_addr learned my addr 172.21.15.159:0/2252733114 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823e59c640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8240102e00 0x7f82400745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823f59e640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82401037c0 0x7f8240074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823ed9d640 1 -- 172.21.15.159:0/2252733114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82401037c0 msgr2=0x7f8240074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823ed9d640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82401037c0 0x7f8240074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823ed9d640 1 -- 172.21.15.159:0/2252733114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8240102e00 msgr2=0x7f82400745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823ed9d640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8240102e00 0x7f82400745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823ed9d640 1 -- 172.21.15.159:0/2252733114 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82400753e0 con 0x7f8240101c00 2024-09-19T06:45:49.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.203+0000 7f823e59c640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8240102e00 0x7f82400745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:49.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.204+0000 7f823ed9d640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240101c00 0x7f8240075f90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f823000b450 tx=0x7f823000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.204+0000 7f8237fff640 1 -- 172.21.15.159:0/2252733114 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230015020 con 0x7f8240101c00 2024-09-19T06:45:49.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.204+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82401a2140 con 0x7f8240101c00 2024-09-19T06:45:49.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.204+0000 7f8237fff640 1 -- 172.21.15.159:0/2252733114 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8230011d70 con 0x7f8240101c00 2024-09-19T06:45:49.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.204+0000 7f8237fff640 1 -- 172.21.15.159:0/2252733114 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823000f340 con 0x7f8240101c00 2024-09-19T06:45:49.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.204+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82401a26d0 con 0x7f8240101c00 2024-09-19T06:45:49.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.205+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8240108fa0 con 0x7f8240101c00 2024-09-19T06:45:49.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.206+0000 7f8237fff640 1 -- 172.21.15.159:0/2252733114 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f8230018020 con 0x7f8240101c00 2024-09-19T06:45:49.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.207+0000 7f8237fff640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f822c0a32d0 0x7f822c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.207+0000 7f823e59c640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f822c0a32d0 0x7f822c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.207+0000 7f8237fff640 1 -- 172.21.15.159:0/2252733114 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f82300cf4c0 con 0x7f8240101c00 2024-09-19T06:45:49.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.207+0000 7f823e59c640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f822c0a32d0 0x7f822c0a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f82280315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.211+0000 7f8237fff640 1 -- 172.21.15.159:0/2252733114 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f823001f020 con 0x7f8240101c00 2024-09-19T06:45:49.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.438+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f8240062df0 con 0x7f8240101c00 2024-09-19T06:45:49.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.441+0000 7f8237fff640 1 -- 172.21.15.159:0/2252733114 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f823000d040 con 0x7f8240101c00 2024-09-19T06:45:49.442 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2024-09-19T06:45:49.442 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCdyOtmunU8GhAA5PkXqjLd/td+hRhe3yYe9Q== 2024-09-19T06:45:49.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f822c0a32d0 msgr2=0x7f822c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f822c0a32d0 0x7f822c0a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f82280315d0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240101c00 msgr2=0x7f8240075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240101c00 0x7f8240075f90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f823000b450 tx=0x7f823000b910 comp rx=0 tx=0).stop 2024-09-19T06:45:49.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 shutdown_connections 2024-09-19T06:45:49.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f822c0a32d0 0x7f822c0a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82401037c0 0x7f8240074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8240102e00 0x7f82400745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 --2- 172.21.15.159:0/2252733114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8240101c00 0x7f8240075f90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 >> 172.21.15.159:0/2252733114 conn(0x7f82400fd390 msgr2=0x7f8240106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 shutdown_connections 2024-09-19T06:45:49.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:49.443+0000 7f82450c5640 1 -- 172.21.15.159:0/2252733114 wait complete. 2024-09-19T06:45:49.813 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:49 smithi159 ceph-mon[30935]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:45:49.813 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:49 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2252733114' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:45:49.813 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:49 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2252733114' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:45:49.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:49 smithi203 ceph-mon[35473]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:45:49.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:49 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2252733114' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:45:49.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:49 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2252733114' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:45:49.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:49 smithi189 ceph-mon[34880]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:45:49.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:49 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2252733114' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:45:49.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:49 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2252733114' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:45:50.125 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:45:50.125 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T06:45:50.125 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T06:45:50.162 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T06:45:50.162 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T06:45:50.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T06:45:50.445 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:50.826 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:50 smithi159 ceph-mon[30935]: pgmap v289: 97 pgs: 97 active+clean; 634 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:50.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:50 smithi203 ceph-mon[35473]: pgmap v289: 97 pgs: 97 active+clean; 634 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:50.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:50 smithi189 ceph-mon[34880]: pgmap v289: 97 pgs: 97 active+clean; 634 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:50.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.904+0000 7f6183bf1640 1 -- 172.21.15.159:0/670811672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c10c180 msgr2=0x7f617c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.904+0000 7f6183bf1640 1 --2- 172.21.15.159:0/670811672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c10c180 0x7f617c10e610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6174009ca0 tx=0x7f617402a950 comp rx=0 tx=0).stop 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.904+0000 7f6183bf1640 1 -- 172.21.15.159:0/670811672 shutdown_connections 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.904+0000 7f6183bf1640 1 --2- 172.21.15.159:0/670811672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c10c180 0x7f617c10e610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.904+0000 7f6183bf1640 1 --2- 172.21.15.159:0/670811672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f617c103700 0x7f617c10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.904+0000 7f6183bf1640 1 --2- 172.21.15.159:0/670811672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f617c102de0 0x7f617c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.904+0000 7f6183bf1640 1 -- 172.21.15.159:0/670811672 >> 172.21.15.159:0/670811672 conn(0x7f617c0fc7a0 msgr2=0x7f617c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.904+0000 7f6183bf1640 1 -- 172.21.15.159:0/670811672 shutdown_connections 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.904+0000 7f6183bf1640 1 -- 172.21.15.159:0/670811672 wait complete. 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f6183bf1640 1 Processor -- start 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f6183bf1640 1 -- start start 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f6183bf1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f617c102de0 0x7f617c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f6183bf1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c103700 0x7f617c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:50.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f6183bf1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f617c10c180 0x7f617c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f6183bf1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f617c111f50 con 0x7f617c103700 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f6183bf1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f617c111dd0 con 0x7f617c10c180 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f6183bf1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f617c1120d0 con 0x7f617c102de0 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f618118c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c103700 0x7f617c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f618118c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c103700 0x7f617c198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48570/0 (socket says 172.21.15.159:48570) 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f618118c640 1 -- 172.21.15.159:0/43200965 learned_addr learned my addr 172.21.15.159:0/43200965 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.905+0000 7f618198d640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f617c102de0 0x7f617c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f618218e640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f617c10c180 0x7f617c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f618118c640 1 -- 172.21.15.159:0/43200965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f617c102de0 msgr2=0x7f617c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f618118c640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f617c102de0 0x7f617c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f618118c640 1 -- 172.21.15.159:0/43200965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f617c10c180 msgr2=0x7f617c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f618118c640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f617c10c180 0x7f617c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:50.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f618118c640 1 -- 172.21.15.159:0/43200965 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617c19d3a0 con 0x7f617c103700 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f618118c640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c103700 0x7f617c198930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f617800c970 tx=0x7f617800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f6172ffd640 1 -- 172.21.15.159:0/43200965 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178007bb0 con 0x7f617c103700 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f6172ffd640 1 -- 172.21.15.159:0/43200965 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6178007d50 con 0x7f617c103700 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f6172ffd640 1 -- 172.21.15.159:0/43200965 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617800f450 con 0x7f617c103700 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f617c19d690 con 0x7f617c103700 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.906+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f617c1a4f70 con 0x7f617c103700 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.907+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617c1031c0 con 0x7f617c103700 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.908+0000 7f6172ffd640 1 -- 172.21.15.159:0/43200965 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f6178004f40 con 0x7f617c103700 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.909+0000 7f6172ffd640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f61680a32d0 0x7f61680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.909+0000 7f618198d640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f61680a32d0 0x7f61680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.909+0000 7f6172ffd640 1 -- 172.21.15.159:0/43200965 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f61780cf6c0 con 0x7f617c103700 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.910+0000 7f618198d640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f61680a32d0 0x7f61680a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f616c00abe0 tx=0x7f616c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:50.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:50.913+0000 7f6172ffd640 1 -- 172.21.15.159:0/43200965 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6178014030 con 0x7f617c103700 2024-09-19T06:45:51.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.127+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f617c1a5170 con 0x7f617c103700 2024-09-19T06:45:51.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.132+0000 7f6172ffd640 1 -- 172.21.15.159:0/43200965 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264059 (secure 0 0 0) 0x7f617809c260 con 0x7f617c103700 2024-09-19T06:45:51.136 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:51.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f61680a32d0 msgr2=0x7f61680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:51.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f61680a32d0 0x7f61680a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f616c00abe0 tx=0x7f616c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c103700 msgr2=0x7f617c198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:51.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c103700 0x7f617c198930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f617800c970 tx=0x7f617800cd70 comp rx=0 tx=0).stop 2024-09-19T06:45:51.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 shutdown_connections 2024-09-19T06:45:51.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f61680a32d0 0x7f61680a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f617c10c180 0x7f617c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f617c103700 0x7f617c198930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 --2- 172.21.15.159:0/43200965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f617c102de0 0x7f617c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 >> 172.21.15.159:0/43200965 conn(0x7f617c0fc7a0 msgr2=0x7f617c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:51.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 shutdown_connections 2024-09-19T06:45:51.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:51.135+0000 7f6183bf1640 1 -- 172.21.15.159:0/43200965 wait complete. 2024-09-19T06:45:51.816 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:51 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/43200965' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:45:51.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:51 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/43200965' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:45:51.846 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2390667146},{"type":"v1","addr":"172.21.15.159:6801","nonce":2390667146}]},"active_addr":"172.21.15.159:6801/2390667146","active_change":"2024-09-19T06:38:33.329939+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.159:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":2526477703}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":2156136647}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":3276076186}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":3424652308}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":3763048477}]}]} 2024-09-19T06:45:51.851 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T06:45:51.852 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T06:45:51.852 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:45:51.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:51 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/43200965' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:45:52.099 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:52.499 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:52 smithi159 ceph-mon[30935]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:52.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 -- 172.21.15.159:0/2973828254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c108300 msgr2=0x7ffa6c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:52.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2973828254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c108300 0x7ffa6c10ec70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009930 tx=0x7ffa6402a420 comp rx=0 tx=0).stop 2024-09-19T06:45:52.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 -- 172.21.15.159:0/2973828254 shutdown_connections 2024-09-19T06:45:52.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2973828254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c108300 0x7ffa6c10ec70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2973828254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa6c103780 0x7ffa6c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2973828254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa6c102dd0 0x7ffa6c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 -- 172.21.15.159:0/2973828254 >> 172.21.15.159:0/2973828254 conn(0x7ffa6c0fc7d0 msgr2=0x7ffa6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 -- 172.21.15.159:0/2973828254 shutdown_connections 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 -- 172.21.15.159:0/2973828254 wait complete. 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.606+0000 7ffa70aea640 1 Processor -- start 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa70aea640 1 -- start start 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa70aea640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c102dd0 0x7ffa6c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa70aea640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa6c103780 0x7ffa6c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa70aea640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa6c108300 0x7ffa6c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa70aea640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c1120d0 con 0x7ffa6c102dd0 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa70aea640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c111f50 con 0x7ffa6c103780 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa70aea640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c112250 con 0x7ffa6c108300 2024-09-19T06:45:52.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa6a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c102dd0 0x7ffa6c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa6a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c102dd0 0x7ffa6c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48582/0 (socket says 172.21.15.159:48582) 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa6a59c640 1 -- 172.21.15.159:0/2134473821 learned_addr learned my addr 172.21.15.159:0/2134473821 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa6a59c640 1 -- 172.21.15.159:0/2134473821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa6c108300 msgr2=0x7ffa6c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa6a59c640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa6c108300 0x7ffa6c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa69d9b640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa6c103780 0x7ffa6c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa6a59c640 1 -- 172.21.15.159:0/2134473821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa6c103780 msgr2=0x7ffa6c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa6a59c640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa6c103780 0x7ffa6c19ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa6a59c640 1 -- 172.21.15.159:0/2134473821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c19f6a0 con 0x7ffa6c102dd0 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa6a59c640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c102dd0 0x7ffa6c19a6f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00cce0 tx=0x7ffa5c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa637fe640 1 -- 172.21.15.159:0/2134473821 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c004b20 con 0x7ffa6c102dd0 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.607+0000 7ffa637fe640 1 -- 172.21.15.159:0/2134473821 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa5c004cc0 con 0x7ffa6c102dd0 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.608+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c19f990 con 0x7ffa6c102dd0 2024-09-19T06:45:52.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.608+0000 7ffa637fe640 1 -- 172.21.15.159:0/2134473821 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00f8c0 con 0x7ffa6c102dd0 2024-09-19T06:45:52.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.608+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c1a7270 con 0x7ffa6c102dd0 2024-09-19T06:45:52.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.609+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c1031b0 con 0x7ffa6c102dd0 2024-09-19T06:45:52.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.610+0000 7ffa637fe640 1 -- 172.21.15.159:0/2134473821 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ffa5c00fa60 con 0x7ffa6c102dd0 2024-09-19T06:45:52.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.611+0000 7ffa637fe640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa580a3350 0x7ffa580a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:52.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.611+0000 7ffa69d9b640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa580a3350 0x7ffa580a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:52.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.611+0000 7ffa637fe640 1 -- 172.21.15.159:0/2134473821 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffa5c0cfba0 con 0x7ffa6c102dd0 2024-09-19T06:45:52.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.611+0000 7ffa69d9b640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa580a3350 0x7ffa580a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0fdf50 tx=0x7ffa54005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:52.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.615+0000 7ffa637fe640 1 -- 172.21.15.159:0/2134473821 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffa5c014030 con 0x7ffa6c102dd0 2024-09-19T06:45:52.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.783+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa6c19ba50 con 0x7ffa6c102dd0 2024-09-19T06:45:52.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.784+0000 7ffa637fe640 1 -- 172.21.15.159:0/2134473821 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22865 (secure 0 0 0) 0x7ffa5c09c740 con 0x7ffa6c102dd0 2024-09-19T06:45:52.786 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:52.786 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":81,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:45:34.831866+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.787+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa580a3350 msgr2=0x7ffa580a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.787+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa580a3350 0x7ffa580a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0fdf50 tx=0x7ffa54005c50 comp rx=0 tx=0).stop 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.787+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c102dd0 msgr2=0x7ffa6c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.787+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c102dd0 0x7ffa6c19a6f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00cce0 tx=0x7ffa5c00a620 comp rx=0 tx=0).stop 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.787+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 shutdown_connections 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.787+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa580a3350 0x7ffa580a5810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.788+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa6c108300 0x7ffa6c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.788+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa6c103780 0x7ffa6c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.788+0000 7ffa70aea640 1 --2- 172.21.15.159:0/2134473821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa6c102dd0 0x7ffa6c19a6f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.788+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 >> 172.21.15.159:0/2134473821 conn(0x7ffa6c0fc7d0 msgr2=0x7ffa6c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.788+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 shutdown_connections 2024-09-19T06:45:52.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:52.788+0000 7ffa70aea640 1 -- 172.21.15.159:0/2134473821 wait complete. 2024-09-19T06:45:52.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:52 smithi203 ceph-mon[35473]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:52 smithi189 ceph-mon[34880]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:45:53.561 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T06:45:53.562 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:45:53.807 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:53.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:53 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2134473821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:53.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:53 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2134473821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:53.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:53 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2134473821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.268+0000 7f06342a6640 1 -- 172.21.15.159:0/2685157795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1036e0 msgr2=0x7f062c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.268+0000 7f06342a6640 1 --2- 172.21.15.159:0/2685157795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1036e0 0x7f062c107b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f061c009930 tx=0x7f061c02a420 comp rx=0 tx=0).stop 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 -- 172.21.15.159:0/2685157795 shutdown_connections 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 --2- 172.21.15.159:0/2685157795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f062c1082a0 0x7f062c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 --2- 172.21.15.159:0/2685157795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1036e0 0x7f062c107b90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 --2- 172.21.15.159:0/2685157795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f062c102d30 0x7f062c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 -- 172.21.15.159:0/2685157795 >> 172.21.15.159:0/2685157795 conn(0x7f062c0fc7d0 msgr2=0x7f062c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 -- 172.21.15.159:0/2685157795 shutdown_connections 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 -- 172.21.15.159:0/2685157795 wait complete. 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 Processor -- start 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 -- start start 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.269+0000 7f06342a6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f062c102d30 0x7f062c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06342a6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f062c1036e0 0x7f062c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06342a6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1082a0 0x7f062c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06342a6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f062c1120c0 con 0x7f062c1082a0 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06342a6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f062c111f40 con 0x7f062c1036e0 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06342a6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f062c112240 con 0x7f062c102d30 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632843640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1082a0 0x7f062c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632843640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1082a0 0x7f062c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48596/0 (socket says 172.21.15.159:48596) 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632843640 1 -- 172.21.15.159:0/2699398701 learned_addr learned my addr 172.21.15.159:0/2699398701 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632042640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f062c102d30 0x7f062c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0631841640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f062c1036e0 0x7f062c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632843640 1 -- 172.21.15.159:0/2699398701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f062c102d30 msgr2=0x7f062c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632843640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f062c102d30 0x7f062c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632843640 1 -- 172.21.15.159:0/2699398701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f062c1036e0 msgr2=0x7f062c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632843640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f062c1036e0 0x7f062c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632843640 1 -- 172.21.15.159:0/2699398701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c19d5f0 con 0x7f062c1082a0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f0632843640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1082a0 0x7f062c19cf10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f062400eaa0 tx=0x7f062400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06237fe640 1 -- 172.21.15.159:0/2699398701 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624004d20 con 0x7f062c1082a0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06237fe640 1 -- 172.21.15.159:0/2699398701 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0624005020 con 0x7f062c1082a0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062c19d8e0 con 0x7f062c1082a0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06237fe640 1 -- 172.21.15.159:0/2699398701 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06240116d0 con 0x7f062c1082a0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.270+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062c1a51c0 con 0x7f062c1082a0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.271+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062c06a850 con 0x7f062c1082a0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.273+0000 7f06237fe640 1 -- 172.21.15.159:0/2699398701 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f06240051d0 con 0x7f062c1082a0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.273+0000 7f06237fe640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f06180a32d0 0x7f06180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.274+0000 7f0632042640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f06180a32d0 0x7f06180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.274+0000 7f06237fe640 1 -- 172.21.15.159:0/2699398701 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f06240cffc0 con 0x7f062c1082a0 2024-09-19T06:45:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.274+0000 7f0632042640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f06180a32d0 0x7f06180a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0628009990 tx=0x7f0628009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.277+0000 7f06237fe640 1 -- 172.21.15.159:0/2699398701 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0624016030 con 0x7f062c1082a0 2024-09-19T06:45:54.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.470+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f062c103110 con 0x7f062c1082a0 2024-09-19T06:45:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.471+0000 7f06237fe640 1 -- 172.21.15.159:0/2699398701 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22865 (secure 0 0 0) 0x7f062c103110 con 0x7f062c1082a0 2024-09-19T06:45:54.473 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:45:54.473 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":81,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:45:34.831866+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:45:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f06180a32d0 msgr2=0x7f06180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f06180a32d0 0x7f06180a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0628009990 tx=0x7f0628009110 comp rx=0 tx=0).stop 2024-09-19T06:45:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1082a0 msgr2=0x7f062c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1082a0 0x7f062c19cf10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f062400eaa0 tx=0x7f062400eea0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 shutdown_connections 2024-09-19T06:45:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f06180a32d0 0x7f06180a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f062c1082a0 0x7f062c19cf10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f062c1036e0 0x7f062c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 --2- 172.21.15.159:0/2699398701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f062c102d30 0x7f062c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 >> 172.21.15.159:0/2699398701 conn(0x7f062c0fc7d0 msgr2=0x7f062c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 shutdown_connections 2024-09-19T06:45:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:54.474+0000 7f06342a6640 1 -- 172.21.15.159:0/2699398701 wait complete. 2024-09-19T06:45:54.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:54 smithi203 ceph-mon[35473]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-19T06:45:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:54 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2699398701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:54.852 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:54 smithi159 ceph-mon[30935]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-19T06:45:54.852 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:54 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2699398701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:54.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:54 smithi189 ceph-mon[34880]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-19T06:45:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:54 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2699398701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:45:55.275 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T06:45:55.275 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T06:45:55.276 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T06:45:55.276 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T06:45:55.277 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T06:45:55.277 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T06:45:55.278 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T06:45:55.278 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T06:45:55.279 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T06:45:55.279 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T06:45:55.280 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T06:45:55.280 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T06:45:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.049 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.054 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.054 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.055 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.056 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.057 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.078 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.094 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.098 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.102 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:56.746 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:56 smithi159 ceph-mon[30935]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 4 op/s 2024-09-19T06:45:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:56 smithi203 ceph-mon[35473]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 4 op/s 2024-09-19T06:45:56.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.826+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/1916667937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0e0100b30 msgr2=0x7fb0e0100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.826+0000 7fb0e7fd2640 1 --2- 172.21.15.159:0/1916667937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0e0100b30 0x7fb0e0100f10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009900 tx=0x7fb0dc02a470 comp rx=0 tx=0).stop 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.826+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/1916667937 shutdown_connections 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.826+0000 7fb0e7fd2640 1 --2- 172.21.15.159:0/1916667937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0e0105f40 0x7fb0e01063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.826+0000 7fb0e7fd2640 1 --2- 172.21.15.159:0/1916667937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0e0101450 0x7fb0e0105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.826+0000 7fb0e7fd2640 1 --2- 172.21.15.159:0/1916667937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0e0100b30 0x7fb0e0100f10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.826+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/1916667937 >> 172.21.15.159:0/1916667937 conn(0x7fb0e00fc7a0 msgr2=0x7fb0e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.826+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/1916667937 shutdown_connections 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.826+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/1916667937 wait complete. 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e7fd2640 1 Processor -- start 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e7fd2640 1 -- start start 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e7fd2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0e0100b30 0x7fb0e01a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e7fd2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0e0101450 0x7fb0e01a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e7fd2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0e0105f40 0x7fb0e019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e7fd2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e01185f0 con 0x7fb0e0101450 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e7fd2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e0118470 con 0x7fb0e0100b30 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e7fd2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e0118770 con 0x7fb0e0105f40 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e556d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0e0101450 0x7fb0e01a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e556d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0e0101450 0x7fb0e01a4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48610/0 (socket says 172.21.15.159:48610) 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e556d640 1 -- 172.21.15.159:0/3429377058 learned_addr learned my addr 172.21.15.159:0/3429377058 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.827+0000 7fb0e5d6e640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0e0100b30 0x7fb0e01a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e656f640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0e0105f40 0x7fb0e019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e556d640 1 -- 172.21.15.159:0/3429377058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0e0105f40 msgr2=0x7fb0e019e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e556d640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0e0105f40 0x7fb0e019e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e556d640 1 -- 172.21.15.159:0/3429377058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0e0100b30 msgr2=0x7fb0e01a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e556d640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0e0100b30 0x7fb0e01a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e556d640 1 -- 172.21.15.159:0/3429377058 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e019f040 con 0x7fb0e0101450 2024-09-19T06:45:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e5d6e640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0e0100b30 0x7fb0e01a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e556d640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0e0101450 0x7fb0e01a4c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c970 tx=0x7fb0d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0d6ffd640 1 -- 172.21.15.159:0/3429377058 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0007bb0 con 0x7fb0e0101450 2024-09-19T06:45:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0d6ffd640 1 -- 172.21.15.159:0/3429377058 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d0007d50 con 0x7fb0e0101450 2024-09-19T06:45:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e019f330 con 0x7fb0e0101450 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0d6ffd640 1 -- 172.21.15.159:0/3429377058 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d000f450 con 0x7fb0e0101450 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.828+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e01ab620 con 0x7fb0e0101450 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.829+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0e0110160 con 0x7fb0e0101450 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.830+0000 7fb0d6ffd640 1 -- 172.21.15.159:0/3429377058 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fb0d0004f20 con 0x7fb0e0101450 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.831+0000 7fb0d6ffd640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb0cc0a3350 0x7fb0cc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.831+0000 7fb0e5d6e640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb0cc0a3350 0x7fb0cc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.831+0000 7fb0d6ffd640 1 -- 172.21.15.159:0/3429377058 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb0d00cfbe0 con 0x7fb0e0101450 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.831+0000 7fb0d6ffd640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] conn(0x7fb0cc0ad000 0x7fb0cc0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.831+0000 7fb0d6ffd640 1 -- 172.21.15.159:0/3429377058 --> [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0cc0afb70 con 0x7fb0cc0ad000 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.831+0000 7fb0d6ffd640 1 -- 172.21.15.159:0/3429377058 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fb0d00d0030 con 0x7fb0e0101450 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.831+0000 7fb0e656f640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] conn(0x7fb0cc0ad000 0x7fb0cc0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.831+0000 7fb0e5d6e640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb0cc0a3350 0x7fb0cc0a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc000c00 tx=0x7fb0dc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.831+0000 7fb0e656f640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] conn(0x7fb0cc0ad000 0x7fb0cc0af4a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.832+0000 7fb0d6ffd640 1 -- 172.21.15.159:0/3429377058 <== osd.9 v2:172.21.15.159:6826/623154511 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb0cc0afb70 con 0x7fb0cc0ad000 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.845+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 --> [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb0e006b070 con 0x7fb0cc0ad000 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0d6ffd640 1 -- 172.21.15.159:0/3429377058 <== osd.9 v2:172.21.15.159:6826/623154511 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb0e006b070 con 0x7fb0cc0ad000 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] conn(0x7fb0cc0ad000 msgr2=0x7fb0cc0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] conn(0x7fb0cc0ad000 0x7fb0cc0af4a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb0cc0a3350 msgr2=0x7fb0cc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb0cc0a3350 0x7fb0cc0a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc000c00 tx=0x7fb0dc005a20 comp rx=0 tx=0).stop 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0e0101450 msgr2=0x7fb0e01a4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 --2- 172.21.15.159:0/3429377058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0e0101450 0x7fb0e01a4c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c970 tx=0x7fb0d000ce30 comp rx=0 tx=0).stop 2024-09-19T06:45:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e656f640 1 -- 172.21.15.159:0/3429377058 reap_dead start 2024-09-19T06:45:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 shutdown_connections 2024-09-19T06:45:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 >> 172.21.15.159:0/3429377058 conn(0x7fb0e00fc7a0 msgr2=0x7fb0e010f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 shutdown_connections 2024-09-19T06:45:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:56.846+0000 7fb0e7fd2640 1 -- 172.21.15.159:0/3429377058 wait complete. 2024-09-19T06:45:56.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:56 smithi189 ceph-mon[34880]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 4 op/s 2024-09-19T06:45:57.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.777+0000 7fa0a1159640 1 -- 172.21.15.159:0/1451265222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa09c102ef0 msgr2=0x7fa09c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:57.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.777+0000 7fa0a1159640 1 --2- 172.21.15.159:0/1451265222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa09c102ef0 0x7fa09c10da40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa094009ca0 tx=0x7fa09402a950 comp rx=0 tx=0).stop 2024-09-19T06:45:57.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.778+0000 7fa0a1159640 1 -- 172.21.15.159:0/1451265222 shutdown_connections 2024-09-19T06:45:57.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.778+0000 7fa0a1159640 1 --2- 172.21.15.159:0/1451265222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa09c102ef0 0x7fa09c10da40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:57.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.778+0000 7fa0a1159640 1 --2- 172.21.15.159:0/1451265222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa09c102570 0x7fa09c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:57.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.778+0000 7fa0a1159640 1 --2- 172.21.15.159:0/1451265222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa09c100e20 0x7fa09c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:57.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.778+0000 7fa0a1159640 1 -- 172.21.15.159:0/1451265222 >> 172.21.15.159:0/1451265222 conn(0x7fa09c0fc7d0 msgr2=0x7fa09c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:57.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.778+0000 7fa0a1159640 1 -- 172.21.15.159:0/1451265222 shutdown_connections 2024-09-19T06:45:57.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.778+0000 7fa0a1159640 1 -- 172.21.15.159:0/1451265222 wait complete. 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.778+0000 7fa0a1159640 1 Processor -- start 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.778+0000 7fa0a1159640 1 -- start start 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa0a1159640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa09c100e20 0x7fa09c197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa0a1159640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa09c102570 0x7fa09c1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa0a1159640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa09c102ef0 0x7fa09c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa0a1159640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c110f80 con 0x7fa09c102570 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa0a1159640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c110e00 con 0x7fa09c102ef0 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa0a1159640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c111100 con 0x7fa09c100e20 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa093fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa09c102570 0x7fa09c1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa093fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa09c102570 0x7fa09c1978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48636/0 (socket says 172.21.15.159:48636) 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa093fff640 1 -- 172.21.15.159:0/2370184579 learned_addr learned my addr 172.21.15.159:0/2370184579 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:57.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa09ad9d640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa09c100e20 0x7fa09c197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:57.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa09b59e640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa09c102ef0 0x7fa09c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:57.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa093fff640 1 -- 172.21.15.159:0/2370184579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa09c100e20 msgr2=0x7fa09c197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:57.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa093fff640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa09c100e20 0x7fa09c197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:57.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa093fff640 1 -- 172.21.15.159:0/2370184579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa09c102ef0 msgr2=0x7fa09c19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:57.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa093fff640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa09c102ef0 0x7fa09c19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:57.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa093fff640 1 -- 172.21.15.159:0/2370184579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c19c330 con 0x7fa09c102570 2024-09-19T06:45:57.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa093fff640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa09c102570 0x7fa09c1978c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa08400d770 tx=0x7fa08400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa098d99640 1 -- 172.21.15.159:0/2370184579 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084017070 con 0x7fa09c102570 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa098d99640 1 -- 172.21.15.159:0/2370184579 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa084005500 con 0x7fa09c102570 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c19c620 con 0x7fa09c102570 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa098d99640 1 -- 172.21.15.159:0/2370184579 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084004e00 con 0x7fa09c102570 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.779+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09c1a3f00 con 0x7fa09c102570 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.780+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa09c1072a0 con 0x7fa09c102570 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.782+0000 7fa098d99640 1 -- 172.21.15.159:0/2370184579 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa084004fa0 con 0x7fa09c102570 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.782+0000 7fa098d99640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa0880a32d0 0x7fa0880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.782+0000 7fa09ad9d640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa0880a32d0 0x7fa0880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.782+0000 7fa098d99640 1 -- 172.21.15.159:0/2370184579 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa0840cf520 con 0x7fa09c102570 2024-09-19T06:45:57.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.782+0000 7fa098d99640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] conn(0x7fa0880acf80 0x7fa0880af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.782+0000 7fa098d99640 1 -- 172.21.15.159:0/2370184579 --> [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa08401ee70 con 0x7fa0880acf80 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.783+0000 7fa098d99640 1 -- 172.21.15.159:0/2370184579 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fa0840cf970 con 0x7fa09c102570 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.783+0000 7fa09ad9d640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa0880a32d0 0x7fa0880a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009bd0 tx=0x7fa08c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.783+0000 7fa09b59e640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] conn(0x7fa0880acf80 0x7fa0880af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.783+0000 7fa09b59e640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] conn(0x7fa0880acf80 0x7fa0880af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.784+0000 7fa098d99640 1 -- 172.21.15.159:0/2370184579 <== osd.1 v2:172.21.15.189:6800/2297013449 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa08401ee70 con 0x7fa0880acf80 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.798+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 --> [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa09c1021b0 con 0x7fa0880acf80 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.798+0000 7fa098d99640 1 -- 172.21.15.159:0/2370184579 <== osd.1 v2:172.21.15.189:6800/2297013449 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa09c1021b0 con 0x7fa0880acf80 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.798+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 >> [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] conn(0x7fa0880acf80 msgr2=0x7fa0880af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.798+0000 7fa0a1159640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] conn(0x7fa0880acf80 0x7fa0880af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.798+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa0880a32d0 msgr2=0x7fa0880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.798+0000 7fa0a1159640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fa0880a32d0 0x7fa0880a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009bd0 tx=0x7fa08c005f90 comp rx=0 tx=0).stop 2024-09-19T06:45:57.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.798+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa09c102570 msgr2=0x7fa09c1978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:57.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.798+0000 7fa0a1159640 1 --2- 172.21.15.159:0/2370184579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa09c102570 0x7fa09c1978c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa08400d770 tx=0x7fa08400dc30 comp rx=0 tx=0).stop 2024-09-19T06:45:57.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.798+0000 7fa09b59e640 1 -- 172.21.15.159:0/2370184579 reap_dead start 2024-09-19T06:45:57.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.799+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 shutdown_connections 2024-09-19T06:45:57.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.799+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 >> 172.21.15.159:0/2370184579 conn(0x7fa09c0fc7d0 msgr2=0x7fa09c106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:57.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.799+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 shutdown_connections 2024-09-19T06:45:57.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:57.799+0000 7fa0a1159640 1 -- 172.21.15.159:0/2370184579 wait complete. 2024-09-19T06:45:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:58.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/2290489783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb48101df0 msgr2=0x7ffb481021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 --2- 172.21.15.159:0/2290489783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb48101df0 0x7ffb481021d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009ca0 tx=0x7ffb3802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/2290489783 shutdown_connections 2024-09-19T06:45:58.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 --2- 172.21.15.159:0/2290489783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb48106f20 0x7ffb4810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 --2- 172.21.15.159:0/2290489783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb481027a0 0x7ffb481067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 --2- 172.21.15.159:0/2290489783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb48101df0 0x7ffb481021d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/2290489783 >> 172.21.15.159:0/2290489783 conn(0x7ffb480fd8f0 msgr2=0x7ffb480ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:58.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/2290489783 shutdown_connections 2024-09-19T06:45:58.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/2290489783 wait complete. 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 Processor -- start 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.324+0000 7ffb4fbd7640 1 -- start start 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4fbd7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb48101df0 0x7ffb48198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4fbd7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb481027a0 0x7ffb48198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4fbd7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb48106f20 0x7ffb4819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4fbd7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48111f40 con 0x7ffb48106f20 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4fbd7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48111dc0 con 0x7ffb48101df0 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4fbd7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481120c0 con 0x7ffb481027a0 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4e174640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb48106f20 0x7ffb4819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4e174640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb48106f20 0x7ffb4819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48654/0 (socket says 172.21.15.159:48654) 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4e174640 1 -- 172.21.15.159:0/1910556574 learned_addr learned my addr 172.21.15.159:0/1910556574 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:45:58.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4d973640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb48101df0 0x7ffb48198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4d172640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb481027a0 0x7ffb48198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4e174640 1 -- 172.21.15.159:0/1910556574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb481027a0 msgr2=0x7ffb48198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4e174640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb481027a0 0x7ffb48198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4e174640 1 -- 172.21.15.159:0/1910556574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb48101df0 msgr2=0x7ffb48198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4e174640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb48101df0 0x7ffb48198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4e174640 1 -- 172.21.15.159:0/1910556574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4819d4d0 con 0x7ffb48106f20 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4e174640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb48106f20 0x7ffb4819cdf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000c970 tx=0x7ffb4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb46ffd640 1 -- 172.21.15.159:0/1910556574 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40007bb0 con 0x7ffb48106f20 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb46ffd640 1 -- 172.21.15.159:0/1910556574 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb40007d50 con 0x7ffb48106f20 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4819d7c0 con 0x7ffb48106f20 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb46ffd640 1 -- 172.21.15.159:0/1910556574 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000f450 con 0x7ffb48106f20 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.325+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb481a50a0 con 0x7ffb48106f20 2024-09-19T06:45:58.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.326+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb48062900 con 0x7ffb48106f20 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.327+0000 7ffb46ffd640 1 -- 172.21.15.159:0/1910556574 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ffb40004f60 con 0x7ffb48106f20 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.328+0000 7ffb46ffd640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffb300a32d0 0x7ffb300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.328+0000 7ffb4d973640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffb300a32d0 0x7ffb300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.328+0000 7ffb46ffd640 1 -- 172.21.15.159:0/1910556574 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffb400cf820 con 0x7ffb48106f20 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.328+0000 7ffb46ffd640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] conn(0x7ffb300acf80 0x7ffb300af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.328+0000 7ffb46ffd640 1 -- 172.21.15.159:0/1910556574 --> [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb40004490 con 0x7ffb300acf80 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.328+0000 7ffb46ffd640 1 -- 172.21.15.159:0/1910556574 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ffb400d42c0 con 0x7ffb48106f20 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.328+0000 7ffb4d973640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffb300a32d0 0x7ffb300a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb38000f80 tx=0x7ffb380093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.329+0000 7ffb4d172640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] conn(0x7ffb300acf80 0x7ffb300af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.329+0000 7ffb4d172640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] conn(0x7ffb300acf80 0x7ffb300af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.330+0000 7ffb46ffd640 1 -- 172.21.15.159:0/1910556574 <== osd.2 v2:172.21.15.203:6800/3236164718 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb40004490 con 0x7ffb300acf80 2024-09-19T06:45:58.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.343+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 --> [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffb48062d80 con 0x7ffb300acf80 2024-09-19T06:45:58.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb46ffd640 1 -- 172.21.15.159:0/1910556574 <== osd.2 v2:172.21.15.203:6800/3236164718 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffb48062d80 con 0x7ffb300acf80 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 >> [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] conn(0x7ffb300acf80 msgr2=0x7ffb300af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] conn(0x7ffb300acf80 0x7ffb300af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffb300a32d0 msgr2=0x7ffb300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffb300a32d0 0x7ffb300a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb38000f80 tx=0x7ffb380093f0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb48106f20 msgr2=0x7ffb4819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 --2- 172.21.15.159:0/1910556574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb48106f20 0x7ffb4819cdf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000c970 tx=0x7ffb4000ce30 comp rx=0 tx=0).stop 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4e174640 1 -- 172.21.15.159:0/1910556574 reap_dead start 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 shutdown_connections 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 >> 172.21.15.159:0/1910556574 conn(0x7ffb480fd8f0 msgr2=0x7ffb480fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:58.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 shutdown_connections 2024-09-19T06:45:58.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:58.344+0000 7ffb4fbd7640 1 -- 172.21.15.159:0/1910556574 wait complete. 2024-09-19T06:45:58.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:45:58 smithi203 ceph-mon[35473]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:45:58.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:45:58 smithi189 ceph-mon[34880]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:45:58.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:45:58 smithi159 ceph-mon[30935]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:45:59.096 INFO:teuthology.orchestra.run.smithi159.stdout:68719476802 2024-09-19T06:45:59.097 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T06:45:59.525 INFO:teuthology.orchestra.run.smithi159.stdout:261993005086 2024-09-19T06:45:59.526 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T06:46:00.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.983+0000 7f209d1ee640 1 -- 172.21.15.159:0/2691540165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2098101de0 msgr2=0x7f20981021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.983+0000 7f209d1ee640 1 --2- 172.21.15.159:0/2691540165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2098101de0 0x7f20981021c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2080009900 tx=0x7f208002a410 comp rx=0 tx=0).stop 2024-09-19T06:46:00.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.983+0000 7f209d1ee640 1 -- 172.21.15.159:0/2691540165 shutdown_connections 2024-09-19T06:46:00.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.983+0000 7f209d1ee640 1 --2- 172.21.15.159:0/2691540165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2098106f10 0x7f209810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.983+0000 7f209d1ee640 1 --2- 172.21.15.159:0/2691540165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098102790 0x7f20981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.983+0000 7f209d1ee640 1 --2- 172.21.15.159:0/2691540165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2098101de0 0x7f20981021c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.983+0000 7f209d1ee640 1 -- 172.21.15.159:0/2691540165 >> 172.21.15.159:0/2691540165 conn(0x7f20980fd8c0 msgr2=0x7f20980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.983+0000 7f209d1ee640 1 -- 172.21.15.159:0/2691540165 shutdown_connections 2024-09-19T06:46:00.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.983+0000 7f209d1ee640 1 -- 172.21.15.159:0/2691540165 wait complete. 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f209d1ee640 1 Processor -- start 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f209d1ee640 1 -- start start 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f209d1ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2098101de0 0x7f2098198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f209d1ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098102790 0x7f2098198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f209d1ee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2098106f10 0x7f209819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f209d1ee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2098111f30 con 0x7f2098101de0 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f209d1ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2098111db0 con 0x7f2098102790 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f209d1ee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f20981120b0 con 0x7f2098106f10 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f2096d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2098101de0 0x7f2098198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f2096d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2098101de0 0x7f2098198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53852/0 (socket says 172.21.15.159:53852) 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f2096d9d640 1 -- 172.21.15.159:0/4289004572 learned_addr learned my addr 172.21.15.159:0/4289004572 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.984+0000 7f209659c640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098102790 0x7f2098198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f209759e640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2098106f10 0x7f209819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f2096d9d640 1 -- 172.21.15.159:0/4289004572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2098106f10 msgr2=0x7f209819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f2096d9d640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2098106f10 0x7f209819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f2096d9d640 1 -- 172.21.15.159:0/4289004572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098102790 msgr2=0x7f2098198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f2096d9d640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098102790 0x7f2098198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f2096d9d640 1 -- 172.21.15.159:0/4289004572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209819d2c0 con 0x7f2098101de0 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f209659c640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2098102790 0x7f2098198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f209759e640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2098106f10 0x7f209819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f2096d9d640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2098101de0 0x7f2098198310 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2080005ab0 tx=0x7f20800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f208ffff640 1 -- 172.21.15.159:0/4289004572 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208003f030 con 0x7f2098101de0 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209819d550 con 0x7f2098101de0 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f208ffff640 1 -- 172.21.15.159:0/4289004572 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2080003ce0 con 0x7f2098101de0 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f208ffff640 1 -- 172.21.15.159:0/4289004572 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080035070 con 0x7f2098101de0 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.985+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20981a4e90 con 0x7f2098101de0 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.986+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20980fefa0 con 0x7f2098101de0 2024-09-19T06:46:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.987+0000 7f208ffff640 1 -- 172.21.15.159:0/4289004572 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f2080042030 con 0x7f2098101de0 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.988+0000 7f208ffff640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f20840a32d0 0x7f20840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.988+0000 7f209659c640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f20840a32d0 0x7f20840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.988+0000 7f208ffff640 1 -- 172.21.15.159:0/4289004572 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f20800f0750 con 0x7f2098101de0 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.988+0000 7f208ffff640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] conn(0x7f20840acf80 0x7f20840af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.988+0000 7f208ffff640 1 -- 172.21.15.159:0/4289004572 --> [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2080003b30 con 0x7f20840acf80 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.988+0000 7f208ffff640 1 -- 172.21.15.159:0/4289004572 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f20800f0ba0 con 0x7f2098101de0 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.989+0000 7f209659c640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f20840a32d0 0x7f20840a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2098108880 tx=0x7f208800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.989+0000 7f209759e640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] conn(0x7f20840acf80 0x7f20840af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.989+0000 7f209759e640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] conn(0x7f20840acf80 0x7f20840af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:45:59.990+0000 7f208ffff640 1 -- 172.21.15.159:0/4289004572 <== osd.10 v2:172.21.15.189:6824/274384931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2080003b30 con 0x7f20840acf80 2024-09-19T06:46:00.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.003+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 --> [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20981032c0 con 0x7f20840acf80 2024-09-19T06:46:00.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f208ffff640 1 -- 172.21.15.159:0/4289004572 <== osd.10 v2:172.21.15.189:6824/274384931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f20981032c0 con 0x7f20840acf80 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 >> [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] conn(0x7f20840acf80 msgr2=0x7f20840af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f209d1ee640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] conn(0x7f20840acf80 0x7f20840af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f20840a32d0 msgr2=0x7f20840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f209d1ee640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f20840a32d0 0x7f20840a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2098108880 tx=0x7f208800a5c0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2098101de0 msgr2=0x7f2098198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f209d1ee640 1 --2- 172.21.15.159:0/4289004572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2098101de0 0x7f2098198310 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2080005ab0 tx=0x7f20800042f0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f209759e640 1 -- 172.21.15.159:0/4289004572 reap_dead start 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 shutdown_connections 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.004+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 >> 172.21.15.159:0/4289004572 conn(0x7f20980fd8c0 msgr2=0x7f20980ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.005+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 shutdown_connections 2024-09-19T06:46:00.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.005+0000 7f209d1ee640 1 -- 172.21.15.159:0/4289004572 wait complete. 2024-09-19T06:46:00.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 -- 172.21.15.159:0/414173585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd18102ef0 msgr2=0x7fdd1810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 --2- 172.21.15.159:0/414173585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd18102ef0 0x7fdd1810da40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009ca0 tx=0x7fdd1402a950 comp rx=0 tx=0).stop 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 -- 172.21.15.159:0/414173585 shutdown_connections 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 --2- 172.21.15.159:0/414173585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd18102ef0 0x7fdd1810da40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 --2- 172.21.15.159:0/414173585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd18102570 0x7fdd181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 --2- 172.21.15.159:0/414173585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd18100e20 0x7fdd18101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 -- 172.21.15.159:0/414173585 >> 172.21.15.159:0/414173585 conn(0x7fdd180fc7d0 msgr2=0x7fdd180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 -- 172.21.15.159:0/414173585 shutdown_connections 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 -- 172.21.15.159:0/414173585 wait complete. 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.186+0000 7fdd20598640 1 Processor -- start 2024-09-19T06:46:00.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd20598640 1 -- start start 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd20598640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd18100e20 0x7fdd180fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd20598640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd18102570 0x7fdd180fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd20598640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd18102ef0 0x7fdd180fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd20598640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdd18110f80 con 0x7fdd18100e20 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd20598640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd18110e00 con 0x7fdd18102570 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd20598640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdd18111100 con 0x7fdd18102ef0 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1e334640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd18100e20 0x7fdd180fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1e334640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd18100e20 0x7fdd180fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53870/0 (socket says 172.21.15.159:53870) 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1e334640 1 -- 172.21.15.159:0/678020281 learned_addr learned my addr 172.21.15.159:0/678020281 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1db33640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd18102570 0x7fdd180fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1eb35640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd18102ef0 0x7fdd180fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1e334640 1 -- 172.21.15.159:0/678020281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd18102ef0 msgr2=0x7fdd180fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1e334640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd18102ef0 0x7fdd180fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1e334640 1 -- 172.21.15.159:0/678020281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd18102570 msgr2=0x7fdd180fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1e334640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd18102570 0x7fdd180fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1e334640 1 -- 172.21.15.159:0/678020281 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd181a6910 con 0x7fdd18100e20 2024-09-19T06:46:00.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd1e334640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd18100e20 0x7fdd180fcc80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000d950 tx=0x7fdd1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd0f7fe640 1 -- 172.21.15.159:0/678020281 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10017070 con 0x7fdd18100e20 2024-09-19T06:46:00.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd0f7fe640 1 -- 172.21.15.159:0/678020281 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd10009c30 con 0x7fdd18100e20 2024-09-19T06:46:00.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd181a6c00 con 0x7fdd18100e20 2024-09-19T06:46:00.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.187+0000 7fdd0f7fe640 1 -- 172.21.15.159:0/678020281 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000f6b0 con 0x7fdd18100e20 2024-09-19T06:46:00.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.188+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd181a7140 con 0x7fdd18100e20 2024-09-19T06:46:00.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.188+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd18062940 con 0x7fdd18100e20 2024-09-19T06:46:00.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.190+0000 7fdd0f7fe640 1 -- 172.21.15.159:0/678020281 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fdd100109d0 con 0x7fdd18100e20 2024-09-19T06:46:00.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.190+0000 7fdd0f7fe640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fdd040a32d0 0x7fdd040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.190+0000 7fdd1db33640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fdd040a32d0 0x7fdd040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.190+0000 7fdd0f7fe640 1 -- 172.21.15.159:0/678020281 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fdd100cfad0 con 0x7fdd18100e20 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.191+0000 7fdd0f7fe640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] conn(0x7fdd040acf80 0x7fdd040af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.191+0000 7fdd0f7fe640 1 -- 172.21.15.159:0/678020281 --> [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd10016ec0 con 0x7fdd040acf80 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.191+0000 7fdd0f7fe640 1 -- 172.21.15.159:0/678020281 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fdd100cff20 con 0x7fdd18100e20 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.191+0000 7fdd1db33640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fdd040a32d0 0x7fdd040a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdd180fe710 tx=0x7fdd0800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.191+0000 7fdd1eb35640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] conn(0x7fdd040acf80 0x7fdd040af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.191+0000 7fdd1eb35640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] conn(0x7fdd040acf80 0x7fdd040af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.192+0000 7fdd0f7fe640 1 -- 172.21.15.159:0/678020281 <== osd.11 v2:172.21.15.203:6824/4150435701 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd10016ec0 con 0x7fdd040acf80 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.205+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 --> [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd18062dc0 con 0x7fdd040acf80 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd0f7fe640 1 -- 172.21.15.159:0/678020281 <== osd.11 v2:172.21.15.203:6824/4150435701 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdd18062dc0 con 0x7fdd040acf80 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 >> [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] conn(0x7fdd040acf80 msgr2=0x7fdd040af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] conn(0x7fdd040acf80 0x7fdd040af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fdd040a32d0 msgr2=0x7fdd040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fdd040a32d0 0x7fdd040a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdd180fe710 tx=0x7fdd0800b410 comp rx=0 tx=0).stop 2024-09-19T06:46:00.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd18100e20 msgr2=0x7fdd180fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 --2- 172.21.15.159:0/678020281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd18100e20 0x7fdd180fcc80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000d950 tx=0x7fdd1000de10 comp rx=0 tx=0).stop 2024-09-19T06:46:00.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd1eb35640 1 -- 172.21.15.159:0/678020281 reap_dead start 2024-09-19T06:46:00.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 shutdown_connections 2024-09-19T06:46:00.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 >> 172.21.15.159:0/678020281 conn(0x7fdd180fc7d0 msgr2=0x7fdd1806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 shutdown_connections 2024-09-19T06:46:00.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:00.206+0000 7fdd20598640 1 -- 172.21.15.159:0/678020281 wait complete. 2024-09-19T06:46:00.774 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:00 smithi159 ceph-mon[30935]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:46:00.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:00 smithi203 ceph-mon[35473]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:46:00.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:00 smithi189 ceph-mon[34880]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:46:01.932 INFO:teuthology.orchestra.run.smithi159.stdout:283467841561 2024-09-19T06:46:01.933 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T06:46:02.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 -- 172.21.15.159:0/3442189734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda08101420 msgr2=0x7fda0810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 --2- 172.21.15.159:0/3442189734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda08101420 0x7fda0810d950 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fda00009cd0 tx=0x7fda0002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 -- 172.21.15.159:0/3442189734 shutdown_connections 2024-09-19T06:46:02.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 --2- 172.21.15.159:0/3442189734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda08101420 0x7fda0810d950 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 --2- 172.21.15.159:0/3442189734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda08100a80 0x7fda08100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 --2- 172.21.15.159:0/3442189734 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda08106a80 0x7fda08106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 -- 172.21.15.159:0/3442189734 >> 172.21.15.159:0/3442189734 conn(0x7fda080fc7a0 msgr2=0x7fda080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:02.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 -- 172.21.15.159:0/3442189734 shutdown_connections 2024-09-19T06:46:02.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 -- 172.21.15.159:0/3442189734 wait complete. 2024-09-19T06:46:02.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 Processor -- start 2024-09-19T06:46:02.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.095+0000 7fda0e689640 1 -- start start 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda0e689640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda08100a80 0x7fda080fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda0e689640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda08101420 0x7fda080fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda0e689640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda08106a80 0x7fda080fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda0e689640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fda08110e80 con 0x7fda08100a80 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda0e689640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda08110d00 con 0x7fda08106a80 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda0e689640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fda08111000 con 0x7fda08101420 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda07fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda08100a80 0x7fda080fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda07fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda08100a80 0x7fda080fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53876/0 (socket says 172.21.15.159:53876) 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda07fff640 1 -- 172.21.15.159:0/1511500314 learned_addr learned my addr 172.21.15.159:0/1511500314 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:02.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda0cc26640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda08106a80 0x7fda080fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda077fe640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda08101420 0x7fda080fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda07fff640 1 -- 172.21.15.159:0/1511500314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda08101420 msgr2=0x7fda080fd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda07fff640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda08101420 0x7fda080fd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda07fff640 1 -- 172.21.15.159:0/1511500314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda08106a80 msgr2=0x7fda080fd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda07fff640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda08106a80 0x7fda080fd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda07fff640 1 -- 172.21.15.159:0/1511500314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda081a68f0 con 0x7fda08100a80 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda077fe640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda08101420 0x7fda080fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda07fff640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda08100a80 0x7fda080fcd30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c970 tx=0x7fd9f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda057fa640 1 -- 172.21.15.159:0/1511500314 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8007bb0 con 0x7fda08100a80 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda081a6be0 con 0x7fda08100a80 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.096+0000 7fda057fa640 1 -- 172.21.15.159:0/1511500314 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f8007d50 con 0x7fda08100a80 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.097+0000 7fda057fa640 1 -- 172.21.15.159:0/1511500314 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f800f450 con 0x7fda08100a80 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.097+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda081a7120 con 0x7fda08100a80 2024-09-19T06:46:02.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.097+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda080628c0 con 0x7fda08100a80 2024-09-19T06:46:02.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.099+0000 7fda057fa640 1 -- 172.21.15.159:0/1511500314 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd9f8004fa0 con 0x7fda08100a80 2024-09-19T06:46:02.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.099+0000 7fda057fa640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd9f00a32d0 0x7fd9f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.100+0000 7fda077fe640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd9f00a32d0 0x7fd9f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.100+0000 7fda057fa640 1 -- 172.21.15.159:0/1511500314 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd9f80cfcb0 con 0x7fda08100a80 2024-09-19T06:46:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.100+0000 7fda057fa640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] conn(0x7fd9f00acf80 0x7fd9f00af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.100+0000 7fda057fa640 1 -- 172.21.15.159:0/1511500314 --> [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9f8012ec0 con 0x7fd9f00acf80 2024-09-19T06:46:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.100+0000 7fda057fa640 1 -- 172.21.15.159:0/1511500314 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fd9f80d0100 con 0x7fda08100a80 2024-09-19T06:46:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.100+0000 7fda0cc26640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] conn(0x7fd9f00acf80 0x7fd9f00af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.100+0000 7fda077fe640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd9f00a32d0 0x7fd9f00a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fda080fe7c0 tx=0x7fd9fc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:02.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.100+0000 7fda0cc26640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] conn(0x7fd9f00acf80 0x7fd9f00af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:02.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.101+0000 7fda057fa640 1 -- 172.21.15.159:0/1511500314 <== osd.3 v2:172.21.15.159:6810/1022245465 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9f8012ec0 con 0x7fd9f00acf80 2024-09-19T06:46:02.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.115+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 --> [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fda08062cc0 con 0x7fd9f00acf80 2024-09-19T06:46:02.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.115+0000 7fda057fa640 1 -- 172.21.15.159:0/1511500314 <== osd.3 v2:172.21.15.159:6810/1022245465 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fda08062cc0 con 0x7fd9f00acf80 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.115+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] conn(0x7fd9f00acf80 msgr2=0x7fd9f00af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.115+0000 7fda0e689640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] conn(0x7fd9f00acf80 0x7fd9f00af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.116+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd9f00a32d0 msgr2=0x7fd9f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.116+0000 7fda0e689640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd9f00a32d0 0x7fd9f00a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fda080fe7c0 tx=0x7fd9fc005d90 comp rx=0 tx=0).stop 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.116+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda08100a80 msgr2=0x7fda080fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.116+0000 7fda0e689640 1 --2- 172.21.15.159:0/1511500314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda08100a80 0x7fda080fcd30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c970 tx=0x7fd9f800ce30 comp rx=0 tx=0).stop 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.116+0000 7fda0cc26640 1 -- 172.21.15.159:0/1511500314 reap_dead start 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.116+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 shutdown_connections 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.116+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 >> 172.21.15.159:0/1511500314 conn(0x7fda080fc7a0 msgr2=0x7fda0806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.116+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 shutdown_connections 2024-09-19T06:46:02.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.116+0000 7fda0e689640 1 -- 172.21.15.159:0/1511500314 wait complete. 2024-09-19T06:46:02.771 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:02 smithi159 ceph-mon[30935]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T06:46:02.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.769+0000 7f8b9daa8640 1 -- 172.21.15.159:0/1775650302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b98100e20 msgr2=0x7f8b98101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.770+0000 7f8b9daa8640 1 --2- 172.21.15.159:0/1775650302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b98100e20 0x7f8b98101200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009900 tx=0x7f8b8802a480 comp rx=0 tx=0).stop 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.770+0000 7f8b9daa8640 1 -- 172.21.15.159:0/1775650302 shutdown_connections 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.770+0000 7f8b9daa8640 1 --2- 172.21.15.159:0/1775650302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b98102ef0 0x7f8b9810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.770+0000 7f8b9daa8640 1 --2- 172.21.15.159:0/1775650302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102570 0x7f8b981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.770+0000 7f8b9daa8640 1 --2- 172.21.15.159:0/1775650302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b98100e20 0x7f8b98101200 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.770+0000 7f8b9daa8640 1 -- 172.21.15.159:0/1775650302 >> 172.21.15.159:0/1775650302 conn(0x7f8b980fc7d0 msgr2=0x7f8b980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.770+0000 7f8b9daa8640 1 -- 172.21.15.159:0/1775650302 shutdown_connections 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.770+0000 7f8b9daa8640 1 -- 172.21.15.159:0/1775650302 wait complete. 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.770+0000 7f8b9daa8640 1 Processor -- start 2024-09-19T06:46:02.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b9daa8640 1 -- start start 2024-09-19T06:46:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b9daa8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b98100e20 0x7f8b98197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b9daa8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b98102570 0x7f8b98197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b9daa8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102ef0 0x7f8b9819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b9daa8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8b98110fa0 con 0x7f8b98102570 2024-09-19T06:46:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b9daa8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8b98110e20 con 0x7f8b98102ef0 2024-09-19T06:46:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b9daa8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8b98111120 con 0x7f8b98100e20 2024-09-19T06:46:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b96ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b98102570 0x7f8b98197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b96ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b98102570 0x7f8b98197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53926/0 (socket says 172.21.15.159:53926) 2024-09-19T06:46:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b96ffd640 1 -- 172.21.15.159:0/2704070181 learned_addr learned my addr 172.21.15.159:0/2704070181 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b977fe640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b98100e20 0x7f8b98197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b97fff640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102ef0 0x7f8b9819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b96ffd640 1 -- 172.21.15.159:0/2704070181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b98100e20 msgr2=0x7f8b98197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b96ffd640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b98100e20 0x7f8b98197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b96ffd640 1 -- 172.21.15.159:0/2704070181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102ef0 msgr2=0x7f8b9819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b96ffd640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b98102ef0 0x7f8b9819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b96ffd640 1 -- 172.21.15.159:0/2704070181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9819c3f0 con 0x7f8b98102570 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.771+0000 7f8b977fe640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b98100e20 0x7f8b98197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.772+0000 7f8b96ffd640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b98102570 0x7f8b98197980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009970 tx=0x7f8b8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.772+0000 7f8b94ff9640 1 -- 172.21.15.159:0/2704070181 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00d020 con 0x7f8b98102570 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.772+0000 7f8b94ff9640 1 -- 172.21.15.159:0/2704070181 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b8c007d40 con 0x7f8b98102570 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.772+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9819c6e0 con 0x7f8b98102570 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.772+0000 7f8b94ff9640 1 -- 172.21.15.159:0/2704070181 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00ccc0 con 0x7f8b98102570 2024-09-19T06:46:02.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.772+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b98069f70 con 0x7f8b98102570 2024-09-19T06:46:02.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.773+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b9806a490 con 0x7f8b98102570 2024-09-19T06:46:02.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.775+0000 7f8b94ff9640 1 -- 172.21.15.159:0/2704070181 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f8b8c00c460 con 0x7f8b98102570 2024-09-19T06:46:02.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.776+0000 7f8b94ff9640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8b800a3350 0x7f8b800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.777+0000 7f8b977fe640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8b800a3350 0x7f8b800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.777+0000 7f8b94ff9640 1 -- 172.21.15.159:0/2704070181 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8b8c0d16c0 con 0x7f8b98102570 2024-09-19T06:46:02.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.777+0000 7f8b94ff9640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] conn(0x7f8b800ad000 0x7f8b800af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:02.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.777+0000 7f8b94ff9640 1 -- 172.21.15.159:0/2704070181 --> [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b800afb70 con 0x7f8b800ad000 2024-09-19T06:46:02.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.777+0000 7f8b94ff9640 1 -- 172.21.15.159:0/2704070181 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f8b8c0d1a70 con 0x7f8b98102570 2024-09-19T06:46:02.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.777+0000 7f8b97fff640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] conn(0x7f8b800ad000 0x7f8b800af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:02.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.777+0000 7f8b977fe640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8b800a3350 0x7f8b800a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b88005ab0 tx=0x7f8b88005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:02.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.778+0000 7f8b97fff640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] conn(0x7f8b800ad000 0x7f8b800af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:02.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.779+0000 7f8b94ff9640 1 -- 172.21.15.159:0/2704070181 <== osd.5 v2:172.21.15.203:6808/2510785256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b800afb70 con 0x7f8b800ad000 2024-09-19T06:46:02.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.794+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 --> [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b9806a890 con 0x7f8b800ad000 2024-09-19T06:46:02.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.794+0000 7f8b94ff9640 1 -- 172.21.15.159:0/2704070181 <== osd.5 v2:172.21.15.203:6808/2510785256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8b9806a890 con 0x7f8b800ad000 2024-09-19T06:46:02.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.794+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 >> [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] conn(0x7f8b800ad000 msgr2=0x7f8b800af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.794+0000 7f8b9daa8640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] conn(0x7f8b800ad000 0x7f8b800af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:02.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.794+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8b800a3350 msgr2=0x7f8b800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.794+0000 7f8b9daa8640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8b800a3350 0x7f8b800a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b88005ab0 tx=0x7f8b88005a20 comp rx=0 tx=0).stop 2024-09-19T06:46:02.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.794+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b98102570 msgr2=0x7f8b98197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:02.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.794+0000 7f8b9daa8640 1 --2- 172.21.15.159:0/2704070181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b98102570 0x7f8b98197980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009970 tx=0x7f8b8c009e30 comp rx=0 tx=0).stop 2024-09-19T06:46:02.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.794+0000 7f8b97fff640 1 -- 172.21.15.159:0/2704070181 reap_dead start 2024-09-19T06:46:02.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.795+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 shutdown_connections 2024-09-19T06:46:02.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.795+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 >> 172.21.15.159:0/2704070181 conn(0x7f8b980fc7d0 msgr2=0x7f8b980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:02.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.795+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 shutdown_connections 2024-09-19T06:46:02.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.795+0000 7f8b9daa8640 1 -- 172.21.15.159:0/2704070181 wait complete. 2024-09-19T06:46:02.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:02 smithi203 ceph-mon[35473]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T06:46:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:02 smithi189 ceph-mon[34880]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T06:46:03.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.665+0000 7f5244051640 1 -- 172.21.15.159:0/3483992701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f523c102da0 msgr2=0x7f523c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.665+0000 7f5244051640 1 --2- 172.21.15.159:0/3483992701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f523c102da0 0x7f523c103180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5238009900 tx=0x7f523802a480 comp rx=0 tx=0).stop 2024-09-19T06:46:03.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.665+0000 7f5244051640 1 -- 172.21.15.159:0/3483992701 shutdown_connections 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.665+0000 7f5244051640 1 --2- 172.21.15.159:0/3483992701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f523c10c180 0x7f523c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.665+0000 7f5244051640 1 --2- 172.21.15.159:0/3483992701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f523c1036c0 0x7f523c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.665+0000 7f5244051640 1 --2- 172.21.15.159:0/3483992701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f523c102da0 0x7f523c103180 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.665+0000 7f5244051640 1 -- 172.21.15.159:0/3483992701 >> 172.21.15.159:0/3483992701 conn(0x7f523c0fc7a0 msgr2=0x7f523c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.665+0000 7f5244051640 1 -- 172.21.15.159:0/3483992701 shutdown_connections 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.665+0000 7f5244051640 1 -- 172.21.15.159:0/3483992701 wait complete. 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5244051640 1 Processor -- start 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5244051640 1 -- start start 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5244051640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f523c102da0 0x7f523c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5244051640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f523c1036c0 0x7f523c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5244051640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f523c10c180 0x7f523c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5244051640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f523c111fa0 con 0x7f523c1036c0 2024-09-19T06:46:03.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5244051640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f523c111e20 con 0x7f523c10c180 2024-09-19T06:46:03.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5244051640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f523c112120 con 0x7f523c102da0 2024-09-19T06:46:03.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f52415ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f523c1036c0 0x7f523c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f52415ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f523c1036c0 0x7f523c100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53902/0 (socket says 172.21.15.159:53902) 2024-09-19T06:46:03.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f52415ec640 1 -- 172.21.15.159:0/3931220356 learned_addr learned my addr 172.21.15.159:0/3931220356 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:03.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5241ded640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f523c102da0 0x7f523c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f52415ec640 1 -- 172.21.15.159:0/3931220356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f523c102da0 msgr2=0x7f523c100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f52415ec640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f523c102da0 0x7f523c100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f52415ec640 1 -- 172.21.15.159:0/3931220356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f523c10c180 msgr2=0x7f523c101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f52415ec640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f523c10c180 0x7f523c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f52415ec640 1 -- 172.21.15.159:0/3931220356 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523c1a69a0 con 0x7f523c1036c0 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.666+0000 7f5241ded640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f523c102da0 0x7f523c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.667+0000 7f52415ec640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f523c1036c0 0x7f523c100f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f522c00b4a0 tx=0x7f522c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.667+0000 7f5232ffd640 1 -- 172.21.15.159:0/3931220356 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c014070 con 0x7f523c1036c0 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.667+0000 7f5232ffd640 1 -- 172.21.15.159:0/3931220356 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f522c010af0 con 0x7f523c1036c0 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.667+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f523c1a6c90 con 0x7f523c1036c0 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.667+0000 7f5232ffd640 1 -- 172.21.15.159:0/3931220356 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c017d10 con 0x7f523c1036c0 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.667+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f523c1a7180 con 0x7f523c1036c0 2024-09-19T06:46:03.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.668+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f523c062900 con 0x7f523c1036c0 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.669+0000 7f5232ffd640 1 -- 172.21.15.159:0/3931220356 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f522c017070 con 0x7f523c1036c0 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.670+0000 7f5232ffd640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f52280a3350 0x7f52280a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.670+0000 7f5241ded640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f52280a3350 0x7f52280a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.670+0000 7f5232ffd640 1 -- 172.21.15.159:0/3931220356 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f522c0cf180 con 0x7f523c1036c0 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.670+0000 7f5232ffd640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] conn(0x7f52280ad000 0x7f52280af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.670+0000 7f5232ffd640 1 -- 172.21.15.159:0/3931220356 --> [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52280afb70 con 0x7f52280ad000 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.670+0000 7f5232ffd640 1 -- 172.21.15.159:0/3931220356 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f522c0cf5d0 con 0x7f523c1036c0 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.670+0000 7f5241ded640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f52280a3350 0x7f52280a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5238000c00 tx=0x7f5238032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.670+0000 7f52425ee640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] conn(0x7f52280ad000 0x7f52280af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.671+0000 7f52425ee640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] conn(0x7f52280ad000 0x7f52280af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.671+0000 7f5232ffd640 1 -- 172.21.15.159:0/3931220356 <== osd.4 v2:172.21.15.189:6808/3807984659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52280afb70 con 0x7f52280ad000 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.686+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 --> [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f523c062d80 con 0x7f52280ad000 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.686+0000 7f5232ffd640 1 -- 172.21.15.159:0/3931220356 <== osd.4 v2:172.21.15.189:6808/3807984659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f523c062d80 con 0x7f52280ad000 2024-09-19T06:46:03.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 >> [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] conn(0x7f52280ad000 msgr2=0x7f52280af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] conn(0x7f52280ad000 0x7f52280af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f52280a3350 msgr2=0x7f52280a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f52280a3350 0x7f52280a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5238000c00 tx=0x7f5238032d50 comp rx=0 tx=0).stop 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f523c1036c0 msgr2=0x7f523c100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 --2- 172.21.15.159:0/3931220356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f523c1036c0 0x7f523c100f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f522c00b4a0 tx=0x7f522c00b960 comp rx=0 tx=0).stop 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f52425ee640 1 -- 172.21.15.159:0/3931220356 reap_dead start 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 shutdown_connections 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 >> 172.21.15.159:0/3931220356 conn(0x7f523c0fc7a0 msgr2=0x7f523c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 shutdown_connections 2024-09-19T06:46:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.687+0000 7f5244051640 1 -- 172.21.15.159:0/3931220356 wait complete. 2024-09-19T06:46:04.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.983+0000 7f6307dd7640 1 -- 172.21.15.159:0/3452415246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6300102790 msgr2=0x7f63001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.983+0000 7f6307dd7640 1 --2- 172.21.15.159:0/3452415246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6300102790 0x7f63001067e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009900 tx=0x7f62f002a410 comp rx=0 tx=0).stop 2024-09-19T06:46:04.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.983+0000 7f6307dd7640 1 -- 172.21.15.159:0/3452415246 shutdown_connections 2024-09-19T06:46:04.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.983+0000 7f6307dd7640 1 --2- 172.21.15.159:0/3452415246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6300106f10 0x7f630010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.983+0000 7f6307dd7640 1 --2- 172.21.15.159:0/3452415246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6300102790 0x7f63001067e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.983+0000 7f6307dd7640 1 --2- 172.21.15.159:0/3452415246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6300101de0 0x7f63001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.983+0000 7f6307dd7640 1 -- 172.21.15.159:0/3452415246 >> 172.21.15.159:0/3452415246 conn(0x7f63000fd8c0 msgr2=0x7f63000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:04.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.983+0000 7f6307dd7640 1 -- 172.21.15.159:0/3452415246 shutdown_connections 2024-09-19T06:46:04.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.983+0000 7f6307dd7640 1 -- 172.21.15.159:0/3452415246 wait complete. 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6307dd7640 1 Processor -- start 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6307dd7640 1 -- start start 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6307dd7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6300101de0 0x7f6300198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6307dd7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6300102790 0x7f63001989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6307dd7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6300106f10 0x7f630019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6307dd7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6300111f70 con 0x7f6300102790 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6307dd7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6300111df0 con 0x7f6300106f10 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6307dd7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f63001120f0 con 0x7f6300101de0 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6305372640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6300102790 0x7f63001989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6305372640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6300102790 0x7f63001989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53958/0 (socket says 172.21.15.159:53958) 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6305372640 1 -- 172.21.15.159:0/4232250184 learned_addr learned my addr 172.21.15.159:0/4232250184 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:04.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6306374640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6300106f10 0x7f630019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6305b73640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6300101de0 0x7f6300198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.984+0000 7f6305372640 1 -- 172.21.15.159:0/4232250184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6300101de0 msgr2=0x7f6300198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f6305372640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6300101de0 0x7f6300198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f6305372640 1 -- 172.21.15.159:0/4232250184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6300106f10 msgr2=0x7f630019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f6305372640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6300106f10 0x7f630019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f6305372640 1 -- 172.21.15.159:0/4232250184 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630019d420 con 0x7f6300102790 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f6306374640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6300106f10 0x7f630019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f6305372640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6300102790 0x7f63001989b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f62f0006010 tx=0x7f62f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f62f6ffd640 1 -- 172.21.15.159:0/4232250184 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f003f030 con 0x7f6300102790 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630019d6b0 con 0x7f6300102790 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f62f6ffd640 1 -- 172.21.15.159:0/4232250184 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62f0003ce0 con 0x7f6300102790 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f62f6ffd640 1 -- 172.21.15.159:0/4232250184 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0035070 con 0x7f6300102790 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.985+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63001a4ff0 con 0x7f6300102790 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.986+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6300062940 con 0x7f6300102790 2024-09-19T06:46:04.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.987+0000 7f62f6ffd640 1 -- 172.21.15.159:0/4232250184 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f62f0042030 con 0x7f6300102790 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.988+0000 7f62f6ffd640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f62ec0a32d0 0x7f62ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.988+0000 7f6305b73640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f62ec0a32d0 0x7f62ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.988+0000 7f62f6ffd640 1 -- 172.21.15.159:0/4232250184 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f62f00f07d0 con 0x7f6300102790 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.988+0000 7f62f6ffd640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] conn(0x7f62ec0acf80 0x7f62ec0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.988+0000 7f62f6ffd640 1 -- 172.21.15.159:0/4232250184 --> [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62f0040e70 con 0x7f62ec0acf80 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.988+0000 7f62f6ffd640 1 -- 172.21.15.159:0/4232250184 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f62f00f0c20 con 0x7f6300102790 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.988+0000 7f6306374640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] conn(0x7f62ec0acf80 0x7f62ec0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.988+0000 7f6305b73640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f62ec0a32d0 0x7f62ec0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f62fc005fd0 tx=0x7f62fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.988+0000 7f6306374640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] conn(0x7f62ec0acf80 0x7f62ec0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:02.989+0000 7f62f6ffd640 1 -- 172.21.15.159:0/4232250184 <== osd.6 v2:172.21.15.159:6818/46949645 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f62f0040e70 con 0x7f62ec0acf80 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.002+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 --> [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6300062d40 con 0x7f62ec0acf80 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f62f6ffd640 1 -- 172.21.15.159:0/4232250184 <== osd.6 v2:172.21.15.159:6818/46949645 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6300062d40 con 0x7f62ec0acf80 2024-09-19T06:46:04.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] conn(0x7f62ec0acf80 msgr2=0x7f62ec0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] conn(0x7f62ec0acf80 0x7f62ec0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f62ec0a32d0 msgr2=0x7f62ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f62ec0a32d0 0x7f62ec0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f62fc005fd0 tx=0x7f62fc005850 comp rx=0 tx=0).stop 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6300102790 msgr2=0x7f63001989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 --2- 172.21.15.159:0/4232250184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6300102790 0x7f63001989b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f62f0006010 tx=0x7f62f00042f0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6306374640 1 -- 172.21.15.159:0/4232250184 reap_dead start 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 shutdown_connections 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 >> 172.21.15.159:0/4232250184 conn(0x7f63000fd8c0 msgr2=0x7f63000fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 shutdown_connections 2024-09-19T06:46:04.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.003+0000 7f6307dd7640 1 -- 172.21.15.159:0/4232250184 wait complete. 2024-09-19T06:46:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.800+0000 7f4315eeb640 1 -- 172.21.15.159:0/324326008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4310102790 msgr2=0x7f43101067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.800+0000 7f4315eeb640 1 --2- 172.21.15.159:0/324326008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4310102790 0x7f43101067e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009900 tx=0x7f42f802a410 comp rx=0 tx=0).stop 2024-09-19T06:46:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 -- 172.21.15.159:0/324326008 shutdown_connections 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 --2- 172.21.15.159:0/324326008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4310106f10 0x7f431010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 --2- 172.21.15.159:0/324326008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4310102790 0x7f43101067e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 --2- 172.21.15.159:0/324326008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4310101de0 0x7f43101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 -- 172.21.15.159:0/324326008 >> 172.21.15.159:0/324326008 conn(0x7f43100fd8c0 msgr2=0x7f43100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 -- 172.21.15.159:0/324326008 shutdown_connections 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 -- 172.21.15.159:0/324326008 wait complete. 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 Processor -- start 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 -- start start 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.801+0000 7f4315eeb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4310101de0 0x7f43100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f4315eeb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4310102790 0x7f4310074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f4315eeb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4310106f10 0x7f4310074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f4315eeb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4310111f70 con 0x7f4310101de0 2024-09-19T06:46:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f4315eeb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4310111df0 con 0x7f4310102790 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f4315eeb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43101120f0 con 0x7f4310106f10 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4310101de0 0x7f43100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4310101de0 0x7f43100744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53968/0 (socket says 172.21.15.159:53968) 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430f7fe640 1 -- 172.21.15.159:0/2957306200 learned_addr learned my addr 172.21.15.159:0/2957306200 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430effd640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4310102790 0x7f4310074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430ffff640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4310106f10 0x7f4310074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430f7fe640 1 -- 172.21.15.159:0/2957306200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4310106f10 msgr2=0x7f4310074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430f7fe640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4310106f10 0x7f4310074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430f7fe640 1 -- 172.21.15.159:0/2957306200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4310102790 msgr2=0x7f4310074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430f7fe640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4310102790 0x7f4310074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430f7fe640 1 -- 172.21.15.159:0/2957306200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43101a6870 con 0x7f4310101de0 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430effd640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4310102790 0x7f4310074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430f7fe640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4310101de0 0x7f43100744f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f430000cce0 tx=0x7f430000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430cff9640 1 -- 172.21.15.159:0/2957306200 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300004b20 con 0x7f4310101de0 2024-09-19T06:46:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430cff9640 1 -- 172.21.15.159:0/2957306200 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4300004cc0 con 0x7f4310101de0 2024-09-19T06:46:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f430cff9640 1 -- 172.21.15.159:0/2957306200 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430000f7d0 con 0x7f4310101de0 2024-09-19T06:46:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43101a6b60 con 0x7f4310101de0 2024-09-19T06:46:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.802+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43101a70a0 con 0x7f4310101de0 2024-09-19T06:46:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.803+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f43100628c0 con 0x7f4310101de0 2024-09-19T06:46:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.804+0000 7f430cff9640 1 -- 172.21.15.159:0/2957306200 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f430000f970 con 0x7f4310101de0 2024-09-19T06:46:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.805+0000 7f430cff9640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f42fc0a32d0 0x7f42fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.805+0000 7f430effd640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f42fc0a32d0 0x7f42fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.805+0000 7f430cff9640 1 -- 172.21.15.159:0/2957306200 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f43000cffa0 con 0x7f4310101de0 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.805+0000 7f430cff9640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] conn(0x7f42fc0acf80 0x7f42fc0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.805+0000 7f430cff9640 1 -- 172.21.15.159:0/2957306200 --> [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42fc0afaf0 con 0x7f42fc0acf80 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.805+0000 7f430cff9640 1 -- 172.21.15.159:0/2957306200 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f43000d03f0 con 0x7f4310101de0 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.806+0000 7f430ffff640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] conn(0x7f42fc0acf80 0x7f42fc0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.806+0000 7f430effd640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f42fc0a32d0 0x7f42fc0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4310075f80 tx=0x7f42f8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.806+0000 7f430ffff640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] conn(0x7f42fc0acf80 0x7f42fc0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.807+0000 7f430cff9640 1 -- 172.21.15.159:0/2957306200 <== osd.0 v2:172.21.15.159:6802/2998326151 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42fc0afaf0 con 0x7f42fc0acf80 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.820+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 --> [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4310062d40 con 0x7f42fc0acf80 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.820+0000 7f430cff9640 1 -- 172.21.15.159:0/2957306200 <== osd.0 v2:172.21.15.159:6802/2998326151 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4310062d40 con 0x7f42fc0acf80 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.820+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] conn(0x7f42fc0acf80 msgr2=0x7f42fc0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.820+0000 7f4315eeb640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] conn(0x7f42fc0acf80 0x7f42fc0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:04.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.820+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f42fc0a32d0 msgr2=0x7f42fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.820+0000 7f4315eeb640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f42fc0a32d0 0x7f42fc0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4310075f80 tx=0x7f42f8005a20 comp rx=0 tx=0).stop 2024-09-19T06:46:04.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.820+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4310101de0 msgr2=0x7f43100744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:04.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.820+0000 7f4315eeb640 1 --2- 172.21.15.159:0/2957306200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4310101de0 0x7f43100744f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f430000cce0 tx=0x7f430000a620 comp rx=0 tx=0).stop 2024-09-19T06:46:04.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.821+0000 7f430ffff640 1 -- 172.21.15.159:0/2957306200 reap_dead start 2024-09-19T06:46:04.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.821+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 shutdown_connections 2024-09-19T06:46:04.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.821+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 >> 172.21.15.159:0/2957306200 conn(0x7f43100fd8c0 msgr2=0x7f43100fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:04.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.821+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 shutdown_connections 2024-09-19T06:46:04.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:03.821+0000 7f4315eeb640 1 -- 172.21.15.159:0/2957306200 wait complete. 2024-09-19T06:46:04.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:04 smithi159 ceph-mon[30935]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:46:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:04 smithi203 ceph-mon[35473]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:46:04.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:04 smithi189 ceph-mon[34880]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:46:05.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.291+0000 7fb777b9a640 1 -- 172.21.15.159:0/4238224728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb770101df0 msgr2=0x7fb7701021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.291+0000 7fb777b9a640 1 --2- 172.21.15.159:0/4238224728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb770101df0 0x7fb7701021d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb764009900 tx=0x7fb76402a410 comp rx=0 tx=0).stop 2024-09-19T06:46:05.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.291+0000 7fb777b9a640 1 -- 172.21.15.159:0/4238224728 shutdown_connections 2024-09-19T06:46:05.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.291+0000 7fb777b9a640 1 --2- 172.21.15.159:0/4238224728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb770106f20 0x7fb77010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.291+0000 7fb777b9a640 1 --2- 172.21.15.159:0/4238224728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7701027a0 0x7fb7701067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.291+0000 7fb777b9a640 1 --2- 172.21.15.159:0/4238224728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb770101df0 0x7fb7701021d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.291+0000 7fb777b9a640 1 -- 172.21.15.159:0/4238224728 >> 172.21.15.159:0/4238224728 conn(0x7fb7700fd8b0 msgr2=0x7fb7700ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 -- 172.21.15.159:0/4238224728 shutdown_connections 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 -- 172.21.15.159:0/4238224728 wait complete. 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 Processor -- start 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 -- start start 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb770101df0 0x7fb7700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7701027a0 0x7fb770074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb770106f20 0x7fb770074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb770111f80 con 0x7fb770106f20 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb770111e00 con 0x7fb7701027a0 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb777b9a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb770112100 con 0x7fb770101df0 2024-09-19T06:46:05.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb776137640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb770106f20 0x7fb770074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb776137640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb770106f20 0x7fb770074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53978/0 (socket says 172.21.15.159:53978) 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.292+0000 7fb776137640 1 -- 172.21.15.159:0/3964598003 learned_addr learned my addr 172.21.15.159:0/3964598003 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb775936640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb770101df0 0x7fb7700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb775135640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7701027a0 0x7fb770074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb776137640 1 -- 172.21.15.159:0/3964598003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb770101df0 msgr2=0x7fb7700744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb776137640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb770101df0 0x7fb7700744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb776137640 1 -- 172.21.15.159:0/3964598003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7701027a0 msgr2=0x7fb770074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb776137640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7701027a0 0x7fb770074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb776137640 1 -- 172.21.15.159:0/3964598003 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7701a6880 con 0x7fb770106f20 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb776137640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb770106f20 0x7fb770074f70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb76800cce0 tx=0x7fb76800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb762ffd640 1 -- 172.21.15.159:0/3964598003 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76800f450 con 0x7fb770106f20 2024-09-19T06:46:05.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7701a6b70 con 0x7fb770106f20 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb762ffd640 1 -- 172.21.15.159:0/3964598003 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb76800fad0 con 0x7fb770106f20 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb762ffd640 1 -- 172.21.15.159:0/3964598003 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768018c10 con 0x7fb770106f20 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.293+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7701a70b0 con 0x7fb770106f20 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.294+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7700628c0 con 0x7fb770106f20 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.295+0000 7fb762ffd640 1 -- 172.21.15.159:0/3964598003 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fb76800f5f0 con 0x7fb770106f20 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.296+0000 7fb762ffd640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb75c0a32d0 0x7fb75c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.296+0000 7fb775936640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb75c0a32d0 0x7fb75c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.296+0000 7fb762ffd640 1 -- 172.21.15.159:0/3964598003 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb7680d02e0 con 0x7fb770106f20 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.296+0000 7fb762ffd640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] conn(0x7fb75c0acf80 0x7fb75c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.296+0000 7fb762ffd640 1 -- 172.21.15.159:0/3964598003 --> [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb75c0afaf0 con 0x7fb75c0acf80 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.296+0000 7fb762ffd640 1 -- 172.21.15.159:0/3964598003 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fb7680d0730 con 0x7fb770106f20 2024-09-19T06:46:05.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.296+0000 7fb775936640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb75c0a32d0 0x7fb75c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb764009230 tx=0x7fb7640058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.297+0000 7fb775135640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] conn(0x7fb75c0acf80 0x7fb75c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.297+0000 7fb775135640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] conn(0x7fb75c0acf80 0x7fb75c0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.298+0000 7fb762ffd640 1 -- 172.21.15.159:0/3964598003 <== osd.7 v2:172.21.15.189:6816/3813484683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb75c0afaf0 con 0x7fb75c0acf80 2024-09-19T06:46:05.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.311+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 --> [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb770062d40 con 0x7fb75c0acf80 2024-09-19T06:46:05.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb762ffd640 1 -- 172.21.15.159:0/3964598003 <== osd.7 v2:172.21.15.189:6816/3813484683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb770062d40 con 0x7fb75c0acf80 2024-09-19T06:46:05.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 >> [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] conn(0x7fb75c0acf80 msgr2=0x7fb75c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] conn(0x7fb75c0acf80 0x7fb75c0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb75c0a32d0 msgr2=0x7fb75c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb75c0a32d0 0x7fb75c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb764009230 tx=0x7fb7640058d0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb770106f20 msgr2=0x7fb770074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 --2- 172.21.15.159:0/3964598003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb770106f20 0x7fb770074f70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb76800cce0 tx=0x7fb76800a620 comp rx=0 tx=0).stop 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb776137640 1 -- 172.21.15.159:0/3964598003 reap_dead start 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 shutdown_connections 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 >> 172.21.15.159:0/3964598003 conn(0x7fb7700fd8b0 msgr2=0x7fb7700feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 shutdown_connections 2024-09-19T06:46:05.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.312+0000 7fb777b9a640 1 -- 172.21.15.159:0/3964598003 wait complete. 2024-09-19T06:46:06.145 INFO:teuthology.orchestra.run.smithi159.stdout:313532612628 2024-09-19T06:46:06.146 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T06:46:06.272 INFO:teuthology.orchestra.run.smithi159.stdout:34359738444 2024-09-19T06:46:06.273 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T06:46:06.671 INFO:teuthology.orchestra.run.smithi159.stdout:201863462954 2024-09-19T06:46:06.671 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T06:46:06.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:06 smithi203 ceph-mon[35473]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:46:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:06 smithi189 ceph-mon[34880]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:46:06.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:06 smithi159 ceph-mon[30935]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:46:07.392 INFO:teuthology.orchestra.run.smithi159.stdout:98784247870 2024-09-19T06:46:07.392 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T06:46:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 -- 172.21.15.159:0/4152983936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc014101420 msgr2=0x7fc01410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 --2- 172.21.15.159:0/4152983936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc014101420 0x7fc01410d950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009cd0 tx=0x7fc00c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 -- 172.21.15.159:0/4152983936 shutdown_connections 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 --2- 172.21.15.159:0/4152983936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc014101420 0x7fc01410d950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 --2- 172.21.15.159:0/4152983936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc014100a80 0x7fc014100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 --2- 172.21.15.159:0/4152983936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc014106a80 0x7fc014106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 -- 172.21.15.159:0/4152983936 >> 172.21.15.159:0/4152983936 conn(0x7fc0140fc7a0 msgr2=0x7fc0140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 -- 172.21.15.159:0/4152983936 shutdown_connections 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 -- 172.21.15.159:0/4152983936 wait complete. 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 Processor -- start 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.742+0000 7fc01adde640 1 -- start start 2024-09-19T06:46:07.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc01adde640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc014100a80 0x7fc01410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc01adde640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc014101420 0x7fc01410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc01adde640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc014106a80 0x7fc01410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc01adde640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc014112020 con 0x7fc014101420 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc01adde640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc014111ea0 con 0x7fc014106a80 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc01adde640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc0141121a0 con 0x7fc014100a80 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc013fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc014101420 0x7fc01410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc013fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc014101420 0x7fc01410e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53990/0 (socket says 172.21.15.159:53990) 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc013fff640 1 -- 172.21.15.159:0/1306375354 learned_addr learned my addr 172.21.15.159:0/1306375354 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc018b7a640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc014100a80 0x7fc01410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc01937b640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc014106a80 0x7fc01410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc013fff640 1 -- 172.21.15.159:0/1306375354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc014100a80 msgr2=0x7fc01410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc013fff640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc014100a80 0x7fc01410e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc013fff640 1 -- 172.21.15.159:0/1306375354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc014106a80 msgr2=0x7fc01410ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc013fff640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc014106a80 0x7fc01410ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc013fff640 1 -- 172.21.15.159:0/1306375354 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0141a6a40 con 0x7fc014101420 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc013fff640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc014101420 0x7fc01410e920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc00000b4a0 tx=0x7fc00000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc011ffb640 1 -- 172.21.15.159:0/1306375354 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000014070 con 0x7fc014101420 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0141a6d30 con 0x7fc014101420 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc011ffb640 1 -- 172.21.15.159:0/1306375354 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc000010af0 con 0x7fc014101420 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.743+0000 7fc011ffb640 1 -- 172.21.15.159:0/1306375354 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000017d10 con 0x7fc014101420 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.744+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0141a7210 con 0x7fc014101420 2024-09-19T06:46:07.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.744+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0140628c0 con 0x7fc014101420 2024-09-19T06:46:07.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.746+0000 7fc011ffb640 1 -- 172.21.15.159:0/1306375354 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc000017070 con 0x7fc014101420 2024-09-19T06:46:07.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.746+0000 7fc011ffb640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc0040a32d0 0x7fc0040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:07.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.746+0000 7fc011ffb640 1 -- 172.21.15.159:0/1306375354 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc0000cedd0 con 0x7fc014101420 2024-09-19T06:46:07.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.746+0000 7fc018b7a640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc0040a32d0 0x7fc0040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:07.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.747+0000 7fc011ffb640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] conn(0x7fc0040acf80 0x7fc0040af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:07.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.747+0000 7fc011ffb640 1 -- 172.21.15.159:0/1306375354 --> [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0040afaf0 con 0x7fc0040acf80 2024-09-19T06:46:07.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.747+0000 7fc011ffb640 1 -- 172.21.15.159:0/1306375354 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fc0000d1490 con 0x7fc014101420 2024-09-19T06:46:07.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.747+0000 7fc01937b640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] conn(0x7fc0040acf80 0x7fc0040af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:07.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.747+0000 7fc018b7a640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc0040a32d0 0x7fc0040a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc008009890 tx=0x7fc008008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.747+0000 7fc01937b640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] conn(0x7fc0040acf80 0x7fc0040af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.748+0000 7fc011ffb640 1 -- 172.21.15.159:0/1306375354 <== osd.8 v2:172.21.15.203:6816/3706643135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0040afaf0 con 0x7fc0040acf80 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.761+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 --> [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc014062cf0 con 0x7fc0040acf80 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.762+0000 7fc011ffb640 1 -- 172.21.15.159:0/1306375354 <== osd.8 v2:172.21.15.203:6816/3706643135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc014062cf0 con 0x7fc0040acf80 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.762+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 >> [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] conn(0x7fc0040acf80 msgr2=0x7fc0040af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.762+0000 7fc01adde640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] conn(0x7fc0040acf80 0x7fc0040af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.762+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc0040a32d0 msgr2=0x7fc0040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.762+0000 7fc01adde640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc0040a32d0 0x7fc0040a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc008009890 tx=0x7fc008008040 comp rx=0 tx=0).stop 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.762+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc014101420 msgr2=0x7fc01410e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.762+0000 7fc01adde640 1 --2- 172.21.15.159:0/1306375354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc014101420 0x7fc01410e920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc00000b4a0 tx=0x7fc00000b960 comp rx=0 tx=0).stop 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.763+0000 7fc01937b640 1 -- 172.21.15.159:0/1306375354 reap_dead start 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.763+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 shutdown_connections 2024-09-19T06:46:07.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.763+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 >> 172.21.15.159:0/1306375354 conn(0x7fc0140fc7a0 msgr2=0x7fc0140fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:07.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.763+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 shutdown_connections 2024-09-19T06:46:07.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:05.763+0000 7fc01adde640 1 -- 172.21.15.159:0/1306375354 wait complete. 2024-09-19T06:46:08.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:08 smithi159 ceph-mon[30935]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T06:46:08.697 INFO:teuthology.orchestra.run.smithi159.stdout:180388626476 2024-09-19T06:46:08.698 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T06:46:08.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:08 smithi203 ceph-mon[35473]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T06:46:08.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:08 smithi189 ceph-mon[34880]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T06:46:09.162 INFO:teuthology.orchestra.run.smithi159.stdout:51539607623 2024-09-19T06:46:09.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T06:46:09.296 INFO:teuthology.orchestra.run.smithi159.stdout:231928234020 2024-09-19T06:46:09.296 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T06:46:09.741 INFO:teuthology.orchestra.run.smithi159.stdout:150323855411 2024-09-19T06:46:09.742 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T06:46:10.252 INFO:teuthology.orchestra.run.smithi159.stdout:128849018936 2024-09-19T06:46:10.252 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T06:46:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:10.736 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:10 smithi159 ceph-mon[30935]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T06:46:10.744 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.827+0000 7f484dffb640 1 -- 172.21.15.159:0/1101696229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 msgr2=0x7f4848101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.827+0000 7f484dffb640 1 --2- 172.21.15.159:0/1101696229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 0x7f4848101200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4838009900 tx=0x7f483802a480 comp rx=0 tx=0).stop 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 -- 172.21.15.159:0/1101696229 shutdown_connections 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 --2- 172.21.15.159:0/1101696229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4848102ef0 0x7f484810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 --2- 172.21.15.159:0/1101696229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4848102570 0x7f48481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 --2- 172.21.15.159:0/1101696229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 0x7f4848101200 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 -- 172.21.15.159:0/1101696229 >> 172.21.15.159:0/1101696229 conn(0x7f48480fc7d0 msgr2=0x7f48480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 -- 172.21.15.159:0/1101696229 shutdown_connections 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 -- 172.21.15.159:0/1101696229 wait complete. 2024-09-19T06:46:10.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 Processor -- start 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 -- start start 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.828+0000 7f484dffb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 0x7f48481994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f484dffb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4848102570 0x7f48481999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f484dffb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4848102ef0 0x7f48481a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f484dffb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4848111020 con 0x7f4848100e20 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f484dffb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4848110ea0 con 0x7f4848102570 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f484dffb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48481111a0 con 0x7f4848102ef0 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f48477fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 0x7f48481994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f48477fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 0x7f48481994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34378/0 (socket says 172.21.15.159:34378) 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f48477fe640 1 -- 172.21.15.159:0/1161716023 learned_addr learned my addr 172.21.15.159:0/1161716023 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f4847fff640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4848102ef0 0x7f48481a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f4846ffd640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4848102570 0x7f48481999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f48477fe640 1 -- 172.21.15.159:0/1161716023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4848102ef0 msgr2=0x7f48481a4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:10.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f48477fe640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4848102ef0 0x7f48481a4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f48477fe640 1 -- 172.21.15.159:0/1161716023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4848102570 msgr2=0x7f48481999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f48477fe640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4848102570 0x7f48481999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f48477fe640 1 -- 172.21.15.159:0/1161716023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48481a4a70 con 0x7f4848100e20 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f4847fff640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4848102ef0 0x7f48481a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f48477fe640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 0x7f48481994b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4838006010 tx=0x7f4838003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f4844ff9640 1 -- 172.21.15.159:0/1161716023 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483803f070 con 0x7f4848100e20 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f4844ff9640 1 -- 172.21.15.159:0/1161716023 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4838031e30 con 0x7f4848100e20 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48481a4c40 con 0x7f4848100e20 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f4844ff9640 1 -- 172.21.15.159:0/1161716023 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838035030 con 0x7f4848100e20 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.829+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48481a50f0 con 0x7f4848100e20 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.831+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4848101280 con 0x7f4848100e20 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.832+0000 7f4844ff9640 1 -- 172.21.15.159:0/1161716023 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4838042070 con 0x7f4848100e20 2024-09-19T06:46:10.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.832+0000 7f4844ff9640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48340a32d0 0x7f48340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:10.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.833+0000 7f4846ffd640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48340a32d0 0x7f48340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:10.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.833+0000 7f4844ff9640 1 -- 172.21.15.159:0/1161716023 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f48380f04c0 con 0x7f4848100e20 2024-09-19T06:46:10.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.833+0000 7f4846ffd640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48340a32d0 0x7f48340a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f484806ab00 tx=0x7f4830008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:10.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:10.836+0000 7f4844ff9640 1 -- 172.21.15.159:0/1161716023 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48380bd060 con 0x7f4848100e20 2024-09-19T06:46:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:10 smithi203 ceph-mon[35473]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T06:46:10.853 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:10.853 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:10.856 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:10.857 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:10.882 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:10.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:10 smithi189 ceph-mon[34880]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T06:46:10.892 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:10.900 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:11.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.047+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f4848109090 con 0x7f4848100e20 2024-09-19T06:46:11.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.048+0000 7f4844ff9640 1 -- 172.21.15.159:0/1161716023 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f48380bc960 con 0x7f4848100e20 2024-09-19T06:46:11.049 INFO:teuthology.orchestra.run.smithi159.stdout:261993005088 2024-09-19T06:46:11.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48340a32d0 msgr2=0x7f48340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:11.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48340a32d0 0x7f48340a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f484806ab00 tx=0x7f4830008040 comp rx=0 tx=0).stop 2024-09-19T06:46:11.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 msgr2=0x7f48481994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:11.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 0x7f48481994b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4838006010 tx=0x7f4838003c80 comp rx=0 tx=0).stop 2024-09-19T06:46:11.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 shutdown_connections 2024-09-19T06:46:11.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f48340a32d0 0x7f48340a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:11.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4848102ef0 0x7f48481a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:11.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4848102570 0x7f48481999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:11.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 --2- 172.21.15.159:0/1161716023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4848100e20 0x7f48481994b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:11.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 >> 172.21.15.159:0/1161716023 conn(0x7f48480fc7d0 msgr2=0x7f48480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:11.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 shutdown_connections 2024-09-19T06:46:11.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:11.050+0000 7f484dffb640 1 -- 172.21.15.159:0/1161716023 wait complete. 2024-09-19T06:46:11.745 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:11 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1161716023' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:46:11.781 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005086 got 261993005088 for osd.9 2024-09-19T06:46:11.782 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:11.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:11 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1161716023' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:46:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:11 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1161716023' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:46:12.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.186+0000 7f19e388b640 1 -- 172.21.15.159:0/3172413406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 msgr2=0x7f19dc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:12.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.186+0000 7f19e388b640 1 --2- 172.21.15.159:0/3172413406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 0x7f19dc10ea90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009ca0 tx=0x7f19d402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.186+0000 7f19e388b640 1 -- 172.21.15.159:0/3172413406 shutdown_connections 2024-09-19T06:46:12.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.186+0000 7f19e388b640 1 --2- 172.21.15.159:0/3172413406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 0x7f19dc10ea90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.186+0000 7f19e388b640 1 --2- 172.21.15.159:0/3172413406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19dc102790 0x7f19dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.186+0000 7f19e388b640 1 --2- 172.21.15.159:0/3172413406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19dc101de0 0x7f19dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.186+0000 7f19e388b640 1 -- 172.21.15.159:0/3172413406 >> 172.21.15.159:0/3172413406 conn(0x7f19dc0fd8c0 msgr2=0x7f19dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.186+0000 7f19e388b640 1 -- 172.21.15.159:0/3172413406 shutdown_connections 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.186+0000 7f19e388b640 1 -- 172.21.15.159:0/3172413406 wait complete. 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.187+0000 7f19e388b640 1 Processor -- start 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.187+0000 7f19e388b640 1 -- start start 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.187+0000 7f19e388b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19dc101de0 0x7f19dc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.187+0000 7f19e388b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19dc102790 0x7f19dc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.187+0000 7f19e388b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 0x7f19dc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.187+0000 7f19e388b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc111fc0 con 0x7f19dc106f10 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.187+0000 7f19e388b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc111e40 con 0x7f19dc102790 2024-09-19T06:46:12.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.187+0000 7f19e388b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc112140 con 0x7f19dc101de0 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1e28640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 0x7f19dc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1e28640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 0x7f19dc19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34398/0 (socket says 172.21.15.159:34398) 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1e28640 1 -- 172.21.15.159:0/950031576 learned_addr learned my addr 172.21.15.159:0/950031576 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e0e26640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19dc102790 0x7f19dc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1627640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19dc101de0 0x7f19dc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1e28640 1 -- 172.21.15.159:0/950031576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19dc101de0 msgr2=0x7f19dc1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1e28640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19dc101de0 0x7f19dc1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1e28640 1 -- 172.21.15.159:0/950031576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19dc102790 msgr2=0x7f19dc198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1e28640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19dc102790 0x7f19dc198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1e28640 1 -- 172.21.15.159:0/950031576 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19dc19d370 con 0x7f19dc106f10 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1627640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19dc101de0 0x7f19dc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:12.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e1e28640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 0x7f19dc19cc90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f19d4003f10 tx=0x7f19d4003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19d27fc640 1 -- 172.21.15.159:0/950031576 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4031710 con 0x7f19dc106f10 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19d27fc640 1 -- 172.21.15.159:0/950031576 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19d40318b0 con 0x7f19dc106f10 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19dc19d600 con 0x7f19dc106f10 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19d27fc640 1 -- 172.21.15.159:0/950031576 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d402fb50 con 0x7f19dc106f10 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.188+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19dc1a4f40 con 0x7f19dc106f10 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.189+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19dc1021c0 con 0x7f19dc106f10 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.190+0000 7f19d27fc640 1 -- 172.21.15.159:0/950031576 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f19d402fcf0 con 0x7f19dc106f10 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.191+0000 7f19d27fc640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19c80a3350 0x7f19c80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.191+0000 7f19e1627640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19c80a3350 0x7f19c80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.191+0000 7f19d27fc640 1 -- 172.21.15.159:0/950031576 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f19d40f0fe0 con 0x7f19dc106f10 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.191+0000 7f19e1627640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19c80a3350 0x7f19c80a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19d80058c0 tx=0x7f19d8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:12.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.194+0000 7f19d27fc640 1 -- 172.21.15.159:0/950031576 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19d40bdd30 con 0x7f19dc106f10 2024-09-19T06:46:12.213 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:12.213 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:12.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.375+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f19dc1a51a0 con 0x7f19dc106f10 2024-09-19T06:46:12.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.375+0000 7f19d27fc640 1 -- 172.21.15.159:0/950031576 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f19d40bd630 con 0x7f19dc106f10 2024-09-19T06:46:12.377 INFO:teuthology.orchestra.run.smithi159.stdout:283467841563 2024-09-19T06:46:12.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.377+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19c80a3350 msgr2=0x7f19c80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:12.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.377+0000 7f19e388b640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19c80a3350 0x7f19c80a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19d80058c0 tx=0x7f19d8005850 comp rx=0 tx=0).stop 2024-09-19T06:46:12.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.377+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 msgr2=0x7f19dc19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:12.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.377+0000 7f19e388b640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 0x7f19dc19cc90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f19d4003f10 tx=0x7f19d4003f40 comp rx=0 tx=0).stop 2024-09-19T06:46:12.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.377+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 shutdown_connections 2024-09-19T06:46:12.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.377+0000 7f19e388b640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f19c80a3350 0x7f19c80a5810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.377+0000 7f19e388b640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19dc106f10 0x7f19dc19cc90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.377+0000 7f19e388b640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19dc102790 0x7f19dc198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.377+0000 7f19e388b640 1 --2- 172.21.15.159:0/950031576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19dc101de0 0x7f19dc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.378+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 >> 172.21.15.159:0/950031576 conn(0x7f19dc0fd8c0 msgr2=0x7f19dc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:12.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.378+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 shutdown_connections 2024-09-19T06:46:12.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.378+0000 7f19e388b640 1 -- 172.21.15.159:0/950031576 wait complete. 2024-09-19T06:46:12.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:12 smithi159 ceph-mon[30935]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T06:46:12.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:12 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/950031576' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:46:12.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:12 smithi189 ceph-mon[34880]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T06:46:12.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:12 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/950031576' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:46:12.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:12 smithi203 ceph-mon[35473]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T06:46:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:12 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/950031576' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:46:12.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 -- 172.21.15.159:0/2441651883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac1027c0 msgr2=0x7f8eac106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 --2- 172.21.15.159:0/2441651883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac1027c0 0x7f8eac106810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009900 tx=0x7f8e9402a410 comp rx=0 tx=0).stop 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 -- 172.21.15.159:0/2441651883 shutdown_connections 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 --2- 172.21.15.159:0/2441651883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8eac106f40 0x7f8eac10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 --2- 172.21.15.159:0/2441651883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac1027c0 0x7f8eac106810 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 --2- 172.21.15.159:0/2441651883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8eac101e10 0x7f8eac1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 -- 172.21.15.159:0/2441651883 >> 172.21.15.159:0/2441651883 conn(0x7f8eac0fd8d0 msgr2=0x7f8eac0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 -- 172.21.15.159:0/2441651883 shutdown_connections 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 -- 172.21.15.159:0/2441651883 wait complete. 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.835+0000 7f8eb18db640 1 Processor -- start 2024-09-19T06:46:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eb18db640 1 -- start start 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eb18db640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac101e10 0x7f8eac198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eb18db640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8eac1027c0 0x7f8eac198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eb18db640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8eac106f40 0x7f8eac19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eb18db640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac111fa0 con 0x7f8eac101e10 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eb18db640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac111e20 con 0x7f8eac106f40 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eb18db640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac112120 con 0x7f8eac1027c0 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac101e10 0x7f8eac198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac101e10 0x7f8eac198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34414/0 (socket says 172.21.15.159:34414) 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaaffd640 1 -- 172.21.15.159:0/3085123250 learned_addr learned my addr 172.21.15.159:0/3085123250 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaa7fc640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8eac1027c0 0x7f8eac198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eab7fe640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8eac106f40 0x7f8eac19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaaffd640 1 -- 172.21.15.159:0/3085123250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8eac1027c0 msgr2=0x7f8eac198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaaffd640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8eac1027c0 0x7f8eac198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaaffd640 1 -- 172.21.15.159:0/3085123250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8eac106f40 msgr2=0x7f8eac19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaaffd640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8eac106f40 0x7f8eac19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaaffd640 1 -- 172.21.15.159:0/3085123250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac19d3f0 con 0x7f8eac101e10 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.836+0000 7f8eaaffd640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac101e10 0x7f8eac198440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00d950 tx=0x7f8e9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.837+0000 7f8eb08d9640 1 -- 172.21.15.159:0/3085123250 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c017070 con 0x7f8eac101e10 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.837+0000 7f8eb08d9640 1 -- 172.21.15.159:0/3085123250 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e9c009c30 con 0x7f8eac101e10 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.837+0000 7f8eb08d9640 1 -- 172.21.15.159:0/3085123250 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00f6b0 con 0x7f8eac101e10 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.837+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eac19d6e0 con 0x7f8eac101e10 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.837+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eac1a4fc0 con 0x7f8eac101e10 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.838+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eac1032f0 con 0x7f8eac101e10 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.839+0000 7f8eb08d9640 1 -- 172.21.15.159:0/3085123250 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f8e9c0109d0 con 0x7f8eac101e10 2024-09-19T06:46:12.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.839+0000 7f8eb08d9640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8e980a3350 0x7f8e980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:12.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.840+0000 7f8eb08d9640 1 -- 172.21.15.159:0/3085123250 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f8e9c0cf5a0 con 0x7f8eac101e10 2024-09-19T06:46:12.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.840+0000 7f8eaa7fc640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8e980a3350 0x7f8e980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:12.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.840+0000 7f8eaa7fc640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8e980a3350 0x7f8e980a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009230 tx=0x7f8e940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:12.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:12.844+0000 7f8eb08d9640 1 -- 172.21.15.159:0/3085123250 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e9c009de0 con 0x7f8eac101e10 2024-09-19T06:46:13.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.016+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f8eac10a120 con 0x7f8eac101e10 2024-09-19T06:46:13.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.016+0000 7f8eb08d9640 1 -- 172.21.15.159:0/3085123250 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f8e9c09baf0 con 0x7f8eac101e10 2024-09-19T06:46:13.018 INFO:teuthology.orchestra.run.smithi159.stdout:313532612630 2024-09-19T06:46:13.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.018+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8e980a3350 msgr2=0x7f8e980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:13.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.018+0000 7f8eb18db640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8e980a3350 0x7f8e980a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009230 tx=0x7f8e940058d0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.018+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac101e10 msgr2=0x7f8eac198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:13.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.018+0000 7f8eb18db640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac101e10 0x7f8eac198440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00d950 tx=0x7f8e9c00de10 comp rx=0 tx=0).stop 2024-09-19T06:46:13.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.018+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 shutdown_connections 2024-09-19T06:46:13.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.018+0000 7f8eb18db640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f8e980a3350 0x7f8e980a5810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.018+0000 7f8eb18db640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8eac106f40 0x7f8eac19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.019+0000 7f8eb18db640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8eac1027c0 0x7f8eac198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.019+0000 7f8eb18db640 1 --2- 172.21.15.159:0/3085123250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eac101e10 0x7f8eac198440 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:13.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.019+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 >> 172.21.15.159:0/3085123250 conn(0x7f8eac0fd8d0 msgr2=0x7f8eac0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:13.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.019+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 shutdown_connections 2024-09-19T06:46:13.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:13.019+0000 7f8eb18db640 1 -- 172.21.15.159:0/3085123250 wait complete. 2024-09-19T06:46:13.813 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:13 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3085123250' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:46:13.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:13 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3085123250' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:46:13.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:13 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3085123250' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:46:14.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 -- 172.21.15.159:0/1875157533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b8103670 msgr2=0x7f67b810bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 --2- 172.21.15.159:0/1875157533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b8103670 0x7f67b810bb60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009900 tx=0x7f67a002a480 comp rx=0 tx=0).stop 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 -- 172.21.15.159:0/1875157533 shutdown_connections 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 --2- 172.21.15.159:0/1875157533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b810c180 0x7f67b810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 --2- 172.21.15.159:0/1875157533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b8103670 0x7f67b810bb60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 --2- 172.21.15.159:0/1875157533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67b8102d50 0x7f67b8103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 -- 172.21.15.159:0/1875157533 >> 172.21.15.159:0/1875157533 conn(0x7f67b80fc7d0 msgr2=0x7f67b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 -- 172.21.15.159:0/1875157533 shutdown_connections 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 -- 172.21.15.159:0/1875157533 wait complete. 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.332+0000 7f67be328640 1 Processor -- start 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67be328640 1 -- start start 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67be328640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b8102d50 0x7f67b81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67be328640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67b8103670 0x7f67b8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67be328640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b810c180 0x7f67b819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67be328640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67b8111f80 con 0x7f67b810c180 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67be328640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67b8111e00 con 0x7f67b8102d50 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67be328640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67b8112100 con 0x7f67b8103670 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67bc8c5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b810c180 0x7f67b819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67bc8c5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b810c180 0x7f67b819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34452/0 (socket says 172.21.15.159:34452) 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67bc8c5640 1 -- 172.21.15.159:0/2862285250 learned_addr learned my addr 172.21.15.159:0/2862285250 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67affff640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67b8103670 0x7f67b8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67b7fff640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b8102d50 0x7f67b81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67bc8c5640 1 -- 172.21.15.159:0/2862285250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67b8103670 msgr2=0x7f67b8198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67bc8c5640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67b8103670 0x7f67b8198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67bc8c5640 1 -- 172.21.15.159:0/2862285250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b8102d50 msgr2=0x7f67b81984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67bc8c5640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b8102d50 0x7f67b81984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67bc8c5640 1 -- 172.21.15.159:0/2862285250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b819d490 con 0x7f67b810c180 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.333+0000 7f67bc8c5640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b810c180 0x7f67b819cdb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f67b000eaa0 tx=0x7f67b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.334+0000 7f67b5ffb640 1 -- 172.21.15.159:0/2862285250 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b000cdb0 con 0x7f67b810c180 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.334+0000 7f67b5ffb640 1 -- 172.21.15.159:0/2862285250 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67b0005020 con 0x7f67b810c180 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.334+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b819d780 con 0x7f67b810c180 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.334+0000 7f67b5ffb640 1 -- 172.21.15.159:0/2862285250 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b00116b0 con 0x7f67b810c180 2024-09-19T06:46:14.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.334+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b81a5060 con 0x7f67b810c180 2024-09-19T06:46:14.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.335+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b806b070 con 0x7f67b810c180 2024-09-19T06:46:14.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.337+0000 7f67b5ffb640 1 -- 172.21.15.159:0/2862285250 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f67b0005560 con 0x7f67b810c180 2024-09-19T06:46:14.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.337+0000 7f67b5ffb640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a40a32d0 0x7f67a40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.337+0000 7f67b7fff640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a40a32d0 0x7f67a40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.337+0000 7f67b5ffb640 1 -- 172.21.15.159:0/2862285250 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f67b00cfc30 con 0x7f67b810c180 2024-09-19T06:46:14.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.338+0000 7f67b7fff640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a40a32d0 0x7f67a40a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67a800bbe0 tx=0x7f67a800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.340+0000 7f67b5ffb640 1 -- 172.21.15.159:0/2862285250 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67b0016030 con 0x7f67b810c180 2024-09-19T06:46:14.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.520+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f67b8103130 con 0x7f67b810c180 2024-09-19T06:46:14.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.520+0000 7f67b5ffb640 1 -- 172.21.15.159:0/2862285250 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f67b8103130 con 0x7f67b810c180 2024-09-19T06:46:14.521 INFO:teuthology.orchestra.run.smithi159.stdout:128849018939 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a40a32d0 msgr2=0x7f67a40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a40a32d0 0x7f67a40a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67a800bbe0 tx=0x7f67a800b390 comp rx=0 tx=0).stop 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b810c180 msgr2=0x7f67b819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b810c180 0x7f67b819cdb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f67b000eaa0 tx=0x7f67b000ef60 comp rx=0 tx=0).stop 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 shutdown_connections 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f67a40a32d0 0x7f67a40a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67b810c180 0x7f67b819cdb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67b8103670 0x7f67b8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 --2- 172.21.15.159:0/2862285250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b8102d50 0x7f67b81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 >> 172.21.15.159:0/2862285250 conn(0x7f67b80fc7d0 msgr2=0x7f67b80fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.522+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 shutdown_connections 2024-09-19T06:46:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.523+0000 7f67be328640 1 -- 172.21.15.159:0/2862285250 wait complete. 2024-09-19T06:46:14.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.541+0000 7fcdc3cee640 1 -- 172.21.15.159:0/905979658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc100a80 msgr2=0x7fcdbc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.541+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/905979658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc100a80 0x7fcdbc100ee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009930 tx=0x7fcdac02a420 comp rx=0 tx=0).stop 2024-09-19T06:46:14.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.541+0000 7fcdc3cee640 1 -- 172.21.15.159:0/905979658 shutdown_connections 2024-09-19T06:46:14.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.541+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/905979658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc101420 0x7fcdbc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.541+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/905979658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc100a80 0x7fcdbc100ee0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.541+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/905979658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdbc106a80 0x7fcdbc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.541+0000 7fcdc3cee640 1 -- 172.21.15.159:0/905979658 >> 172.21.15.159:0/905979658 conn(0x7fcdbc0fc7a0 msgr2=0x7fcdbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.542+0000 7fcdc3cee640 1 -- 172.21.15.159:0/905979658 shutdown_connections 2024-09-19T06:46:14.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.542+0000 7fcdc3cee640 1 -- 172.21.15.159:0/905979658 wait complete. 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.542+0000 7fcdc3cee640 1 Processor -- start 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.542+0000 7fcdc3cee640 1 -- start start 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc3cee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc100a80 0x7fcdbc197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc3cee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc101420 0x7fcdbc197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc3cee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdbc106a80 0x7fcdbc19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc3cee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc110e80 con 0x7fcdbc101420 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1289640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc101420 0x7fcdbc197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1289640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc101420 0x7fcdbc197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34466/0 (socket says 172.21.15.159:34466) 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1289640 1 -- 172.21.15.159:0/3897492160 learned_addr learned my addr 172.21.15.159:0/3897492160 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1a8a640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc100a80 0x7fcdbc197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc110d00 con 0x7fcdbc100a80 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc111000 con 0x7fcdbc106a80 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc228b640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdbc106a80 0x7fcdbc19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1289640 1 -- 172.21.15.159:0/3897492160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdbc106a80 msgr2=0x7fcdbc19bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1289640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdbc106a80 0x7fcdbc19bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1289640 1 -- 172.21.15.159:0/3897492160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc100a80 msgr2=0x7fcdbc197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1289640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc100a80 0x7fcdbc197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1289640 1 -- 172.21.15.159:0/3897492160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc19c2f0 con 0x7fcdbc101420 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc228b640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdbc106a80 0x7fcdbc19bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.543+0000 7fcdc1289640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc101420 0x7fcdbc197880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009230 tx=0x7fcdac004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.544+0000 7fcdb2ffd640 1 -- 172.21.15.159:0/3897492160 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac03f030 con 0x7fcdbc101420 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.544+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc19c580 con 0x7fcdbc101420 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.544+0000 7fcdb2ffd640 1 -- 172.21.15.159:0/3897492160 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdac004440 con 0x7fcdbc101420 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.544+0000 7fcdb2ffd640 1 -- 172.21.15.159:0/3897492160 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac035070 con 0x7fcdbc101420 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.544+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc1a3ec0 con 0x7fcdbc101420 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.545+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdbc100ee0 con 0x7fcdbc101420 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.546+0000 7fcdb2ffd640 1 -- 172.21.15.159:0/3897492160 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fcdac042030 con 0x7fcdbc101420 2024-09-19T06:46:14.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.547+0000 7fcdb2ffd640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcda80a32d0 0x7fcda80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.547+0000 7fcdb2ffd640 1 -- 172.21.15.159:0/3897492160 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fcdac0f0200 con 0x7fcdbc101420 2024-09-19T06:46:14.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.547+0000 7fcdc1a8a640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcda80a32d0 0x7fcda80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.548+0000 7fcdc1a8a640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcda80a32d0 0x7fcda80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009b50 tx=0x7fcdb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.554+0000 7fcdb2ffd640 1 -- 172.21.15.159:0/3897492160 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcdac0bc750 con 0x7fcdbc101420 2024-09-19T06:46:14.715 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:14 smithi159 ceph-mon[30935]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T06:46:14.715 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:14 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1022352135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:46:14.715 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:14 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2862285250' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:46:14.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.735+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcdbc108ff0 con 0x7fcdbc101420 2024-09-19T06:46:14.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.735+0000 7fcdb2ffd640 1 -- 172.21.15.159:0/3897492160 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcdac0c0a50 con 0x7fcdbc101420 2024-09-19T06:46:14.737 INFO:teuthology.orchestra.run.smithi159.stdout:150323855413 2024-09-19T06:46:14.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcda80a32d0 msgr2=0x7fcda80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcda80a32d0 0x7fcda80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009b50 tx=0x7fcdb8005f90 comp rx=0 tx=0).stop 2024-09-19T06:46:14.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc101420 msgr2=0x7fcdbc197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc101420 0x7fcdbc197880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009230 tx=0x7fcdac004040 comp rx=0 tx=0).stop 2024-09-19T06:46:14.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 shutdown_connections 2024-09-19T06:46:14.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcda80a32d0 0x7fcda80a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdbc106a80 0x7fcdbc19bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdbc101420 0x7fcdbc197880 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 --2- 172.21.15.159:0/3897492160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc100a80 0x7fcdbc197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 >> 172.21.15.159:0/3897492160 conn(0x7fcdbc0fc7a0 msgr2=0x7fcdbc0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 shutdown_connections 2024-09-19T06:46:14.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.738+0000 7fcdc3cee640 1 -- 172.21.15.159:0/3897492160 wait complete. 2024-09-19T06:46:14.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:14 smithi203 ceph-mon[35473]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T06:46:14.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:14 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1022352135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:46:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:14 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2862285250' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:46:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:14 smithi189 ceph-mon[34880]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T06:46:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:14 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1022352135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:46:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:14 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2862285250' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:46:15.769 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:15 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3897492160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:46:15.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018936 got 128849018939 for osd.4 2024-09-19T06:46:15.799 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:15.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:15 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3897492160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:46:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:15 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3897492160' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:46:15.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 -- 172.21.15.159:0/3589509707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4106a90 msgr2=0x7febf4106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:15.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 --2- 172.21.15.159:0/3589509707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4106a90 0x7febf4106e70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7febf0009930 tx=0x7febf002a420 comp rx=0 tx=0).stop 2024-09-19T06:46:15.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 -- 172.21.15.159:0/3589509707 shutdown_connections 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 --2- 172.21.15.159:0/3589509707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febf4101430 0x7febf410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 --2- 172.21.15.159:0/3589509707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febf4100a90 0x7febf4100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 --2- 172.21.15.159:0/3589509707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4106a90 0x7febf4106e70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 -- 172.21.15.159:0/3589509707 >> 172.21.15.159:0/3589509707 conn(0x7febf40fc7d0 msgr2=0x7febf40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 -- 172.21.15.159:0/3589509707 shutdown_connections 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 -- 172.21.15.159:0/3589509707 wait complete. 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.951+0000 7febfbbfe640 1 Processor -- start 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febfbbfe640 1 -- start start 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febfbbfe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4100a90 0x7febf41974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febfbbfe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febf4101430 0x7febf4197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febfbbfe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febf4106a90 0x7febf419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febfbbfe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7febf4110f30 con 0x7febf4100a90 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febfbbfe640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7febf4110db0 con 0x7febf4106a90 2024-09-19T06:46:15.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febfbbfe640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7febf41110b0 con 0x7febf4101430 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf999a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4100a90 0x7febf41974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf999a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4100a90 0x7febf41974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34494/0 (socket says 172.21.15.159:34494) 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf999a640 1 -- 172.21.15.159:0/887164911 learned_addr learned my addr 172.21.15.159:0/887164911 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febfa19b640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febf4106a90 0x7febf419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf999a640 1 -- 172.21.15.159:0/887164911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febf4101430 msgr2=0x7febf4197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf9199640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febf4101430 0x7febf4197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf999a640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febf4101430 0x7febf4197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf999a640 1 -- 172.21.15.159:0/887164911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febf4106a90 msgr2=0x7febf419bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf999a640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febf4106a90 0x7febf419bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf999a640 1 -- 172.21.15.159:0/887164911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf419c480 con 0x7febf4100a90 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.952+0000 7febf999a640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4100a90 0x7febf41974d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7febf0009a50 tx=0x7febf0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.953+0000 7febeaffd640 1 -- 172.21.15.159:0/887164911 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf003f030 con 0x7febf4100a90 2024-09-19T06:46:15.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.953+0000 7febeaffd640 1 -- 172.21.15.159:0/887164911 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf0003ce0 con 0x7febf4100a90 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.953+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf419c710 con 0x7febf4100a90 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.953+0000 7febeaffd640 1 -- 172.21.15.159:0/887164911 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0035070 con 0x7febf4100a90 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.953+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf41a4050 con 0x7febf4100a90 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.954+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf41021d0 con 0x7febf4100a90 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.955+0000 7febeaffd640 1 -- 172.21.15.159:0/887164911 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7febf0042030 con 0x7febf4100a90 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.955+0000 7febeaffd640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7febe00a32d0 0x7febe00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.955+0000 7febf9199640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7febe00a32d0 0x7febe00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.955+0000 7febeaffd640 1 -- 172.21.15.159:0/887164911 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7febf00f0190 con 0x7febf4100a90 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.956+0000 7febf9199640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7febe00a32d0 0x7febe00a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7febf40fee00 tx=0x7febe4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:15.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:15.959+0000 7febeaffd640 1 -- 172.21.15.159:0/887164911 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7febf00bccd0 con 0x7febf4100a90 2024-09-19T06:46:16.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.229+0000 7f64c37b3640 1 -- 172.21.15.159:0/1252714875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc101420 msgr2=0x7f64bc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.229+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1252714875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc101420 0x7f64bc10d950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009cd0 tx=0x7f64b402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.229+0000 7f64c37b3640 1 -- 172.21.15.159:0/1252714875 shutdown_connections 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.229+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1252714875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc101420 0x7f64bc10d950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.229+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1252714875 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64bc100a80 0x7f64bc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.229+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1252714875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64bc106a80 0x7f64bc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.229+0000 7f64c37b3640 1 -- 172.21.15.159:0/1252714875 >> 172.21.15.159:0/1252714875 conn(0x7f64bc0fc7a0 msgr2=0x7f64bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.229+0000 7f64c37b3640 1 -- 172.21.15.159:0/1252714875 shutdown_connections 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.229+0000 7f64c37b3640 1 -- 172.21.15.159:0/1252714875 wait complete. 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c37b3640 1 Processor -- start 2024-09-19T06:46:16.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c37b3640 1 -- start start 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c37b3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc100a80 0x7f64bc19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c37b3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64bc101420 0x7f64bc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c37b3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64bc106a80 0x7f64bc19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c37b3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc110e80 con 0x7f64bc100a80 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c37b3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc110d00 con 0x7f64bc101420 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c37b3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc111000 con 0x7f64bc106a80 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c154f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc100a80 0x7f64bc19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c154f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc100a80 0x7f64bc19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34434/0 (socket says 172.21.15.159:34434) 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c154f640 1 -- 172.21.15.159:0/1022352135 learned_addr learned my addr 172.21.15.159:0/1022352135 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c1d50640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64bc106a80 0x7f64bc19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c154f640 1 -- 172.21.15.159:0/1022352135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64bc106a80 msgr2=0x7f64bc19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c154f640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64bc106a80 0x7f64bc19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c154f640 1 -- 172.21.15.159:0/1022352135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64bc101420 msgr2=0x7f64bc19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c154f640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64bc101420 0x7f64bc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c154f640 1 -- 172.21.15.159:0/1022352135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64bc19f5c0 con 0x7f64bc100a80 2024-09-19T06:46:16.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.230+0000 7f64c1d50640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64bc106a80 0x7f64bc19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:16.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.231+0000 7f64c154f640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc100a80 0x7f64bc19a610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f64b800d950 tx=0x7f64b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:16.090 INFO:teuthology.orchestra.run.smithi159.stdout:34359738446 2024-09-19T06:46:16.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.231+0000 7f64b27fc640 1 -- 172.21.15.159:0/1022352135 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8017070 con 0x7f64bc100a80 2024-09-19T06:46:16.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.231+0000 7f64b27fc640 1 -- 172.21.15.159:0/1022352135 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64b8009c30 con 0x7f64bc100a80 2024-09-19T06:46:16.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.231+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64bc19f8b0 con 0x7f64bc100a80 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.231+0000 7f64b27fc640 1 -- 172.21.15.159:0/1022352135 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b800f6b0 con 0x7f64bc100a80 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.231+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64bc1a7190 con 0x7f64bc100a80 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.232+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64bc100ee0 con 0x7f64bc100a80 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.233+0000 7f64b27fc640 1 -- 172.21.15.159:0/1022352135 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f64b80109d0 con 0x7f64bc100a80 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.234+0000 7f64b27fc640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f64a80a32d0 0x7f64a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.234+0000 7f64c0d4e640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f64a80a32d0 0x7f64a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.234+0000 7f64b27fc640 1 -- 172.21.15.159:0/1022352135 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f64b80cf700 con 0x7f64bc100a80 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.234+0000 7f64c0d4e640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f64a80a32d0 0x7f64a80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64ac005fd0 tx=0x7f64ac005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.238+0000 7f64b27fc640 1 -- 172.21.15.159:0/1022352135 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f64b8009de0 con 0x7f64bc100a80 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.444+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f64bc1a7390 con 0x7f64bc100a80 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.444+0000 7f64b27fc640 1 -- 172.21.15.159:0/1022352135 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f64b809c2a0 con 0x7f64bc100a80 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f64a80a32d0 msgr2=0x7f64a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f64a80a32d0 0x7f64a80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64ac005fd0 tx=0x7f64ac005850 comp rx=0 tx=0).stop 2024-09-19T06:46:16.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc100a80 msgr2=0x7f64bc19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc100a80 0x7f64bc19a610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f64b800d950 tx=0x7f64b800de10 comp rx=0 tx=0).stop 2024-09-19T06:46:16.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 shutdown_connections 2024-09-19T06:46:16.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f64a80a32d0 0x7f64a80a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64bc106a80 0x7f64bc19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64bc101420 0x7f64bc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 --2- 172.21.15.159:0/1022352135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64bc100a80 0x7f64bc19a610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 >> 172.21.15.159:0/1022352135 conn(0x7f64bc0fc7a0 msgr2=0x7f64bc10c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:16.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 shutdown_connections 2024-09-19T06:46:16.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:14.447+0000 7f64c37b3640 1 -- 172.21.15.159:0/1022352135 wait complete. 2024-09-19T06:46:16.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.134+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7febf4109000 con 0x7febf4100a90 2024-09-19T06:46:16.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.134+0000 7febeaffd640 1 -- 172.21.15.159:0/887164911 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7febf00bc5d0 con 0x7febf4100a90 2024-09-19T06:46:16.136 INFO:teuthology.orchestra.run.smithi159.stdout:201863462956 2024-09-19T06:46:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7febe00a32d0 msgr2=0x7febe00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7febe00a32d0 0x7febe00a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7febf40fee00 tx=0x7febe4008040 comp rx=0 tx=0).stop 2024-09-19T06:46:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4100a90 msgr2=0x7febf41974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4100a90 0x7febf41974d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7febf0009a50 tx=0x7febf0004270 comp rx=0 tx=0).stop 2024-09-19T06:46:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 shutdown_connections 2024-09-19T06:46:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7febe00a32d0 0x7febe00a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febf4106a90 0x7febf419bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febf4101430 0x7febf4197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 --2- 172.21.15.159:0/887164911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf4100a90 0x7febf41974d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 >> 172.21.15.159:0/887164911 conn(0x7febf40fc7d0 msgr2=0x7febf40fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:16.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 shutdown_connections 2024-09-19T06:46:16.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.137+0000 7febfbbfe640 1 -- 172.21.15.159:0/887164911 wait complete. 2024-09-19T06:46:16.754 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:16 smithi159 ceph-mon[30935]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:16.754 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:16 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/887164911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:46:16.755 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612628 got 313532612630 for osd.11 2024-09-19T06:46:16.755 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:16.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:16 smithi203 ceph-mon[35473]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:16.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:16 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/887164911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:46:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:16 smithi189 ceph-mon[34880]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:16 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/887164911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.926+0000 7fea36633640 1 -- 172.21.15.159:0/2393666553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30100a80 msgr2=0x7fea30100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.926+0000 7fea36633640 1 --2- 172.21.15.159:0/2393666553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30100a80 0x7fea30100ee0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fea24009930 tx=0x7fea2402a420 comp rx=0 tx=0).stop 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.926+0000 7fea36633640 1 -- 172.21.15.159:0/2393666553 shutdown_connections 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.926+0000 7fea36633640 1 --2- 172.21.15.159:0/2393666553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea30101420 0x7fea3010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.926+0000 7fea36633640 1 --2- 172.21.15.159:0/2393666553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30100a80 0x7fea30100ee0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.926+0000 7fea36633640 1 --2- 172.21.15.159:0/2393666553 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.926+0000 7fea36633640 1 -- 172.21.15.159:0/2393666553 >> 172.21.15.159:0/2393666553 conn(0x7fea300fc7a0 msgr2=0x7fea300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.926+0000 7fea36633640 1 -- 172.21.15.159:0/2393666553 shutdown_connections 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.926+0000 7fea36633640 1 -- 172.21.15.159:0/2393666553 wait complete. 2024-09-19T06:46:16.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea36633640 1 Processor -- start 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea36633640 1 -- start start 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea36633640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea30100a80 0x7fea3010e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea36633640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30101420 0x7fea3010e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea36633640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea3010ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea36633640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea30111fa0 con 0x7fea30101420 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea36633640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea30111e20 con 0x7fea30100a80 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea36633640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea30112120 con 0x7fea30106a80 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea2f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30101420 0x7fea3010e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea2f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30101420 0x7fea3010e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34512/0 (socket says 172.21.15.159:34512) 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea2f7fe640 1 -- 172.21.15.159:0/1589618115 learned_addr learned my addr 172.21.15.159:0/1589618115 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea34bd0640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea3010ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea2f7fe640 1 -- 172.21.15.159:0/1589618115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 msgr2=0x7fea3010ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea2f7fe640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea3010ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea2f7fe640 1 -- 172.21.15.159:0/1589618115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea30100a80 msgr2=0x7fea3010e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea2f7fe640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea30100a80 0x7fea3010e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea2f7fe640 1 -- 172.21.15.159:0/1589618115 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea301a6830 con 0x7fea30101420 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea34bd0640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea3010ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.927+0000 7fea2f7fe640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30101420 0x7fea3010e920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fea24009a50 tx=0x7fea24004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.928+0000 7fea2d7fa640 1 -- 172.21.15.159:0/1589618115 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2403f030 con 0x7fea30101420 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.928+0000 7fea2d7fa640 1 -- 172.21.15.159:0/1589618115 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea24003ce0 con 0x7fea30101420 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.928+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea301a6ac0 con 0x7fea30101420 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.928+0000 7fea2d7fa640 1 -- 172.21.15.159:0/1589618115 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24035070 con 0x7fea30101420 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.928+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea301a6fa0 con 0x7fea30101420 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.929+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea30100ee0 con 0x7fea30101420 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.930+0000 7fea2d7fa640 1 -- 172.21.15.159:0/1589618115 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fea24042030 con 0x7fea30101420 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.930+0000 7fea2d7fa640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fea180a32d0 0x7fea180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:16.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.930+0000 7fea2ffff640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fea180a32d0 0x7fea180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:16.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.931+0000 7fea2d7fa640 1 -- 172.21.15.159:0/1589618115 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fea240f0560 con 0x7fea30101420 2024-09-19T06:46:16.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.931+0000 7fea2ffff640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fea180a32d0 0x7fea180a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fea2000a930 tx=0x7fea20005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:16.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:16.933+0000 7fea2d7fa640 1 -- 172.21.15.159:0/1589618115 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea240bd100 con 0x7fea30101420 2024-09-19T06:46:17.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.106+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fea301a71d0 con 0x7fea30101420 2024-09-19T06:46:17.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.107+0000 7fea2d7fa640 1 -- 172.21.15.159:0/1589618115 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea240bca00 con 0x7fea30101420 2024-09-19T06:46:17.108 INFO:teuthology.orchestra.run.smithi159.stdout:68719476805 2024-09-19T06:46:17.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fea180a32d0 msgr2=0x7fea180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:17.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fea180a32d0 0x7fea180a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fea2000a930 tx=0x7fea20005c00 comp rx=0 tx=0).stop 2024-09-19T06:46:17.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30101420 msgr2=0x7fea3010e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:17.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30101420 0x7fea3010e920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fea24009a50 tx=0x7fea24004270 comp rx=0 tx=0).stop 2024-09-19T06:46:17.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 shutdown_connections 2024-09-19T06:46:17.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fea180a32d0 0x7fea180a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:17.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea30106a80 0x7fea3010ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:17.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea30101420 0x7fea3010e920 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:17.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 --2- 172.21.15.159:0/1589618115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea30100a80 0x7fea3010e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:17.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 >> 172.21.15.159:0/1589618115 conn(0x7fea300fc7a0 msgr2=0x7fea300fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:17.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 shutdown_connections 2024-09-19T06:46:17.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:17.109+0000 7fea36633640 1 -- 172.21.15.159:0/1589618115 wait complete. 2024-09-19T06:46:17.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738446 for osd.0 2024-09-19T06:46:17.418 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:17.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:17 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1589618115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:46:17.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:17 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1589618115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:46:17.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:17 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1589618115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.310+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1991680532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 msgr2=0x7f3d1410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.310+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1991680532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 0x7f3d1410da40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009ca0 tx=0x7f3d0402a950 comp rx=0 tx=0).stop 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.310+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1991680532 shutdown_connections 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.310+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1991680532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 0x7f3d1410da40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.310+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1991680532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d14102570 0x7f3d141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.310+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1991680532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d14100e20 0x7f3d14101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.310+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1991680532 >> 172.21.15.159:0/1991680532 conn(0x7f3d140fc7d0 msgr2=0x7f3d140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1991680532 shutdown_connections 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1991680532 wait complete. 2024-09-19T06:46:18.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 Processor -- start 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 -- start start 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d14100e20 0x7f3d1419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d14102570 0x7f3d1419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 0x7f3d1419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3d141120a0 con 0x7f3d14102ef0 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14111f20 con 0x7f3d14102570 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.311+0000 7f3d1b3ac640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14112220 con 0x7f3d14100e20 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19949640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 0x7f3d1419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19949640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 0x7f3d1419eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34520/0 (socket says 172.21.15.159:34520) 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19949640 1 -- 172.21.15.159:0/1722706939 learned_addr learned my addr 172.21.15.159:0/1722706939 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:18.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d18947640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d14102570 0x7f3d1419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19148640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d14100e20 0x7f3d1419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19949640 1 -- 172.21.15.159:0/1722706939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d14100e20 msgr2=0x7f3d1419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19949640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d14100e20 0x7f3d1419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19949640 1 -- 172.21.15.159:0/1722706939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d14102570 msgr2=0x7f3d1419ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19949640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d14102570 0x7f3d1419ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19949640 1 -- 172.21.15.159:0/1722706939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1419f6d0 con 0x7f3d14102ef0 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d19949640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 0x7f3d1419eff0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d0402ae70 tx=0x7f3d0402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d127fc640 1 -- 172.21.15.159:0/1722706939 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04034040 con 0x7f3d14102ef0 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1419f960 con 0x7f3d14102ef0 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d127fc640 1 -- 172.21.15.159:0/1722706939 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d04030920 con 0x7f3d14102ef0 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d127fc640 1 -- 172.21.15.159:0/1722706939 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04045480 con 0x7f3d14102ef0 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.312+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d141a72a0 con 0x7f3d14102ef0 2024-09-19T06:46:18.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.313+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d14101200 con 0x7f3d14102ef0 2024-09-19T06:46:18.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.315+0000 7f3d127fc640 1 -- 172.21.15.159:0/1722706939 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3d04037020 con 0x7f3d14102ef0 2024-09-19T06:46:18.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.315+0000 7f3d127fc640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3cfc0a32d0 0x7f3cfc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:18.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.315+0000 7f3d19148640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3cfc0a32d0 0x7f3cfc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:18.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.315+0000 7f3d127fc640 1 -- 172.21.15.159:0/1722706939 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3d040f0a10 con 0x7f3d14102ef0 2024-09-19T06:46:18.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.316+0000 7f3d19148640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3cfc0a32d0 0x7f3cfc0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009890 tx=0x7f3d0c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:18.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.319+0000 7f3d127fc640 1 -- 172.21.15.159:0/1722706939 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d04081210 con 0x7f3d14102ef0 2024-09-19T06:46:18.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.491+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3d1410fb10 con 0x7f3d14102ef0 2024-09-19T06:46:18.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.491+0000 7f3d127fc640 1 -- 172.21.15.159:0/1722706939 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3d040bd6c0 con 0x7f3d14102ef0 2024-09-19T06:46:18.493 INFO:teuthology.orchestra.run.smithi159.stdout:180388626479 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3cfc0a32d0 msgr2=0x7f3cfc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3cfc0a32d0 0x7f3cfc0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009890 tx=0x7f3d0c008040 comp rx=0 tx=0).stop 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 msgr2=0x7f3d1419eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 0x7f3d1419eff0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d0402ae70 tx=0x7f3d0402f5d0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 shutdown_connections 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f3cfc0a32d0 0x7f3cfc0a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14102ef0 0x7f3d1419eff0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d14102570 0x7f3d1419ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 --2- 172.21.15.159:0/1722706939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d14100e20 0x7f3d1419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.493+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 >> 172.21.15.159:0/1722706939 conn(0x7f3d140fc7d0 msgr2=0x7f3d14106be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:18.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.494+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 shutdown_connections 2024-09-19T06:46:18.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:18.494+0000 7f3d1b3ac640 1 -- 172.21.15.159:0/1722706939 wait complete. 2024-09-19T06:46:18.801 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:18 smithi159 ceph-mon[30935]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:18.801 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:18 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1722706939' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:46:18.830 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841561 got 283467841563 for osd.10 2024-09-19T06:46:18.830 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:18.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:18 smithi203 ceph-mon[35473]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:18.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:18 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1722706939' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:46:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:18 smithi189 ceph-mon[34880]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:18 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1722706939' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:46:18.948 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855411 got 150323855413 for osd.5 2024-09-19T06:46:18.948 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:19.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.107+0000 7fb3653f6640 1 -- 172.21.15.159:0/3460465961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 msgr2=0x7fb36010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:19.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.107+0000 7fb3653f6640 1 --2- 172.21.15.159:0/3460465961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 0x7fb36010da40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb358009ca0 tx=0x7fb35802a950 comp rx=0 tx=0).stop 2024-09-19T06:46:19.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.107+0000 7fb3653f6640 1 -- 172.21.15.159:0/3460465961 shutdown_connections 2024-09-19T06:46:19.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.107+0000 7fb3653f6640 1 --2- 172.21.15.159:0/3460465961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 0x7fb36010da40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.107+0000 7fb3653f6640 1 --2- 172.21.15.159:0/3460465961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb360102570 0x7fb3601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.107+0000 7fb3653f6640 1 --2- 172.21.15.159:0/3460465961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb360100e20 0x7fb360101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.107+0000 7fb3653f6640 1 -- 172.21.15.159:0/3460465961 >> 172.21.15.159:0/3460465961 conn(0x7fb3600fc7d0 msgr2=0x7fb3600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:19.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.107+0000 7fb3653f6640 1 -- 172.21.15.159:0/3460465961 shutdown_connections 2024-09-19T06:46:19.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.107+0000 7fb3653f6640 1 -- 172.21.15.159:0/3460465961 wait complete. 2024-09-19T06:46:19.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb3653f6640 1 Processor -- start 2024-09-19T06:46:19.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb3653f6640 1 -- start start 2024-09-19T06:46:19.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb3653f6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb360100e20 0x7fb3601984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:19.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb3653f6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb360102570 0x7fb360198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:19.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb3653f6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 0x7fb36019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb3653f6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb360110f80 con 0x7fb360102ef0 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb3653f6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb360110e00 con 0x7fb360102570 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb3653f6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb360111100 con 0x7fb360100e20 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb35f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 0x7fb36019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb35f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 0x7fb36019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34538/0 (socket says 172.21.15.159:34538) 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb35f7fe640 1 -- 172.21.15.159:0/1922297752 learned_addr learned my addr 172.21.15.159:0/1922297752 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb35effd640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb360100e20 0x7fb3601984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.108+0000 7fb35e7fc640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb360102570 0x7fb360198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb35f7fe640 1 -- 172.21.15.159:0/1922297752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb360100e20 msgr2=0x7fb3601984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb35f7fe640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb360100e20 0x7fb3601984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb35f7fe640 1 -- 172.21.15.159:0/1922297752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb360102570 msgr2=0x7fb360198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb35f7fe640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb360102570 0x7fb360198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb35f7fe640 1 -- 172.21.15.159:0/1922297752 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36019d480 con 0x7fb360102ef0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb35f7fe640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 0x7fb36019cda0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb35802ae70 tx=0x7fb35802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb347fff640 1 -- 172.21.15.159:0/1922297752 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358034040 con 0x7fb360102ef0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb36019d710 con 0x7fb360102ef0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb347fff640 1 -- 172.21.15.159:0/1922297752 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb358030920 con 0x7fb360102ef0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb347fff640 1 -- 172.21.15.159:0/1922297752 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358045480 con 0x7fb360102ef0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.109+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3601a5050 con 0x7fb360102ef0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.110+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3601021b0 con 0x7fb360102ef0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.111+0000 7fb347fff640 1 -- 172.21.15.159:0/1922297752 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fb358037020 con 0x7fb360102ef0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.112+0000 7fb347fff640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3480a32d0 0x7fb3480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.112+0000 7fb347fff640 1 -- 172.21.15.159:0/1922297752 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb3580f0810 con 0x7fb360102ef0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.112+0000 7fb35effd640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3480a32d0 0x7fb3480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.112+0000 7fb35effd640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3480a32d0 0x7fb3480a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb350005fd0 tx=0x7fb35000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.116+0000 7fb347fff640 1 -- 172.21.15.159:0/1922297752 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3580bd4c0 con 0x7fb360102ef0 2024-09-19T06:46:19.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.291+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fb36010a0a0 con 0x7fb360102ef0 2024-09-19T06:46:19.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.292+0000 7fb347fff640 1 -- 172.21.15.159:0/1922297752 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb3580bcdc0 con 0x7fb360102ef0 2024-09-19T06:46:19.294 INFO:teuthology.orchestra.run.smithi159.stdout:231928234022 2024-09-19T06:46:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3480a32d0 msgr2=0x7fb3480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3480a32d0 0x7fb3480a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb350005fd0 tx=0x7fb35000b390 comp rx=0 tx=0).stop 2024-09-19T06:46:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 msgr2=0x7fb36019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 0x7fb36019cda0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb35802ae70 tx=0x7fb35802f5d0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 shutdown_connections 2024-09-19T06:46:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb3480a32d0 0x7fb3480a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb360102ef0 0x7fb36019cda0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb360102570 0x7fb360198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 --2- 172.21.15.159:0/1922297752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb360100e20 0x7fb3601984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 >> 172.21.15.159:0/1922297752 conn(0x7fb3600fc7d0 msgr2=0x7fb36006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 shutdown_connections 2024-09-19T06:46:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:19.294+0000 7fb3653f6640 1 -- 172.21.15.159:0/1922297752 wait complete. 2024-09-19T06:46:19.565 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:19.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:19 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:19.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:19 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1922297752' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:46:19.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:19 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:19.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:19 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1922297752' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:46:19.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:19 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:19.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:19 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1922297752' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:46:19.995 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234020 got 231928234022 for osd.8 2024-09-19T06:46:19.995 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:20.421 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626476 got 180388626479 for osd.6 2024-09-19T06:46:20.421 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:20.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:20 smithi159 ceph-mon[30935]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:20.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:20 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:20 smithi203 ceph-mon[35473]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:20 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:20 smithi189 ceph-mon[34880]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:20 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 -- 172.21.15.159:0/2222676678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c102d30 msgr2=0x7f0e0c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 --2- 172.21.15.159:0/2222676678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c102d30 0x7f0e0c103110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009930 tx=0x7f0e0802a420 comp rx=0 tx=0).stop 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 -- 172.21.15.159:0/2222676678 shutdown_connections 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 --2- 172.21.15.159:0/2222676678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e0c1082a0 0x7f0e0c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 --2- 172.21.15.159:0/2222676678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e0c1036e0 0x7f0e0c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 --2- 172.21.15.159:0/2222676678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c102d30 0x7f0e0c103110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 -- 172.21.15.159:0/2222676678 >> 172.21.15.159:0/2222676678 conn(0x7f0e0c0fc7d0 msgr2=0x7f0e0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 -- 172.21.15.159:0/2222676678 shutdown_connections 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 -- 172.21.15.159:0/2222676678 wait complete. 2024-09-19T06:46:21.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 Processor -- start 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.106+0000 7f0e1380e640 1 -- start start 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e1380e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e0c102d30 0x7f0e0c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e1380e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e0c1036e0 0x7f0e0c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e1380e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c1082a0 0x7f0e0c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e1380e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c1120a0 con 0x7f0e0c1082a0 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e1380e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c111f20 con 0x7f0e0c102d30 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e1380e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c112220 con 0x7f0e0c1036e0 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e11dab640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c1082a0 0x7f0e0c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e11dab640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c1082a0 0x7f0e0c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57888/0 (socket says 172.21.15.159:57888) 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e11dab640 1 -- 172.21.15.159:0/4089593732 learned_addr learned my addr 172.21.15.159:0/4089593732 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e115aa640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e0c102d30 0x7f0e0c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e10da9640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e0c1036e0 0x7f0e0c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e11dab640 1 -- 172.21.15.159:0/4089593732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e0c1036e0 msgr2=0x7f0e0c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e11dab640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e0c1036e0 0x7f0e0c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e11dab640 1 -- 172.21.15.159:0/4089593732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e0c102d30 msgr2=0x7f0e0c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e11dab640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e0c102d30 0x7f0e0c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e11dab640 1 -- 172.21.15.159:0/4089593732 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0c1a6a50 con 0x7f0e0c1082a0 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e10da9640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e0c1036e0 0x7f0e0c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e11dab640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c1082a0 0x7f0e0c101410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009fd0 tx=0x7f0e0400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e027fc640 1 -- 172.21.15.159:0/4089593732 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04017070 con 0x7f0e0c1082a0 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e0c1a6d40 con 0x7f0e0c1082a0 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e027fc640 1 -- 172.21.15.159:0/4089593732 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e04003e50 con 0x7f0e0c1082a0 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.107+0000 7f0e027fc640 1 -- 172.21.15.159:0/4089593732 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e040106c0 con 0x7f0e0c1082a0 2024-09-19T06:46:21.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.108+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e0c1a7230 con 0x7f0e0c1082a0 2024-09-19T06:46:21.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.108+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e0c06a850 con 0x7f0e0c1082a0 2024-09-19T06:46:21.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.110+0000 7f0e027fc640 1 -- 172.21.15.159:0/4089593732 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0e04003970 con 0x7f0e0c1082a0 2024-09-19T06:46:21.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.111+0000 7f0e027fc640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0df80a32d0 0x7f0df80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:21.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.111+0000 7f0e115aa640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0df80a32d0 0x7f0df80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:21.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.111+0000 7f0e027fc640 1 -- 172.21.15.159:0/4089593732 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0e040cf7f0 con 0x7f0e0c1082a0 2024-09-19T06:46:21.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.112+0000 7f0e115aa640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0df80a32d0 0x7f0df80a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009900 tx=0x7f0e080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:21.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.115+0000 7f0e027fc640 1 -- 172.21.15.159:0/4089593732 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0e0409c390 con 0x7f0e0c1082a0 2024-09-19T06:46:21.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.036+0000 7eff643d6640 1 -- 172.21.15.159:0/1293085488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 msgr2=0x7eff5c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.036+0000 7eff643d6640 1 --2- 172.21.15.159:0/1293085488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 0x7eff5c103110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7eff58009930 tx=0x7eff5802a420 comp rx=0 tx=0).stop 2024-09-19T06:46:21.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.036+0000 7eff643d6640 1 -- 172.21.15.159:0/1293085488 shutdown_connections 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.036+0000 7eff643d6640 1 --2- 172.21.15.159:0/1293085488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff5c1082a0 0x7eff5c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.036+0000 7eff643d6640 1 --2- 172.21.15.159:0/1293085488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff5c1036e0 0x7eff5c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.036+0000 7eff643d6640 1 --2- 172.21.15.159:0/1293085488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 0x7eff5c103110 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.036+0000 7eff643d6640 1 -- 172.21.15.159:0/1293085488 >> 172.21.15.159:0/1293085488 conn(0x7eff5c0fc7d0 msgr2=0x7eff5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.036+0000 7eff643d6640 1 -- 172.21.15.159:0/1293085488 shutdown_connections 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.036+0000 7eff643d6640 1 -- 172.21.15.159:0/1293085488 wait complete. 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.037+0000 7eff643d6640 1 Processor -- start 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.037+0000 7eff643d6640 1 -- start start 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.037+0000 7eff643d6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 0x7eff5c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.037+0000 7eff643d6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff5c1036e0 0x7eff5c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.037+0000 7eff643d6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff5c1082a0 0x7eff5c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:21.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.037+0000 7eff643d6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c1120a0 con 0x7eff5c102d30 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff643d6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c111f20 con 0x7eff5c1036e0 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff643d6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c112220 con 0x7eff5c1082a0 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62172640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 0x7eff5c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff61971640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff5c1036e0 0x7eff5c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62172640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 0x7eff5c1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57862/0 (socket says 172.21.15.159:57862) 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62172640 1 -- 172.21.15.159:0/2116374938 learned_addr learned my addr 172.21.15.159:0/2116374938 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62973640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff5c1082a0 0x7eff5c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62172640 1 -- 172.21.15.159:0/2116374938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff5c1082a0 msgr2=0x7eff5c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62172640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff5c1082a0 0x7eff5c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62172640 1 -- 172.21.15.159:0/2116374938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff5c1036e0 msgr2=0x7eff5c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62172640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff5c1036e0 0x7eff5c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62172640 1 -- 172.21.15.159:0/2116374938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c19d570 con 0x7eff5c102d30 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62973640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff5c1082a0 0x7eff5c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:21.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff62172640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 0x7eff5c1985c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff58009230 tx=0x7eff58004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff537fe640 1 -- 172.21.15.159:0/2116374938 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5803f030 con 0x7eff5c102d30 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff537fe640 1 -- 172.21.15.159:0/2116374938 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff58003ad0 con 0x7eff5c102d30 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5c19d800 con 0x7eff5c102d30 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff537fe640 1 -- 172.21.15.159:0/2116374938 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58035070 con 0x7eff5c102d30 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.038+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5c1a5140 con 0x7eff5c102d30 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.039+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5c06a850 con 0x7eff5c102d30 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.040+0000 7eff537fe640 1 -- 172.21.15.159:0/2116374938 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7eff58042030 con 0x7eff5c102d30 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.041+0000 7eff537fe640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff480a32d0 0x7eff480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.041+0000 7eff537fe640 1 -- 172.21.15.159:0/2116374938 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7eff580effa0 con 0x7eff5c102d30 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.041+0000 7eff61971640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff480a32d0 0x7eff480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.042+0000 7eff61971640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff480a32d0 0x7eff480a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0fee20 tx=0x7eff4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:21.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.045+0000 7eff537fe640 1 -- 172.21.15.159:0/2116374938 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7eff580bcb40 con 0x7eff5c102d30 2024-09-19T06:46:21.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.221+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7eff5c10a2b0 con 0x7eff5c102d30 2024-09-19T06:46:21.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.221+0000 7eff537fe640 1 -- 172.21.15.159:0/2116374938 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff580bc440 con 0x7eff5c102d30 2024-09-19T06:46:21.223 INFO:teuthology.orchestra.run.smithi159.stdout:98784247873 2024-09-19T06:46:21.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff480a32d0 msgr2=0x7eff480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff480a32d0 0x7eff480a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0fee20 tx=0x7eff4c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 msgr2=0x7eff5c1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 0x7eff5c1985c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff58009230 tx=0x7eff58004270 comp rx=0 tx=0).stop 2024-09-19T06:46:21.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 shutdown_connections 2024-09-19T06:46:21.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7eff480a32d0 0x7eff480a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff5c1082a0 0x7eff5c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff5c1036e0 0x7eff5c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 --2- 172.21.15.159:0/2116374938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff5c102d30 0x7eff5c1985c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 >> 172.21.15.159:0/2116374938 conn(0x7eff5c0fc7d0 msgr2=0x7eff5c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:21.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 shutdown_connections 2024-09-19T06:46:21.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.224+0000 7eff643d6640 1 -- 172.21.15.159:0/2116374938 wait complete. 2024-09-19T06:46:21.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.290+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0e0c10a2b0 con 0x7f0e0c1082a0 2024-09-19T06:46:21.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.290+0000 7f0e027fc640 1 -- 172.21.15.159:0/4089593732 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e0409bc90 con 0x7f0e0c1082a0 2024-09-19T06:46:21.291 INFO:teuthology.orchestra.run.smithi159.stdout:51539607627 2024-09-19T06:46:21.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0df80a32d0 msgr2=0x7f0df80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0df80a32d0 0x7f0df80a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009900 tx=0x7f0e080058d0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c1082a0 msgr2=0x7f0e0c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c1082a0 0x7f0e0c101410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009fd0 tx=0x7f0e0400b260 comp rx=0 tx=0).stop 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 shutdown_connections 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0df80a32d0 0x7f0df80a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e0c1082a0 0x7f0e0c101410 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e0c1036e0 0x7f0e0c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 --2- 172.21.15.159:0/4089593732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e0c102d30 0x7f0e0c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 >> 172.21.15.159:0/4089593732 conn(0x7f0e0c0fc7d0 msgr2=0x7f0e0c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 shutdown_connections 2024-09-19T06:46:21.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:21.292+0000 7f0e1380e640 1 -- 172.21.15.159:0/4089593732 wait complete. 2024-09-19T06:46:21.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:21 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2116374938' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:46:21.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:21 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/4089593732' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:46:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:21 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2116374938' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:46:21.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:21 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/4089593732' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:46:21.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:21 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2116374938' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:46:21.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:21 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/4089593732' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:46:22.119 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247870 got 98784247873 for osd.3 2024-09-19T06:46:22.119 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:22.550 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462954 got 201863462956 for osd.7 2024-09-19T06:46:22.551 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:22.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:22 smithi203 ceph-mon[35473]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:22.874 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:22 smithi159 ceph-mon[30935]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:22.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:22 smithi189 ceph-mon[34880]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:23.211 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476802 got 68719476805 for osd.2 2024-09-19T06:46:23.211 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:23.634 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607623 got 51539607627 for osd.1 2024-09-19T06:46:23.634 DEBUG:teuthology.parallel:result is None 2024-09-19T06:46:23.634 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:46:23.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:46:24.426 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:24.732 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:24 smithi159 ceph-mon[30935]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:24.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:24 smithi203 ceph-mon[35473]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:24.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:24 smithi189 ceph-mon[34880]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:24.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.963+0000 7fb860880640 1 -- 172.21.15.159:0/196526755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c102570 msgr2=0x7fb85c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:24.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.963+0000 7fb860880640 1 --2- 172.21.15.159:0/196526755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c102570 0x7fb85c1029b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb850009900 tx=0x7fb85002a480 comp rx=0 tx=0).stop 2024-09-19T06:46:24.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.963+0000 7fb860880640 1 -- 172.21.15.159:0/196526755 shutdown_connections 2024-09-19T06:46:24.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.963+0000 7fb860880640 1 --2- 172.21.15.159:0/196526755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb85c102ef0 0x7fb85c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:24.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.963+0000 7fb860880640 1 --2- 172.21.15.159:0/196526755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c102570 0x7fb85c1029b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:24.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.963+0000 7fb860880640 1 --2- 172.21.15.159:0/196526755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb85c100e20 0x7fb85c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:24.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.963+0000 7fb860880640 1 -- 172.21.15.159:0/196526755 >> 172.21.15.159:0/196526755 conn(0x7fb85c0fc7d0 msgr2=0x7fb85c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:24.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.963+0000 7fb860880640 1 -- 172.21.15.159:0/196526755 shutdown_connections 2024-09-19T06:46:24.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.963+0000 7fb860880640 1 -- 172.21.15.159:0/196526755 wait complete. 2024-09-19T06:46:24.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.964+0000 7fb860880640 1 Processor -- start 2024-09-19T06:46:24.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.964+0000 7fb860880640 1 -- start start 2024-09-19T06:46:24.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.964+0000 7fb860880640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c100e20 0x7fb85c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.964+0000 7fb860880640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb85c102570 0x7fb85c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.964+0000 7fb860880640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb85c102ef0 0x7fb85c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb860880640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c110f80 con 0x7fb85c100e20 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb860880640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c110e00 con 0x7fb85c102ef0 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb860880640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c111100 con 0x7fb85c102570 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c100e20 0x7fb85c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c100e20 0x7fb85c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57910/0 (socket says 172.21.15.159:57910) 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85a59c640 1 -- 172.21.15.159:0/2595985979 learned_addr learned my addr 172.21.15.159:0/2595985979 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb859d9b640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb85c102570 0x7fb85c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85ad9d640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb85c102ef0 0x7fb85c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85a59c640 1 -- 172.21.15.159:0/2595985979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb85c102570 msgr2=0x7fb85c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85a59c640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb85c102570 0x7fb85c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:24.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85a59c640 1 -- 172.21.15.159:0/2595985979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb85c102ef0 msgr2=0x7fb85c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:24.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85a59c640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb85c102ef0 0x7fb85c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:24.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85a59c640 1 -- 172.21.15.159:0/2595985979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c19d490 con 0x7fb85c100e20 2024-09-19T06:46:24.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb85a59c640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c100e20 0x7fb85c1984e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c890 tx=0x7fb84c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:24.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb84b7fe640 1 -- 172.21.15.159:0/2595985979 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c004220 con 0x7fb85c100e20 2024-09-19T06:46:24.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85c19d780 con 0x7fb85c100e20 2024-09-19T06:46:24.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb84b7fe640 1 -- 172.21.15.159:0/2595985979 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb84c0043c0 con 0x7fb85c100e20 2024-09-19T06:46:24.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.965+0000 7fb84b7fe640 1 -- 172.21.15.159:0/2595985979 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c0049e0 con 0x7fb85c100e20 2024-09-19T06:46:24.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.966+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85c0fcbb0 con 0x7fb85c100e20 2024-09-19T06:46:24.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.966+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85c101200 con 0x7fb85c100e20 2024-09-19T06:46:24.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.968+0000 7fb84b7fe640 1 -- 172.21.15.159:0/2595985979 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fb84c0079b0 con 0x7fb85c100e20 2024-09-19T06:46:24.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.968+0000 7fb84b7fe640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb8440a3350 0x7fb8440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:24.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.969+0000 7fb859d9b640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb8440a3350 0x7fb8440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:24.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.969+0000 7fb84b7fe640 1 -- 172.21.15.159:0/2595985979 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fb84c0cfad0 con 0x7fb85c100e20 2024-09-19T06:46:24.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.969+0000 7fb859d9b640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb8440a3350 0x7fb8440a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb850000c00 tx=0x7fb8500058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:24.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:24.972+0000 7fb84b7fe640 1 -- 172.21.15.159:0/2595985979 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb84c014030 con 0x7fb85c100e20 2024-09-19T06:46:25.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.156+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb85c062630 con 0x7fb8440a3350 2024-09-19T06:46:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.164+0000 7fb84b7fe640 1 -- 172.21.15.159:0/2595985979 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258928 (secure 0 0 0) 0x7fb85c062630 con 0x7fb8440a3350 2024-09-19T06:46:25.168 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:25.169 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:46:25.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.167+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb8440a3350 msgr2=0x7fb8440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.167+0000 7fb860880640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb8440a3350 0x7fb8440a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb850000c00 tx=0x7fb8500058d0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.167+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c100e20 msgr2=0x7fb85c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.167+0000 7fb860880640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c100e20 0x7fb85c1984e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c890 tx=0x7fb84c00cd50 comp rx=0 tx=0).stop 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.168+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 shutdown_connections 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.168+0000 7fb860880640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fb8440a3350 0x7fb8440a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.168+0000 7fb860880640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb85c102ef0 0x7fb85c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.168+0000 7fb860880640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb85c102570 0x7fb85c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.168+0000 7fb860880640 1 --2- 172.21.15.159:0/2595985979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb85c100e20 0x7fb85c1984e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.168+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 >> 172.21.15.159:0/2595985979 conn(0x7fb85c0fc7d0 msgr2=0x7fb85c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.168+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 shutdown_connections 2024-09-19T06:46:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:25.168+0000 7fb860880640 1 -- 172.21.15.159:0/2595985979 wait complete. 2024-09-19T06:46:25.868 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-19T06:46:23.423586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":248,"num_read_kb":239,"num_write":266,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364136,"kb_used_data":10704,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577688,"statfs":{"total":1151940427776,"available":1151567552512,"internally_reserved":0,"allocated":10960896,"data_stored":7145805,"data_compressed":181872,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003060"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838543+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:45:34.838543+0000","last_peered":"2024-09-19T06:45:34.838543+0000","last_clean":"2024-09-19T06:45:34.838543+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:45:34.838543+0000","last_undegraded":"2024-09-19T06:45:34.838543+0000","last_fullsized":"2024-09-19T06:45:34.838543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836449+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:45:34.836449+0000","last_peered":"2024-09-19T06:45:34.836449+0000","last_clean":"2024-09-19T06:45:34.836449+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:45:34.836449+0000","last_undegraded":"2024-09-19T06:45:34.836449+0000","last_fullsized":"2024-09-19T06:45:34.836449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836354+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:45:34.836354+0000","last_peered":"2024-09-19T06:45:34.836354+0000","last_clean":"2024-09-19T06:45:34.836354+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:45:34.836354+0000","last_undegraded":"2024-09-19T06:45:34.836354+0000","last_fullsized":"2024-09-19T06:45:34.836354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838457+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:45:34.838457+0000","last_peered":"2024-09-19T06:45:34.838457+0000","last_clean":"2024-09-19T06:45:34.838457+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:45:34.838457+0000","last_undegraded":"2024-09-19T06:45:34.838457+0000","last_fullsized":"2024-09-19T06:45:34.838457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841913+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:45:34.841913+0000","last_peered":"2024-09-19T06:45:34.841913+0000","last_clean":"2024-09-19T06:45:34.841913+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:45:34.841913+0000","last_undegraded":"2024-09-19T06:45:34.841913+0000","last_fullsized":"2024-09-19T06:45:34.841913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971761+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:45:34.971761+0000","last_peered":"2024-09-19T06:45:34.971761+0000","last_clean":"2024-09-19T06:45:34.971761+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:45:34.971761+0000","last_undegraded":"2024-09-19T06:45:34.971761+0000","last_fullsized":"2024-09-19T06:45:34.971761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843804+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:45:34.843804+0000","last_peered":"2024-09-19T06:45:34.843804+0000","last_clean":"2024-09-19T06:45:34.843804+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:45:34.843804+0000","last_undegraded":"2024-09-19T06:45:34.843804+0000","last_fullsized":"2024-09-19T06:45:34.843804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971412+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:45:34.971412+0000","last_peered":"2024-09-19T06:45:34.971412+0000","last_clean":"2024-09-19T06:45:34.971412+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:45:34.971412+0000","last_undegraded":"2024-09-19T06:45:34.971412+0000","last_fullsized":"2024-09-19T06:45:34.971412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842122+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:45:34.842122+0000","last_peered":"2024-09-19T06:45:34.842122+0000","last_clean":"2024-09-19T06:45:34.842122+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:45:34.842122+0000","last_undegraded":"2024-09-19T06:45:34.842122+0000","last_fullsized":"2024-09-19T06:45:34.842122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972290+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:45:34.972290+0000","last_peered":"2024-09-19T06:45:34.972290+0000","last_clean":"2024-09-19T06:45:34.972290+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:45:34.972290+0000","last_undegraded":"2024-09-19T06:45:34.972290+0000","last_fullsized":"2024-09-19T06:45:34.972290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844423+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:45:34.844423+0000","last_peered":"2024-09-19T06:45:34.844423+0000","last_clean":"2024-09-19T06:45:34.844423+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:45:34.844423+0000","last_undegraded":"2024-09-19T06:45:34.844423+0000","last_fullsized":"2024-09-19T06:45:34.844423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.973287+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:45:34.973287+0000","last_peered":"2024-09-19T06:45:34.973287+0000","last_clean":"2024-09-19T06:45:34.973287+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:45:34.973287+0000","last_undegraded":"2024-09-19T06:45:34.973287+0000","last_fullsized":"2024-09-19T06:45:34.973287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834791+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:45:34.834791+0000","last_peered":"2024-09-19T06:45:34.834791+0000","last_clean":"2024-09-19T06:45:34.834791+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:45:34.834791+0000","last_undegraded":"2024-09-19T06:45:34.834791+0000","last_fullsized":"2024-09-19T06:45:34.834791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836158+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:45:34.836158+0000","last_peered":"2024-09-19T06:45:34.836158+0000","last_clean":"2024-09-19T06:45:34.836158+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:45:34.836158+0000","last_undegraded":"2024-09-19T06:45:34.836158+0000","last_fullsized":"2024-09-19T06:45:34.836158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836159+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:45:34.836159+0000","last_peered":"2024-09-19T06:45:34.836159+0000","last_clean":"2024-09-19T06:45:34.836159+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:45:34.836159+0000","last_undegraded":"2024-09-19T06:45:34.836159+0000","last_fullsized":"2024-09-19T06:45:34.836159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841633+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:45:34.841633+0000","last_peered":"2024-09-19T06:45:34.841633+0000","last_clean":"2024-09-19T06:45:34.841633+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:45:34.841633+0000","last_undegraded":"2024-09-19T06:45:34.841633+0000","last_fullsized":"2024-09-19T06:45:34.841633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838658+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:45:34.838658+0000","last_peered":"2024-09-19T06:45:34.838658+0000","last_clean":"2024-09-19T06:45:34.838658+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:45:34.838658+0000","last_undegraded":"2024-09-19T06:45:34.838658+0000","last_fullsized":"2024-09-19T06:45:34.838658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838728+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:45:34.838728+0000","last_peered":"2024-09-19T06:45:34.838728+0000","last_clean":"2024-09-19T06:45:34.838728+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:45:34.838728+0000","last_undegraded":"2024-09-19T06:45:34.838728+0000","last_fullsized":"2024-09-19T06:45:34.838728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836019+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:45:34.836019+0000","last_peered":"2024-09-19T06:45:34.836019+0000","last_clean":"2024-09-19T06:45:34.836019+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:45:34.836019+0000","last_undegraded":"2024-09-19T06:45:34.836019+0000","last_fullsized":"2024-09-19T06:45:34.836019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.837959+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:45:34.837959+0000","last_peered":"2024-09-19T06:45:34.837959+0000","last_clean":"2024-09-19T06:45:34.837959+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:45:34.837959+0000","last_undegraded":"2024-09-19T06:45:34.837959+0000","last_fullsized":"2024-09-19T06:45:34.837959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834879+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:45:34.834879+0000","last_peered":"2024-09-19T06:45:34.834879+0000","last_clean":"2024-09-19T06:45:34.834879+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:45:34.834879+0000","last_undegraded":"2024-09-19T06:45:34.834879+0000","last_fullsized":"2024-09-19T06:45:34.834879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841800+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:45:34.841800+0000","last_peered":"2024-09-19T06:45:34.841800+0000","last_clean":"2024-09-19T06:45:34.841800+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:45:34.841800+0000","last_undegraded":"2024-09-19T06:45:34.841800+0000","last_fullsized":"2024-09-19T06:45:34.841800+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971330+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:45:34.971330+0000","last_peered":"2024-09-19T06:45:34.971330+0000","last_clean":"2024-09-19T06:45:34.971330+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:45:34.971330+0000","last_undegraded":"2024-09-19T06:45:34.971330+0000","last_fullsized":"2024-09-19T06:45:34.971330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843683+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:45:34.843683+0000","last_peered":"2024-09-19T06:45:34.843683+0000","last_clean":"2024-09-19T06:45:34.843683+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:45:34.843683+0000","last_undegraded":"2024-09-19T06:45:34.843683+0000","last_fullsized":"2024-09-19T06:45:34.843683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971688+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:45:34.971688+0000","last_peered":"2024-09-19T06:45:34.971688+0000","last_clean":"2024-09-19T06:45:34.971688+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:45:34.971688+0000","last_undegraded":"2024-09-19T06:45:34.971688+0000","last_fullsized":"2024-09-19T06:45:34.971688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836151+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:45:34.836151+0000","last_peered":"2024-09-19T06:45:34.836151+0000","last_clean":"2024-09-19T06:45:34.836151+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:45:34.836151+0000","last_undegraded":"2024-09-19T06:45:34.836151+0000","last_fullsized":"2024-09-19T06:45:34.836151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.837958+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:45:34.837958+0000","last_peered":"2024-09-19T06:45:34.837958+0000","last_clean":"2024-09-19T06:45:34.837958+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:45:34.837958+0000","last_undegraded":"2024-09-19T06:45:34.837958+0000","last_fullsized":"2024-09-19T06:45:34.837958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834831+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:45:34.834831+0000","last_peered":"2024-09-19T06:45:34.834831+0000","last_clean":"2024-09-19T06:45:34.834831+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:45:34.834831+0000","last_undegraded":"2024-09-19T06:45:34.834831+0000","last_fullsized":"2024-09-19T06:45:34.834831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843370+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:45:34.843370+0000","last_peered":"2024-09-19T06:45:34.843370+0000","last_clean":"2024-09-19T06:45:34.843370+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:45:34.843370+0000","last_undegraded":"2024-09-19T06:45:34.843370+0000","last_fullsized":"2024-09-19T06:45:34.843370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.835760+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:45:34.835760+0000","last_peered":"2024-09-19T06:45:34.835760+0000","last_clean":"2024-09-19T06:45:34.835760+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:45:34.835760+0000","last_undegraded":"2024-09-19T06:45:34.835760+0000","last_fullsized":"2024-09-19T06:45:34.835760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.835752+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:45:34.835752+0000","last_peered":"2024-09-19T06:45:34.835752+0000","last_clean":"2024-09-19T06:45:34.835752+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:45:34.835752+0000","last_undegraded":"2024-09-19T06:45:34.835752+0000","last_fullsized":"2024-09-19T06:45:34.835752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841201+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:45:34.841201+0000","last_peered":"2024-09-19T06:45:34.841201+0000","last_clean":"2024-09-19T06:45:34.841201+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:45:34.841201+0000","last_undegraded":"2024-09-19T06:45:34.841201+0000","last_fullsized":"2024-09-19T06:45:34.841201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841011+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:45:34.841011+0000","last_peered":"2024-09-19T06:45:34.841011+0000","last_clean":"2024-09-19T06:45:34.841011+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:45:34.841011+0000","last_undegraded":"2024-09-19T06:45:34.841011+0000","last_fullsized":"2024-09-19T06:45:34.841011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.846845+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:45:34.846845+0000","last_peered":"2024-09-19T06:45:34.846845+0000","last_clean":"2024-09-19T06:45:34.846845+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:45:34.846845+0000","last_undegraded":"2024-09-19T06:45:34.846845+0000","last_fullsized":"2024-09-19T06:45:34.846845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839526+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:45:34.839526+0000","last_peered":"2024-09-19T06:45:34.839526+0000","last_clean":"2024-09-19T06:45:34.839526+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:45:34.839526+0000","last_undegraded":"2024-09-19T06:45:34.839526+0000","last_fullsized":"2024-09-19T06:45:34.839526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971775+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:45:34.971775+0000","last_peered":"2024-09-19T06:45:34.971775+0000","last_clean":"2024-09-19T06:45:34.971775+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:45:34.971775+0000","last_undegraded":"2024-09-19T06:45:34.971775+0000","last_fullsized":"2024-09-19T06:45:34.971775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834620+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:45:34.834620+0000","last_peered":"2024-09-19T06:45:34.834620+0000","last_clean":"2024-09-19T06:45:34.834620+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:45:34.834620+0000","last_undegraded":"2024-09-19T06:45:34.834620+0000","last_fullsized":"2024-09-19T06:45:34.834620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971516+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:45:34.971516+0000","last_peered":"2024-09-19T06:45:34.971516+0000","last_clean":"2024-09-19T06:45:34.971516+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:45:34.971516+0000","last_undegraded":"2024-09-19T06:45:34.971516+0000","last_fullsized":"2024-09-19T06:45:34.971516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839090+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:45:34.839090+0000","last_peered":"2024-09-19T06:45:34.839090+0000","last_clean":"2024-09-19T06:45:34.839090+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:45:34.839090+0000","last_undegraded":"2024-09-19T06:45:34.839090+0000","last_fullsized":"2024-09-19T06:45:34.839090+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838500+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:45:34.838500+0000","last_peered":"2024-09-19T06:45:34.838500+0000","last_clean":"2024-09-19T06:45:34.838500+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:45:34.838500+0000","last_undegraded":"2024-09-19T06:45:34.838500+0000","last_fullsized":"2024-09-19T06:45:34.838500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972242+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:45:34.972242+0000","last_peered":"2024-09-19T06:45:34.972242+0000","last_clean":"2024-09-19T06:45:34.972242+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:45:34.972242+0000","last_undegraded":"2024-09-19T06:45:34.972242+0000","last_fullsized":"2024-09-19T06:45:34.972242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841937+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:45:34.841937+0000","last_peered":"2024-09-19T06:45:34.841937+0000","last_clean":"2024-09-19T06:45:34.841937+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:45:34.841937+0000","last_undegraded":"2024-09-19T06:45:34.841937+0000","last_fullsized":"2024-09-19T06:45:34.841937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843676+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:45:34.843676+0000","last_peered":"2024-09-19T06:45:34.843676+0000","last_clean":"2024-09-19T06:45:34.843676+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:45:34.843676+0000","last_undegraded":"2024-09-19T06:45:34.843676+0000","last_fullsized":"2024-09-19T06:45:34.843676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.847063+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:45:34.847063+0000","last_peered":"2024-09-19T06:45:34.847063+0000","last_clean":"2024-09-19T06:45:34.847063+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:45:34.847063+0000","last_undegraded":"2024-09-19T06:45:34.847063+0000","last_fullsized":"2024-09-19T06:45:34.847063+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839212+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:45:34.839212+0000","last_peered":"2024-09-19T06:45:34.839212+0000","last_clean":"2024-09-19T06:45:34.839212+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:45:34.839212+0000","last_undegraded":"2024-09-19T06:45:34.839212+0000","last_fullsized":"2024-09-19T06:45:34.839212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841822+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:45:34.841822+0000","last_peered":"2024-09-19T06:45:34.841822+0000","last_clean":"2024-09-19T06:45:34.841822+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:45:34.841822+0000","last_undegraded":"2024-09-19T06:45:34.841822+0000","last_fullsized":"2024-09-19T06:45:34.841822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'28","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:46:18.897729+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:46:18.897729+0000","last_peered":"2024-09-19T06:46:18.897729+0000","last_clean":"2024-09-19T06:46:18.897729+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:46:18.897729+0000","last_undegraded":"2024-09-19T06:46:18.897729+0000","last_fullsized":"2024-09-19T06:46:18.897729+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":114,"num_write":28,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841524+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:45:34.841524+0000","last_peered":"2024-09-19T06:45:34.841524+0000","last_clean":"2024-09-19T06:45:34.841524+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:45:34.841524+0000","last_undegraded":"2024-09-19T06:45:34.841524+0000","last_fullsized":"2024-09-19T06:45:34.841524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836029+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:45:34.836029+0000","last_peered":"2024-09-19T06:45:34.836029+0000","last_clean":"2024-09-19T06:45:34.836029+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:45:34.836029+0000","last_undegraded":"2024-09-19T06:45:34.836029+0000","last_fullsized":"2024-09-19T06:45:34.836029+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834657+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:45:34.834657+0000","last_peered":"2024-09-19T06:45:34.834657+0000","last_clean":"2024-09-19T06:45:34.834657+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:45:34.834657+0000","last_undegraded":"2024-09-19T06:45:34.834657+0000","last_fullsized":"2024-09-19T06:45:34.834657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838481+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:45:34.838481+0000","last_peered":"2024-09-19T06:45:34.838481+0000","last_clean":"2024-09-19T06:45:34.838481+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:45:34.838481+0000","last_undegraded":"2024-09-19T06:45:34.838481+0000","last_fullsized":"2024-09-19T06:45:34.838481+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844215+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:45:34.844215+0000","last_peered":"2024-09-19T06:45:34.844215+0000","last_clean":"2024-09-19T06:45:34.844215+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:45:34.844215+0000","last_undegraded":"2024-09-19T06:45:34.844215+0000","last_fullsized":"2024-09-19T06:45:34.844215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838328+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:45:34.838328+0000","last_peered":"2024-09-19T06:45:34.838328+0000","last_clean":"2024-09-19T06:45:34.838328+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:45:34.838328+0000","last_undegraded":"2024-09-19T06:45:34.838328+0000","last_fullsized":"2024-09-19T06:45:34.838328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.973152+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:45:34.973152+0000","last_peered":"2024-09-19T06:45:34.973152+0000","last_clean":"2024-09-19T06:45:34.973152+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:45:34.973152+0000","last_undegraded":"2024-09-19T06:45:34.973152+0000","last_fullsized":"2024-09-19T06:45:34.973152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842229+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:45:34.842229+0000","last_peered":"2024-09-19T06:45:34.842229+0000","last_clean":"2024-09-19T06:45:34.842229+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:45:34.842229+0000","last_undegraded":"2024-09-19T06:45:34.842229+0000","last_fullsized":"2024-09-19T06:45:34.842229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838241+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:45:34.838241+0000","last_peered":"2024-09-19T06:45:34.838241+0000","last_clean":"2024-09-19T06:45:34.838241+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:45:34.838241+0000","last_undegraded":"2024-09-19T06:45:34.838241+0000","last_fullsized":"2024-09-19T06:45:34.838241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841909+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:45:34.841909+0000","last_peered":"2024-09-19T06:45:34.841909+0000","last_clean":"2024-09-19T06:45:34.841909+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:45:34.841909+0000","last_undegraded":"2024-09-19T06:45:34.841909+0000","last_fullsized":"2024-09-19T06:45:34.841909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838064+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:45:34.838064+0000","last_peered":"2024-09-19T06:45:34.838064+0000","last_clean":"2024-09-19T06:45:34.838064+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:45:34.838064+0000","last_undegraded":"2024-09-19T06:45:34.838064+0000","last_fullsized":"2024-09-19T06:45:34.838064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834898+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:45:34.834898+0000","last_peered":"2024-09-19T06:45:34.834898+0000","last_clean":"2024-09-19T06:45:34.834898+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:45:34.834898+0000","last_undegraded":"2024-09-19T06:45:34.834898+0000","last_fullsized":"2024-09-19T06:45:34.834898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844431+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:45:34.844431+0000","last_peered":"2024-09-19T06:45:34.844431+0000","last_clean":"2024-09-19T06:45:34.844431+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:45:34.844431+0000","last_undegraded":"2024-09-19T06:45:34.844431+0000","last_fullsized":"2024-09-19T06:45:34.844431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839314+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:45:34.839314+0000","last_peered":"2024-09-19T06:45:34.839314+0000","last_clean":"2024-09-19T06:45:34.839314+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:45:34.839314+0000","last_undegraded":"2024-09-19T06:45:34.839314+0000","last_fullsized":"2024-09-19T06:45:34.839314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843610+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:45:34.843610+0000","last_peered":"2024-09-19T06:45:34.843610+0000","last_clean":"2024-09-19T06:45:34.843610+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:45:34.843610+0000","last_undegraded":"2024-09-19T06:45:34.843610+0000","last_fullsized":"2024-09-19T06:45:34.843610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836123+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:45:34.836123+0000","last_peered":"2024-09-19T06:45:34.836123+0000","last_clean":"2024-09-19T06:45:34.836123+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:45:34.836123+0000","last_undegraded":"2024-09-19T06:45:34.836123+0000","last_fullsized":"2024-09-19T06:45:34.836123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844519+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:45:34.844519+0000","last_peered":"2024-09-19T06:45:34.844519+0000","last_clean":"2024-09-19T06:45:34.844519+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:45:34.844519+0000","last_undegraded":"2024-09-19T06:45:34.844519+0000","last_fullsized":"2024-09-19T06:45:34.844519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":346,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843957+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:45:34.843957+0000","last_peered":"2024-09-19T06:45:34.843957+0000","last_clean":"2024-09-19T06:45:34.843957+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:45:34.843957+0000","last_undegraded":"2024-09-19T06:45:34.843957+0000","last_fullsized":"2024-09-19T06:45:34.843957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838447+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:45:34.838447+0000","last_peered":"2024-09-19T06:45:34.838447+0000","last_clean":"2024-09-19T06:45:34.838447+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:45:34.838447+0000","last_undegraded":"2024-09-19T06:45:34.838447+0000","last_fullsized":"2024-09-19T06:45:34.838447+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971505+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:45:34.971505+0000","last_peered":"2024-09-19T06:45:34.971505+0000","last_clean":"2024-09-19T06:45:34.971505+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:45:34.971505+0000","last_undegraded":"2024-09-19T06:45:34.971505+0000","last_fullsized":"2024-09-19T06:45:34.971505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844023+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:45:34.844023+0000","last_peered":"2024-09-19T06:45:34.844023+0000","last_clean":"2024-09-19T06:45:34.844023+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:45:34.844023+0000","last_undegraded":"2024-09-19T06:45:34.844023+0000","last_fullsized":"2024-09-19T06:45:34.844023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834590+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:45:34.834590+0000","last_peered":"2024-09-19T06:45:34.834590+0000","last_clean":"2024-09-19T06:45:34.834590+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:45:34.834590+0000","last_undegraded":"2024-09-19T06:45:34.834590+0000","last_fullsized":"2024-09-19T06:45:34.834590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834693+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:45:34.834693+0000","last_peered":"2024-09-19T06:45:34.834693+0000","last_clean":"2024-09-19T06:45:34.834693+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:45:34.834693+0000","last_undegraded":"2024-09-19T06:45:34.834693+0000","last_fullsized":"2024-09-19T06:45:34.834693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838558+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:45:34.838558+0000","last_peered":"2024-09-19T06:45:34.838558+0000","last_clean":"2024-09-19T06:45:34.838558+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:45:34.838558+0000","last_undegraded":"2024-09-19T06:45:34.838558+0000","last_fullsized":"2024-09-19T06:45:34.838558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844146+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:45:34.844146+0000","last_peered":"2024-09-19T06:45:34.844146+0000","last_clean":"2024-09-19T06:45:34.844146+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:45:34.844146+0000","last_undegraded":"2024-09-19T06:45:34.844146+0000","last_fullsized":"2024-09-19T06:45:34.844146+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971935+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:45:34.971935+0000","last_peered":"2024-09-19T06:45:34.971935+0000","last_clean":"2024-09-19T06:45:34.971935+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:45:34.971935+0000","last_undegraded":"2024-09-19T06:45:34.971935+0000","last_fullsized":"2024-09-19T06:45:34.971935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838632+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:45:34.838632+0000","last_peered":"2024-09-19T06:45:34.838632+0000","last_clean":"2024-09-19T06:45:34.838632+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:45:34.838632+0000","last_undegraded":"2024-09-19T06:45:34.838632+0000","last_fullsized":"2024-09-19T06:45:34.838632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972155+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:45:34.972155+0000","last_peered":"2024-09-19T06:45:34.972155+0000","last_clean":"2024-09-19T06:45:34.972155+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:45:34.972155+0000","last_undegraded":"2024-09-19T06:45:34.972155+0000","last_fullsized":"2024-09-19T06:45:34.972155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841771+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:45:34.841771+0000","last_peered":"2024-09-19T06:45:34.841771+0000","last_clean":"2024-09-19T06:45:34.841771+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:45:34.841771+0000","last_undegraded":"2024-09-19T06:45:34.841771+0000","last_fullsized":"2024-09-19T06:45:34.841771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834937+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:45:34.834937+0000","last_peered":"2024-09-19T06:45:34.834937+0000","last_clean":"2024-09-19T06:45:34.834937+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:45:34.834937+0000","last_undegraded":"2024-09-19T06:45:34.834937+0000","last_fullsized":"2024-09-19T06:45:34.834937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:45.780646+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:45:45.780646+0000","last_peered":"2024-09-19T06:45:45.780646+0000","last_clean":"2024-09-19T06:45:45.780646+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:45:45.780646+0000","last_undegraded":"2024-09-19T06:45:45.780646+0000","last_fullsized":"2024-09-19T06:45:45.780646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971798+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:45:34.971798+0000","last_peered":"2024-09-19T06:45:34.971798+0000","last_clean":"2024-09-19T06:45:34.971798+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:45:34.971798+0000","last_undegraded":"2024-09-19T06:45:34.971798+0000","last_fullsized":"2024-09-19T06:45:34.971798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838771+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:45:34.838771+0000","last_peered":"2024-09-19T06:45:34.838771+0000","last_clean":"2024-09-19T06:45:34.838771+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:45:34.838771+0000","last_undegraded":"2024-09-19T06:45:34.838771+0000","last_fullsized":"2024-09-19T06:45:34.838771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972922+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:45:34.972922+0000","last_peered":"2024-09-19T06:45:34.972922+0000","last_clean":"2024-09-19T06:45:34.972922+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:45:34.972922+0000","last_undegraded":"2024-09-19T06:45:34.972922+0000","last_fullsized":"2024-09-19T06:45:34.972922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841810+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:45:34.841810+0000","last_peered":"2024-09-19T06:45:34.841810+0000","last_clean":"2024-09-19T06:45:34.841810+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:45:34.841810+0000","last_undegraded":"2024-09-19T06:45:34.841810+0000","last_fullsized":"2024-09-19T06:45:34.841810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.840921+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:45:34.840921+0000","last_peered":"2024-09-19T06:45:34.840921+0000","last_clean":"2024-09-19T06:45:34.840921+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:45:34.840921+0000","last_undegraded":"2024-09-19T06:45:34.840921+0000","last_fullsized":"2024-09-19T06:45:34.840921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971446+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:45:34.971446+0000","last_peered":"2024-09-19T06:45:34.971446+0000","last_clean":"2024-09-19T06:45:34.971446+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:45:34.971446+0000","last_undegraded":"2024-09-19T06:45:34.971446+0000","last_fullsized":"2024-09-19T06:45:34.971446+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838320+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:45:34.838320+0000","last_peered":"2024-09-19T06:45:34.838320+0000","last_clean":"2024-09-19T06:45:34.838320+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:45:34.838320+0000","last_undegraded":"2024-09-19T06:45:34.838320+0000","last_fullsized":"2024-09-19T06:45:34.838320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972570+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:45:34.972570+0000","last_peered":"2024-09-19T06:45:34.972570+0000","last_clean":"2024-09-19T06:45:34.972570+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:45:34.972570+0000","last_undegraded":"2024-09-19T06:45:34.972570+0000","last_fullsized":"2024-09-19T06:45:34.972570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971518+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:45:34.971518+0000","last_peered":"2024-09-19T06:45:34.971518+0000","last_clean":"2024-09-19T06:45:34.971518+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:45:34.971518+0000","last_undegraded":"2024-09-19T06:45:34.971518+0000","last_fullsized":"2024-09-19T06:45:34.971518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842086+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:45:34.842086+0000","last_peered":"2024-09-19T06:45:34.842086+0000","last_clean":"2024-09-19T06:45:34.842086+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:45:34.842086+0000","last_undegraded":"2024-09-19T06:45:34.842086+0000","last_fullsized":"2024-09-19T06:45:34.842086+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844057+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:45:34.844057+0000","last_peered":"2024-09-19T06:45:34.844057+0000","last_clean":"2024-09-19T06:45:34.844057+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:45:34.844057+0000","last_undegraded":"2024-09-19T06:45:34.844057+0000","last_fullsized":"2024-09-19T06:45:34.844057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839054+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:45:34.839054+0000","last_peered":"2024-09-19T06:45:34.839054+0000","last_clean":"2024-09-19T06:45:34.839054+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:45:34.839054+0000","last_undegraded":"2024-09-19T06:45:34.839054+0000","last_fullsized":"2024-09-19T06:45:34.839054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.847185+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:45:34.847185+0000","last_peered":"2024-09-19T06:45:34.847185+0000","last_clean":"2024-09-19T06:45:34.847185+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:45:34.847185+0000","last_undegraded":"2024-09-19T06:45:34.847185+0000","last_fullsized":"2024-09-19T06:45:34.847185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841692+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:45:34.841692+0000","last_peered":"2024-09-19T06:45:34.841692+0000","last_clean":"2024-09-19T06:45:34.841692+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:45:34.841692+0000","last_undegraded":"2024-09-19T06:45:34.841692+0000","last_fullsized":"2024-09-19T06:45:34.841692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841638+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:45:34.841638+0000","last_peered":"2024-09-19T06:45:34.841638+0000","last_clean":"2024-09-19T06:45:34.841638+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:45:34.841638+0000","last_undegraded":"2024-09-19T06:45:34.841638+0000","last_fullsized":"2024-09-19T06:45:34.841638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836435+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:45:34.836435+0000","last_peered":"2024-09-19T06:45:34.836435+0000","last_clean":"2024-09-19T06:45:34.836435+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:45:34.836435+0000","last_undegraded":"2024-09-19T06:45:34.836435+0000","last_fullsized":"2024-09-19T06:45:34.836435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971775+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:45:34.971775+0000","last_peered":"2024-09-19T06:45:34.971775+0000","last_clean":"2024-09-19T06:45:34.971775+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:45:34.971775+0000","last_undegraded":"2024-09-19T06:45:34.971775+0000","last_fullsized":"2024-09-19T06:45:34.971775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971608+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:45:34.971608+0000","last_peered":"2024-09-19T06:45:34.971608+0000","last_clean":"2024-09-19T06:45:34.971608+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:45:34.971608+0000","last_undegraded":"2024-09-19T06:45:34.971608+0000","last_fullsized":"2024-09-19T06:45:34.971608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838849+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:45:34.838849+0000","last_peered":"2024-09-19T06:45:34.838849+0000","last_clean":"2024-09-19T06:45:34.838849+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:45:34.838849+0000","last_undegraded":"2024-09-19T06:45:34.838849+0000","last_fullsized":"2024-09-19T06:45:34.838849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":112,"num_read_kb":120,"num_write":83,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":190851,"data_compressed":5439,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281443,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612632,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":431929,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841565,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1085427,"data_compressed":43362,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":432511,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":432533,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1022996,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":432046,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":1022596,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018941,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":431951,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":432267,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476807,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":494782,"data_compressed":7567,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":494748,"data_compressed":7567,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":432019,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":62819,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62853,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63013,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:46:25.873 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:46:26.153 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:26.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 -- 172.21.15.159:0/2054161758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100eb0 msgr2=0x7fe4181067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/2054161758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100eb0 0x7fe4181067a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009900 tx=0x7fe40c02a410 comp rx=0 tx=0).stop 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 -- 172.21.15.159:0/2054161758 shutdown_connections 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/2054161758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe418106ed0 0x7fe41810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/2054161758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100eb0 0x7fe4181067a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/2054161758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe418100500 0x7fe4181008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 -- 172.21.15.159:0/2054161758 >> 172.21.15.159:0/2054161758 conn(0x7fe4180fc5c0 msgr2=0x7fe4180fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 -- 172.21.15.159:0/2054161758 shutdown_connections 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 -- 172.21.15.159:0/2054161758 wait complete. 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.632+0000 7fe41d6b3640 1 Processor -- start 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe41d6b3640 1 -- start start 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe41d6b3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100500 0x7fe418198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:26.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe41d6b3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe418100eb0 0x7fe418198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe41d6b3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe418106ed0 0x7fe41819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe41d6b3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe418112020 con 0x7fe418100500 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe41d6b3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe418111ea0 con 0x7fe418106ed0 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe41d6b3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe4181121a0 con 0x7fe418100eb0 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe416ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100500 0x7fe418198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe416ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100500 0x7fe418198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57936/0 (socket says 172.21.15.159:57936) 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe416ffd640 1 -- 172.21.15.159:0/3565308287 learned_addr learned my addr 172.21.15.159:0/3565308287 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe4177fe640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe418106ed0 0x7fe41819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe416ffd640 1 -- 172.21.15.159:0/3565308287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe418100eb0 msgr2=0x7fe418198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe4167fc640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe418100eb0 0x7fe418198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe416ffd640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe418100eb0 0x7fe418198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe416ffd640 1 -- 172.21.15.159:0/3565308287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe418106ed0 msgr2=0x7fe41819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:26.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe416ffd640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe418106ed0 0x7fe41819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe416ffd640 1 -- 172.21.15.159:0/3565308287 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41819d530 con 0x7fe418100500 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe4177fe640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe418106ed0 0x7fe41819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.633+0000 7fe416ffd640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100500 0x7fe418198580 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe40800ba50 tx=0x7fe40800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.634+0000 7fe3fffff640 1 -- 172.21.15.159:0/3565308287 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe408019070 con 0x7fe418100500 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.634+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41819d820 con 0x7fe418100500 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.634+0000 7fe3fffff640 1 -- 172.21.15.159:0/3565308287 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe40800cbe0 con 0x7fe418100500 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.634+0000 7fe3fffff640 1 -- 172.21.15.159:0/3565308287 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4080076e0 con 0x7fe418100500 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.634+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4181a5100 con 0x7fe418100500 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.635+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe418100960 con 0x7fe418100500 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.636+0000 7fe3fffff640 1 -- 172.21.15.159:0/3565308287 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe40801c070 con 0x7fe418100500 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.636+0000 7fe3fffff640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe4000a32d0 0x7fe4000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.636+0000 7fe4167fc640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe4000a32d0 0x7fe4000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:26.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.636+0000 7fe3fffff640 1 -- 172.21.15.159:0/3565308287 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fe4080cf010 con 0x7fe418100500 2024-09-19T06:46:26.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.637+0000 7fe4167fc640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe4000a32d0 0x7fe4000a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0096c0 tx=0x7fe40c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:26.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.640+0000 7fe3fffff640 1 -- 172.21.15.159:0/3565308287 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe40809bcc0 con 0x7fe418100500 2024-09-19T06:46:26.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.807+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe418062630 con 0x7fe4000a32d0 2024-09-19T06:46:26.808 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:26 smithi159 ceph-mon[30935]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:46:26.808 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:26 smithi159 ceph-mon[30935]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:26.808 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:26.808 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:26.809 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:26.809 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:26.809 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:26 smithi159 ceph-mon[30935]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:26.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.813+0000 7fe3fffff640 1 -- 172.21.15.159:0/3565308287 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258928 (secure 0 0 0) 0x7fe418062630 con 0x7fe4000a32d0 2024-09-19T06:46:26.816 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:26.817 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:46:26.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.816+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe4000a32d0 msgr2=0x7fe4000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:26.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.816+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe4000a32d0 0x7fe4000a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0096c0 tx=0x7fe40c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.816+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100500 msgr2=0x7fe418198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:26.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.816+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100500 0x7fe418198580 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe40800ba50 tx=0x7fe40800bf10 comp rx=0 tx=0).stop 2024-09-19T06:46:26.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.817+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 shutdown_connections 2024-09-19T06:46:26.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.817+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fe4000a32d0 0x7fe4000a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.817+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe418106ed0 0x7fe41819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.817+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe418100eb0 0x7fe418198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.817+0000 7fe41d6b3640 1 --2- 172.21.15.159:0/3565308287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe418100500 0x7fe418198580 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:26.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.817+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 >> 172.21.15.159:0/3565308287 conn(0x7fe4180fc5c0 msgr2=0x7fe418105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:26.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.817+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 shutdown_connections 2024-09-19T06:46:26.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:26.817+0000 7fe41d6b3640 1 -- 172.21.15.159:0/3565308287 wait complete. 2024-09-19T06:46:26.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:26 smithi203 ceph-mon[35473]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:46:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:26 smithi203 ceph-mon[35473]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:26.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:26 smithi203 ceph-mon[35473]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:26.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:26 smithi189 ceph-mon[34880]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:46:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:26 smithi189 ceph-mon[34880]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:26.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:26 smithi189 ceph-mon[34880]: from='mgr.14150 172.21.15.159:0/2897666583' entity='mgr.x' 2024-09-19T06:46:27.504 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-19T06:46:25.424284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":258,"num_read_kb":244,"num_write":266,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364136,"kb_used_data":10704,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577688,"statfs":{"total":1151940427776,"available":1151567552512,"internally_reserved":0,"allocated":10960896,"data_stored":7145805,"data_compressed":181872,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003268"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838543+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:45:34.838543+0000","last_peered":"2024-09-19T06:45:34.838543+0000","last_clean":"2024-09-19T06:45:34.838543+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:45:34.838543+0000","last_undegraded":"2024-09-19T06:45:34.838543+0000","last_fullsized":"2024-09-19T06:45:34.838543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836449+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:45:34.836449+0000","last_peered":"2024-09-19T06:45:34.836449+0000","last_clean":"2024-09-19T06:45:34.836449+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:45:34.836449+0000","last_undegraded":"2024-09-19T06:45:34.836449+0000","last_fullsized":"2024-09-19T06:45:34.836449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836354+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:45:34.836354+0000","last_peered":"2024-09-19T06:45:34.836354+0000","last_clean":"2024-09-19T06:45:34.836354+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:45:34.836354+0000","last_undegraded":"2024-09-19T06:45:34.836354+0000","last_fullsized":"2024-09-19T06:45:34.836354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838457+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:45:34.838457+0000","last_peered":"2024-09-19T06:45:34.838457+0000","last_clean":"2024-09-19T06:45:34.838457+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:45:34.838457+0000","last_undegraded":"2024-09-19T06:45:34.838457+0000","last_fullsized":"2024-09-19T06:45:34.838457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841913+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:45:34.841913+0000","last_peered":"2024-09-19T06:45:34.841913+0000","last_clean":"2024-09-19T06:45:34.841913+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:45:34.841913+0000","last_undegraded":"2024-09-19T06:45:34.841913+0000","last_fullsized":"2024-09-19T06:45:34.841913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971761+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:45:34.971761+0000","last_peered":"2024-09-19T06:45:34.971761+0000","last_clean":"2024-09-19T06:45:34.971761+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:45:34.971761+0000","last_undegraded":"2024-09-19T06:45:34.971761+0000","last_fullsized":"2024-09-19T06:45:34.971761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843804+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:45:34.843804+0000","last_peered":"2024-09-19T06:45:34.843804+0000","last_clean":"2024-09-19T06:45:34.843804+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:45:34.843804+0000","last_undegraded":"2024-09-19T06:45:34.843804+0000","last_fullsized":"2024-09-19T06:45:34.843804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971412+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:45:34.971412+0000","last_peered":"2024-09-19T06:45:34.971412+0000","last_clean":"2024-09-19T06:45:34.971412+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:45:34.971412+0000","last_undegraded":"2024-09-19T06:45:34.971412+0000","last_fullsized":"2024-09-19T06:45:34.971412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842122+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:45:34.842122+0000","last_peered":"2024-09-19T06:45:34.842122+0000","last_clean":"2024-09-19T06:45:34.842122+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:45:34.842122+0000","last_undegraded":"2024-09-19T06:45:34.842122+0000","last_fullsized":"2024-09-19T06:45:34.842122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972290+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:45:34.972290+0000","last_peered":"2024-09-19T06:45:34.972290+0000","last_clean":"2024-09-19T06:45:34.972290+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:45:34.972290+0000","last_undegraded":"2024-09-19T06:45:34.972290+0000","last_fullsized":"2024-09-19T06:45:34.972290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844423+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:45:34.844423+0000","last_peered":"2024-09-19T06:45:34.844423+0000","last_clean":"2024-09-19T06:45:34.844423+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:45:34.844423+0000","last_undegraded":"2024-09-19T06:45:34.844423+0000","last_fullsized":"2024-09-19T06:45:34.844423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.973287+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:45:34.973287+0000","last_peered":"2024-09-19T06:45:34.973287+0000","last_clean":"2024-09-19T06:45:34.973287+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:45:34.973287+0000","last_undegraded":"2024-09-19T06:45:34.973287+0000","last_fullsized":"2024-09-19T06:45:34.973287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834791+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:45:34.834791+0000","last_peered":"2024-09-19T06:45:34.834791+0000","last_clean":"2024-09-19T06:45:34.834791+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:45:34.834791+0000","last_undegraded":"2024-09-19T06:45:34.834791+0000","last_fullsized":"2024-09-19T06:45:34.834791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836158+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:45:34.836158+0000","last_peered":"2024-09-19T06:45:34.836158+0000","last_clean":"2024-09-19T06:45:34.836158+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:45:34.836158+0000","last_undegraded":"2024-09-19T06:45:34.836158+0000","last_fullsized":"2024-09-19T06:45:34.836158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836159+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:45:34.836159+0000","last_peered":"2024-09-19T06:45:34.836159+0000","last_clean":"2024-09-19T06:45:34.836159+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:45:34.836159+0000","last_undegraded":"2024-09-19T06:45:34.836159+0000","last_fullsized":"2024-09-19T06:45:34.836159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841633+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:45:34.841633+0000","last_peered":"2024-09-19T06:45:34.841633+0000","last_clean":"2024-09-19T06:45:34.841633+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:45:34.841633+0000","last_undegraded":"2024-09-19T06:45:34.841633+0000","last_fullsized":"2024-09-19T06:45:34.841633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838658+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:45:34.838658+0000","last_peered":"2024-09-19T06:45:34.838658+0000","last_clean":"2024-09-19T06:45:34.838658+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:45:34.838658+0000","last_undegraded":"2024-09-19T06:45:34.838658+0000","last_fullsized":"2024-09-19T06:45:34.838658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838728+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:45:34.838728+0000","last_peered":"2024-09-19T06:45:34.838728+0000","last_clean":"2024-09-19T06:45:34.838728+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:45:34.838728+0000","last_undegraded":"2024-09-19T06:45:34.838728+0000","last_fullsized":"2024-09-19T06:45:34.838728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836019+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:45:34.836019+0000","last_peered":"2024-09-19T06:45:34.836019+0000","last_clean":"2024-09-19T06:45:34.836019+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:45:34.836019+0000","last_undegraded":"2024-09-19T06:45:34.836019+0000","last_fullsized":"2024-09-19T06:45:34.836019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.837959+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:45:34.837959+0000","last_peered":"2024-09-19T06:45:34.837959+0000","last_clean":"2024-09-19T06:45:34.837959+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:45:34.837959+0000","last_undegraded":"2024-09-19T06:45:34.837959+0000","last_fullsized":"2024-09-19T06:45:34.837959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834879+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:45:34.834879+0000","last_peered":"2024-09-19T06:45:34.834879+0000","last_clean":"2024-09-19T06:45:34.834879+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:45:34.834879+0000","last_undegraded":"2024-09-19T06:45:34.834879+0000","last_fullsized":"2024-09-19T06:45:34.834879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841800+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:45:34.841800+0000","last_peered":"2024-09-19T06:45:34.841800+0000","last_clean":"2024-09-19T06:45:34.841800+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:45:34.841800+0000","last_undegraded":"2024-09-19T06:45:34.841800+0000","last_fullsized":"2024-09-19T06:45:34.841800+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971330+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:45:34.971330+0000","last_peered":"2024-09-19T06:45:34.971330+0000","last_clean":"2024-09-19T06:45:34.971330+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:45:34.971330+0000","last_undegraded":"2024-09-19T06:45:34.971330+0000","last_fullsized":"2024-09-19T06:45:34.971330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843683+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:45:34.843683+0000","last_peered":"2024-09-19T06:45:34.843683+0000","last_clean":"2024-09-19T06:45:34.843683+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:45:34.843683+0000","last_undegraded":"2024-09-19T06:45:34.843683+0000","last_fullsized":"2024-09-19T06:45:34.843683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971688+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:45:34.971688+0000","last_peered":"2024-09-19T06:45:34.971688+0000","last_clean":"2024-09-19T06:45:34.971688+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:45:34.971688+0000","last_undegraded":"2024-09-19T06:45:34.971688+0000","last_fullsized":"2024-09-19T06:45:34.971688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836151+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:45:34.836151+0000","last_peered":"2024-09-19T06:45:34.836151+0000","last_clean":"2024-09-19T06:45:34.836151+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:45:34.836151+0000","last_undegraded":"2024-09-19T06:45:34.836151+0000","last_fullsized":"2024-09-19T06:45:34.836151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.837958+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:45:34.837958+0000","last_peered":"2024-09-19T06:45:34.837958+0000","last_clean":"2024-09-19T06:45:34.837958+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:45:34.837958+0000","last_undegraded":"2024-09-19T06:45:34.837958+0000","last_fullsized":"2024-09-19T06:45:34.837958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834831+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:45:34.834831+0000","last_peered":"2024-09-19T06:45:34.834831+0000","last_clean":"2024-09-19T06:45:34.834831+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:45:34.834831+0000","last_undegraded":"2024-09-19T06:45:34.834831+0000","last_fullsized":"2024-09-19T06:45:34.834831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843370+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:45:34.843370+0000","last_peered":"2024-09-19T06:45:34.843370+0000","last_clean":"2024-09-19T06:45:34.843370+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:45:34.843370+0000","last_undegraded":"2024-09-19T06:45:34.843370+0000","last_fullsized":"2024-09-19T06:45:34.843370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.835760+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:45:34.835760+0000","last_peered":"2024-09-19T06:45:34.835760+0000","last_clean":"2024-09-19T06:45:34.835760+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:45:34.835760+0000","last_undegraded":"2024-09-19T06:45:34.835760+0000","last_fullsized":"2024-09-19T06:45:34.835760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.835752+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:45:34.835752+0000","last_peered":"2024-09-19T06:45:34.835752+0000","last_clean":"2024-09-19T06:45:34.835752+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:45:34.835752+0000","last_undegraded":"2024-09-19T06:45:34.835752+0000","last_fullsized":"2024-09-19T06:45:34.835752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841201+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:45:34.841201+0000","last_peered":"2024-09-19T06:45:34.841201+0000","last_clean":"2024-09-19T06:45:34.841201+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:45:34.841201+0000","last_undegraded":"2024-09-19T06:45:34.841201+0000","last_fullsized":"2024-09-19T06:45:34.841201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841011+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:45:34.841011+0000","last_peered":"2024-09-19T06:45:34.841011+0000","last_clean":"2024-09-19T06:45:34.841011+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:45:34.841011+0000","last_undegraded":"2024-09-19T06:45:34.841011+0000","last_fullsized":"2024-09-19T06:45:34.841011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.846845+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:45:34.846845+0000","last_peered":"2024-09-19T06:45:34.846845+0000","last_clean":"2024-09-19T06:45:34.846845+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:45:34.846845+0000","last_undegraded":"2024-09-19T06:45:34.846845+0000","last_fullsized":"2024-09-19T06:45:34.846845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839526+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:45:34.839526+0000","last_peered":"2024-09-19T06:45:34.839526+0000","last_clean":"2024-09-19T06:45:34.839526+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:45:34.839526+0000","last_undegraded":"2024-09-19T06:45:34.839526+0000","last_fullsized":"2024-09-19T06:45:34.839526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971775+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:45:34.971775+0000","last_peered":"2024-09-19T06:45:34.971775+0000","last_clean":"2024-09-19T06:45:34.971775+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:45:34.971775+0000","last_undegraded":"2024-09-19T06:45:34.971775+0000","last_fullsized":"2024-09-19T06:45:34.971775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834620+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:45:34.834620+0000","last_peered":"2024-09-19T06:45:34.834620+0000","last_clean":"2024-09-19T06:45:34.834620+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:45:34.834620+0000","last_undegraded":"2024-09-19T06:45:34.834620+0000","last_fullsized":"2024-09-19T06:45:34.834620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971516+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:45:34.971516+0000","last_peered":"2024-09-19T06:45:34.971516+0000","last_clean":"2024-09-19T06:45:34.971516+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:45:34.971516+0000","last_undegraded":"2024-09-19T06:45:34.971516+0000","last_fullsized":"2024-09-19T06:45:34.971516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839090+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:45:34.839090+0000","last_peered":"2024-09-19T06:45:34.839090+0000","last_clean":"2024-09-19T06:45:34.839090+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:45:34.839090+0000","last_undegraded":"2024-09-19T06:45:34.839090+0000","last_fullsized":"2024-09-19T06:45:34.839090+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838500+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:45:34.838500+0000","last_peered":"2024-09-19T06:45:34.838500+0000","last_clean":"2024-09-19T06:45:34.838500+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:45:34.838500+0000","last_undegraded":"2024-09-19T06:45:34.838500+0000","last_fullsized":"2024-09-19T06:45:34.838500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972242+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:45:34.972242+0000","last_peered":"2024-09-19T06:45:34.972242+0000","last_clean":"2024-09-19T06:45:34.972242+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:45:34.972242+0000","last_undegraded":"2024-09-19T06:45:34.972242+0000","last_fullsized":"2024-09-19T06:45:34.972242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841937+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:45:34.841937+0000","last_peered":"2024-09-19T06:45:34.841937+0000","last_clean":"2024-09-19T06:45:34.841937+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:45:34.841937+0000","last_undegraded":"2024-09-19T06:45:34.841937+0000","last_fullsized":"2024-09-19T06:45:34.841937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843676+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:45:34.843676+0000","last_peered":"2024-09-19T06:45:34.843676+0000","last_clean":"2024-09-19T06:45:34.843676+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:45:34.843676+0000","last_undegraded":"2024-09-19T06:45:34.843676+0000","last_fullsized":"2024-09-19T06:45:34.843676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.847063+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:45:34.847063+0000","last_peered":"2024-09-19T06:45:34.847063+0000","last_clean":"2024-09-19T06:45:34.847063+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:45:34.847063+0000","last_undegraded":"2024-09-19T06:45:34.847063+0000","last_fullsized":"2024-09-19T06:45:34.847063+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839212+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:45:34.839212+0000","last_peered":"2024-09-19T06:45:34.839212+0000","last_clean":"2024-09-19T06:45:34.839212+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:45:34.839212+0000","last_undegraded":"2024-09-19T06:45:34.839212+0000","last_fullsized":"2024-09-19T06:45:34.839212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841822+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:45:34.841822+0000","last_peered":"2024-09-19T06:45:34.841822+0000","last_clean":"2024-09-19T06:45:34.841822+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:45:34.841822+0000","last_undegraded":"2024-09-19T06:45:34.841822+0000","last_fullsized":"2024-09-19T06:45:34.841822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'28","reported_seq":166,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:46:23.904479+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:46:23.904479+0000","last_peered":"2024-09-19T06:46:23.904479+0000","last_clean":"2024-09-19T06:46:23.904479+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:46:23.904479+0000","last_undegraded":"2024-09-19T06:46:23.904479+0000","last_fullsized":"2024-09-19T06:46:23.904479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":119,"num_write":28,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841524+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:45:34.841524+0000","last_peered":"2024-09-19T06:45:34.841524+0000","last_clean":"2024-09-19T06:45:34.841524+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:45:34.841524+0000","last_undegraded":"2024-09-19T06:45:34.841524+0000","last_fullsized":"2024-09-19T06:45:34.841524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836029+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:45:34.836029+0000","last_peered":"2024-09-19T06:45:34.836029+0000","last_clean":"2024-09-19T06:45:34.836029+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:45:34.836029+0000","last_undegraded":"2024-09-19T06:45:34.836029+0000","last_fullsized":"2024-09-19T06:45:34.836029+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834657+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:45:34.834657+0000","last_peered":"2024-09-19T06:45:34.834657+0000","last_clean":"2024-09-19T06:45:34.834657+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:45:34.834657+0000","last_undegraded":"2024-09-19T06:45:34.834657+0000","last_fullsized":"2024-09-19T06:45:34.834657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838481+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:45:34.838481+0000","last_peered":"2024-09-19T06:45:34.838481+0000","last_clean":"2024-09-19T06:45:34.838481+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:45:34.838481+0000","last_undegraded":"2024-09-19T06:45:34.838481+0000","last_fullsized":"2024-09-19T06:45:34.838481+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844215+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:45:34.844215+0000","last_peered":"2024-09-19T06:45:34.844215+0000","last_clean":"2024-09-19T06:45:34.844215+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:45:34.844215+0000","last_undegraded":"2024-09-19T06:45:34.844215+0000","last_fullsized":"2024-09-19T06:45:34.844215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838328+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:45:34.838328+0000","last_peered":"2024-09-19T06:45:34.838328+0000","last_clean":"2024-09-19T06:45:34.838328+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:45:34.838328+0000","last_undegraded":"2024-09-19T06:45:34.838328+0000","last_fullsized":"2024-09-19T06:45:34.838328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.973152+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:45:34.973152+0000","last_peered":"2024-09-19T06:45:34.973152+0000","last_clean":"2024-09-19T06:45:34.973152+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:45:34.973152+0000","last_undegraded":"2024-09-19T06:45:34.973152+0000","last_fullsized":"2024-09-19T06:45:34.973152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842229+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:45:34.842229+0000","last_peered":"2024-09-19T06:45:34.842229+0000","last_clean":"2024-09-19T06:45:34.842229+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:45:34.842229+0000","last_undegraded":"2024-09-19T06:45:34.842229+0000","last_fullsized":"2024-09-19T06:45:34.842229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838241+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:45:34.838241+0000","last_peered":"2024-09-19T06:45:34.838241+0000","last_clean":"2024-09-19T06:45:34.838241+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:45:34.838241+0000","last_undegraded":"2024-09-19T06:45:34.838241+0000","last_fullsized":"2024-09-19T06:45:34.838241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841909+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:45:34.841909+0000","last_peered":"2024-09-19T06:45:34.841909+0000","last_clean":"2024-09-19T06:45:34.841909+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:45:34.841909+0000","last_undegraded":"2024-09-19T06:45:34.841909+0000","last_fullsized":"2024-09-19T06:45:34.841909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838064+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:45:34.838064+0000","last_peered":"2024-09-19T06:45:34.838064+0000","last_clean":"2024-09-19T06:45:34.838064+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:45:34.838064+0000","last_undegraded":"2024-09-19T06:45:34.838064+0000","last_fullsized":"2024-09-19T06:45:34.838064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834898+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:45:34.834898+0000","last_peered":"2024-09-19T06:45:34.834898+0000","last_clean":"2024-09-19T06:45:34.834898+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:45:34.834898+0000","last_undegraded":"2024-09-19T06:45:34.834898+0000","last_fullsized":"2024-09-19T06:45:34.834898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844431+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:45:34.844431+0000","last_peered":"2024-09-19T06:45:34.844431+0000","last_clean":"2024-09-19T06:45:34.844431+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:45:34.844431+0000","last_undegraded":"2024-09-19T06:45:34.844431+0000","last_fullsized":"2024-09-19T06:45:34.844431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839314+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:45:34.839314+0000","last_peered":"2024-09-19T06:45:34.839314+0000","last_clean":"2024-09-19T06:45:34.839314+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:45:34.839314+0000","last_undegraded":"2024-09-19T06:45:34.839314+0000","last_fullsized":"2024-09-19T06:45:34.839314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843610+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:45:34.843610+0000","last_peered":"2024-09-19T06:45:34.843610+0000","last_clean":"2024-09-19T06:45:34.843610+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:45:34.843610+0000","last_undegraded":"2024-09-19T06:45:34.843610+0000","last_fullsized":"2024-09-19T06:45:34.843610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836123+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:45:34.836123+0000","last_peered":"2024-09-19T06:45:34.836123+0000","last_clean":"2024-09-19T06:45:34.836123+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:45:34.836123+0000","last_undegraded":"2024-09-19T06:45:34.836123+0000","last_fullsized":"2024-09-19T06:45:34.836123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844519+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:45:34.844519+0000","last_peered":"2024-09-19T06:45:34.844519+0000","last_clean":"2024-09-19T06:45:34.844519+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:45:34.844519+0000","last_undegraded":"2024-09-19T06:45:34.844519+0000","last_fullsized":"2024-09-19T06:45:34.844519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":346,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.843957+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:45:34.843957+0000","last_peered":"2024-09-19T06:45:34.843957+0000","last_clean":"2024-09-19T06:45:34.843957+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:45:34.843957+0000","last_undegraded":"2024-09-19T06:45:34.843957+0000","last_fullsized":"2024-09-19T06:45:34.843957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838447+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:45:34.838447+0000","last_peered":"2024-09-19T06:45:34.838447+0000","last_clean":"2024-09-19T06:45:34.838447+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:45:34.838447+0000","last_undegraded":"2024-09-19T06:45:34.838447+0000","last_fullsized":"2024-09-19T06:45:34.838447+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971505+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:45:34.971505+0000","last_peered":"2024-09-19T06:45:34.971505+0000","last_clean":"2024-09-19T06:45:34.971505+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:45:34.971505+0000","last_undegraded":"2024-09-19T06:45:34.971505+0000","last_fullsized":"2024-09-19T06:45:34.971505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844023+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:45:34.844023+0000","last_peered":"2024-09-19T06:45:34.844023+0000","last_clean":"2024-09-19T06:45:34.844023+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:45:34.844023+0000","last_undegraded":"2024-09-19T06:45:34.844023+0000","last_fullsized":"2024-09-19T06:45:34.844023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834590+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:45:34.834590+0000","last_peered":"2024-09-19T06:45:34.834590+0000","last_clean":"2024-09-19T06:45:34.834590+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:45:34.834590+0000","last_undegraded":"2024-09-19T06:45:34.834590+0000","last_fullsized":"2024-09-19T06:45:34.834590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834693+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:45:34.834693+0000","last_peered":"2024-09-19T06:45:34.834693+0000","last_clean":"2024-09-19T06:45:34.834693+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:45:34.834693+0000","last_undegraded":"2024-09-19T06:45:34.834693+0000","last_fullsized":"2024-09-19T06:45:34.834693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838558+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:45:34.838558+0000","last_peered":"2024-09-19T06:45:34.838558+0000","last_clean":"2024-09-19T06:45:34.838558+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:45:34.838558+0000","last_undegraded":"2024-09-19T06:45:34.838558+0000","last_fullsized":"2024-09-19T06:45:34.838558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844146+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:45:34.844146+0000","last_peered":"2024-09-19T06:45:34.844146+0000","last_clean":"2024-09-19T06:45:34.844146+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:45:34.844146+0000","last_undegraded":"2024-09-19T06:45:34.844146+0000","last_fullsized":"2024-09-19T06:45:34.844146+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971935+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:45:34.971935+0000","last_peered":"2024-09-19T06:45:34.971935+0000","last_clean":"2024-09-19T06:45:34.971935+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:45:34.971935+0000","last_undegraded":"2024-09-19T06:45:34.971935+0000","last_fullsized":"2024-09-19T06:45:34.971935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838632+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:45:34.838632+0000","last_peered":"2024-09-19T06:45:34.838632+0000","last_clean":"2024-09-19T06:45:34.838632+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:45:34.838632+0000","last_undegraded":"2024-09-19T06:45:34.838632+0000","last_fullsized":"2024-09-19T06:45:34.838632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972155+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:45:34.972155+0000","last_peered":"2024-09-19T06:45:34.972155+0000","last_clean":"2024-09-19T06:45:34.972155+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:45:34.972155+0000","last_undegraded":"2024-09-19T06:45:34.972155+0000","last_fullsized":"2024-09-19T06:45:34.972155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841771+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:45:34.841771+0000","last_peered":"2024-09-19T06:45:34.841771+0000","last_clean":"2024-09-19T06:45:34.841771+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:45:34.841771+0000","last_undegraded":"2024-09-19T06:45:34.841771+0000","last_fullsized":"2024-09-19T06:45:34.841771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.834937+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:45:34.834937+0000","last_peered":"2024-09-19T06:45:34.834937+0000","last_clean":"2024-09-19T06:45:34.834937+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:45:34.834937+0000","last_undegraded":"2024-09-19T06:45:34.834937+0000","last_fullsized":"2024-09-19T06:45:34.834937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:45.780646+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:45:45.780646+0000","last_peered":"2024-09-19T06:45:45.780646+0000","last_clean":"2024-09-19T06:45:45.780646+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:45:45.780646+0000","last_undegraded":"2024-09-19T06:45:45.780646+0000","last_fullsized":"2024-09-19T06:45:45.780646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971798+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:45:34.971798+0000","last_peered":"2024-09-19T06:45:34.971798+0000","last_clean":"2024-09-19T06:45:34.971798+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:45:34.971798+0000","last_undegraded":"2024-09-19T06:45:34.971798+0000","last_fullsized":"2024-09-19T06:45:34.971798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838771+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:45:34.838771+0000","last_peered":"2024-09-19T06:45:34.838771+0000","last_clean":"2024-09-19T06:45:34.838771+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:45:34.838771+0000","last_undegraded":"2024-09-19T06:45:34.838771+0000","last_fullsized":"2024-09-19T06:45:34.838771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972922+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:45:34.972922+0000","last_peered":"2024-09-19T06:45:34.972922+0000","last_clean":"2024-09-19T06:45:34.972922+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:45:34.972922+0000","last_undegraded":"2024-09-19T06:45:34.972922+0000","last_fullsized":"2024-09-19T06:45:34.972922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841810+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:45:34.841810+0000","last_peered":"2024-09-19T06:45:34.841810+0000","last_clean":"2024-09-19T06:45:34.841810+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:45:34.841810+0000","last_undegraded":"2024-09-19T06:45:34.841810+0000","last_fullsized":"2024-09-19T06:45:34.841810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.840921+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:45:34.840921+0000","last_peered":"2024-09-19T06:45:34.840921+0000","last_clean":"2024-09-19T06:45:34.840921+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:45:34.840921+0000","last_undegraded":"2024-09-19T06:45:34.840921+0000","last_fullsized":"2024-09-19T06:45:34.840921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971446+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:45:34.971446+0000","last_peered":"2024-09-19T06:45:34.971446+0000","last_clean":"2024-09-19T06:45:34.971446+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:45:34.971446+0000","last_undegraded":"2024-09-19T06:45:34.971446+0000","last_fullsized":"2024-09-19T06:45:34.971446+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838320+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:45:34.838320+0000","last_peered":"2024-09-19T06:45:34.838320+0000","last_clean":"2024-09-19T06:45:34.838320+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:45:34.838320+0000","last_undegraded":"2024-09-19T06:45:34.838320+0000","last_fullsized":"2024-09-19T06:45:34.838320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.972570+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:45:34.972570+0000","last_peered":"2024-09-19T06:45:34.972570+0000","last_clean":"2024-09-19T06:45:34.972570+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:45:34.972570+0000","last_undegraded":"2024-09-19T06:45:34.972570+0000","last_fullsized":"2024-09-19T06:45:34.972570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971518+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:45:34.971518+0000","last_peered":"2024-09-19T06:45:34.971518+0000","last_clean":"2024-09-19T06:45:34.971518+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:45:34.971518+0000","last_undegraded":"2024-09-19T06:45:34.971518+0000","last_fullsized":"2024-09-19T06:45:34.971518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.842086+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:45:34.842086+0000","last_peered":"2024-09-19T06:45:34.842086+0000","last_clean":"2024-09-19T06:45:34.842086+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:45:34.842086+0000","last_undegraded":"2024-09-19T06:45:34.842086+0000","last_fullsized":"2024-09-19T06:45:34.842086+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.844057+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:45:34.844057+0000","last_peered":"2024-09-19T06:45:34.844057+0000","last_clean":"2024-09-19T06:45:34.844057+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:45:34.844057+0000","last_undegraded":"2024-09-19T06:45:34.844057+0000","last_fullsized":"2024-09-19T06:45:34.844057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.839054+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:45:34.839054+0000","last_peered":"2024-09-19T06:45:34.839054+0000","last_clean":"2024-09-19T06:45:34.839054+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:45:34.839054+0000","last_undegraded":"2024-09-19T06:45:34.839054+0000","last_fullsized":"2024-09-19T06:45:34.839054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.847185+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:45:34.847185+0000","last_peered":"2024-09-19T06:45:34.847185+0000","last_clean":"2024-09-19T06:45:34.847185+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:45:34.847185+0000","last_undegraded":"2024-09-19T06:45:34.847185+0000","last_fullsized":"2024-09-19T06:45:34.847185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841692+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:45:34.841692+0000","last_peered":"2024-09-19T06:45:34.841692+0000","last_clean":"2024-09-19T06:45:34.841692+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:45:34.841692+0000","last_undegraded":"2024-09-19T06:45:34.841692+0000","last_fullsized":"2024-09-19T06:45:34.841692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.841638+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:45:34.841638+0000","last_peered":"2024-09-19T06:45:34.841638+0000","last_clean":"2024-09-19T06:45:34.841638+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:45:34.841638+0000","last_undegraded":"2024-09-19T06:45:34.841638+0000","last_fullsized":"2024-09-19T06:45:34.841638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.836435+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:45:34.836435+0000","last_peered":"2024-09-19T06:45:34.836435+0000","last_clean":"2024-09-19T06:45:34.836435+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:45:34.836435+0000","last_undegraded":"2024-09-19T06:45:34.836435+0000","last_fullsized":"2024-09-19T06:45:34.836435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971775+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:45:34.971775+0000","last_peered":"2024-09-19T06:45:34.971775+0000","last_clean":"2024-09-19T06:45:34.971775+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:45:34.971775+0000","last_undegraded":"2024-09-19T06:45:34.971775+0000","last_fullsized":"2024-09-19T06:45:34.971775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.971608+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:45:34.971608+0000","last_peered":"2024-09-19T06:45:34.971608+0000","last_clean":"2024-09-19T06:45:34.971608+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:45:34.971608+0000","last_undegraded":"2024-09-19T06:45:34.971608+0000","last_fullsized":"2024-09-19T06:45:34.971608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:45:34.838849+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:45:34.838849+0000","last_peered":"2024-09-19T06:45:34.838849+0000","last_clean":"2024-09-19T06:45:34.838849+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:45:34.838849+0000","last_undegraded":"2024-09-19T06:45:34.838849+0000","last_fullsized":"2024-09-19T06:45:34.838849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":122,"num_read_kb":125,"num_write":83,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":190851,"data_compressed":5439,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281443,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612633,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":431929,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841566,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1085427,"data_compressed":43362,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005092,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":432511,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":432533,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1022996,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":432046,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":1022596,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018941,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":431951,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":432267,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476807,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":494782,"data_compressed":7567,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":494748,"data_compressed":7567,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":432019,"data_compressed":5754,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34156,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":62819,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62853,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63013,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:46:27.508 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:46:27.508 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T06:46:27.508 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T06:46:27.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T06:46:27.759 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:27.880 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:27 smithi159 ceph-mon[30935]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:46:27.881 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:27 smithi159 ceph-mon[30935]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:27.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:27 smithi189 ceph-mon[34880]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:46:27.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:27 smithi189 ceph-mon[34880]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:27 smithi203 ceph-mon[35473]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:46:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:27 smithi203 ceph-mon[35473]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:28.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 -- 172.21.15.159:0/1603464233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494102570 msgr2=0x7fc4941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 --2- 172.21.15.159:0/1603464233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494102570 0x7fc4941029b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc488009900 tx=0x7fc48802a480 comp rx=0 tx=0).stop 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 -- 172.21.15.159:0/1603464233 shutdown_connections 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 --2- 172.21.15.159:0/1603464233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc494102ef0 0x7fc49410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 --2- 172.21.15.159:0/1603464233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494102570 0x7fc4941029b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 --2- 172.21.15.159:0/1603464233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc494100e20 0x7fc494101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 -- 172.21.15.159:0/1603464233 >> 172.21.15.159:0/1603464233 conn(0x7fc4940fc7d0 msgr2=0x7fc4940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 -- 172.21.15.159:0/1603464233 shutdown_connections 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 -- 172.21.15.159:0/1603464233 wait complete. 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.308+0000 7fc49b863640 1 Processor -- start 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc49b863640 1 -- start start 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc49b863640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494100e20 0x7fc49410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:28.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc49b863640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc494102570 0x7fc49410ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc49b863640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc494102ef0 0x7fc49410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc49b863640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc494112120 con 0x7fc494100e20 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc49b863640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc494111fa0 con 0x7fc494102570 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc49b863640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4941122a0 con 0x7fc494102ef0 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc4995ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494100e20 0x7fc49410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc4995ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494100e20 0x7fc49410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57946/0 (socket says 172.21.15.159:57946) 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc4995ff640 1 -- 172.21.15.159:0/1953625338 learned_addr learned my addr 172.21.15.159:0/1953625338 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc498dfe640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc494102570 0x7fc49410ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc4995ff640 1 -- 172.21.15.159:0/1953625338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc494102ef0 msgr2=0x7fc49410ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc499e00640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc494102ef0 0x7fc49410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc4995ff640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc494102ef0 0x7fc49410ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc4995ff640 1 -- 172.21.15.159:0/1953625338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc494102570 msgr2=0x7fc49410ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc4995ff640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc494102570 0x7fc49410ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc4995ff640 1 -- 172.21.15.159:0/1953625338 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4941a6b00 con 0x7fc494100e20 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.309+0000 7fc4995ff640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494100e20 0x7fc49410e4d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc48400ba50 tx=0x7fc48400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.310+0000 7fc4927fc640 1 -- 172.21.15.159:0/1953625338 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484019070 con 0x7fc494100e20 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.310+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4941a6df0 con 0x7fc494100e20 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.310+0000 7fc4927fc640 1 -- 172.21.15.159:0/1953625338 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48400cbe0 con 0x7fc494100e20 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.310+0000 7fc4927fc640 1 -- 172.21.15.159:0/1953625338 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4840076e0 con 0x7fc494100e20 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.310+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4941a7250 con 0x7fc494100e20 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.311+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc494101280 con 0x7fc494100e20 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.312+0000 7fc4927fc640 1 -- 172.21.15.159:0/1953625338 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc48401c070 con 0x7fc494100e20 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.312+0000 7fc4927fc640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc47c0a32d0 0x7fc47c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.313+0000 7fc498dfe640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc47c0a32d0 0x7fc47c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.313+0000 7fc4927fc640 1 -- 172.21.15.159:0/1953625338 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fc4840cf420 con 0x7fc494100e20 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.313+0000 7fc498dfe640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc47c0a32d0 0x7fc47c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc488000c00 tx=0x7fc4880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:28.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.316+0000 7fc4927fc640 1 -- 172.21.15.159:0/1953625338 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc48409ba80 con 0x7fc494100e20 2024-09-19T06:46:28.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.521+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc49410fa00 con 0x7fc494100e20 2024-09-19T06:46:28.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.522+0000 7fc4927fc640 1 -- 172.21.15.159:0/1953625338 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc48409fd80 con 0x7fc494100e20 2024-09-19T06:46:28.523 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:28.523 INFO:teuthology.orchestra.run.smithi159.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T06:46:28.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc47c0a32d0 msgr2=0x7fc47c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:28.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc47c0a32d0 0x7fc47c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc488000c00 tx=0x7fc4880058d0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494100e20 msgr2=0x7fc49410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:28.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494100e20 0x7fc49410e4d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc48400ba50 tx=0x7fc48400bf10 comp rx=0 tx=0).stop 2024-09-19T06:46:28.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 shutdown_connections 2024-09-19T06:46:28.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fc47c0a32d0 0x7fc47c0a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc494102ef0 0x7fc49410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc494102570 0x7fc49410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 --2- 172.21.15.159:0/1953625338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc494100e20 0x7fc49410e4d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:28.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 >> 172.21.15.159:0/1953625338 conn(0x7fc4940fc7d0 msgr2=0x7fc4940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:28.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 shutdown_connections 2024-09-19T06:46:28.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:28.524+0000 7fc49b863640 1 -- 172.21.15.159:0/1953625338 wait complete. 2024-09-19T06:46:28.834 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:28 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1953625338' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:46:28.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:28 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1953625338' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:46:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:28 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1953625338' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:46:29.189 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T06:46:29.189 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:46:29.439 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:29.861 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:29 smithi159 ceph-mon[30935]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:29.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:29 smithi189 ceph-mon[34880]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:29.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.859+0000 7f99a4b22640 1 -- 172.21.15.159:0/1227429264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 msgr2=0x7f99a010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:29.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.859+0000 7f99a4b22640 1 --2- 172.21.15.159:0/1227429264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 0x7f99a010da40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9990009900 tx=0x7f999002a480 comp rx=0 tx=0).stop 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.859+0000 7f99a4b22640 1 -- 172.21.15.159:0/1227429264 shutdown_connections 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.859+0000 7f99a4b22640 1 --2- 172.21.15.159:0/1227429264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 0x7f99a010da40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.859+0000 7f99a4b22640 1 --2- 172.21.15.159:0/1227429264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a0102570 0x7f99a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.859+0000 7f99a4b22640 1 --2- 172.21.15.159:0/1227429264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99a0100e20 0x7f99a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.859+0000 7f99a4b22640 1 -- 172.21.15.159:0/1227429264 >> 172.21.15.159:0/1227429264 conn(0x7f99a00fc7d0 msgr2=0x7f99a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.859+0000 7f99a4b22640 1 -- 172.21.15.159:0/1227429264 shutdown_connections 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.859+0000 7f99a4b22640 1 -- 172.21.15.159:0/1227429264 wait complete. 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f99a4b22640 1 Processor -- start 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f99a4b22640 1 -- start start 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f99a4b22640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99a0100e20 0x7f99a01985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f99a4b22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a0102570 0x7f99a0198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f99a4b22640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 0x7f99a019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f99a4b22640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f99a0112120 con 0x7f99a0102ef0 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f99a4b22640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99a0111fa0 con 0x7f99a0102570 2024-09-19T06:46:29.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f99a4b22640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99a01122a0 con 0x7f99a0100e20 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f999ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 0x7f99a019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f999ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 0x7f99a019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42274/0 (socket says 172.21.15.159:42274) 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f999ed9d640 1 -- 172.21.15.159:0/348434956 learned_addr learned my addr 172.21.15.159:0/348434956 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.860+0000 7f999e59c640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99a0100e20 0x7f99a01985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f999dd9b640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a0102570 0x7f99a0198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f999ed9d640 1 -- 172.21.15.159:0/348434956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99a0100e20 msgr2=0x7f99a01985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f999ed9d640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99a0100e20 0x7f99a01985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f999ed9d640 1 -- 172.21.15.159:0/348434956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a0102570 msgr2=0x7f99a0198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f999ed9d640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a0102570 0x7f99a0198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f999ed9d640 1 -- 172.21.15.159:0/348434956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a019d590 con 0x7f99a0102ef0 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f999dd9b640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a0102570 0x7f99a0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f999e59c640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99a0100e20 0x7f99a01985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f999ed9d640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 0x7f99a019ceb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9990005ab0 tx=0x7f9990003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:29.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f99977fe640 1 -- 172.21.15.159:0/348434956 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999003f070 con 0x7f99a0102ef0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f99977fe640 1 -- 172.21.15.159:0/348434956 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9990031e30 con 0x7f99a0102ef0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a019d820 con 0x7f99a0102ef0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f99977fe640 1 -- 172.21.15.159:0/348434956 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990035030 con 0x7f99a0102ef0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.861+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a01a5160 con 0x7f99a0102ef0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.862+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a0101280 con 0x7f99a0102ef0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.863+0000 7f99977fe640 1 -- 172.21.15.159:0/348434956 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9990042070 con 0x7f99a0102ef0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.864+0000 7f99977fe640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f998c0a32d0 0x7f998c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.864+0000 7f999e59c640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f998c0a32d0 0x7f998c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.864+0000 7f99977fe640 1 -- 172.21.15.159:0/348434956 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f99900f0b50 con 0x7f99a0102ef0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.865+0000 7f999e59c640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f998c0a32d0 0x7f998c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9998009fa0 tx=0x7f9998009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:29.867+0000 7f99977fe640 1 -- 172.21.15.159:0/348434956 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f99900bd6f0 con 0x7f99a0102ef0 2024-09-19T06:46:30.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.070+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99a0109090 con 0x7f99a0102ef0 2024-09-19T06:46:30.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.070+0000 7f99977fe640 1 -- 172.21.15.159:0/348434956 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f9990003e20 con 0x7f99a0102ef0 2024-09-19T06:46:30.072 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:30.072 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:46:30.072 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:46:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.072+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f998c0a32d0 msgr2=0x7f998c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.072+0000 7f99a4b22640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f998c0a32d0 0x7f998c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9998009fa0 tx=0x7f9998009570 comp rx=0 tx=0).stop 2024-09-19T06:46:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.072+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 msgr2=0x7f99a019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.072+0000 7f99a4b22640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 0x7f99a019ceb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9990005ab0 tx=0x7f9990003c30 comp rx=0 tx=0).stop 2024-09-19T06:46:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.073+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 shutdown_connections 2024-09-19T06:46:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.073+0000 7f99a4b22640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f998c0a32d0 0x7f998c0a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.073+0000 7f99a4b22640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99a0102ef0 0x7f99a019ceb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.073+0000 7f99a4b22640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99a0102570 0x7f99a0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.073+0000 7f99a4b22640 1 --2- 172.21.15.159:0/348434956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99a0100e20 0x7f99a01985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:30.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.073+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 >> 172.21.15.159:0/348434956 conn(0x7f99a00fc7d0 msgr2=0x7f99a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:30.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.073+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 shutdown_connections 2024-09-19T06:46:30.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:30.073+0000 7f99a4b22640 1 -- 172.21.15.159:0/348434956 wait complete. 2024-09-19T06:46:30.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:29 smithi203 ceph-mon[35473]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:30.732 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:46:30.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:30 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/348434956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:30.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:30 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/348434956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:30.980 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:30 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/348434956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:31.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.503+0000 7f080e170640 1 -- 172.21.15.159:0/3402719892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808100a80 msgr2=0x7f0808100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.503+0000 7f080e170640 1 --2- 172.21.15.159:0/3402719892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808100a80 0x7f0808100ee0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009930 tx=0x7f07fc02a420 comp rx=0 tx=0).stop 2024-09-19T06:46:31.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.503+0000 7f080e170640 1 -- 172.21.15.159:0/3402719892 shutdown_connections 2024-09-19T06:46:31.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.503+0000 7f080e170640 1 --2- 172.21.15.159:0/3402719892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0808101420 0x7f080810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.503+0000 7f080e170640 1 --2- 172.21.15.159:0/3402719892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808100a80 0x7f0808100ee0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.503+0000 7f080e170640 1 --2- 172.21.15.159:0/3402719892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0808106a80 0x7f0808106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.503+0000 7f080e170640 1 -- 172.21.15.159:0/3402719892 >> 172.21.15.159:0/3402719892 conn(0x7f08080fc7a0 msgr2=0x7f08080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:31.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.503+0000 7f080e170640 1 -- 172.21.15.159:0/3402719892 shutdown_connections 2024-09-19T06:46:31.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.503+0000 7f080e170640 1 -- 172.21.15.159:0/3402719892 wait complete. 2024-09-19T06:46:31.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f080e170640 1 Processor -- start 2024-09-19T06:46:31.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f080e170640 1 -- start start 2024-09-19T06:46:31.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f080e170640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0808100a80 0x7f08081992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f080e170640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0808101420 0x7f08081997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f080e170640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808106a80 0x7f08081a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f080e170640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0808110ea0 con 0x7f0808106a80 2024-09-19T06:46:31.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f080e170640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0808110d20 con 0x7f0808101420 2024-09-19T06:46:31.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f080e170640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0808111020 con 0x7f0808100a80 2024-09-19T06:46:31.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f0807fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808106a80 0x7f08081a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f0807fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808106a80 0x7f08081a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42294/0 (socket says 172.21.15.159:42294) 2024-09-19T06:46:31.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f0807fff640 1 -- 172.21.15.159:0/614474346 learned_addr learned my addr 172.21.15.159:0/614474346 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:31.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f08077fe640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0808100a80 0x7f08081992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f0806ffd640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0808101420 0x7f08081997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f0807fff640 1 -- 172.21.15.159:0/614474346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0808100a80 msgr2=0x7f08081992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f0807fff640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0808100a80 0x7f08081992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f0807fff640 1 -- 172.21.15.159:0/614474346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0808101420 msgr2=0x7f08081997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f0807fff640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0808101420 0x7f08081997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f0807fff640 1 -- 172.21.15.159:0/614474346 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08081a4870 con 0x7f0808106a80 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.504+0000 7f08077fe640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0808100a80 0x7f08081992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.505+0000 7f0807fff640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808106a80 0x7f08081a4330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f080000b970 tx=0x7f080000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.505+0000 7f0804ff9640 1 -- 172.21.15.159:0/614474346 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800019070 con 0x7f0808106a80 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.505+0000 7f0804ff9640 1 -- 172.21.15.159:0/614474346 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f080000cb40 con 0x7f0808106a80 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.505+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08081a4a40 con 0x7f0808106a80 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.505+0000 7f0804ff9640 1 -- 172.21.15.159:0/614474346 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800007650 con 0x7f0808106a80 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.505+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08081a4f50 con 0x7f0808106a80 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.506+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0808100ee0 con 0x7f0808106a80 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.507+0000 7f0804ff9640 1 -- 172.21.15.159:0/614474346 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f080001c070 con 0x7f0808106a80 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.508+0000 7f0804ff9640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f07f00a3350 0x7f07f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:31.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.508+0000 7f08077fe640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f07f00a3350 0x7f07f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:31.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.508+0000 7f0804ff9640 1 -- 172.21.15.159:0/614474346 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f08000cf3d0 con 0x7f0808106a80 2024-09-19T06:46:31.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.508+0000 7f08077fe640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f07f00a3350 0x7f07f00a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07f800abe0 tx=0x7f07f800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:31.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.511+0000 7f0804ff9640 1 -- 172.21.15.159:0/614474346 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f080009c080 con 0x7f0808106a80 2024-09-19T06:46:31.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.716+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08081a51e0 con 0x7f0808106a80 2024-09-19T06:46:31.718 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:31 smithi159 ceph-mon[30935]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:31.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.717+0000 7f0804ff9640 1 -- 172.21.15.159:0/614474346 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f080009b980 con 0x7f0808106a80 2024-09-19T06:46:31.719 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:31.719 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:46:31.719 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f07f00a3350 msgr2=0x7f07f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f07f00a3350 0x7f07f00a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07f800abe0 tx=0x7f07f800a5c0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808106a80 msgr2=0x7f08081a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808106a80 0x7f08081a4330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f080000b970 tx=0x7f080000be30 comp rx=0 tx=0).stop 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 shutdown_connections 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f07f00a3350 0x7f07f00a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0808106a80 0x7f08081a4330 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0808101420 0x7f08081997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 --2- 172.21.15.159:0/614474346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0808100a80 0x7f08081992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:31.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.719+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 >> 172.21.15.159:0/614474346 conn(0x7f08080fc7a0 msgr2=0x7f08080fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:31.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.720+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 shutdown_connections 2024-09-19T06:46:31.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:31.720+0000 7f080e170640 1 -- 172.21.15.159:0/614474346 wait complete. 2024-09-19T06:46:31.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:31 smithi189 ceph-mon[34880]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:32.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:31 smithi203 ceph-mon[35473]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:32.435 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:46:32.683 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:32.804 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:32 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/614474346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:32 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/614474346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:32 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/614474346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:33.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 -- 172.21.15.159:0/650709273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38106a80 msgr2=0x7f0e38106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/650709273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38106a80 0x7f0e38106e60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009930 tx=0x7f0e3402a420 comp rx=0 tx=0).stop 2024-09-19T06:46:33.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 -- 172.21.15.159:0/650709273 shutdown_connections 2024-09-19T06:46:33.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/650709273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e38101420 0x7f0e3810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/650709273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e38100a80 0x7f0e38100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/650709273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38106a80 0x7f0e38106e60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 -- 172.21.15.159:0/650709273 >> 172.21.15.159:0/650709273 conn(0x7f0e380fc7a0 msgr2=0x7f0e380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 -- 172.21.15.159:0/650709273 shutdown_connections 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 -- 172.21.15.159:0/650709273 wait complete. 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 Processor -- start 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.155+0000 7f0e3fba6640 1 -- start start 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3fba6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e38100a80 0x7f0e381984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3fba6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38101420 0x7f0e381989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3fba6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e38106a80 0x7f0e3819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3fba6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38110ea0 con 0x7f0e38101420 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3fba6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38110d20 con 0x7f0e38106a80 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3fba6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38111020 con 0x7f0e38100a80 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d141640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38101420 0x7f0e381989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d141640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38101420 0x7f0e381989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42308/0 (socket says 172.21.15.159:42308) 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d141640 1 -- 172.21.15.159:0/744809401 learned_addr learned my addr 172.21.15.159:0/744809401 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3e143640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e38106a80 0x7f0e3819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d942640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e38100a80 0x7f0e381984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d141640 1 -- 172.21.15.159:0/744809401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e38100a80 msgr2=0x7f0e381984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d141640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e38100a80 0x7f0e381984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d141640 1 -- 172.21.15.159:0/744809401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e38106a80 msgr2=0x7f0e3819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d141640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e38106a80 0x7f0e3819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d141640 1 -- 172.21.15.159:0/744809401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3819d450 con 0x7f0e38101420 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d942640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e38100a80 0x7f0e381984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3d141640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38101420 0x7f0e381989e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800b4a0 tx=0x7f0e2800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e2effd640 1 -- 172.21.15.159:0/744809401 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28014070 con 0x7f0e38101420 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e2effd640 1 -- 172.21.15.159:0/744809401 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e28010af0 con 0x7f0e38101420 2024-09-19T06:46:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3819d740 con 0x7f0e38101420 2024-09-19T06:46:33.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e2effd640 1 -- 172.21.15.159:0/744809401 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28017d10 con 0x7f0e38101420 2024-09-19T06:46:33.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.156+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e381a5020 con 0x7f0e38101420 2024-09-19T06:46:33.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.157+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e38100ee0 con 0x7f0e38101420 2024-09-19T06:46:33.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.158+0000 7f0e2effd640 1 -- 172.21.15.159:0/744809401 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0e28017070 con 0x7f0e38101420 2024-09-19T06:46:33.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.159+0000 7f0e2effd640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0e240a3350 0x7f0e240a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:33.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.159+0000 7f0e3d942640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0e240a3350 0x7f0e240a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:33.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.159+0000 7f0e2effd640 1 -- 172.21.15.159:0/744809401 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0e280cedc0 con 0x7f0e38101420 2024-09-19T06:46:33.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.159+0000 7f0e3d942640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0e240a3350 0x7f0e240a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0e34000c00 tx=0x7f0e34032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:33.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.163+0000 7f0e2effd640 1 -- 172.21.15.159:0/744809401 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0e2809ba70 con 0x7f0e38101420 2024-09-19T06:46:33.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.334+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e3810a060 con 0x7f0e38101420 2024-09-19T06:46:33.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.336+0000 7f0e2effd640 1 -- 172.21.15.159:0/744809401 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22865 (secure 0 0 0) 0x7f0e2809b370 con 0x7f0e38101420 2024-09-19T06:46:33.337 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:33.337 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":81,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:45:34.831866+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0e240a3350 msgr2=0x7f0e240a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0e240a3350 0x7f0e240a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0e34000c00 tx=0x7f0e34032d50 comp rx=0 tx=0).stop 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38101420 msgr2=0x7f0e381989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38101420 0x7f0e381989e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800b4a0 tx=0x7f0e2800b960 comp rx=0 tx=0).stop 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 shutdown_connections 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0e240a3350 0x7f0e240a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e38106a80 0x7f0e3819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e38101420 0x7f0e381989e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 --2- 172.21.15.159:0/744809401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e38100a80 0x7f0e381984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.338+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 >> 172.21.15.159:0/744809401 conn(0x7f0e380fc7a0 msgr2=0x7f0e3806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.339+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 shutdown_connections 2024-09-19T06:46:33.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:33.339+0000 7f0e3fba6640 1 -- 172.21.15.159:0/744809401 wait complete. 2024-09-19T06:46:33.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:33 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/744809401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:46:33.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:33 smithi189 ceph-mon[34880]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:33.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:33 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/744809401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:46:33.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:33 smithi159 ceph-mon[30935]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:34.048 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:46:34.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:33 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/744809401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:46:34.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:33 smithi203 ceph-mon[35473]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:34.298 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:34.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.791+0000 7f575c9eb640 1 -- 172.21.15.159:0/1273545097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 msgr2=0x7f57581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.791+0000 7f575c9eb640 1 --2- 172.21.15.159:0/1273545097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 0x7f57581067e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5740009900 tx=0x7f574002a410 comp rx=0 tx=0).stop 2024-09-19T06:46:34.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.791+0000 7f575c9eb640 1 -- 172.21.15.159:0/1273545097 shutdown_connections 2024-09-19T06:46:34.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.791+0000 7f575c9eb640 1 --2- 172.21.15.159:0/1273545097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758106f10 0x7f575810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.791+0000 7f575c9eb640 1 --2- 172.21.15.159:0/1273545097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 0x7f57581067e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.791+0000 7f575c9eb640 1 --2- 172.21.15.159:0/1273545097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5758101de0 0x7f57581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.791+0000 7f575c9eb640 1 -- 172.21.15.159:0/1273545097 >> 172.21.15.159:0/1273545097 conn(0x7f57580fd8c0 msgr2=0x7f57580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.791+0000 7f575c9eb640 1 -- 172.21.15.159:0/1273545097 shutdown_connections 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.791+0000 7f575c9eb640 1 -- 172.21.15.159:0/1273545097 wait complete. 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f575c9eb640 1 Processor -- start 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f575c9eb640 1 -- start start 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f575c9eb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5758101de0 0x7f5758198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f575c9eb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 0x7f57581989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f575c9eb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758106f10 0x7f575819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f575c9eb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5758111f70 con 0x7f5758102790 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f575c9eb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5758111df0 con 0x7f5758101de0 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f575c9eb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f57581120f0 con 0x7f5758106f10 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f574ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 0x7f57581989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f574ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 0x7f57581989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42328/0 (socket says 172.21.15.159:42328) 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f574ffff640 1 -- 172.21.15.159:0/3467190229 learned_addr learned my addr 172.21.15.159:0/3467190229 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f575659c640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5758101de0 0x7f5758198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f5756d9d640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758106f10 0x7f575819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f574ffff640 1 -- 172.21.15.159:0/3467190229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758106f10 msgr2=0x7f575819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f574ffff640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758106f10 0x7f575819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f574ffff640 1 -- 172.21.15.159:0/3467190229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5758101de0 msgr2=0x7f5758198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f574ffff640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5758101de0 0x7f5758198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.792+0000 7f574ffff640 1 -- 172.21.15.159:0/3467190229 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575819d420 con 0x7f5758102790 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.793+0000 7f575659c640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5758101de0 0x7f5758198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.793+0000 7f574ffff640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 0x7f57581989b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5740006010 tx=0x7f5740004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.793+0000 7f574f7fe640 1 -- 172.21.15.159:0/3467190229 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574003f030 con 0x7f5758102790 2024-09-19T06:46:34.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.793+0000 7f574f7fe640 1 -- 172.21.15.159:0/3467190229 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5740004440 con 0x7f5758102790 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.793+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575819d6b0 con 0x7f5758102790 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.793+0000 7f574f7fe640 1 -- 172.21.15.159:0/3467190229 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740035070 con 0x7f5758102790 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.793+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57581a4ff0 con 0x7f5758102790 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.794+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57581032c0 con 0x7f5758102790 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.795+0000 7f574f7fe640 1 -- 172.21.15.159:0/3467190229 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5740042030 con 0x7f5758102790 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.795+0000 7f574f7fe640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f57440a32d0 0x7f57440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.796+0000 7f575659c640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f57440a32d0 0x7f57440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.796+0000 7f574f7fe640 1 -- 172.21.15.159:0/3467190229 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f57400effd0 con 0x7f5758102790 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.796+0000 7f575659c640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f57440a32d0 0x7f57440a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5748009c20 tx=0x7f5748005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:34.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:34.800+0000 7f574f7fe640 1 -- 172.21.15.159:0/3467190229 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57400bcb10 con 0x7f5758102790 2024-09-19T06:46:35.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.000+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f575810a0f0 con 0x7f5758102790 2024-09-19T06:46:35.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.000+0000 7f574f7fe640 1 -- 172.21.15.159:0/3467190229 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f57400bc410 con 0x7f5758102790 2024-09-19T06:46:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:35.002 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:46:35.002 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:46:35.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f57440a32d0 msgr2=0x7f57440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f57440a32d0 0x7f57440a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5748009c20 tx=0x7f5748005f90 comp rx=0 tx=0).stop 2024-09-19T06:46:35.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 msgr2=0x7f57581989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:35.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 0x7f57581989b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5740006010 tx=0x7f5740004040 comp rx=0 tx=0).stop 2024-09-19T06:46:35.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 shutdown_connections 2024-09-19T06:46:35.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f57440a32d0 0x7f57440a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758106f10 0x7f575819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5758102790 0x7f57581989b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 --2- 172.21.15.159:0/3467190229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5758101de0 0x7f5758198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:35.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 >> 172.21.15.159:0/3467190229 conn(0x7f57580fd8c0 msgr2=0x7f57580feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:35.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 shutdown_connections 2024-09-19T06:46:35.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:35.003+0000 7f575c9eb640 1 -- 172.21.15.159:0/3467190229 wait complete. 2024-09-19T06:46:35.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:35 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3467190229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:35.376 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:35 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3467190229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:35.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:35 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3467190229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:35.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:45:23.401782+0000', 'modified': '2024-09-19T06:45:32.442633+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24487}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6839/1818858628', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 1818858628}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 1818858628}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.203:6839/3762709136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 3762709136}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 3762709136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24487, 'qdb_cluster': [24487]} 2024-09-19T06:46:35.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T06:46:35.715 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:46:35.964 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:36.313 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:36 smithi159 ceph-mon[30935]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:36.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:36 smithi203 ceph-mon[35473]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:36.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:36 smithi189 ceph-mon[34880]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.392+0000 7f3766f96640 1 -- 172.21.15.159:0/4012982816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 msgr2=0x7f376010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.392+0000 7f3766f96640 1 --2- 172.21.15.159:0/4012982816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 0x7f376010d950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3758009cd0 tx=0x7f375802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.392+0000 7f3766f96640 1 -- 172.21.15.159:0/4012982816 shutdown_connections 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.392+0000 7f3766f96640 1 --2- 172.21.15.159:0/4012982816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 0x7f376010d950 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.392+0000 7f3766f96640 1 --2- 172.21.15.159:0/4012982816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3760100a80 0x7f3760100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.392+0000 7f3766f96640 1 --2- 172.21.15.159:0/4012982816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3760106a80 0x7f3760106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.392+0000 7f3766f96640 1 -- 172.21.15.159:0/4012982816 >> 172.21.15.159:0/4012982816 conn(0x7f37600fc7a0 msgr2=0x7f37600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.392+0000 7f3766f96640 1 -- 172.21.15.159:0/4012982816 shutdown_connections 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.392+0000 7f3766f96640 1 -- 172.21.15.159:0/4012982816 wait complete. 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f3766f96640 1 Processor -- start 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f3766f96640 1 -- start start 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f3766f96640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3760100a80 0x7f3760199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f3766f96640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 0x7f3760199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f3766f96640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3760106a80 0x7f37601a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f3766f96640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3760110ed0 con 0x7f3760101420 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f3766f96640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3760110d50 con 0x7f3760106a80 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f3766f96640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3760111050 con 0x7f3760100a80 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f375ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 0x7f3760199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f375ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 0x7f3760199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42350/0 (socket says 172.21.15.159:42350) 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f375ffff640 1 -- 172.21.15.159:0/3343903886 learned_addr learned my addr 172.21.15.159:0/3343903886 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f3764d32640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3760100a80 0x7f3760199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.393+0000 7f375ffff640 1 -- 172.21.15.159:0/3343903886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3760100a80 msgr2=0x7f3760199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f3765533640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3760106a80 0x7f37601a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f375ffff640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3760100a80 0x7f3760199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f375ffff640 1 -- 172.21.15.159:0/3343903886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3760106a80 msgr2=0x7f37601a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f375ffff640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3760106a80 0x7f37601a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f375ffff640 1 -- 172.21.15.159:0/3343903886 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37601a47c0 con 0x7f3760101420 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f375ffff640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 0x7f3760199740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f374c00c890 tx=0x7f374c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f375dffb640 1 -- 172.21.15.159:0/3343903886 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c004220 con 0x7f3760101420 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f375dffb640 1 -- 172.21.15.159:0/3343903886 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f374c0043c0 con 0x7f3760101420 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f375dffb640 1 -- 172.21.15.159:0/3343903886 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c0049e0 con 0x7f3760101420 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f3766f96640 1 -- 172.21.15.159:0/3343903886 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37601a4990 con 0x7f3760101420 2024-09-19T06:46:36.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.394+0000 7f3766f96640 1 -- 172.21.15.159:0/3343903886 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37601a4ed0 con 0x7f3760101420 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.396+0000 7f375dffb640 1 -- 172.21.15.159:0/3343903886 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f374c0079b0 con 0x7f3760101420 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f376936f740 1 Processor -- start 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f376936f740 1 -- start start 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f375dffb640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f37500a3350 0x7f37500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3765533640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f37500a3350 0x7f37500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f376936f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc06c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f375dffb640 1 -- 172.21.15.159:0/3343903886 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f374c0cfbf0 con 0x7f3760101420 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f376936f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 0x555d0dc15a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f376936f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc15fc0 0x555d0dc183b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f376936f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d0db6d090 con 0x555d0dc068b0 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f376936f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555d0db14a70 con 0x555d0dc071d0 2024-09-19T06:46:36.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f376936f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d0db69050 con 0x555d0dc15fc0 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3764d32640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc06c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3764d32640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc06c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42366/0 (socket says 172.21.15.159:42366) 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3764d32640 1 -- 172.21.15.159:0/2469571121 learned_addr learned my addr 172.21.15.159:0/2469571121 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f375ffff640 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 0x555d0dc15a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3765533640 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc15fc0 0x555d0dc183b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3764d32640 1 -- 172.21.15.159:0/2469571121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc15fc0 msgr2=0x555d0dc183b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3764d32640 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc15fc0 0x555d0dc183b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3764d32640 1 -- 172.21.15.159:0/2469571121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 msgr2=0x555d0dc15a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3764d32640 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 0x555d0dc15a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3764d32640 1 -- 172.21.15.159:0/2469571121 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0db21130 con 0x555d0dc068b0 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f375ffff640 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 0x555d0dc15a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.397+0000 7f3765533640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f37500a3350 0x7f37500a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3758009cd0 tx=0x7f3758031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f3764d32640 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc06c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f375400bac0 tx=0x7f375400bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd8899aaf05ee53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f374affd640 1 -- 172.21.15.159:0/2469571121 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754017420 con 0x555d0dc068b0 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f374affd640 1 -- 172.21.15.159:0/2469571121 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3754017aa0 con 0x555d0dc068b0 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f374affd640 1 -- 172.21.15.159:0/2469571121 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375400fb20 con 0x555d0dc068b0 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f376936f740 1 -- 172.21.15.159:0/2469571121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 msgr2=0x555d0dc06c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f376936f740 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc06c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f375400bac0 tx=0x7f375400bf80 comp rx=0 tx=0).stop 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f376936f740 1 -- 172.21.15.159:0/2469571121 shutdown_connections 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f376936f740 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc15fc0 0x555d0dc183b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f376936f740 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 0x555d0dc15a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f376936f740 1 --2- 172.21.15.159:0/2469571121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc06c90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.398+0000 7f376936f740 1 -- 172.21.15.159:0/2469571121 >> 172.21.15.159:0/2469571121 conn(0x555d0dc02f60 msgr2=0x555d0dc03340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 -- 172.21.15.159:0/2469571121 shutdown_connections 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 -- 172.21.15.159:0/2469571121 wait complete. 2024-09-19T06:46:36.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 -- start start 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 Processor -- start 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc068b0 0x555d0dc15780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 0x555d0dc12b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc15fc0 0x555d0dc13060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d0dc18b90 con 0x555d0dc15fc0 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555d0db27f20 con 0x555d0dc068b0 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d0dc18d10 con 0x555d0dc071d0 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f376936f740 10 client.0 _ll_register_callbacks cb 0x555d0daf1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f3765533640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc15fc0 0x555d0dc13060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f3765533640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc15fc0 0x555d0dc13060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42368/0 (socket says 172.21.15.159:42368) 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f3765533640 1 -- 172.21.15.159:0/3646681565 learned_addr learned my addr 172.21.15.159:0/3646681565 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:36.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.399+0000 7f375ffff640 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 0x555d0dc12b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f3764d32640 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc068b0 0x555d0dc15780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f3765533640 1 -- 172.21.15.159:0/3646681565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 msgr2=0x555d0dc12b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f3765533640 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 0x555d0dc12b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f3765533640 1 -- 172.21.15.159:0/3646681565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc068b0 msgr2=0x555d0dc15780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f3765533640 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc068b0 0x555d0dc15780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f3765533640 1 -- 172.21.15.159:0/3646681565 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0d8de2b0 con 0x555d0dc15fc0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f3765533640 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc15fc0 0x555d0dc13060 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3758009ca0 tx=0x7f375802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9baf612fc36bef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f373ffff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f373ffff640 1 -- 172.21.15.159:0/3646681565 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375804c070 con 0x555d0dc15fc0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f373ffff640 1 -- 172.21.15.159:0/3646681565 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f3758004790 con 0x555d0dc15fc0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f376936f740 1 -- 172.21.15.159:0/3646681565 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3754017aa0 con 0x555d0dc15fc0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f373ffff640 1 -- 172.21.15.159:0/3646681565 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3758031d70 con 0x555d0dc15fc0 2024-09-19T06:46:36.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f376936f740 10 client.14973 fetch_fsmap learned FSMap version 20 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f376936f740 1 -- 172.21.15.159:0/3646681565 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555d0dc243f0 con 0x555d0dc15fc0 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.400+0000 7f373ffff640 1 -- 172.21.15.159:0/3646681565 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3754017aa0 con 0x555d0dc15fc0 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f373ffff640 1 -- 172.21.15.159:0/3646681565 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3758030070 con 0x555d0dc15fc0 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f376936f740 10 client.14973 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f376936f740 10 client.14973 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f376936f740 20 client.14973 populate_metadata read hostname 'smithi159' 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f376936f740 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x555d0dc26a60 0x555d0dc27ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f376936f740 4 client.14973 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f376936f740 1 -- 172.21.15.159:0/3646681565 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d0db7a600 con 0x555d0dc26a60 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f3764d32640 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x555d0dc26a60 0x555d0dc27ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f373ffff640 10 client.14973 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.401+0000 7f3764d32640 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x555d0dc26a60 0x555d0dc27ed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d95676e211de1da server_cookie=54d8a964e55103d3 in_seq=0 out_seq=0 2024-09-19T06:46:36.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.402+0000 7f373ffff640 1 -- 172.21.15.159:0/3646681565 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d0db7a600 con 0x555d0dc26a60 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.402+0000 7f373ffff640 10 client.14973 handle_command_reply: tid=0 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.402+0000 7f376936f740 1 client.14973 shutdown 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 -- 172.21.15.159:0/3646681565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc15fc0 msgr2=0x555d0dc13060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc15fc0 0x555d0dc13060 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3758009ca0 tx=0x7f375802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 -- 172.21.15.159:0/3646681565 shutdown_connections 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x555d0dc26a60 0x555d0dc27ed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc15fc0 0x555d0dc13060 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f373ffff640 0 client.14973 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 0x555d0dc12b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 --2- 172.21.15.159:0/3646681565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc068b0 0x555d0dc15780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 -- 172.21.15.159:0/3646681565 >> 172.21.15.159:0/3646681565 conn(0x555d0dc02f60 msgr2=0x555d0dc08cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 -- 172.21.15.159:0/3646681565 shutdown_connections 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 1 -- 172.21.15.159:0/3646681565 wait complete. 2024-09-19T06:46:36.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.403+0000 7f376936f740 20 client.14973 trim_cache size 0 max 16384 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f376936f740 1 Processor -- start 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f376936f740 1 -- start start 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f376936f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc27ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f376936f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 0x555d0dc27800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f376936f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc15fc0 0x555d0dc26390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f376936f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d0dc26210 con 0x555d0dc068b0 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f376936f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555d0dc268e0 con 0x555d0dc071d0 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f376936f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d0dc26fb0 con 0x555d0dc15fc0 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f3764d32640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc27ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f3764d32640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc27ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42374/0 (socket says 172.21.15.159:42374) 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f3764d32640 1 -- 172.21.15.159:0/3431028268 learned_addr learned my addr 172.21.15.159:0/3431028268 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:36.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f3764d32640 1 -- 172.21.15.159:0/3431028268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc15fc0 msgr2=0x555d0dc26390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f3764d32640 1 --2- 172.21.15.159:0/3431028268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc15fc0 0x555d0dc26390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f3764d32640 1 -- 172.21.15.159:0/3431028268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 msgr2=0x555d0dc27800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f3764d32640 1 --2- 172.21.15.159:0/3431028268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 0x555d0dc27800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.421+0000 7f3764d32640 1 -- 172.21.15.159:0/3431028268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0dc15af0 con 0x555d0dc068b0 2024-09-19T06:46:36.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f3764d32640 1 --2- 172.21.15.159:0/3431028268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc27ed0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f375400b9e0 tx=0x7f375400f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7162743fa7f3d567 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f374a7fc640 1 -- 172.21.15.159:0/3431028268 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375400f490 con 0x555d0dc068b0 2024-09-19T06:46:36.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f374a7fc640 1 -- 172.21.15.159:0/3431028268 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f375400fd10 con 0x555d0dc068b0 2024-09-19T06:46:36.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f374a7fc640 1 -- 172.21.15.159:0/3431028268 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754028bc0 con 0x555d0dc068b0 2024-09-19T06:46:36.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f376936f740 1 -- 172.21.15.159:0/3431028268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 msgr2=0x555d0dc27ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f376936f740 1 --2- 172.21.15.159:0/3431028268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc27ed0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f375400b9e0 tx=0x7f375400f660 comp rx=0 tx=0).stop 2024-09-19T06:46:36.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f376936f740 1 -- 172.21.15.159:0/3431028268 shutdown_connections 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f376936f740 1 --2- 172.21.15.159:0/3431028268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc15fc0 0x555d0dc26390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f376936f740 1 --2- 172.21.15.159:0/3431028268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc071d0 0x555d0dc27800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f376936f740 1 --2- 172.21.15.159:0/3431028268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc27ed0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f376936f740 1 -- 172.21.15.159:0/3431028268 >> 172.21.15.159:0/3431028268 conn(0x555d0dc02f60 msgr2=0x555d0dc03340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f376936f740 1 -- 172.21.15.159:0/3431028268 shutdown_connections 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.422+0000 7f376936f740 1 -- 172.21.15.159:0/3431028268 wait complete. 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f376936f740 1 -- start start 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f376936f740 1 Processor -- start 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f376936f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc30500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f376936f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 0x555d0dc30a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f376936f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc15fc0 0x555d0dc16d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f376936f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d0dc27d50 con 0x555d0dc068b0 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f376936f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555d0dc27680 con 0x555d0dc15fc0 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f376936f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d0dc28420 con 0x555d0dc071d0 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f376936f740 10 client.0 _ll_register_callbacks cb 0x7f3758041050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f3764d32640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc30500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f3764d32640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc30500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42376/0 (socket says 172.21.15.159:42376) 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.423+0000 7f3764d32640 1 -- 172.21.15.159:0/2353747532 learned_addr learned my addr 172.21.15.159:0/2353747532 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f375ffff640 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 0x555d0dc30a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f3765533640 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc15fc0 0x555d0dc16d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f3764d32640 1 -- 172.21.15.159:0/2353747532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 msgr2=0x555d0dc30a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f3764d32640 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 0x555d0dc30a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f3764d32640 1 -- 172.21.15.159:0/2353747532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc15fc0 msgr2=0x555d0dc16d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:36.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f3764d32640 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc15fc0 0x555d0dc16d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f3764d32640 1 -- 172.21.15.159:0/2353747532 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0dc07000 con 0x555d0dc068b0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f3765533640 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc15fc0 0x555d0dc16d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f3764d32640 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc30500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3754028450 tx=0x7f375400f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc8b491706d6602 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f373ffff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f373ffff640 1 -- 172.21.15.159:0/2353747532 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375402d070 con 0x555d0dc068b0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f373ffff640 1 -- 172.21.15.159:0/2353747532 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f375400f970 con 0x555d0dc068b0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f376936f740 1 -- 172.21.15.159:0/2353747532 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f375400fd10 con 0x555d0dc068b0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f373ffff640 1 -- 172.21.15.159:0/2353747532 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f375400fb70 con 0x555d0dc068b0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f376936f740 10 client.14979 fetch_fsmap learned FSMap version 20 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f376936f740 1 -- 172.21.15.159:0/2353747532 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555d0dc2dc00 con 0x555d0dc068b0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.424+0000 7f373ffff640 1 -- 172.21.15.159:0/2353747532 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f375400fd10 con 0x555d0dc068b0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f373ffff640 1 -- 172.21.15.159:0/2353747532 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f37540179c0 con 0x555d0dc068b0 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f376936f740 10 client.14979 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:46:36.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f376936f740 10 client.14979 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f376936f740 20 client.14979 populate_metadata read hostname 'smithi159' 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f376936f740 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x555d0dc95190 0x555d0dc93ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f376936f740 4 client.14979 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f376936f740 1 -- 172.21.15.159:0/2353747532 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "status"}) -- 0x555d0db74b10 con 0x555d0dc95190 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f375ffff640 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x555d0dc95190 0x555d0dc93ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f375ffff640 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x555d0dc95190 0x555d0dc93ea0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da571dbbb1693ccc server_cookie=76360bae539b6d71 in_seq=0 out_seq=0 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f373ffff640 10 client.14979 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f373ffff640 1 -- 172.21.15.159:0/2353747532 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555d0db74b10 con 0x555d0dc95190 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f373ffff640 10 client.14979 handle_command_reply: tid=0 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.425+0000 7f376936f740 1 client.14979 shutdown 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 -- 172.21.15.159:0/2353747532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 msgr2=0x555d0dc30500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc30500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3754028450 tx=0x7f375400f4b0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 -- 172.21.15.159:0/2353747532 shutdown_connections 2024-09-19T06:46:36.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x555d0dc95190 0x555d0dc93ea0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d0dc15fc0 0x555d0dc16d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d0dc071d0 0x555d0dc30a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 --2- 172.21.15.159:0/2353747532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d0dc068b0 0x555d0dc30500 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f373ffff640 0 client.14979 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 -- 172.21.15.159:0/2353747532 >> 172.21.15.159:0/2353747532 conn(0x555d0dc02f60 msgr2=0x555d0dbfdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 -- 172.21.15.159:0/2353747532 shutdown_connections 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 1 -- 172.21.15.159:0/2353747532 wait complete. 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f376936f740 20 client.14979 trim_cache size 0 max 16384 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stdout: "cluster_fsid": "82c73dba-7651-11ef-bceb-c7b262605968", 2024-09-19T06:46:36.432 INFO:teuthology.orchestra.run.smithi159.stdout: "whoami": 0, 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 24487, 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout: "want_state": "up:active", 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout: "state": "up:active", 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs", 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout: "rank_uptime": 72.653820354999993, 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout: "mdsmap_epoch": 20, 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch": 81, 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout: "uptime": 92.008977243999993 2024-09-19T06:46:36.433 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f3766f96640 1 -- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f37500a3350 msgr2=0x7f37500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f3766f96640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f37500a3350 0x7f37500a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3758009cd0 tx=0x7f3758031510 comp rx=0 tx=0).stop 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f3766f96640 1 -- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 msgr2=0x7f3760199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.426+0000 7f3766f96640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 0x7f3760199740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f374c00c890 tx=0x7f374c00cd50 comp rx=0 tx=0).stop 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.427+0000 7f3766f96640 1 -- 172.21.15.159:0/3343903886 shutdown_connections 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.427+0000 7f3766f96640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f37500a3350 0x7f37500a5810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.427+0000 7f3766f96640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3760106a80 0x7f37601a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.427+0000 7f3766f96640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3760101420 0x7f3760199740 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.427+0000 7f3766f96640 1 --2- 172.21.15.159:0/3343903886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3760100a80 0x7f3760199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:36.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.427+0000 7f3766f96640 1 -- 172.21.15.159:0/3343903886 >> 172.21.15.159:0/3343903886 conn(0x7f37600fc7a0 msgr2=0x7f37600fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:36.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.427+0000 7f3766f96640 1 -- 172.21.15.159:0/3343903886 shutdown_connections 2024-09-19T06:46:36.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:36.427+0000 7f3766f96640 1 -- 172.21.15.159:0/3343903886 wait complete. 2024-09-19T06:46:37.138 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T06:46:37.138 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:46:37.148 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T06:46:37.148 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T06:46:37.395 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 -- 172.21.15.159:0/2938801871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194102690 msgr2=0x7f2194108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 --2- 172.21.15.159:0/2938801871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194102690 0x7f2194108f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f218c009ca0 tx=0x7f218c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 -- 172.21.15.159:0/2938801871 shutdown_connections 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 --2- 172.21.15.159:0/2938801871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194102690 0x7f2194108f20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 --2- 172.21.15.159:0/2938801871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2194101cd0 0x7f2194102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 --2- 172.21.15.159:0/2938801871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2194100ad0 0x7f2194100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 -- 172.21.15.159:0/2938801871 >> 172.21.15.159:0/2938801871 conn(0x7f21940fc280 msgr2=0x7f21940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 -- 172.21.15.159:0/2938801871 shutdown_connections 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 -- 172.21.15.159:0/2938801871 wait complete. 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 Processor -- start 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 -- start start 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194100ad0 0x7f219406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2194101cd0 0x7f219419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2194102690 0x7f219419f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f219410c730 con 0x7f2194100ad0 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f219410c5b0 con 0x7f2194102690 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.894+0000 7f219bfa1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f219410c8b0 con 0x7f2194101cd0 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f2199d3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194100ad0 0x7f219406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f2199d3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194100ad0 0x7f219406aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42388/0 (socket says 172.21.15.159:42388) 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f2199d3d640 1 -- 172.21.15.159:0/724787567 learned_addr learned my addr 172.21.15.159:0/724787567 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f219a53e640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2194102690 0x7f219419f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f219953c640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2194101cd0 0x7f219419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f2199d3d640 1 -- 172.21.15.159:0/724787567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2194101cd0 msgr2=0x7f219419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f2199d3d640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2194101cd0 0x7f219419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f2199d3d640 1 -- 172.21.15.159:0/724787567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2194102690 msgr2=0x7f219419f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f2199d3d640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2194102690 0x7f219419f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f2199d3d640 1 -- 172.21.15.159:0/724787567 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219419fb10 con 0x7f2194100ad0 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f2199d3d640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194100ad0 0x7f219406aad0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f219000d950 tx=0x7f219000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f218affd640 1 -- 172.21.15.159:0/724787567 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190017020 con 0x7f2194100ad0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f218affd640 1 -- 172.21.15.159:0/724787567 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2190009c30 con 0x7f2194100ad0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219419fda0 con 0x7f2194100ad0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f218affd640 1 -- 172.21.15.159:0/724787567 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219000f740 con 0x7f2194100ad0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.895+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21941a0260 con 0x7f2194100ad0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.896+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2194107ef0 con 0x7f2194100ad0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.897+0000 7f218affd640 1 -- 172.21.15.159:0/724787567 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f219001a020 con 0x7f2194100ad0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.898+0000 7f218affd640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f21800a3350 0x7f21800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.898+0000 7f219953c640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f21800a3350 0x7f21800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.898+0000 7f218affd640 1 -- 172.21.15.159:0/724787567 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f21900cf3c0 con 0x7f2194100ad0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.898+0000 7f219953c640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f21800a3350 0x7f21800a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f219406b050 tx=0x7f218400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:37.902+0000 7f218affd640 1 -- 172.21.15.159:0/724787567 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2190021070 con 0x7f2194100ad0 2024-09-19T06:46:38.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.081+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2194062630 con 0x7f21800a3350 2024-09-19T06:46:38.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.082+0000 7f218affd640 1 -- 172.21.15.159:0/724787567 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2194062630 con 0x7f21800a3350 2024-09-19T06:46:38.084 INFO:teuthology.orchestra.run.smithi159.stdout:Backend: cephadm 2024-09-19T06:46:38.084 INFO:teuthology.orchestra.run.smithi159.stdout:Available: Yes 2024-09-19T06:46:38.084 INFO:teuthology.orchestra.run.smithi159.stdout:Paused: No 2024-09-19T06:46:38.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.084+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f21800a3350 msgr2=0x7f21800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.084+0000 7f219bfa1640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f21800a3350 0x7f21800a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f219406b050 tx=0x7f218400b390 comp rx=0 tx=0).stop 2024-09-19T06:46:38.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.084+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194100ad0 msgr2=0x7f219406aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.084+0000 7f219bfa1640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194100ad0 0x7f219406aad0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f219000d950 tx=0x7f219000de10 comp rx=0 tx=0).stop 2024-09-19T06:46:38.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.085+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 shutdown_connections 2024-09-19T06:46:38.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.085+0000 7f219bfa1640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f21800a3350 0x7f21800a5810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.085+0000 7f219bfa1640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2194102690 0x7f219419f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.085+0000 7f219bfa1640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2194101cd0 0x7f219419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.085+0000 7f219bfa1640 1 --2- 172.21.15.159:0/724787567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2194100ad0 0x7f219406aad0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.085+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 >> 172.21.15.159:0/724787567 conn(0x7f21940fc280 msgr2=0x7f21941050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.085+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 shutdown_connections 2024-09-19T06:46:38.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:38.085+0000 7f219bfa1640 1 -- 172.21.15.159:0/724787567 wait complete. 2024-09-19T06:46:38.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:38 smithi203 ceph-mon[35473]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:38.861 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:38 smithi159 ceph-mon[30935]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:38.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:38 smithi189 ceph-mon[34880]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:38.894 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T06:46:39.144 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:39.587 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:39 smithi159 ceph-mon[30935]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:39.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 -- 172.21.15.159:0/3270894645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 msgr2=0x7f5568108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 --2- 172.21.15.159:0/3270894645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 0x7f5568108f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5560009ca0 tx=0x7f556002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 -- 172.21.15.159:0/3270894645 shutdown_connections 2024-09-19T06:46:39.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 --2- 172.21.15.159:0/3270894645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 0x7f5568108f20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 --2- 172.21.15.159:0/3270894645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5568101cd0 0x7f5568102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 --2- 172.21.15.159:0/3270894645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5568100ad0 0x7f5568100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 -- 172.21.15.159:0/3270894645 >> 172.21.15.159:0/3270894645 conn(0x7f55680fc280 msgr2=0x7f55680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 -- 172.21.15.159:0/3270894645 shutdown_connections 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 -- 172.21.15.159:0/3270894645 wait complete. 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.586+0000 7f556dbc0640 1 Processor -- start 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f556dbc0640 1 -- start start 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f556dbc0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5568100ad0 0x7f5568197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f556dbc0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5568101cd0 0x7f5568198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f556dbc0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 0x7f556819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f556dbc0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f556810c7d0 con 0x7f5568102690 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f556dbc0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f556810c650 con 0x7f5568100ad0 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f556dbc0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f556810c950 con 0x7f5568101cd0 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5567fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 0x7f556819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5567fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 0x7f556819f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42440/0 (socket says 172.21.15.159:42440) 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5567fff640 1 -- 172.21.15.159:0/2172284240 learned_addr learned my addr 172.21.15.159:0/2172284240 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5566ffd640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5568101cd0 0x7f5568198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f55677fe640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5568100ad0 0x7f5568197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5567fff640 1 -- 172.21.15.159:0/2172284240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5568101cd0 msgr2=0x7f5568198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5567fff640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5568101cd0 0x7f5568198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5567fff640 1 -- 172.21.15.159:0/2172284240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5568100ad0 msgr2=0x7f5568197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5567fff640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5568100ad0 0x7f5568197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5567fff640 1 -- 172.21.15.159:0/2172284240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556819fb70 con 0x7f5568102690 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.587+0000 7f5566ffd640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5568101cd0 0x7f5568198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.588+0000 7f5567fff640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 0x7f556819f500 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f55600098d0 tx=0x7f556002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.588+0000 7f5564ff9640 1 -- 172.21.15.159:0/2172284240 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556002fc30 con 0x7f5568102690 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.588+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556819fe00 con 0x7f5568102690 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.588+0000 7f5564ff9640 1 -- 172.21.15.159:0/2172284240 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5560003e50 con 0x7f5568102690 2024-09-19T06:46:39.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.588+0000 7f5564ff9640 1 -- 172.21.15.159:0/2172284240 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600305c0 con 0x7f5568102690 2024-09-19T06:46:39.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.588+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55681a0330 con 0x7f5568102690 2024-09-19T06:46:39.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.589+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55681a0590 con 0x7f5568102690 2024-09-19T06:46:39.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.590+0000 7f5564ff9640 1 -- 172.21.15.159:0/2172284240 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5560004b40 con 0x7f5568102690 2024-09-19T06:46:39.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.591+0000 7f5564ff9640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f55500a3300 0x7f55500a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.591+0000 7f55677fe640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f55500a3300 0x7f55500a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.591+0000 7f5564ff9640 1 -- 172.21.15.159:0/2172284240 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f55600f0f80 con 0x7f5568102690 2024-09-19T06:46:39.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.591+0000 7f55677fe640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f55500a3300 0x7f55500a57c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5568101b30 tx=0x7f5558008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.594+0000 7f5564ff9640 1 -- 172.21.15.159:0/2172284240 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55600bdc30 con 0x7f5568102690 2024-09-19T06:46:39.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.770+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f55681a0760 con 0x7f55500a3300 2024-09-19T06:46:39.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.782+0000 7f5564ff9640 1 -- 172.21.15.159:0/2172284240 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f55681a0760 con 0x7f55500a3300 2024-09-19T06:46:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:46:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:mds.a smithi159 running (89s) 13s ago 89s 15.6M - 19.1.1-361-g2f599a46 d2baa855c067 30fab5e7f69b 2024-09-19T06:46:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:mds.b smithi189 running (87s) 19s ago 86s 18.1M - 19.1.1-361-g2f599a46 d2baa855c067 1930efd25bf7 2024-09-19T06:46:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:mds.c smithi203 running (101s) 19s ago 100s 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 a5d9e09df2d0 2024-09-19T06:46:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:mds.d smithi159 running (109s) 13s ago 108s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 7e716c692274 2024-09-19T06:46:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:mds.e smithi189 running (106s) 19s ago 105s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 4bdc73a359bf 2024-09-19T06:46:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:mds.f smithi203 running (103s) 19s ago 103s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 6e733e568cd8 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mds.g smithi159 running (92s) 13s ago 92s 16.5M - 19.1.1-361-g2f599a46 d2baa855c067 f0f476929a60 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mds.h smithi189 running (98s) 19s ago 97s 16.5M - 19.1.1-361-g2f599a46 d2baa855c067 fae9a2299096 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mds.i smithi203 running (95s) 19s ago 95s 25.7M - 19.1.1-361-g2f599a46 d2baa855c067 d8bd847cff05 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mds.j smithi159 running (112s) 13s ago 112s 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 f8ea31394b3d 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mds.k smithi189 running (115s) 19s ago 115s 16.9M - 19.1.1-361-g2f599a46 d2baa855c067 44ac5cdd8d06 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mds.l smithi203 running (118s) 19s ago 118s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 ecef4d148ff3 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.x smithi159 *:9283,8765 running (8m) 13s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 d70b5d613ab8 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.y smithi189 *:8443,8765 running (7m) 19s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 a25f5e01e527 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.z smithi203 *:8443,8765 running (7m) 19s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 cd0004496eb1 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mon.a smithi159 running (8m) 13s ago 9m 51.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 2bf001ca4d21 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mon.b smithi189 running (7m) 19s ago 7m 39.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 23f295b00c42 2024-09-19T06:46:39.784 INFO:teuthology.orchestra.run.smithi159.stdout:mon.c smithi203 running (7m) 19s ago 7m 38.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 c5cd3c7c105a 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (6m) 13s ago 6m 46.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 8ccc064a662d 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi189 running (6m) 19s ago 6m 56.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 151eac50f629 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi203 running (6m) 19s ago 6m 58.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 acb89449b489 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi159 running (5m) 13s ago 5m 53.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 abf2c8f582fb 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi189 running (5m) 19s ago 5m 42.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 7b96d7147936 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi203 running (4m) 19s ago 4m 58.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 37ba70723139 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.6 smithi159 running (4m) 13s ago 4m 51.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 62c94f49c2a9 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.7 smithi189 running (3m) 19s ago 3m 44.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 ab7dcc580eef 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.8 smithi203 running (3m) 19s ago 3m 45.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a1ac5de13260 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.9 smithi159 running (3m) 13s ago 3m 52.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 48fee7f13ace 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.10 smithi189 running (2m) 19s ago 2m 43.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 9fff0bdbbff5 2024-09-19T06:46:39.785 INFO:teuthology.orchestra.run.smithi159.stdout:osd.11 smithi203 running (2m) 19s ago 2m 42.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a8b45f2d421a 2024-09-19T06:46:39.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f55500a3300 msgr2=0x7f55500a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f55500a3300 0x7f55500a57c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5568101b30 tx=0x7f5558008040 comp rx=0 tx=0).stop 2024-09-19T06:46:39.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 msgr2=0x7f556819f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 0x7f556819f500 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f55600098d0 tx=0x7f556002f840 comp rx=0 tx=0).stop 2024-09-19T06:46:39.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 shutdown_connections 2024-09-19T06:46:39.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f55500a3300 0x7f55500a57c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5568102690 0x7f556819f500 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5568101cd0 0x7f5568198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 --2- 172.21.15.159:0/2172284240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5568100ad0 0x7f5568197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 >> 172.21.15.159:0/2172284240 conn(0x7f55680fc280 msgr2=0x7f5568069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 shutdown_connections 2024-09-19T06:46:39.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:39.784+0000 7f556dbc0640 1 -- 172.21.15.159:0/2172284240 wait complete. 2024-09-19T06:46:39.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:39 smithi203 ceph-mon[35473]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:39.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:39 smithi189 ceph-mon[34880]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:40.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T06:46:40.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:40 smithi159 ceph-mon[30935]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:40.750 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:40.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:40 smithi203 ceph-mon[35473]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:40.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:40 smithi189 ceph-mon[34880]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:41.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.262+0000 7f0547e1d640 1 -- 172.21.15.159:0/2792807476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 msgr2=0x7f0540103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.262+0000 7f0547e1d640 1 --2- 172.21.15.159:0/2792807476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 0x7f0540103280 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0530009900 tx=0x7f053002a410 comp rx=0 tx=0).stop 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.262+0000 7f0547e1d640 1 -- 172.21.15.159:0/2792807476 shutdown_connections 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.262+0000 7f0547e1d640 1 --2- 172.21.15.159:0/2792807476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05401037c0 0x7f054010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.262+0000 7f0547e1d640 1 --2- 172.21.15.159:0/2792807476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 0x7f0540103280 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.262+0000 7f0547e1d640 1 --2- 172.21.15.159:0/2792807476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0540101c00 0x7f0540102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.262+0000 7f0547e1d640 1 -- 172.21.15.159:0/2792807476 >> 172.21.15.159:0/2792807476 conn(0x7f05400fd390 msgr2=0x7f05400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.262+0000 7f0547e1d640 1 -- 172.21.15.159:0/2792807476 shutdown_connections 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.262+0000 7f0547e1d640 1 -- 172.21.15.159:0/2792807476 wait complete. 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f0547e1d640 1 Processor -- start 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f0547e1d640 1 -- start start 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f0547e1d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0540101c00 0x7f0540197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:41.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f0547e1d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 0x7f05401983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f0547e1d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05401037c0 0x7f054019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f0547e1d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f054010d860 con 0x7f0540102e00 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f0547e1d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f054010d6e0 con 0x7f0540101c00 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f0547e1d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f054010d9e0 con 0x7f05401037c0 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05453b8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 0x7f05401983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05453b8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 0x7f05401983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42458/0 (socket says 172.21.15.159:42458) 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05453b8640 1 -- 172.21.15.159:0/377150328 learned_addr learned my addr 172.21.15.159:0/377150328 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f0545bb9640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0540101c00 0x7f0540197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05463ba640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05401037c0 0x7f054019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05453b8640 1 -- 172.21.15.159:0/377150328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05401037c0 msgr2=0x7f054019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05453b8640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05401037c0 0x7f054019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05453b8640 1 -- 172.21.15.159:0/377150328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0540101c00 msgr2=0x7f0540197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:41.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05453b8640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0540101c00 0x7f0540197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05453b8640 1 -- 172.21.15.159:0/377150328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054019fab0 con 0x7f0540102e00 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.263+0000 7f05453b8640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 0x7f05401983c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0530009230 tx=0x7f0530004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.264+0000 7f0536ffd640 1 -- 172.21.15.159:0/377150328 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053003f030 con 0x7f0540102e00 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.264+0000 7f0536ffd640 1 -- 172.21.15.159:0/377150328 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0530003ce0 con 0x7f0540102e00 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.264+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054019fd40 con 0x7f0540102e00 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.264+0000 7f0536ffd640 1 -- 172.21.15.159:0/377150328 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530035070 con 0x7f0540102e00 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.264+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05401a01c0 con 0x7f0540102e00 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.265+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0540108fd0 con 0x7f0540102e00 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.266+0000 7f0536ffd640 1 -- 172.21.15.159:0/377150328 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0530042030 con 0x7f0540102e00 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.266+0000 7f0536ffd640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f052c0a3300 0x7f052c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.266+0000 7f0545bb9640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f052c0a3300 0x7f052c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.266+0000 7f0536ffd640 1 -- 172.21.15.159:0/377150328 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f05300f0140 con 0x7f0540102e00 2024-09-19T06:46:41.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.267+0000 7f0545bb9640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f052c0a3300 0x7f052c0a57c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0540102c60 tx=0x7f053c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:41.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.270+0000 7f0536ffd640 1 -- 172.21.15.159:0/377150328 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05300bc690 con 0x7f0540102e00 2024-09-19T06:46:41.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.448+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0540062630 con 0x7f052c0a3300 2024-09-19T06:46:41.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.454+0000 7f0536ffd640 1 -- 172.21.15.159:0/377150328 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f0540062630 con 0x7f052c0a3300 2024-09-19T06:46:41.455 INFO:teuthology.orchestra.run.smithi159.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T06:46:41.455 INFO:teuthology.orchestra.run.smithi159.stdout:mds.all 12/12 21s ago 2m smithi159=a;smithi159=d;smithi159=g;smithi159=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T06:46:41.455 INFO:teuthology.orchestra.run.smithi159.stdout:mgr 3/3 21s ago 7m smithi159=x;smithi189=y;smithi203=z;count:3 2024-09-19T06:46:41.455 INFO:teuthology.orchestra.run.smithi159.stdout:mon 3/3 21s ago 7m smithi159:172.21.15.159=a;smithi189:172.21.15.189=b;smithi203:172.21.15.203=c;count:3 2024-09-19T06:46:41.455 INFO:teuthology.orchestra.run.smithi159.stdout:osd 12 21s ago - 2024-09-19T06:46:41.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f052c0a3300 msgr2=0x7f052c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:41.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f052c0a3300 0x7f052c0a57c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0540102c60 tx=0x7f053c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 msgr2=0x7f05401983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 0x7f05401983c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0530009230 tx=0x7f0530004430 comp rx=0 tx=0).stop 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 shutdown_connections 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f052c0a3300 0x7f052c0a57c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05401037c0 0x7f054019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0540102e00 0x7f05401983c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 --2- 172.21.15.159:0/377150328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0540101c00 0x7f0540197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 >> 172.21.15.159:0/377150328 conn(0x7f05400fd390 msgr2=0x7f05401061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 shutdown_connections 2024-09-19T06:46:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:41.456+0000 7f0547e1d640 1 -- 172.21.15.159:0/377150328 wait complete. 2024-09-19T06:46:41.779 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:41 smithi159 ceph-mon[30935]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:41.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:41 smithi203 ceph-mon[35473]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:41.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:41 smithi189 ceph-mon[34880]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:42.099 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T06:46:42.345 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:42.759 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:42 smithi159 ceph-mon[30935]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:42.759 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:42 smithi159 ceph-mon[30935]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:42.789 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:42 smithi189 ceph-mon[34880]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:42.789 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:42 smithi189 ceph-mon[34880]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:42.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:42 smithi203 ceph-mon[35473]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:42.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:42 smithi203 ceph-mon[35473]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:42.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.841+0000 7f71af9bd640 1 -- 172.21.15.159:0/3313627855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8107940 msgr2=0x7f71a8109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:42.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.841+0000 7f71af9bd640 1 --2- 172.21.15.159:0/3313627855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8107940 0x7f71a8109d30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009ca0 tx=0x7f71a002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.841+0000 7f71af9bd640 1 -- 172.21.15.159:0/3313627855 shutdown_connections 2024-09-19T06:46:42.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.841+0000 7f71af9bd640 1 --2- 172.21.15.159:0/3313627855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8107940 0x7f71a8109d30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.841+0000 7f71af9bd640 1 --2- 172.21.15.159:0/3313627855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71a8105010 0x7f71a8107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.841+0000 7f71af9bd640 1 --2- 172.21.15.159:0/3313627855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a81026e0 0x7f71a8104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.841+0000 7f71af9bd640 1 -- 172.21.15.159:0/3313627855 >> 172.21.15.159:0/3313627855 conn(0x7f71a80fc280 msgr2=0x7f71a80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.841+0000 7f71af9bd640 1 -- 172.21.15.159:0/3313627855 shutdown_connections 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.841+0000 7f71af9bd640 1 -- 172.21.15.159:0/3313627855 wait complete. 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71af9bd640 1 Processor -- start 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71af9bd640 1 -- start start 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71af9bd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a81026e0 0x7f71a8197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71af9bd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8105010 0x7f71a8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71af9bd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71a8107940 0x7f71a819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71af9bd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f71a810d860 con 0x7f71a8105010 2024-09-19T06:46:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71af9bd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f71a810d6e0 con 0x7f71a81026e0 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71af9bd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71a810d9e0 con 0x7f71a8107940 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71acf58640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8105010 0x7f71a8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71acf58640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8105010 0x7f71a8198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42464/0 (socket says 172.21.15.159:42464) 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71acf58640 1 -- 172.21.15.159:0/1455203674 learned_addr learned my addr 172.21.15.159:0/1455203674 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71ad759640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a81026e0 0x7f71a8197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71adf5a640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71a8107940 0x7f71a819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71acf58640 1 -- 172.21.15.159:0/1455203674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71a8107940 msgr2=0x7f71a819f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71acf58640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71a8107940 0x7f71a819f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71acf58640 1 -- 172.21.15.159:0/1455203674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a81026e0 msgr2=0x7f71a8197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71acf58640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a81026e0 0x7f71a8197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71acf58640 1 -- 172.21.15.159:0/1455203674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a819fa50 con 0x7f71a8105010 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.842+0000 7f71acf58640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8105010 0x7f71a8198360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f719800c970 tx=0x7f719800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.843+0000 7f719e7fc640 1 -- 172.21.15.159:0/1455203674 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198014070 con 0x7f71a8105010 2024-09-19T06:46:42.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.843+0000 7f719e7fc640 1 -- 172.21.15.159:0/1455203674 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7198004440 con 0x7f71a8105010 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.843+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a819fd40 con 0x7f71a8105010 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.843+0000 7f719e7fc640 1 -- 172.21.15.159:0/1455203674 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719800f450 con 0x7f71a8105010 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.843+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a81a0270 con 0x7f71a8105010 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.844+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a80fdd70 con 0x7f71a8105010 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.845+0000 7f719e7fc640 1 -- 172.21.15.159:0/1455203674 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7198017070 con 0x7f71a8105010 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.845+0000 7f719e7fc640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f71940a3380 0x7f71940a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.845+0000 7f71ad759640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f71940a3380 0x7f71940a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.845+0000 7f719e7fc640 1 -- 172.21.15.159:0/1455203674 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f71980cf470 con 0x7f71a8105010 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.846+0000 7f71ad759640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f71940a3380 0x7f71940a5840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f71a400bbe0 tx=0x7f71a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:42.849+0000 7f719e7fc640 1 -- 172.21.15.159:0/1455203674 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f719801e030 con 0x7f71a8105010 2024-09-19T06:46:43.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.020+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f71a8062630 con 0x7f71940a3380 2024-09-19T06:46:43.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.022+0000 7f719e7fc640 1 -- 172.21.15.159:0/1455203674 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f71a8062630 con 0x7f71940a3380 2024-09-19T06:46:43.023 INFO:teuthology.orchestra.run.smithi159.stdout:HOST ADDR LABELS STATUS 2024-09-19T06:46:43.023 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159 172.21.15.159 2024-09-19T06:46:43.023 INFO:teuthology.orchestra.run.smithi159.stdout:smithi189 172.21.15.189 2024-09-19T06:46:43.023 INFO:teuthology.orchestra.run.smithi159.stdout:smithi203 172.21.15.203 2024-09-19T06:46:43.023 INFO:teuthology.orchestra.run.smithi159.stdout:3 hosts in cluster 2024-09-19T06:46:43.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f71940a3380 msgr2=0x7f71940a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:43.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f71940a3380 0x7f71940a5840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f71a400bbe0 tx=0x7f71a400b390 comp rx=0 tx=0).stop 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8105010 msgr2=0x7f71a8198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8105010 0x7f71a8198360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f719800c970 tx=0x7f719800ce30 comp rx=0 tx=0).stop 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 shutdown_connections 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f71940a3380 0x7f71940a5840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71a8107940 0x7f71a819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71a8105010 0x7f71a8198360 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 --2- 172.21.15.159:0/1455203674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71a81026e0 0x7f71a8197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 >> 172.21.15.159:0/1455203674 conn(0x7f71a80fc280 msgr2=0x7f71a8102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 shutdown_connections 2024-09-19T06:46:43.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:43.024+0000 7f71af9bd640 1 -- 172.21.15.159:0/1455203674 wait complete. 2024-09-19T06:46:43.727 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T06:46:43.976 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:44.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.474+0000 7fcb625b3640 1 -- 172.21.15.159:0/3837770559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c1026c0 msgr2=0x7fcb5c108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:44.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.474+0000 7fcb625b3640 1 --2- 172.21.15.159:0/3837770559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c1026c0 0x7fcb5c108f50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009ca0 tx=0x7fcb5402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.474+0000 7fcb625b3640 1 -- 172.21.15.159:0/3837770559 shutdown_connections 2024-09-19T06:46:44.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.474+0000 7fcb625b3640 1 --2- 172.21.15.159:0/3837770559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c1026c0 0x7fcb5c108f50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.474+0000 7fcb625b3640 1 --2- 172.21.15.159:0/3837770559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb5c101d00 0x7fcb5c102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.474+0000 7fcb625b3640 1 --2- 172.21.15.159:0/3837770559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c100b00 0x7fcb5c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.474+0000 7fcb625b3640 1 -- 172.21.15.159:0/3837770559 >> 172.21.15.159:0/3837770559 conn(0x7fcb5c0fc290 msgr2=0x7fcb5c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.474+0000 7fcb625b3640 1 -- 172.21.15.159:0/3837770559 shutdown_connections 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.474+0000 7fcb625b3640 1 -- 172.21.15.159:0/3837770559 wait complete. 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb625b3640 1 Processor -- start 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb625b3640 1 -- start start 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb625b3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c100b00 0x7fcb5c196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb625b3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c101d00 0x7fcb5c197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb625b3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb5c1026c0 0x7fcb5c19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb625b3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c10c880 con 0x7fcb5c100b00 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb625b3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c10c700 con 0x7fcb5c1026c0 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb625b3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c10ca00 con 0x7fcb5c101d00 2024-09-19T06:46:44.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb5bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c100b00 0x7fcb5c196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb5bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c100b00 0x7fcb5c196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42486/0 (socket says 172.21.15.159:42486) 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb5bfff640 1 -- 172.21.15.159:0/1501016343 learned_addr learned my addr 172.21.15.159:0/1501016343 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb53fff640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c101d00 0x7fcb5c197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb60b50640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb5c1026c0 0x7fcb5c19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb5bfff640 1 -- 172.21.15.159:0/1501016343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c101d00 msgr2=0x7fcb5c197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb5bfff640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c101d00 0x7fcb5c197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb5bfff640 1 -- 172.21.15.159:0/1501016343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb5c1026c0 msgr2=0x7fcb5c19e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb5bfff640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb5c1026c0 0x7fcb5c19e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb5bfff640 1 -- 172.21.15.159:0/1501016343 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c19ebf0 con 0x7fcb5c100b00 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb53fff640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c101d00 0x7fcb5c197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:44.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.475+0000 7fcb5bfff640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c100b00 0x7fcb5c196fc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00b450 tx=0x7fcb4c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.476+0000 7fcb59ffb640 1 -- 172.21.15.159:0/1501016343 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c015020 con 0x7fcb5c100b00 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.476+0000 7fcb59ffb640 1 -- 172.21.15.159:0/1501016343 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb4c011d70 con 0x7fcb5c100b00 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.476+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5c19eee0 con 0x7fcb5c100b00 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.476+0000 7fcb59ffb640 1 -- 172.21.15.159:0/1501016343 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00f340 con 0x7fcb5c100b00 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.476+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5c19f3b0 con 0x7fcb5c100b00 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.477+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5c107ff0 con 0x7fcb5c100b00 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.478+0000 7fcb59ffb640 1 -- 172.21.15.159:0/1501016343 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fcb4c018020 con 0x7fcb5c100b00 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.478+0000 7fcb59ffb640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcb480a3380 0x7fcb480a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.479+0000 7fcb53fff640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcb480a3380 0x7fcb480a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.479+0000 7fcb59ffb640 1 -- 172.21.15.159:0/1501016343 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fcb4c0cf4a0 con 0x7fcb5c100b00 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.479+0000 7fcb53fff640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcb480a3380 0x7fcb480a5840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcb44006fd0 tx=0x7fcb44008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.483+0000 7fcb59ffb640 1 -- 172.21.15.159:0/1501016343 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb4c01f020 con 0x7fcb5c100b00 2024-09-19T06:46:44.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:44 smithi159 ceph-mon[30935]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:44.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:44 smithi159 ceph-mon[30935]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:44.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.660+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 --> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fcb5c062630 con 0x7fcb480a3380 2024-09-19T06:46:44.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.662+0000 7fcb59ffb640 1 -- 172.21.15.159:0/1501016343 <== mgr.14150 v2:172.21.15.159:6800/2390667146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fcb5c062630 con 0x7fcb480a3380 2024-09-19T06:46:44.663 INFO:teuthology.orchestra.run.smithi159.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T06:46:44.663 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GH400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T06:46:44.663 INFO:teuthology.orchestra.run.smithi159.stdout:smithi189 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232004L400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:46:44.663 INFO:teuthology.orchestra.run.smithi159.stdout:smithi203 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:46:44.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcb480a3380 msgr2=0x7fcb480a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:44.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcb480a3380 0x7fcb480a5840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcb44006fd0 tx=0x7fcb44008040 comp rx=0 tx=0).stop 2024-09-19T06:46:44.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c100b00 msgr2=0x7fcb5c196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:44.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c100b00 0x7fcb5c196fc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00b450 tx=0x7fcb4c00b910 comp rx=0 tx=0).stop 2024-09-19T06:46:44.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 shutdown_connections 2024-09-19T06:46:44.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fcb480a3380 0x7fcb480a5840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb5c1026c0 0x7fcb5c19e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c101d00 0x7fcb5c197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 --2- 172.21.15.159:0/1501016343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb5c100b00 0x7fcb5c196fc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 >> 172.21.15.159:0/1501016343 conn(0x7fcb5c0fc290 msgr2=0x7fcb5c1051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:44.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 shutdown_connections 2024-09-19T06:46:44.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:44.664+0000 7fcb625b3640 1 -- 172.21.15.159:0/1501016343 wait complete. 2024-09-19T06:46:44.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:44 smithi203 ceph-mon[35473]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:44.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:44 smithi203 ceph-mon[35473]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:44 smithi189 ceph-mon[34880]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:44 smithi189 ceph-mon[34880]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:45.300 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:46:45.310 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T06:46:45.310 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T06:46:45.557 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:46.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.041+0000 7f0aa17a1640 1 -- 172.21.15.159:0/3829466247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c102e00 msgr2=0x7f0a9c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.041+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/3829466247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c102e00 0x7f0a9c103280 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009900 tx=0x7f0a8402a410 comp rx=0 tx=0).stop 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.041+0000 7f0aa17a1640 1 -- 172.21.15.159:0/3829466247 shutdown_connections 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.041+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/3829466247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a9c1037c0 0x7f0a9c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.041+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/3829466247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c102e00 0x7f0a9c103280 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.041+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/3829466247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a9c101c00 0x7f0a9c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.041+0000 7f0aa17a1640 1 -- 172.21.15.159:0/3829466247 >> 172.21.15.159:0/3829466247 conn(0x7f0a9c0fd390 msgr2=0x7f0a9c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.041+0000 7f0aa17a1640 1 -- 172.21.15.159:0/3829466247 shutdown_connections 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.041+0000 7f0aa17a1640 1 -- 172.21.15.159:0/3829466247 wait complete. 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0aa17a1640 1 Processor -- start 2024-09-19T06:46:46.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0aa17a1640 1 -- start start 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0aa17a1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c101c00 0x7f0a9c197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0aa17a1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a9c102e00 0x7f0a9c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0aa17a1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a9c1037c0 0x7f0a9c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0aa17a1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c10d880 con 0x7f0a9c101c00 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0aa17a1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c10d700 con 0x7f0a9c102e00 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0aa17a1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c10da00 con 0x7f0a9c1037c0 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0a9affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c101c00 0x7f0a9c197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0a9affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c101c00 0x7f0a9c197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42500/0 (socket says 172.21.15.159:42500) 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.042+0000 7f0a9affd640 1 -- 172.21.15.159:0/1907457374 learned_addr learned my addr 172.21.15.159:0/1907457374 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a9b7fe640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a9c1037c0 0x7f0a9c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a927fc640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a9c102e00 0x7f0a9c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a9affd640 1 -- 172.21.15.159:0/1907457374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a9c1037c0 msgr2=0x7f0a9c19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:46.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a9affd640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a9c1037c0 0x7f0a9c19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a9affd640 1 -- 172.21.15.159:0/1907457374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a9c102e00 msgr2=0x7f0a9c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a9affd640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a9c102e00 0x7f0a9c198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a9affd640 1 -- 172.21.15.159:0/1907457374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c19fb40 con 0x7f0a9c101c00 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a9affd640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c101c00 0x7f0a9c197f10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00d950 tx=0x7f0a8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a98ff9640 1 -- 172.21.15.159:0/1907457374 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c017070 con 0x7f0a9c101c00 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a98ff9640 1 -- 172.21.15.159:0/1907457374 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a8c009c30 con 0x7f0a9c101c00 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9c19fe30 con 0x7f0a9c101c00 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0a98ff9640 1 -- 172.21.15.159:0/1907457374 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00f600 con 0x7f0a9c101c00 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.043+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9c1a0280 con 0x7f0a9c101c00 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.044+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9c109050 con 0x7f0a9c101c00 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.045+0000 7f0a98ff9640 1 -- 172.21.15.159:0/1907457374 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0a8c01a070 con 0x7f0a9c101c00 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.046+0000 7f0a98ff9640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0a880a3300 0x7f0a880a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:46.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.046+0000 7f0a927fc640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0a880a3300 0x7f0a880a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:46.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.046+0000 7f0a98ff9640 1 -- 172.21.15.159:0/1907457374 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f0a8c0cf4f0 con 0x7f0a9c101c00 2024-09-19T06:46:46.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.046+0000 7f0a927fc640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0a880a3300 0x7f0a880a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0a84031610 tx=0x7f0a84000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:46.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.050+0000 7f0a98ff9640 1 -- 172.21.15.159:0/1907457374 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a8c09c090 con 0x7f0a9c101c00 2024-09-19T06:46:46.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.250+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0a9c02da10 con 0x7f0a9c101c00 2024-09-19T06:46:46.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.250+0000 7f0a98ff9640 1 -- 172.21.15.159:0/1907457374 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+3062 (secure 0 0 0) 0x7f0a8c09b990 con 0x7f0a9c101c00 2024-09-19T06:46:46.252 INFO:teuthology.orchestra.run.smithi159.stdout:e20 2024-09-19T06:46:46.253 INFO:teuthology.orchestra.run.smithi159.stdout:btime 2024-09-19T06:45:32:821073+0000 2024-09-19T06:46:46.253 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:46:46.253 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:46:46.253 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-09-19T06:46:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:46.254 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:46:46.254 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-09-19T06:46:46.254 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 20 2024-09-19T06:46:46.254 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T06:46:46.254 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-09-19T06:45:23.401782+0000 2024-09-19T06:46:46.254 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-09-19T06:45:32.442633+0000 2024-09-19T06:46:46.255 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-09-19T06:46:46.255 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-09-19T06:46:46.255 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 300 2024-09-19T06:46:46.255 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-09-19T06:46:46.255 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-09-19T06:46:46.256 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-09-19T06:46:46.256 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-09-19T06:46:46.256 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-09-19T06:46:46.256 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 0 2024-09-19T06:46:46.256 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:46:46.256 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-09-19T06:46:46.257 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-09-19T06:46:46.257 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=24487} 2024-09-19T06:46:46.257 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-09-19T06:46:46.257 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-09-19T06:46:46.257 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-09-19T06:46:46.258 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-09-19T06:46:46.258 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-09-19T06:46:46.258 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-09-19T06:46:46.258 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-09-19T06:46:46.258 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-09-19T06:46:46.259 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 0 2024-09-19T06:46:46.259 INFO:teuthology.orchestra.run.smithi159.stdout:qdb_cluster leader: 24487 members: 24487 2024-09-19T06:46:46.259 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.i{0:24487} state up:active seq 6 addr [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.259 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b{0:24482} state up:standby-replay seq 1 addr [v2:172.21.15.189:6838/1818858628,v1:172.21.15.189:6839/1818858628] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:46.260 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-09-19T06:46:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:46.260 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.159:6834/2983935292,v1:172.21.15.159:6835/2983935292] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.260 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d{-1:14553} state up:standby seq 1 addr [v2:172.21.15.159:6836/1806152492,v1:172.21.15.159:6837/1806152492] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.260 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.g{-1:14613} state up:standby seq 1 addr [v2:172.21.15.159:6838/3807456889,v1:172.21.15.159:6839/3807456889] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.261 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a{-1:14619} state up:standby seq 1 addr [v2:172.21.15.159:6840/2821417176,v1:172.21.15.159:6841/2821417176] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.261 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.k{-1:24401} state up:standby seq 1 addr [v2:172.21.15.189:6832/2134153159,v1:172.21.15.189:6833/2134153159] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.261 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.l{-1:24415} state up:standby seq 1 addr [v2:172.21.15.203:6832/4124611480,v1:172.21.15.203:6833/4124611480] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.261 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.e{-1:24425} state up:standby seq 1 addr [v2:172.21.15.189:6834/3575906757,v1:172.21.15.189:6835/3575906757] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.261 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.h{-1:24455} state up:standby seq 1 addr [v2:172.21.15.189:6836/1888227213,v1:172.21.15.189:6837/1888227213] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.261 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.f{-1:24460} state up:standby seq 1 addr [v2:172.21.15.203:6834/818128260,v1:172.21.15.203:6835/818128260] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.262 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c{-1:24466} state up:standby seq 1 addr [v2:172.21.15.203:6836/1596598644,v1:172.21.15.203:6837/1596598644] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:46:46.263 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:46:46.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0a880a3300 msgr2=0x7f0a880a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:46.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0a880a3300 0x7f0a880a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0a84031610 tx=0x7f0a84000bc0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c101c00 msgr2=0x7f0a9c197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:46.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c101c00 0x7f0a9c197f10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00d950 tx=0x7f0a8c00de10 comp rx=0 tx=0).stop 2024-09-19T06:46:46.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 shutdown_connections 2024-09-19T06:46:46.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f0a880a3300 0x7f0a880a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a9c1037c0 0x7f0a9c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a9c102e00 0x7f0a9c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 --2- 172.21.15.159:0/1907457374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a9c101c00 0x7f0a9c197f10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:46.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 >> 172.21.15.159:0/1907457374 conn(0x7f0a9c0fd390 msgr2=0x7f0a9c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:46.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 shutdown_connections 2024-09-19T06:46:46.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:46.253+0000 7f0aa17a1640 1 -- 172.21.15.159:0/1907457374 wait complete. 2024-09-19T06:46:46.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:46 smithi159 ceph-mon[30935]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:46.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:46 smithi159 ceph-mon[30935]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:46.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:46 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1907457374' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:46:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:46 smithi203 ceph-mon[35473]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:46 smithi203 ceph-mon[35473]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:46.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:46 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1907457374' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:46:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:46 smithi189 ceph-mon[34880]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:46 smithi189 ceph-mon[34880]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:46 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1907457374' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:46:46.997 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T06:46:47.243 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:47.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.698+0000 7ff73fbec640 1 -- 172.21.15.159:0/1460993361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 msgr2=0x7ff738108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.698+0000 7ff73fbec640 1 --2- 172.21.15.159:0/1460993361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 0x7ff738108f20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff730009ca0 tx=0x7ff73002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.698+0000 7ff73fbec640 1 -- 172.21.15.159:0/1460993361 shutdown_connections 2024-09-19T06:46:47.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.698+0000 7ff73fbec640 1 --2- 172.21.15.159:0/1460993361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 0x7ff738108f20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.698+0000 7ff73fbec640 1 --2- 172.21.15.159:0/1460993361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff738101cd0 0x7ff738102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.698+0000 7ff73fbec640 1 --2- 172.21.15.159:0/1460993361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff738100ad0 0x7ff738100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.698+0000 7ff73fbec640 1 -- 172.21.15.159:0/1460993361 >> 172.21.15.159:0/1460993361 conn(0x7ff7380fc280 msgr2=0x7ff7380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:47.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.698+0000 7ff73fbec640 1 -- 172.21.15.159:0/1460993361 shutdown_connections 2024-09-19T06:46:47.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.698+0000 7ff73fbec640 1 -- 172.21.15.159:0/1460993361 wait complete. 2024-09-19T06:46:47.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73fbec640 1 Processor -- start 2024-09-19T06:46:47.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73fbec640 1 -- start start 2024-09-19T06:46:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73fbec640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff738100ad0 0x7ff73810b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73fbec640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff738101cd0 0x7ff738109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73fbec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 0x7ff738109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73fbec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff73810d960 con 0x7ff738102690 2024-09-19T06:46:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73fbec640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff73810d7e0 con 0x7ff738100ad0 2024-09-19T06:46:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73fbec640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff73810dae0 con 0x7ff738101cd0 2024-09-19T06:46:47.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73e189640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 0x7ff738109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73e189640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 0x7ff738109fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42506/0 (socket says 172.21.15.159:42506) 2024-09-19T06:46:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73e189640 1 -- 172.21.15.159:0/3666090180 learned_addr learned my addr 172.21.15.159:0/3666090180 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73e189640 1 -- 172.21.15.159:0/3666090180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff738101cd0 msgr2=0x7ff738109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73e189640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff738101cd0 0x7ff738109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73e189640 1 -- 172.21.15.159:0/3666090180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff738100ad0 msgr2=0x7ff73810b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73d988640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff738100ad0 0x7ff73810b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73e189640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff738100ad0 0x7ff73810b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.699+0000 7ff73e189640 1 -- 172.21.15.159:0/3666090180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73810a8a0 con 0x7ff738102690 2024-09-19T06:46:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.700+0000 7ff73e189640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 0x7ff738109fe0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff7300098d0 tx=0x7ff73002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:47.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.700+0000 7ff72effd640 1 -- 172.21.15.159:0/3666090180 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73002fc30 con 0x7ff738102690 2024-09-19T06:46:47.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.700+0000 7ff72effd640 1 -- 172.21.15.159:0/3666090180 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff730003e50 con 0x7ff738102690 2024-09-19T06:46:47.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.700+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7381a2140 con 0x7ff738102690 2024-09-19T06:46:47.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.700+0000 7ff72effd640 1 -- 172.21.15.159:0/3666090180 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300305c0 con 0x7ff738102690 2024-09-19T06:46:47.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.700+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7381a2720 con 0x7ff738102690 2024-09-19T06:46:47.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.701+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff738107f40 con 0x7ff738102690 2024-09-19T06:46:47.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.703+0000 7ff72effd640 1 -- 172.21.15.159:0/3666090180 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff730004b40 con 0x7ff738102690 2024-09-19T06:46:47.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.703+0000 7ff72effd640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7240a3350 0x7ff7240a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.703+0000 7ff73d988640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7240a3350 0x7ff7240a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.703+0000 7ff72effd640 1 -- 172.21.15.159:0/3666090180 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ff7300f0ee0 con 0x7ff738102690 2024-09-19T06:46:47.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.704+0000 7ff73d988640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7240a3350 0x7ff7240a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff738101b30 tx=0x7ff734008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:47.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.706+0000 7ff72effd640 1 -- 172.21.15.159:0/3666090180 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7300bdb90 con 0x7ff738102690 2024-09-19T06:46:47.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.874+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7ff73802d980 con 0x7ff738102690 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.875+0000 7ff72effd640 1 -- 172.21.15.159:0/3666090180 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v81) ==== 56+0+5358 (secure 0 0 0) 0x7ff7300bd490 con 0x7ff738102690 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 81 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:fsid 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-09-19T06:37:38.556116+0000 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-09-19T06:45:34.831866+0000 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:crush_version 26 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:full_ratio 0.95 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:backfillfull_ratio 0.9 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:nearfull_ratio 0.85 2024-09-19T06:46:47.876 INFO:teuthology.orchestra.run.smithi159.stdout:require_min_compat_client luminous 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:min_compat_client luminous 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:require_osd_release squid 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:stretch_mode_enabled false 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:max_osd 12 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6802/2998326151,v1:172.21.15.159:6803/2998326151] [v2:172.21.15.159:6804/2998326151,v1:172.21.15.159:6805/2998326151] exists,up 2486cf57-4865-4e17-9c7f-77f87827299c 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 up in weight 1 up_from 12 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6800/2297013449,v1:172.21.15.189:6801/2297013449] [v2:172.21.15.189:6802/2297013449,v1:172.21.15.189:6803/2297013449] exists,up 84853b71-3763-46a8-bd4d-56bf68801c09 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 up in weight 1 up_from 16 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6800/3236164718,v1:172.21.15.203:6801/3236164718] [v2:172.21.15.203:6802/3236164718,v1:172.21.15.203:6803/3236164718] exists,up 49aa2a29-471b-48e6-97f0-04f58c824dde 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 up in weight 1 up_from 23 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6810/1022245465,v1:172.21.15.159:6811/1022245465] [v2:172.21.15.159:6812/1022245465,v1:172.21.15.159:6813/1022245465] exists,up 446be896-916b-4fca-80f9-132c9786a9bf 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 up in weight 1 up_from 30 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6808/3807984659,v1:172.21.15.189:6809/3807984659] [v2:172.21.15.189:6810/3807984659,v1:172.21.15.189:6811/3807984659] exists,up 88500d1e-e298-47a6-a704-07c09f025773 2024-09-19T06:46:47.877 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 up in weight 1 up_from 35 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6808/2510785256,v1:172.21.15.203:6809/2510785256] [v2:172.21.15.203:6810/2510785256,v1:172.21.15.203:6811/2510785256] exists,up 0a156a5d-e640-45d6-bb29-c50a3b827351 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:osd.6 up in weight 1 up_from 42 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6818/46949645,v1:172.21.15.159:6819/46949645] [v2:172.21.15.159:6820/46949645,v1:172.21.15.159:6821/46949645] exists,up cda5238c-fc5d-4c45-b495-781bc5de8142 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:osd.7 up in weight 1 up_from 47 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6816/3813484683,v1:172.21.15.189:6817/3813484683] [v2:172.21.15.189:6818/3813484683,v1:172.21.15.189:6819/3813484683] exists,up 8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:osd.8 up in weight 1 up_from 54 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6816/3706643135,v1:172.21.15.203:6817/3706643135] [v2:172.21.15.203:6818/3706643135,v1:172.21.15.203:6819/3706643135] exists,up 351b6b47-cfc7-4274-9cc5-a11b341f8695 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:osd.9 up in weight 1 up_from 61 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6826/623154511,v1:172.21.15.159:6827/623154511] [v2:172.21.15.159:6828/623154511,v1:172.21.15.159:6829/623154511] exists,up 76ab4227-85ea-40eb-b916-b897d8496768 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:osd.10 up in weight 1 up_from 66 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6824/274384931,v1:172.21.15.189:6825/274384931] [v2:172.21.15.189:6826/274384931,v1:172.21.15.189:6827/274384931] exists,up 72665ec5-c275-4e11-a0a2-2326c4a08be9 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:osd.11 up in weight 1 up_from 73 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6824/4150435701,v1:172.21.15.203:6825/4150435701] [v2:172.21.15.203:6826/4150435701,v1:172.21.15.203:6827/4150435701] exists,up 2bef0c50-64ad-4014-a6ad-db56a89ad139 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 2.1b [2,4] 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 2.1c [8,11] 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 3.6 [4,6] 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 3.10 [5,9] 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 3.17 [4,7] 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 3.20 [5,9] 2024-09-19T06:46:47.878 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 3.23 [4,8] 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 3.28 [3,8] 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:pg_upmap_items 3.34 [4,9] 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:0/4146600912 expires 2024-09-20T06:38:33.329792+0000 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:6801/3687310237 expires 2024-09-20T06:38:33.329792+0000 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:0/3612735042 expires 2024-09-20T06:38:33.329792+0000 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:6801/141750176 expires 2024-09-20T06:38:10.187881+0000 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:6800/3687310237 expires 2024-09-20T06:38:33.329792+0000 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:6800/141750176 expires 2024-09-20T06:38:10.187881+0000 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:0/3917454568 expires 2024-09-20T06:38:33.329792+0000 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:0/1858964097 expires 2024-09-20T06:38:10.187881+0000 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:0/2881238143 expires 2024-09-20T06:38:10.187881+0000 2024-09-19T06:46:47.879 INFO:teuthology.orchestra.run.smithi159.stdout:blocklist 172.21.15.159:0/3688060506 expires 2024-09-20T06:38:10.187881+0000 2024-09-19T06:46:47.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7240a3350 msgr2=0x7ff7240a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7240a3350 0x7ff7240a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff738101b30 tx=0x7ff734008040 comp rx=0 tx=0).stop 2024-09-19T06:46:47.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 msgr2=0x7ff738109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 0x7ff738109fe0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff7300098d0 tx=0x7ff73002f840 comp rx=0 tx=0).stop 2024-09-19T06:46:47.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 shutdown_connections 2024-09-19T06:46:47.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ff7240a3350 0x7ff7240a5810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff738102690 0x7ff738109fe0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff738101cd0 0x7ff738109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 --2- 172.21.15.159:0/3666090180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff738100ad0 0x7ff73810b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 >> 172.21.15.159:0/3666090180 conn(0x7ff7380fc280 msgr2=0x7ff738105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:47.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 shutdown_connections 2024-09-19T06:46:47.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:47.878+0000 7ff73fbec640 1 -- 172.21.15.159:0/3666090180 wait complete. 2024-09-19T06:46:48.589 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T06:46:48.601 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:46:48.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:48 smithi203 ceph-mon[35473]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:48 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3666090180' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:46:48.851 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:48 smithi189 ceph-mon[34880]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:48.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:48 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3666090180' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:46:48.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:48 smithi159 ceph-mon[30935]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:48.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:48 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3666090180' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.333+0000 7f638adb9640 1 -- 172.21.15.159:0/3211472379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f638410c1a0 msgr2=0x7f638410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.333+0000 7f638adb9640 1 --2- 172.21.15.159:0/3211472379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f638410c1a0 0x7f638410e610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f637c009ca0 tx=0x7f637c02a950 comp rx=0 tx=0).stop 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.333+0000 7f638adb9640 1 -- 172.21.15.159:0/3211472379 shutdown_connections 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.333+0000 7f638adb9640 1 --2- 172.21.15.159:0/3211472379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f638410c1a0 0x7f638410e610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.333+0000 7f638adb9640 1 --2- 172.21.15.159:0/3211472379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6384103720 0x7f638410bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.333+0000 7f638adb9640 1 --2- 172.21.15.159:0/3211472379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6384102e00 0x7f63841031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.333+0000 7f638adb9640 1 -- 172.21.15.159:0/3211472379 >> 172.21.15.159:0/3211472379 conn(0x7f63840fc7a0 msgr2=0x7f63840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.333+0000 7f638adb9640 1 -- 172.21.15.159:0/3211472379 shutdown_connections 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.333+0000 7f638adb9640 1 -- 172.21.15.159:0/3211472379 wait complete. 2024-09-19T06:46:49.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f638adb9640 1 Processor -- start 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f638adb9640 1 -- start start 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f638adb9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6384102e00 0x7f6384198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f638adb9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6384103720 0x7f63841988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f638adb9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f638410c1a0 0x7f638419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f638adb9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6384111f50 con 0x7f6384103720 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f638adb9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6384111dd0 con 0x7f638410c1a0 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f638adb9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f63841120d0 con 0x7f6384102e00 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6383fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6384103720 0x7f63841988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6383fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6384103720 0x7f63841988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41510/0 (socket says 172.21.15.159:41510) 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6383fff640 1 -- 172.21.15.159:0/736772266 learned_addr learned my addr 172.21.15.159:0/736772266 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:49.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6388b55640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6384102e00 0x7f6384198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6389356640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f638410c1a0 0x7f638419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6383fff640 1 -- 172.21.15.159:0/736772266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6384102e00 msgr2=0x7f6384198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6383fff640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6384102e00 0x7f6384198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6383fff640 1 -- 172.21.15.159:0/736772266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f638410c1a0 msgr2=0x7f638419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6383fff640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f638410c1a0 0x7f638419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6383fff640 1 -- 172.21.15.159:0/736772266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638419d320 con 0x7f6384103720 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.334+0000 7f6383fff640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6384103720 0x7f63841988b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f637000e9f0 tx=0x7f637000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.335+0000 7f6381ffb640 1 -- 172.21.15.159:0/736772266 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637000ccc0 con 0x7f6384103720 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.335+0000 7f6381ffb640 1 -- 172.21.15.159:0/736772266 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637000ce60 con 0x7f6384103720 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.335+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638419d610 con 0x7f6384103720 2024-09-19T06:46:49.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.335+0000 7f6381ffb640 1 -- 172.21.15.159:0/736772266 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370010690 con 0x7f6384103720 2024-09-19T06:46:49.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.335+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63841a4ef0 con 0x7f6384103720 2024-09-19T06:46:49.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.336+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63841031e0 con 0x7f6384103720 2024-09-19T06:46:49.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.337+0000 7f6381ffb640 1 -- 172.21.15.159:0/736772266 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f63700046c0 con 0x7f6384103720 2024-09-19T06:46:49.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.337+0000 7f6381ffb640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63740a32d0 0x7f63740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.338+0000 7f6388b55640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63740a32d0 0x7f63740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.338+0000 7f6381ffb640 1 -- 172.21.15.159:0/736772266 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f63700d0000 con 0x7f6384103720 2024-09-19T06:46:49.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.338+0000 7f6388b55640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63740a32d0 0x7f63740a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f637800abe0 tx=0x7f637800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:49.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.341+0000 7f6381ffb640 1 -- 172.21.15.159:0/736772266 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6370054210 con 0x7f6384103720 2024-09-19T06:46:49.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.543+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63841996d0 con 0x7f6384103720 2024-09-19T06:46:49.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.543+0000 7f6381ffb640 1 -- 172.21.15.159:0/736772266 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f637009cc40 con 0x7f6384103720 2024-09-19T06:46:49.545 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:49.545 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:46:49.545 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:46:49.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63740a32d0 msgr2=0x7f63740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63740a32d0 0x7f63740a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f637800abe0 tx=0x7f637800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6384103720 msgr2=0x7f63841988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6384103720 0x7f63841988b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f637000e9f0 tx=0x7f637000edf0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 shutdown_connections 2024-09-19T06:46:49.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f63740a32d0 0x7f63740a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f638410c1a0 0x7f638419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6384103720 0x7f63841988b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 --2- 172.21.15.159:0/736772266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6384102e00 0x7f6384198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 >> 172.21.15.159:0/736772266 conn(0x7f63840fc7a0 msgr2=0x7f63840fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:49.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 shutdown_connections 2024-09-19T06:46:49.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:49.546+0000 7f638adb9640 1 -- 172.21.15.159:0/736772266 wait complete. 2024-09-19T06:46:50.258 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:46:50.506 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:50.627 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:50 smithi159 ceph-mon[30935]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:50.627 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:50 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/736772266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:50.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:50 smithi203 ceph-mon[35473]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:50.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:50 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/736772266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:50.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:50 smithi189 ceph-mon[34880]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:50.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:50 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/736772266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:51.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 -- 172.21.15.159:0/58536024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8100a80 msgr2=0x7fd8b8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/58536024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8100a80 0x7fd8b8100ee0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009930 tx=0x7fd8a002a420 comp rx=0 tx=0).stop 2024-09-19T06:46:51.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 -- 172.21.15.159:0/58536024 shutdown_connections 2024-09-19T06:46:51.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/58536024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8b8101420 0x7fd8b810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/58536024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8100a80 0x7fd8b8100ee0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/58536024 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b8106a80 0x7fd8b8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 -- 172.21.15.159:0/58536024 >> 172.21.15.159:0/58536024 conn(0x7fd8b80fc7a0 msgr2=0x7fd8b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 -- 172.21.15.159:0/58536024 shutdown_connections 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 -- 172.21.15.159:0/58536024 wait complete. 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 Processor -- start 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.004+0000 7fd8be2e1640 1 -- start start 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8be2e1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b8100a80 0x7fd8b8102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8be2e1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8b8101420 0x7fd8b8102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8be2e1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8106a80 0x7fd8b81030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8be2e1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b8110e80 con 0x7fd8b8106a80 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8be2e1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b8110d00 con 0x7fd8b8101420 2024-09-19T06:46:51.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8be2e1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b8111000 con 0x7fd8b8100a80 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8bc87e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8106a80 0x7fd8b81030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8bc87e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8106a80 0x7fd8b81030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41540/0 (socket says 172.21.15.159:41540) 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8bc87e640 1 -- 172.21.15.159:0/3165580521 learned_addr learned my addr 172.21.15.159:0/3165580521 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8bc87e640 1 -- 172.21.15.159:0/3165580521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b8100a80 msgr2=0x7fd8b8102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8b7fff640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b8100a80 0x7fd8b8102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8b77fe640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8b8101420 0x7fd8b8102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8bc87e640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b8100a80 0x7fd8b8102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8bc87e640 1 -- 172.21.15.159:0/3165580521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8b8101420 msgr2=0x7fd8b8102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8bc87e640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8b8101420 0x7fd8b8102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8bc87e640 1 -- 172.21.15.159:0/3165580521 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b81a6800 con 0x7fd8b8106a80 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8b7fff640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b8100a80 0x7fd8b8102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8b77fe640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8b8101420 0x7fd8b8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8bc87e640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8106a80 0x7fd8b81030d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000cce0 tx=0x7fd8b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.005+0000 7fd8b57fa640 1 -- 172.21.15.159:0/3165580521 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000f450 con 0x7fd8b8106a80 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.006+0000 7fd8b57fa640 1 -- 172.21.15.159:0/3165580521 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8b000fad0 con 0x7fd8b8106a80 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.006+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b81a6af0 con 0x7fd8b8106a80 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.006+0000 7fd8b57fa640 1 -- 172.21.15.159:0/3165580521 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0018c10 con 0x7fd8b8106a80 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.006+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b81a7030 con 0x7fd8b8106a80 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.007+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b8100ee0 con 0x7fd8b8106a80 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.008+0000 7fd8b57fa640 1 -- 172.21.15.159:0/3165580521 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd8b000f5f0 con 0x7fd8b8106a80 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.009+0000 7fd8b57fa640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd8a40a3350 0x7fd8a40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.009+0000 7fd8b7fff640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd8a40a3350 0x7fd8a40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.009+0000 7fd8b57fa640 1 -- 172.21.15.159:0/3165580521 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fd8b00d0220 con 0x7fd8b8106a80 2024-09-19T06:46:51.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.009+0000 7fd8b7fff640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd8a40a3350 0x7fd8a40a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800baa0 tx=0x7fd8a8005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:51.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.012+0000 7fd8b57fa640 1 -- 172.21.15.159:0/3165580521 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd8b0014030 con 0x7fd8b8106a80 2024-09-19T06:46:51.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.212+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8b8103b80 con 0x7fd8b8106a80 2024-09-19T06:46:51.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.212+0000 7fd8b57fa640 1 -- 172.21.15.159:0/3165580521 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7fd8b009ced0 con 0x7fd8b8106a80 2024-09-19T06:46:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:51.214 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:46:51.214 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:46:51.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd8a40a3350 msgr2=0x7fd8a40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd8a40a3350 0x7fd8a40a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800baa0 tx=0x7fd8a8005d20 comp rx=0 tx=0).stop 2024-09-19T06:46:51.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8106a80 msgr2=0x7fd8b81030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8106a80 0x7fd8b81030d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000cce0 tx=0x7fd8b000a620 comp rx=0 tx=0).stop 2024-09-19T06:46:51.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 shutdown_connections 2024-09-19T06:46:51.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fd8a40a3350 0x7fd8a40a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b8106a80 0x7fd8b81030d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8b8101420 0x7fd8b8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 --2- 172.21.15.159:0/3165580521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b8100a80 0x7fd8b8102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 >> 172.21.15.159:0/3165580521 conn(0x7fd8b80fc7a0 msgr2=0x7fd8b8104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:51.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 shutdown_connections 2024-09-19T06:46:51.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:51.215+0000 7fd8be2e1640 1 -- 172.21.15.159:0/3165580521 wait complete. 2024-09-19T06:46:51.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:51 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3165580521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:51.887 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:51 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3165580521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:51.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:51 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3165580521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:51.915 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:46:52.166 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:52.600 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:52 smithi159 ceph-mon[30935]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:52.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.677+0000 7f165113b640 1 -- 172.21.15.159:0/3331240256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 msgr2=0x7f164c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:52.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.677+0000 7f165113b640 1 --2- 172.21.15.159:0/3331240256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 0x7f164c101200 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f163c009900 tx=0x7f163c02a480 comp rx=0 tx=0).stop 2024-09-19T06:46:52.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.678+0000 7f165113b640 1 -- 172.21.15.159:0/3331240256 shutdown_connections 2024-09-19T06:46:52.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.678+0000 7f165113b640 1 --2- 172.21.15.159:0/3331240256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102ef0 0x7f164c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:52.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.678+0000 7f165113b640 1 --2- 172.21.15.159:0/3331240256 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c102570 0x7f164c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:52.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.678+0000 7f165113b640 1 --2- 172.21.15.159:0/3331240256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 0x7f164c101200 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.678+0000 7f165113b640 1 -- 172.21.15.159:0/3331240256 >> 172.21.15.159:0/3331240256 conn(0x7f164c0fc7d0 msgr2=0x7f164c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.678+0000 7f165113b640 1 -- 172.21.15.159:0/3331240256 shutdown_connections 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.678+0000 7f165113b640 1 -- 172.21.15.159:0/3331240256 wait complete. 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.678+0000 7f165113b640 1 Processor -- start 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f165113b640 1 -- start start 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f165113b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 0x7f164c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f165113b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 0x7f164c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f165113b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c102ef0 0x7f164c1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f165113b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f164c110fc0 con 0x7f164c100e20 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f165113b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f164c110e40 con 0x7f164c102570 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f165113b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f164c111140 con 0x7f164c102ef0 2024-09-19T06:46:52.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 0x7f164c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 0x7f164c1993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41548/0 (socket says 172.21.15.159:41548) 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164ad9d640 1 -- 172.21.15.159:0/1978957050 learned_addr learned my addr 172.21.15.159:0/1978957050 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164b59e640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c102ef0 0x7f164c1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164a59c640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 0x7f164c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164ad9d640 1 -- 172.21.15.159:0/1978957050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c102ef0 msgr2=0x7f164c1a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164ad9d640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c102ef0 0x7f164c1a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164ad9d640 1 -- 172.21.15.159:0/1978957050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 msgr2=0x7f164c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164ad9d640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 0x7f164c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.679+0000 7f164ad9d640 1 -- 172.21.15.159:0/1978957050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c1a4990 con 0x7f164c100e20 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.680+0000 7f164ad9d640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 0x7f164c1993d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f163c006010 tx=0x7f163c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.680+0000 7f1643fff640 1 -- 172.21.15.159:0/1978957050 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c03f070 con 0x7f164c100e20 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.680+0000 7f1643fff640 1 -- 172.21.15.159:0/1978957050 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f163c031e30 con 0x7f164c100e20 2024-09-19T06:46:52.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.680+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c1a4b60 con 0x7f164c100e20 2024-09-19T06:46:52.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.680+0000 7f1643fff640 1 -- 172.21.15.159:0/1978957050 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c035030 con 0x7f164c100e20 2024-09-19T06:46:52.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.680+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c1a5010 con 0x7f164c100e20 2024-09-19T06:46:52.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.681+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164c101200 con 0x7f164c100e20 2024-09-19T06:46:52.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.682+0000 7f1643fff640 1 -- 172.21.15.159:0/1978957050 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f163c042070 con 0x7f164c100e20 2024-09-19T06:46:52.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.683+0000 7f1643fff640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f16380a3350 0x7f16380a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:52.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.683+0000 7f164a59c640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f16380a3350 0x7f16380a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:52.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.683+0000 7f1643fff640 1 -- 172.21.15.159:0/1978957050 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f163c0f09f0 con 0x7f164c100e20 2024-09-19T06:46:52.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.683+0000 7f164a59c640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f16380a3350 0x7f16380a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1634005fd0 tx=0x7f1634005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:52.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.686+0000 7f1643fff640 1 -- 172.21.15.159:0/1978957050 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f163c0bd620 con 0x7f164c100e20 2024-09-19T06:46:52.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:52 smithi203 ceph-mon[35473]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:52.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.854+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f164c109090 con 0x7f164c100e20 2024-09-19T06:46:52.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.856+0000 7f1643fff640 1 -- 172.21.15.159:0/1978957050 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22865 (secure 0 0 0) 0x7f163c0bcf20 con 0x7f164c100e20 2024-09-19T06:46:52.857 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:46:52.858 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":81,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:45:34.831866+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:46:52.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f16380a3350 msgr2=0x7f16380a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:52.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f16380a3350 0x7f16380a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1634005fd0 tx=0x7f1634005e20 comp rx=0 tx=0).stop 2024-09-19T06:46:52.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 msgr2=0x7f164c1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:52.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 0x7f164c1993d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f163c006010 tx=0x7f163c003c80 comp rx=0 tx=0).stop 2024-09-19T06:46:52.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 shutdown_connections 2024-09-19T06:46:52.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f16380a3350 0x7f16380a5810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:52.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c102ef0 0x7f164c1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:52.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 0x7f164c199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:52.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 --2- 172.21.15.159:0/1978957050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100e20 0x7f164c1993d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:52.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.858+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 >> 172.21.15.159:0/1978957050 conn(0x7f164c0fc7d0 msgr2=0x7f164c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:52.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.859+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 shutdown_connections 2024-09-19T06:46:52.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:52.859+0000 7f165113b640 1 -- 172.21.15.159:0/1978957050 wait complete. 2024-09-19T06:46:52.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:52 smithi189 ceph-mon[34880]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:46:53.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:45:23.401782+0000', 'modified': '2024-09-19T06:45:32.442633+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24487}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6839/1818858628', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 1818858628}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 1818858628}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.203:6839/3762709136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 3762709136}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 3762709136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24487, 'qdb_cluster': [24487]} 2024-09-19T06:46:53.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T06:46:53.538 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:46:53.786 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:53.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:53 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1978957050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:46:53.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:53 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1978957050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:46:53.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:53 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1978957050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:46:54.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.306+0000 7fbef16aa640 1 -- 172.21.15.159:0/108050477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102570 msgr2=0x7fbeec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 --2- 172.21.15.159:0/108050477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102570 0x7fbeec1029b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009900 tx=0x7fbed402a480 comp rx=0 tx=0).stop 2024-09-19T06:46:54.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 -- 172.21.15.159:0/108050477 shutdown_connections 2024-09-19T06:46:54.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 --2- 172.21.15.159:0/108050477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeec102ef0 0x7fbeec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 --2- 172.21.15.159:0/108050477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102570 0x7fbeec1029b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 --2- 172.21.15.159:0/108050477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec100e20 0x7fbeec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 -- 172.21.15.159:0/108050477 >> 172.21.15.159:0/108050477 conn(0x7fbeec0fc7d0 msgr2=0x7fbeec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 -- 172.21.15.159:0/108050477 shutdown_connections 2024-09-19T06:46:54.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 -- 172.21.15.159:0/108050477 wait complete. 2024-09-19T06:46:54.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 Processor -- start 2024-09-19T06:46:54.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 -- start start 2024-09-19T06:46:54.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.307+0000 7fbef16aa640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeec100e20 0x7fbeec198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbef16aa640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec102570 0x7fbeec198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbef16aa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102ef0 0x7fbeec19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbef16aa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec110f80 con 0x7fbeec102ef0 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbef16aa640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec110e00 con 0x7fbeec100e20 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbef16aa640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec111100 con 0x7fbeec102570 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102ef0 0x7fbeec19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102ef0 0x7fbeec19ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41568/0 (socket says 172.21.15.159:41568) 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeb7fe640 1 -- 172.21.15.159:0/3717952841 learned_addr learned my addr 172.21.15.159:0/3717952841 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeec100e20 0x7fbeec198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbee3fff640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec102570 0x7fbeec198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeb7fe640 1 -- 172.21.15.159:0/3717952841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec102570 msgr2=0x7fbeec198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeb7fe640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec102570 0x7fbeec198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeb7fe640 1 -- 172.21.15.159:0/3717952841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeec100e20 msgr2=0x7fbeec198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeb7fe640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeec100e20 0x7fbeec198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeb7fe640 1 -- 172.21.15.159:0/3717952841 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec19d520 con 0x7fbeec102ef0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbeeb7fe640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102ef0 0x7fbeec19ce40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbee400eaa0 tx=0x7fbee400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbee8ff9640 1 -- 172.21.15.159:0/3717952841 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee400cdb0 con 0x7fbeec102ef0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbef16aa640 1 -- 172.21.15.159:0/3717952841 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeec19d810 con 0x7fbeec102ef0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.308+0000 7fbee8ff9640 1 -- 172.21.15.159:0/3717952841 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbee4005020 con 0x7fbeec102ef0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.309+0000 7fbee8ff9640 1 -- 172.21.15.159:0/3717952841 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee40116b0 con 0x7fbeec102ef0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.309+0000 7fbef16aa640 1 -- 172.21.15.159:0/3717952841 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeec1a50f0 con 0x7fbeec102ef0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.311+0000 7fbee8ff9640 1 -- 172.21.15.159:0/3717952841 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fbee4005560 con 0x7fbeec102ef0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.311+0000 7fbee8ff9640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fbed80a32d0 0x7fbed80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.311+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fbed80a32d0 0x7fbed80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.311+0000 7fbee8ff9640 1 -- 172.21.15.159:0/3717952841 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fbee40cfca0 con 0x7fbeec102ef0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.312+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fbed80a32d0 0x7fbed80a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00bbe0 tx=0x7fbedc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.312+0000 7fbef3a83740 1 Processor -- start 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.312+0000 7fbef3a83740 1 -- start start 2024-09-19T06:46:54.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 0x55cebd415db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd420670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd422fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbef3a83740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55cebd37c090 con 0x55cebd4162f0 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbef3a83740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cebd323a70 con 0x55cebd4159d0 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbef3a83740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cebd378050 con 0x55cebd420bb0 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbee3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd420670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbee3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd420670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41584/0 (socket says 172.21.15.159:41584) 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbee3fff640 1 -- 172.21.15.159:0/1660541271 learned_addr learned my addr 172.21.15.159:0/1660541271 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/1660541271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 0x55cebd415db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbeeb7fe640 1 --2- 172.21.15.159:0/1660541271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd422fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbee3fff640 1 -- 172.21.15.159:0/1660541271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 msgr2=0x55cebd422fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbee3fff640 1 --2- 172.21.15.159:0/1660541271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd422fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbee3fff640 1 -- 172.21.15.159:0/1660541271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 msgr2=0x55cebd415db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbee3fff640 1 --2- 172.21.15.159:0/1660541271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 0x55cebd415db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbee3fff640 1 -- 172.21.15.159:0/1660541271 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cebd330130 con 0x55cebd4162f0 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.313+0000 7fbee3fff640 1 --2- 172.21.15.159:0/1660541271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd420670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbed402a9a0 tx=0x7fbed40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1fd6e6222f8363 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbee17fa640 1 -- 172.21.15.159:0/1660541271 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4035030 con 0x55cebd4162f0 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbee17fa640 1 -- 172.21.15.159:0/1660541271 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbed40044b0 con 0x55cebd4162f0 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbee17fa640 1 -- 172.21.15.159:0/1660541271 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed40035f0 con 0x55cebd4162f0 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbef3a83740 1 -- 172.21.15.159:0/1660541271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 msgr2=0x55cebd420670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbef3a83740 1 --2- 172.21.15.159:0/1660541271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd420670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbed402a9a0 tx=0x7fbed40040c0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbef3a83740 1 -- 172.21.15.159:0/1660541271 shutdown_connections 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbef3a83740 1 --2- 172.21.15.159:0/1660541271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd422fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbef3a83740 1 --2- 172.21.15.159:0/1660541271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd420670 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbef3a83740 1 --2- 172.21.15.159:0/1660541271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 0x55cebd415db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.314+0000 7fbef3a83740 1 -- 172.21.15.159:0/1660541271 >> 172.21.15.159:0/1660541271 conn(0x55cebd411f60 msgr2=0x55cebd412340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 -- 172.21.15.159:0/1660541271 shutdown_connections 2024-09-19T06:46:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 -- 172.21.15.159:0/1660541271 wait complete. 2024-09-19T06:46:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 -- start start 2024-09-19T06:46:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 Processor -- start 2024-09-19T06:46:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd420450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 0x55cebd41d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd41dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55cebd423780 con 0x55cebd4159d0 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cebd336f20 con 0x55cebd4162f0 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cebd423900 con 0x55cebd420bb0 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbef3a83740 10 client.0 _ll_register_callbacks cb 0x55cebd300030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbeeaffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd420450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbeeaffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd420450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41590/0 (socket says 172.21.15.159:41590) 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbeeaffd640 1 -- 172.21.15.159:0/3346795401 learned_addr learned my addr 172.21.15.159:0/3346795401 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.315+0000 7fbeeb7fe640 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd41dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbee3fff640 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 0x55cebd41d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbeeaffd640 1 -- 172.21.15.159:0/3346795401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 msgr2=0x55cebd41dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd41dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbeeaffd640 1 -- 172.21.15.159:0/3346795401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 msgr2=0x55cebd41d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 0x55cebd41d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbeeaffd640 1 -- 172.21.15.159:0/3346795401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cebd0ed2b0 con 0x55cebd4159d0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbee3fff640 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 0x55cebd41d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd420450 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0117e0 tx=0x7fbedc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7372696c6b06bd87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbed27fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbed27fc640 1 -- 172.21.15.159:0/3346795401 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc01fbb0 con 0x55cebd4159d0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbed27fc640 1 -- 172.21.15.159:0/3346795401 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fbedc01fd50 con 0x55cebd4159d0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbef3a83740 1 -- 172.21.15.159:0/3346795401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed40044b0 con 0x55cebd4159d0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbed27fc640 1 -- 172.21.15.159:0/3346795401 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbedc028440 con 0x55cebd4159d0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbef3a83740 10 client.15051 fetch_fsmap learned FSMap version 20 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbef3a83740 1 -- 172.21.15.159:0/3346795401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cebd42f070 con 0x55cebd4159d0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.316+0000 7fbed27fc640 1 -- 172.21.15.159:0/3346795401 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbed40044b0 con 0x55cebd4159d0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.317+0000 7fbed27fc640 1 -- 172.21.15.159:0/3346795401 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbedc026070 con 0x55cebd4159d0 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.317+0000 7fbef3a83740 10 client.15051 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:46:54.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.317+0000 7fbef3a83740 10 client.15051 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:46:54.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.317+0000 7fbef3a83740 20 client.15051 populate_metadata read hostname 'smithi159' 2024-09-19T06:46:54.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.317+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55cebd431750 0x55cebd432bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.317+0000 7fbef3a83740 4 client.15051 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:54.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.317+0000 7fbef3a83740 1 -- 172.21.15.159:0/3346795401 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cebd389600 con 0x55cebd431750 2024-09-19T06:46:54.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.317+0000 7fbee3fff640 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55cebd431750 0x55cebd432bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.318+0000 7fbed27fc640 10 client.15051 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:46:54.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.318+0000 7fbee3fff640 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55cebd431750 0x55cebd432bc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae9f0295d84c41ab server_cookie=d883fead217dd53c in_seq=0 out_seq=0 2024-09-19T06:46:54.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbed27fc640 1 -- 172.21.15.159:0/3346795401 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cebd389600 con 0x55cebd431750 2024-09-19T06:46:54.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbed27fc640 10 client.15051 handle_command_reply: tid=0 2024-09-19T06:46:54.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 client.15051 shutdown 2024-09-19T06:46:54.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 -- 172.21.15.159:0/3346795401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 msgr2=0x55cebd420450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd420450 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0117e0 tx=0x7fbedc004730 comp rx=0 tx=0).stop 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 -- 172.21.15.159:0/3346795401 shutdown_connections 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55cebd431750 0x55cebd432bc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd41dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 0x55cebd41d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3346795401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd420450 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbed27fc640 0 client.15051 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 -- 172.21.15.159:0/3346795401 >> 172.21.15.159:0/3346795401 conn(0x55cebd411f60 msgr2=0x55cebd417c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 -- 172.21.15.159:0/3346795401 shutdown_connections 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 1 -- 172.21.15.159:0/3346795401 wait complete. 2024-09-19T06:46:54.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.319+0000 7fbef3a83740 20 client.15051 trim_cache size 0 max 16384 2024-09-19T06:46:54.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbef3a83740 1 Processor -- start 2024-09-19T06:46:54.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbef3a83740 1 -- start start 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd42d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 0x55cebd41d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd41dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbef3a83740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55cebd430f00 con 0x55cebd4159d0 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbef3a83740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cebd4315d0 con 0x55cebd4162f0 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbef3a83740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cebd431ca0 con 0x55cebd420bb0 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbeeaffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd42d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbeeaffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd42d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41606/0 (socket says 172.21.15.159:41606) 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbeeaffd640 1 -- 172.21.15.159:0/533902787 learned_addr learned my addr 172.21.15.159:0/533902787 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbeeaffd640 1 -- 172.21.15.159:0/533902787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 msgr2=0x55cebd41dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/533902787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd41dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbeeaffd640 1 -- 172.21.15.159:0/533902787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 msgr2=0x55cebd41d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbee3fff640 1 --2- 172.21.15.159:0/533902787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 0x55cebd41d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/533902787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 0x55cebd41d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.337+0000 7fbeeaffd640 1 -- 172.21.15.159:0/533902787 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cebd415800 con 0x55cebd4159d0 2024-09-19T06:46:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.338+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/533902787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd42d090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbedc005d00 tx=0x7fbedc0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9313bedc9e6263a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.338+0000 7fbee0ff9640 1 -- 172.21.15.159:0/533902787 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc032d00 con 0x55cebd4159d0 2024-09-19T06:46:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.338+0000 7fbee0ff9640 1 -- 172.21.15.159:0/533902787 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbedc01fce0 con 0x55cebd4159d0 2024-09-19T06:46:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.338+0000 7fbee0ff9640 1 -- 172.21.15.159:0/533902787 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc028b20 con 0x55cebd4159d0 2024-09-19T06:46:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 -- 172.21.15.159:0/533902787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 msgr2=0x55cebd42d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 --2- 172.21.15.159:0/533902787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd42d090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbedc005d00 tx=0x7fbedc0326e0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 -- 172.21.15.159:0/533902787 shutdown_connections 2024-09-19T06:46:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 --2- 172.21.15.159:0/533902787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd41dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 --2- 172.21.15.159:0/533902787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4162f0 0x55cebd41d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 --2- 172.21.15.159:0/533902787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4159d0 0x55cebd42d090 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 -- 172.21.15.159:0/533902787 >> 172.21.15.159:0/533902787 conn(0x55cebd411f60 msgr2=0x55cebd40cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 -- 172.21.15.159:0/533902787 shutdown_connections 2024-09-19T06:46:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 -- 172.21.15.159:0/533902787 wait complete. 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 -- start start 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 Processor -- start 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 0x55cebd4365c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd436b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd43ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55cebd432a40 con 0x55cebd4162f0 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cebd432370 con 0x55cebd4159d0 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cebd433110 con 0x55cebd420bb0 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.339+0000 7fbef3a83740 10 client.0 _ll_register_callbacks cb 0x7fbedc010cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbee3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd436b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbee3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd436b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41618/0 (socket says 172.21.15.159:41618) 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbee3fff640 1 -- 172.21.15.159:0/3705120931 learned_addr learned my addr 172.21.15.159:0/3705120931 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 0x55cebd4365c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbeeb7fe640 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd43ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbee3fff640 1 -- 172.21.15.159:0/3705120931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 msgr2=0x55cebd43ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbee3fff640 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd43ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbee3fff640 1 -- 172.21.15.159:0/3705120931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 msgr2=0x55cebd4365c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbee3fff640 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 0x55cebd4365c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbee3fff640 1 -- 172.21.15.159:0/3705120931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cebd43b1e0 con 0x55cebd4162f0 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 0x55cebd4365c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbee3fff640 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd436b00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbed4005c40 tx=0x7fbed4004b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2494ec8ec84131c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbed27fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:46:54.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbed27fc640 1 -- 172.21.15.159:0/3705120931 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4035030 con 0x55cebd4162f0 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbed27fc640 1 -- 172.21.15.159:0/3705120931 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fbed40048c0 con 0x55cebd4162f0 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbef3a83740 1 -- 172.21.15.159:0/3705120931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbedc01fce0 con 0x55cebd4162f0 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbed27fc640 1 -- 172.21.15.159:0/3705120931 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbed404f420 con 0x55cebd4162f0 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbef3a83740 10 client.15057 fetch_fsmap learned FSMap version 20 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.340+0000 7fbef3a83740 1 -- 172.21.15.159:0/3705120931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cebd49b8b0 con 0x55cebd4162f0 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbed27fc640 1 -- 172.21.15.159:0/3705120931 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbedc01fce0 con 0x55cebd4162f0 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbed27fc640 1 -- 172.21.15.159:0/3705120931 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbed40319f0 con 0x55cebd4162f0 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbef3a83740 10 client.15057 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbef3a83740 10 client.15057 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbef3a83740 20 client.15057 populate_metadata read hostname 'smithi159' 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55cebd4a0120 0x55cebd49ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbef3a83740 4 client.15057 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbef3a83740 1 -- 172.21.15.159:0/3705120931 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "status"}) -- 0x55cebd383b10 con 0x55cebd4a0120 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55cebd4a0120 0x55cebd49ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbed27fc640 10 client.15057 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.341+0000 7fbeeaffd640 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55cebd4a0120 0x55cebd49ee30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=513d27dcc714f6d0 server_cookie=dc3603654b5d5e36 in_seq=0 out_seq=0 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbed27fc640 1 -- 172.21.15.159:0/3705120931 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55cebd383b10 con 0x55cebd4a0120 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbed27fc640 10 client.15057 handle_command_reply: tid=0 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 client.15057 shutdown 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 -- 172.21.15.159:0/3705120931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 msgr2=0x55cebd436b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd436b00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbed4005c40 tx=0x7fbed4004b70 comp rx=0 tx=0).stop 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 -- 172.21.15.159:0/3705120931 shutdown_connections 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55cebd4a0120 0x55cebd49ee30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cebd420bb0 0x55cebd43ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cebd4162f0 0x55cebd436b00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbed27fc640 0 client.15057 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:46:54.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 --2- 172.21.15.159:0/3705120931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cebd4159d0 0x55cebd4365c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 -- 172.21.15.159:0/3705120931 >> 172.21.15.159:0/3705120931 conn(0x55cebd411f60 msgr2=0x55cebd41d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 -- 172.21.15.159:0/3705120931 shutdown_connections 2024-09-19T06:46:54.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 1 -- 172.21.15.159:0/3705120931 wait complete. 2024-09-19T06:46:54.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.342+0000 7fbef3a83740 20 client.15057 trim_cache size 0 max 16384 2024-09-19T06:46:54.350 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:46:54.350 INFO:teuthology.orchestra.run.smithi159.stdout: "cluster_fsid": "82c73dba-7651-11ef-bceb-c7b262605968", 2024-09-19T06:46:54.350 INFO:teuthology.orchestra.run.smithi159.stdout: "whoami": 0, 2024-09-19T06:46:54.350 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 24487, 2024-09-19T06:46:54.350 INFO:teuthology.orchestra.run.smithi159.stdout: "want_state": "up:active", 2024-09-19T06:46:54.350 INFO:teuthology.orchestra.run.smithi159.stdout: "state": "up:active", 2024-09-19T06:46:54.351 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs", 2024-09-19T06:46:54.351 INFO:teuthology.orchestra.run.smithi159.stdout: "rank_uptime": 90.570025806000004, 2024-09-19T06:46:54.351 INFO:teuthology.orchestra.run.smithi159.stdout: "mdsmap_epoch": 20, 2024-09-19T06:46:54.351 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch": 81, 2024-09-19T06:46:54.351 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch_barrier": 79, 2024-09-19T06:46:54.351 INFO:teuthology.orchestra.run.smithi159.stdout: "uptime": 109.925181886 2024-09-19T06:46:54.351 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:46:54.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 -- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fbed80a32d0 msgr2=0x7fbed80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fbed80a32d0 0x7fbed80a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00bbe0 tx=0x7fbedc00b390 comp rx=0 tx=0).stop 2024-09-19T06:46:54.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 -- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102ef0 msgr2=0x7fbeec19ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102ef0 0x7fbeec19ce40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbee400eaa0 tx=0x7fbee400ef60 comp rx=0 tx=0).stop 2024-09-19T06:46:54.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 -- 172.21.15.159:0/3717952841 shutdown_connections 2024-09-19T06:46:54.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7fbed80a32d0 0x7fbed80a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbeec102ef0 0x7fbeec19ce40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec102570 0x7fbeec198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 --2- 172.21.15.159:0/3717952841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbeec100e20 0x7fbeec198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 -- 172.21.15.159:0/3717952841 >> 172.21.15.159:0/3717952841 conn(0x7fbeec0fc7d0 msgr2=0x7fbeec06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 -- 172.21.15.159:0/3717952841 shutdown_connections 2024-09-19T06:46:54.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:54.343+0000 7fbef16aa640 1 -- 172.21.15.159:0/3717952841 wait complete. 2024-09-19T06:46:54.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:54 smithi203 ceph-mon[35473]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:54 smithi189 ceph-mon[34880]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:54.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:54 smithi159 ceph-mon[30935]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:46:55.008 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T06:46:55.018 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T06:46:55.018 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T06:46:55.018 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T06:46:55.018 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T06:46:55.019 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:46:55.019 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T06:46:55.019 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T06:46:55.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.121+0000 7f1e46b9f640 1 -- 172.21.15.159:0/41145550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40101a30 msgr2=0x7f1e40101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:55.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.121+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/41145550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40101a30 0x7f1e40101eb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009900 tx=0x7f1e3402a410 comp rx=0 tx=0).stop 2024-09-19T06:46:55.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.122+0000 7f1e46b9f640 1 -- 172.21.15.159:0/41145550 shutdown_connections 2024-09-19T06:46:55.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.122+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/41145550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e401023f0 0x7f1e40108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.122+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/41145550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40101a30 0x7f1e40101eb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.122+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/41145550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e40100840 0x7f1e40100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.122+0000 7f1e46b9f640 1 -- 172.21.15.159:0/41145550 >> 172.21.15.159:0/41145550 conn(0x7f1e400fbfa0 msgr2=0x7f1e400fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:55.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.122+0000 7f1e46b9f640 1 -- 172.21.15.159:0/41145550 shutdown_connections 2024-09-19T06:46:55.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.122+0000 7f1e46b9f640 1 -- 172.21.15.159:0/41145550 wait complete. 2024-09-19T06:46:55.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e46b9f640 1 Processor -- start 2024-09-19T06:46:55.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e46b9f640 1 -- start start 2024-09-19T06:46:55.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e46b9f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40100840 0x7f1e4006a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e46b9f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e40101a30 0x7f1e4019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e46b9f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e401023f0 0x7f1e4019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e46b9f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4010c4a0 con 0x7f1e40100840 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e46b9f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4010c320 con 0x7f1e40101a30 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e46b9f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4010c620 con 0x7f1e401023f0 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e45b9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40100840 0x7f1e4006a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e45b9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40100840 0x7f1e4006a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41630/0 (socket says 172.21.15.159:41630) 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e45b9d640 1 -- 172.21.15.159:0/2880780797 learned_addr learned my addr 172.21.15.159:0/2880780797 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e4539c640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e40101a30 0x7f1e4019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e45b9d640 1 -- 172.21.15.159:0/2880780797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e401023f0 msgr2=0x7f1e4019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e45b9d640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e401023f0 0x7f1e4019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e45b9d640 1 -- 172.21.15.159:0/2880780797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e40101a30 msgr2=0x7f1e4019c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e45b9d640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e40101a30 0x7f1e4019c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e45b9d640 1 -- 172.21.15.159:0/2880780797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4019f910 con 0x7f1e40100840 2024-09-19T06:46:55.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.123+0000 7f1e45b9d640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40100840 0x7f1e4006a410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c970 tx=0x7f1e3c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:55.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.124+0000 7f1e32ffd640 1 -- 172.21.15.159:0/2880780797 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c004220 con 0x7f1e40100840 2024-09-19T06:46:55.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.124+0000 7f1e32ffd640 1 -- 172.21.15.159:0/2880780797 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e3c0043c0 con 0x7f1e40100840 2024-09-19T06:46:55.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.124+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4019fba0 con 0x7f1e40100840 2024-09-19T06:46:55.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.124+0000 7f1e32ffd640 1 -- 172.21.15.159:0/2880780797 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00f450 con 0x7f1e40100840 2024-09-19T06:46:55.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.124+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e401a0110 con 0x7f1e40100840 2024-09-19T06:46:55.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.125+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e40107c80 con 0x7f1e40100840 2024-09-19T06:46:55.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.126+0000 7f1e32ffd640 1 -- 172.21.15.159:0/2880780797 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f1e3c0079b0 con 0x7f1e40100840 2024-09-19T06:46:55.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.127+0000 7f1e32ffd640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1e2c0a3350 0x7f1e2c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:55.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.127+0000 7f1e4539c640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1e2c0a3350 0x7f1e2c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:55.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.127+0000 7f1e32ffd640 1 -- 172.21.15.159:0/2880780797 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f1e3c0cf7e0 con 0x7f1e40100840 2024-09-19T06:46:55.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.127+0000 7f1e4539c640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1e2c0a3350 0x7f1e2c0a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e340314e0 tx=0x7f1e34000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:55.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.131+0000 7f1e32ffd640 1 -- 172.21.15.159:0/2880780797 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e3c014030 con 0x7f1e40100840 2024-09-19T06:46:55.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.361+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f1e4002da30 con 0x7f1e40100840 2024-09-19T06:46:55.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.530+0000 7f1e32ffd640 1 -- 172.21.15.159:0/2880780797 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f1e3c09c380 con 0x7f1e40100840 2024-09-19T06:46:55.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1e2c0a3350 msgr2=0x7f1e2c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:55.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1e2c0a3350 0x7f1e2c0a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e340314e0 tx=0x7f1e34000bc0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40100840 msgr2=0x7f1e4006a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:55.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40100840 0x7f1e4006a410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c970 tx=0x7f1e3c00ce30 comp rx=0 tx=0).stop 2024-09-19T06:46:55.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 shutdown_connections 2024-09-19T06:46:55.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7f1e2c0a3350 0x7f1e2c0a5810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e401023f0 0x7f1e4019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e40101a30 0x7f1e4019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 --2- 172.21.15.159:0/2880780797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e40100840 0x7f1e4006a410 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:55.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 >> 172.21.15.159:0/2880780797 conn(0x7f1e400fbfa0 msgr2=0x7f1e40104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:55.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 shutdown_connections 2024-09-19T06:46:55.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:55.532+0000 7f1e46b9f640 1 -- 172.21.15.159:0/2880780797 wait complete. 2024-09-19T06:46:55.549 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T06:46:55.574 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T06:46:55.574 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T06:46:55.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:55.574 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-09-19T06:46:55.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:55.591 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2024-09-19T06:46:55.659 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2024-09-19T06:46:55.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:46:55.661 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-19T06:46:55.661 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:46:55.661 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:46:55.662 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T06:46:55.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:55 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2880780797' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:46:55.842 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: ignoring --setuser ceph since I am not root 2024-09-19T06:46:55.842 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: ignoring --setgroup ceph since I am not root 2024-09-19T06:46:55.842 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:55 smithi203 ceph-mgr[37288]: -- 172.21.15.203:0/2108032868 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ebd12b10e0 con 0x55ebd128e800 2024-09-19T06:46:55.842 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:55.686+0000 7fb682808040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:46:55.842 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:55.742+0000 7fb682808040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:46:55.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:55 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2880780797' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:46:55.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:55 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: ignoring --setuser ceph since I am not root 2024-09-19T06:46:55.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:55 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: ignoring --setgroup ceph since I am not root 2024-09-19T06:46:55.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:55 smithi189 ceph-mgr[36256]: -- 172.21.15.189:0/817468157 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a309f350e0 con 0x55a309f13000 2024-09-19T06:46:55.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:55 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:55.682+0000 7f35ac75a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:46:55.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:55 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:55.738+0000 7f35ac75a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:46:55.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:55 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:55.886+0000 7f35ac75a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:46:55.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:55 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2880780797' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:46:55.897 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: ignoring --setuser ceph since I am not root 2024-09-19T06:46:55.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: ignoring --setgroup ceph since I am not root 2024-09-19T06:46:55.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:55.685+0000 7f9dc43ae040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:46:55.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:55.746+0000 7f9dc43ae040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:46:55.959 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:56.229 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:55.904+0000 7f9dc43ae040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:46:56.229 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:55.979+0000 7f9dc43ae040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:46:56.229 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:56.129+0000 7f9dc43ae040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:46:56.241 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:55 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:55.952+0000 7f35ac75a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:46:56.241 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:56 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:56.099+0000 7f35ac75a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:46:56.241 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:56 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:56.240+0000 7f35ac75a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:46:56.247 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:55.891+0000 7fb682808040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:46:56.248 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:55.958+0000 7fb682808040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:46:56.248 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:56.106+0000 7fb682808040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:46:56.248 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:56.246+0000 7fb682808040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:46:56.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.467+0000 7ffa85c1c640 1 -- 172.21.15.159:0/1970809164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa80102570 msgr2=0x7ffa801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.467+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/1970809164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa80102570 0x7ffa801029b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009900 tx=0x7ffa7402a480 comp rx=0 tx=0).stop 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.467+0000 7ffa85c1c640 1 -- 172.21.15.159:0/1970809164 shutdown_connections 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.467+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/1970809164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa80102ef0 0x7ffa8010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.467+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/1970809164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa80102570 0x7ffa801029b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.467+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/1970809164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa80100e20 0x7ffa80101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.467+0000 7ffa85c1c640 1 -- 172.21.15.159:0/1970809164 >> 172.21.15.159:0/1970809164 conn(0x7ffa800fc7d0 msgr2=0x7ffa800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.467+0000 7ffa85c1c640 1 -- 172.21.15.159:0/1970809164 shutdown_connections 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.467+0000 7ffa85c1c640 1 -- 172.21.15.159:0/1970809164 wait complete. 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.468+0000 7ffa85c1c640 1 Processor -- start 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.468+0000 7ffa85c1c640 1 -- start start 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.468+0000 7ffa85c1c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa80100e20 0x7ffa80197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.468+0000 7ffa85c1c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa80102570 0x7ffa80197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:56.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa85c1c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa80102ef0 0x7ffa8019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa85c1c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80110f80 con 0x7ffa80102ef0 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa85c1c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80110e00 con 0x7ffa80100e20 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa85c1c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80111100 con 0x7ffa80102570 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa80100e20 0x7ffa80197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa80102ef0 0x7ffa8019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa80100e20 0x7ffa80197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:44206/0 (socket says 172.21.15.159:44206) 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7f7fe640 1 -- 172.21.15.159:0/3946932011 learned_addr learned my addr 172.21.15.159:0/3946932011 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7effd640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa80102570 0x7ffa80197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7f7fe640 1 -- 172.21.15.159:0/3946932011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa80102570 msgr2=0x7ffa80197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7f7fe640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa80102570 0x7ffa80197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7f7fe640 1 -- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa80102ef0 msgr2=0x7ffa8019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7f7fe640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa80102ef0 0x7ffa8019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7f7fe640 1 -- 172.21.15.159:0/3946932011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8019c3f0 con 0x7ffa80100e20 2024-09-19T06:46:56.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7effd640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa80102570 0x7ffa80197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7ffff640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa80102ef0 0x7ffa8019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7f7fe640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa80100e20 0x7ffa80197440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000e9f0 tx=0x7ffa7000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7cff9640 1 -- 172.21.15.159:0/3946932011 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7000cd80 con 0x7ffa80100e20 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8019c6e0 con 0x7ffa80100e20 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7cff9640 1 -- 172.21.15.159:0/3946932011 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa70005500 con 0x7ffa80100e20 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.469+0000 7ffa7cff9640 1 -- 172.21.15.159:0/3946932011 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70010690 con 0x7ffa80100e20 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.470+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa801a3fc0 con 0x7ffa80100e20 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.470+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa80101200 con 0x7ffa80100e20 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.472+0000 7ffa7cff9640 1 -- 172.21.15.159:0/3946932011 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 138424+0+0 (secure 0 0 0) 0x7ffa70004f60 con 0x7ffa80100e20 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.472+0000 7ffa7cff9640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa680a3320 0x7ffa680a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.472+0000 7ffa7effd640 1 -- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa680a3320 msgr2=0x7ffa680a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2390667146 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.472+0000 7ffa7cff9640 1 -- 172.21.15.159:0/3946932011 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7ffa700cff40 con 0x7ffa80100e20 2024-09-19T06:46:56.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.472+0000 7ffa7effd640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa680a3320 0x7ffa680a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:46:56.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.476+0000 7ffa7cff9640 1 -- 172.21.15.159:0/3946932011 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffa7009cae0 con 0x7ffa80100e20 2024-09-19T06:46:56.532 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:56.275+0000 7f9dc43ae040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:46:56.532 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:56 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2880780797' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:46:56.532 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:56 smithi159 ceph-mon[30935]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:46:56.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.673+0000 7ffa7effd640 1 -- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa680a3320 msgr2=0x7ffa680a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2390667146 2024-09-19T06:46:56.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.673+0000 7ffa7effd640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa680a3320 0x7ffa680a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:46:56.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.687+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffa80109090 con 0x7ffa80100e20 2024-09-19T06:46:56.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.687+0000 7ffa7cff9640 1 -- 172.21.15.159:0/3946932011 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7ffa7009c3e0 con 0x7ffa80100e20 2024-09-19T06:46:56.688 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T06:46:56.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.689+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa680a3320 msgr2=0x7ffa680a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:46:56.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.689+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa680a3320 0x7ffa680a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa80100e20 msgr2=0x7ffa80197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:56.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa80100e20 0x7ffa80197440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000e9f0 tx=0x7ffa7000edf0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 shutdown_connections 2024-09-19T06:46:56.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:6800/2390667146,v1:172.21.15.159:6801/2390667146] conn(0x7ffa680a3320 0x7ffa680a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa80102ef0 0x7ffa8019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa80102570 0x7ffa80197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 --2- 172.21.15.159:0/3946932011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa80100e20 0x7ffa80197440 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:56.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 >> 172.21.15.159:0/3946932011 conn(0x7ffa800fc7d0 msgr2=0x7ffa800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:56.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 shutdown_connections 2024-09-19T06:46:56.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:56.690+0000 7ffa85c1c640 1 -- 172.21.15.159:0/3946932011 wait complete. 2024-09-19T06:46:56.800 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:56 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2880780797' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:46:56.800 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:56 smithi189 ceph-mon[34880]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:46:56.801 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:56 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:56.551+0000 7f35ac75a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:46:56.801 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:56 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:56.612+0000 7f35ac75a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:46:56.806 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:56 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2880780797' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:46:56.806 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:56 smithi203 ceph-mon[35473]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:46:56.806 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:56.560+0000 7fb682808040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:46:56.806 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:56.620+0000 7fb682808040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:46:56.807 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:56.805+0000 7fb682808040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:46:56.860 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:56.601+0000 7f9dc43ae040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:46:56.860 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:56.664+0000 7f9dc43ae040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:46:57.137 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:56 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:56.799+0000 7f35ac75a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:46:57.397 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:56.858+0000 7f9dc43ae040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:46:57.438 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T06:46:57.438 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:46:57.438 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2024-09-19T06:46:57.438 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T06:46:57.438 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:46:57.438 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T06:46:57.438 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:46:57.438 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:46:57.438 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:46:57.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:57.439 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2024-09-19T06:46:57.456 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:46:57.456 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:46:57.456 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:46:57.456 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:46:57.456 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-09-19T06:46:57.456 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:46:57.456 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42206sec preferred_lft 42206sec 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link noprefixroute 2024-09-19T06:46:57.457 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:46:57.458 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:46:57.458 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:46:57.458 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-19T06:46:57.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:46:57.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2024-09-19T06:46:57.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2024-09-19T06:46:57.459 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:46:57.459 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-19T06:46:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:46:57.659 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:46:57 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3946932011' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:46:57.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:46:57.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:57.670 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:46:57.694 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-09-19T06:46:57.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:57.696 DEBUG:teuthology.orchestra.run.smithi159:> route 2024-09-19T06:46:57.766 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2024-09-19T06:46:57.766 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:46:57.766 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T06:46:57.766 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T06:46:57.766 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:46:57.767 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:46:57.767 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-19T06:46:57.767 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T06:46:57.767 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T06:46:57.767 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T06:46:57.767 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-19T06:46:57.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:46:57 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3946932011' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:46:57.845 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:57 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:57.690+0000 7fb682808040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:46:57.845 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:57 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:57.758+0000 7fb682808040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:46:57.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:46:57.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:46:57 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3946932011' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:46:57.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:57 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:57.677+0000 7f35ac75a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:46:57.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:57 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:57.745+0000 7f35ac75a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:46:57.953 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:57 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:57.784+0000 7f9dc43ae040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:46:57.953 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:57 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:57.856+0000 7f9dc43ae040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:46:58.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:46:58.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:58.045 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-09-19T06:46:58.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:58.061 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2024-09-19T06:46:58.117 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:46:58.117 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-19T06:46:58.117 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:46:58.117 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T06:46:58.117 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-19T06:46:58.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:46:58.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:46:58.237 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T06:46:58.237 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:46:58.237 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-19T06:46:58.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T06:46:58.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:46:58.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T06:46:58.238 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T06:46:58.238 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T06:46:58.238 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-19T06:46:58.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:46:58.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:46:58.365 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:46:58.366 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-09-19T06:46:58.366 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2024-09-19T06:46:58.366 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:46:58.366 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-09-19T06:46:58.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:46:58.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:46:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:46:58.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:46:58.445 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T06:46:58.460 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:46:58.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:46:58.460 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:46:58.515 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T06:46:58.516 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T06:46:58.516 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/31b323c4-b4da-472c-b034-46b31af8d345 2024-09-19T06:46:58.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:58.516 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/31b323c4-b4da-472c-b034-46b31af8d345 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-19T06:46:58.617 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-19T06:46:58.617 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-19T06:46:58.710 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:58 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:58.452+0000 7f35ac75a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:46:58.710 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:58 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:58.566+0000 7f35ac75a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:46:58.729 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:58.467+0000 7fb682808040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:46:58.729 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:58.584+0000 7fb682808040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:46:58.748 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-19T06:46:58.748 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-19T06:46:58.748 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.189:3300,172.21.15.203:3300" 2024-09-19T06:46:58.748 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with new device syntax: 0@82c73dba-7651-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/31b323c4-b4da-472c-b034-46b31af8d345 2024-09-19T06:46:58.748 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.159:3300/172.21.15.189:3300/172.21.15.203:3300" will pass to kernel 2024-09-19T06:46:58.749 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T06:46:58.749 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2024-09-19T06:46:58.750 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T06:46:58.750 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T06:46:58.750 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T06:46:58.751 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T06:46:58.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:46:58.752 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:46:58.896 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:58.622+0000 7f9dc43ae040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:46:58.897 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:58.745+0000 7f9dc43ae040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:46:58.991 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:58 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:58.708+0000 7f35ac75a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:46:58.991 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:58 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:58.771+0000 7f35ac75a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:46:58.991 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:58 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:58.921+0000 7f35ac75a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:46:58.991 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:58 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:58.989+0000 7f35ac75a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:46:59.012 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:58.727+0000 7fb682808040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:46:59.013 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:58.792+0000 7fb682808040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:46:59.013 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:58.942+0000 7fb682808040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:46:59.013 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:59.011+0000 7fb682808040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:46:59.148 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:58.895+0000 7f9dc43ae040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:46:59.148 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:58.956+0000 7f9dc43ae040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:46:59.148 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:59.107+0000 7f9dc43ae040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:46:59.273 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:59.050+0000 7f35ac75a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:46:59.273 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:59.207+0000 7f35ac75a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:46:59.295 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:59.072+0000 7fb682808040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:46:59.295 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:59.229+0000 7fb682808040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:46:59.295 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:59.293+0000 7fb682808040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:46:59.461 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:59.176+0000 7f9dc43ae040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:46:59.461 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:59.236+0000 7f9dc43ae040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:46:59.461 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:59.395+0000 7f9dc43ae040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:46:59.538 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:59.271+0000 7f35ac75a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:46:59.539 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:59.338+0000 7f35ac75a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:46:59.539 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:59.420+0000 7f35ac75a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:46:59.539 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:59.479+0000 7f35ac75a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:46:59.539 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:46:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:46:59.537+0000 7f35ac75a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:46:59.560 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:59.360+0000 7fb682808040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:46:59.560 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:59.442+0000 7fb682808040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:46:59.561 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:59.501+0000 7fb682808040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:46:59.561 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:46:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:46:59.559+0000 7fb682808040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:46:59.730 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:59.460+0000 7f9dc43ae040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:46:59.730 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:59.526+0000 7f9dc43ae040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:46:59.730 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:59.609+0000 7f9dc43ae040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:46:59.730 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:59.669+0000 7f9dc43ae040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:46:59.730 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:46:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:46:59.728+0000 7f9dc43ae040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:47:00.564 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:47:00.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:47:00.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:47:00.637 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y[36252]: 2024-09-19T06:47:00.326+0000 7f35ac75a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: Standby manager daemon y restarted 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: Standby manager daemon y started 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: Standby manager daemon z restarted 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: Standby manager daemon z started 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:47:00.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:47:00.639 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:00 smithi189 ceph-mon[34880]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:47:00.641 INFO:teuthology.orchestra.run.smithi159.stdout:client15087 2024-09-19T06:47:00.642 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:47:00.642 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:47:00.647 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.529+0000 7f9dc43ae040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:47:00.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: Standby manager daemon y restarted 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: Standby manager daemon y started 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: Standby manager daemon z restarted 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: Standby manager daemon z started 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:47:00.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-mon[30935]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:47:00.659 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:47:00.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:47:00.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:47:00.781 INFO:teuthology.orchestra.run.smithi159.stdout:client15087 2024-09-19T06:47:00.782 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:47:00.841 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z[37284]: 2024-09-19T06:47:00.346+0000 7fb682808040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:47:00.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: Standby manager daemon y restarted 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: Standby manager daemon y started 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.189:0/1284435278' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: Standby manager daemon z restarted 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: Standby manager daemon z started 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:47:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:00 smithi203 ceph-mon[35473]: from='mgr.? 172.21.15.203:0/2482585558' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:47:00.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:47:00.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:47:00.862 INFO:teuthology.orchestra.run.smithi159.stdout:client15087 2024-09-19T06:47:00.863 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/82c73dba-7651-11ef-bceb-c7b262605968.client15087/status') 2024-09-19T06:47:00.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:47:00.930 INFO:teuthology.orchestra.run.smithi159.stdout:instance: client.15087 (3)192.168.0.1:0/1315693489 2024-09-19T06:47:00.930 INFO:teuthology.orchestra.run.smithi159.stdout:blocklisted: false 2024-09-19T06:47:00.930 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records in 2024-09-19T06:47:00.930 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records out 2024-09-19T06:47:00.930 INFO:teuthology.orchestra.run.smithi159.stderr:70 bytes copied, 3.5213e-05 s, 2.0 MB/s 2024-09-19T06:47:00.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:47:00.938 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T06:47:00.949 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T06:47:00.969 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:47:01.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.070+0000 7f3da88af640 1 -- 172.21.15.159:0/3026027776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da4100a10 msgr2=0x7f3da4100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.070+0000 7f3da88af640 1 --2- 172.21.15.159:0/3026027776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da4100a10 0x7f3da4100e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009900 tx=0x7f3d9402a410 comp rx=0 tx=0).stop 2024-09-19T06:47:01.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.071+0000 7f3da88af640 1 -- 172.21.15.159:0/3026027776 shutdown_connections 2024-09-19T06:47:01.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.071+0000 7f3da88af640 1 --2- 172.21.15.159:0/3026027776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3da41025c0 0x7f3da4108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.071+0000 7f3da88af640 1 --2- 172.21.15.159:0/3026027776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3da4101c00 0x7f3da4102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.071+0000 7f3da88af640 1 --2- 172.21.15.159:0/3026027776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da4100a10 0x7f3da4100e10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.071+0000 7f3da88af640 1 -- 172.21.15.159:0/3026027776 >> 172.21.15.159:0/3026027776 conn(0x7f3da40fc170 msgr2=0x7f3da40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:01.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.071+0000 7f3da88af640 1 -- 172.21.15.159:0/3026027776 shutdown_connections 2024-09-19T06:47:01.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.071+0000 7f3da88af640 1 -- 172.21.15.159:0/3026027776 wait complete. 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da88af640 1 Processor -- start 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da88af640 1 -- start start 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da88af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3da4100a10 0x7f3da4196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da88af640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3da4101c00 0x7f3da41972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da88af640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da41025c0 0x7f3da419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da88af640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3da410c690 con 0x7f3da41025c0 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da88af640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3da410c510 con 0x7f3da4101c00 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da88af640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3da410c810 con 0x7f3da4100a10 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da2d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da41025c0 0x7f3da419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da2d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da41025c0 0x7f3da419e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57222/0 (socket says 172.21.15.159:57222) 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da2d9d640 1 -- 172.21.15.159:0/2361258373 learned_addr learned my addr 172.21.15.159:0/2361258373 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da259c640 1 --2- 172.21.15.159:0/2361258373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3da4100a10 0x7f3da4196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da1d9b640 1 --2- 172.21.15.159:0/2361258373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3da4101c00 0x7f3da41972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da2d9d640 1 -- 172.21.15.159:0/2361258373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3da4100a10 msgr2=0x7f3da4196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da2d9d640 1 --2- 172.21.15.159:0/2361258373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3da4100a10 0x7f3da4196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da2d9d640 1 -- 172.21.15.159:0/2361258373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3da4101c00 msgr2=0x7f3da41972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da2d9d640 1 --2- 172.21.15.159:0/2361258373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3da4101c00 0x7f3da41972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da2d9d640 1 -- 172.21.15.159:0/2361258373 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da419e990 con 0x7f3da41025c0 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.072+0000 7f3da2d9d640 1 --2- 172.21.15.159:0/2361258373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da41025c0 0x7f3da419e320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00eaa0 tx=0x7f3d9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.073+0000 7f3d937fe640 1 -- 172.21.15.159:0/2361258373 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00cdb0 con 0x7f3da41025c0 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.073+0000 7f3da88af640 1 -- 172.21.15.159:0/2361258373 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da419ec80 con 0x7f3da41025c0 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.073+0000 7f3d937fe640 1 -- 172.21.15.159:0/2361258373 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d9c005020 con 0x7f3da41025c0 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.073+0000 7f3d937fe640 1 -- 172.21.15.159:0/2361258373 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0116b0 con 0x7f3da41025c0 2024-09-19T06:47:01.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.073+0000 7f3da88af640 1 -- 172.21.15.159:0/2361258373 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da419f1d0 con 0x7f3da41025c0 2024-09-19T06:47:01.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.074+0000 7f3da88af640 1 -- 172.21.15.159:0/2361258373 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da4107e50 con 0x7f3da41025c0 2024-09-19T06:47:01.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.076+0000 7f3d937fe640 1 -- 172.21.15.159:0/2361258373 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7f3d9c005560 con 0x7f3da41025c0 2024-09-19T06:47:01.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.077+0000 7f3d937fe640 1 -- 172.21.15.159:0/2361258373 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f3d9c0cf700 con 0x7f3da41025c0 2024-09-19T06:47:01.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.081+0000 7f3d937fe640 1 -- 172.21.15.159:0/2361258373 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d9c016030 con 0x7f3da41025c0 2024-09-19T06:47:01.148 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.815+0000 7f9d2dd04640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.148 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.815+0000 7f9d2dd04640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.148 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.815+0000 7f9d2dd04640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.148 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.815+0000 7f9d2dd04640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.148 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.815+0000 7f9d2dd04640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.149 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.816+0000 7f9d2acfe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.149 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.816+0000 7f9d2acfe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.149 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.816+0000 7f9d2acfe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.149 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.816+0000 7f9d2acfe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.149 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:00.816+0000 7f9d2acfe640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:47:01.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.260+0000 7f3da88af640 1 -- 172.21.15.159:0/2361258373 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3da4062e90 con 0x7f3da41025c0 2024-09-19T06:47:01.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.261+0000 7f3d937fe640 1 -- 172.21.15.159:0/2361258373 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+23312 (secure 0 0 0) 0x7f3d9c09c6d0 con 0x7f3da41025c0 2024-09-19T06:47:01.263 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:01.263 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":82,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:47:00.531454+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:6800/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2156136647":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2526477703":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3276076186":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3424652308":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3763048477":"2024-09-20T06:47:00.531421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:47:01.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.264+0000 7f3da88af640 1 -- 172.21.15.159:0/2361258373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da41025c0 msgr2=0x7f3da419e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.264+0000 7f3da88af640 1 --2- 172.21.15.159:0/2361258373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da41025c0 0x7f3da419e320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00eaa0 tx=0x7f3d9c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:47:01.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.264+0000 7f3da88af640 1 -- 172.21.15.159:0/2361258373 shutdown_connections 2024-09-19T06:47:01.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.264+0000 7f3da88af640 1 --2- 172.21.15.159:0/2361258373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3da41025c0 0x7f3da419e320 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.264+0000 7f3da88af640 1 --2- 172.21.15.159:0/2361258373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3da4101c00 0x7f3da41972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.264+0000 7f3da88af640 1 --2- 172.21.15.159:0/2361258373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3da4100a10 0x7f3da4196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.264+0000 7f3da88af640 1 -- 172.21.15.159:0/2361258373 >> 172.21.15.159:0/2361258373 conn(0x7f3da40fc170 msgr2=0x7f3da4105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:01.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.264+0000 7f3da88af640 1 -- 172.21.15.159:0/2361258373 shutdown_connections 2024-09-19T06:47:01.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.264+0000 7f3da88af640 1 -- 172.21.15.159:0/2361258373 wait complete. 2024-09-19T06:47:01.277 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:40:47.637521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:45:19.566504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:45:21.598793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:47:01.278 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:47:01.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.387+0000 7fa7af92c640 1 -- 172.21.15.159:0/2462608804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a81025e0 msgr2=0x7fa7a81049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.387+0000 7fa7af92c640 1 --2- 172.21.15.159:0/2462608804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a81025e0 0x7fa7a81049d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009900 tx=0x7fa7a402a410 comp rx=0 tx=0).stop 2024-09-19T06:47:01.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.387+0000 7fa7af92c640 1 -- 172.21.15.159:0/2462608804 shutdown_connections 2024-09-19T06:47:01.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.387+0000 7fa7af92c640 1 --2- 172.21.15.159:0/2462608804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a8107840 0x7fa7a8109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.387+0000 7fa7af92c640 1 --2- 172.21.15.159:0/2462608804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7a8104f10 0x7fa7a8107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.387+0000 7fa7af92c640 1 --2- 172.21.15.159:0/2462608804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a81025e0 0x7fa7a81049d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.387+0000 7fa7af92c640 1 -- 172.21.15.159:0/2462608804 >> 172.21.15.159:0/2462608804 conn(0x7fa7a80fc140 msgr2=0x7fa7a80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:01.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.387+0000 7fa7af92c640 1 -- 172.21.15.159:0/2462608804 shutdown_connections 2024-09-19T06:47:01.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.387+0000 7fa7af92c640 1 -- 172.21.15.159:0/2462608804 wait complete. 2024-09-19T06:47:01.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7af92c640 1 Processor -- start 2024-09-19T06:47:01.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7af92c640 1 -- start start 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7af92c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81025e0 0x7fa7a8197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7af92c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7a8104f10 0x7fa7a81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7af92c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8107840 0x7fa7a819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7af92c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a810d7d0 con 0x7fa7a8107840 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7af92c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a810d650 con 0x7fa7a81025e0 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7af92c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a810d950 con 0x7fa7a8104f10 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7adec9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8107840 0x7fa7a819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7adec9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8107840 0x7fa7a819f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57250/0 (socket says 172.21.15.159:57250) 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7ad6c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81025e0 0x7fa7a8197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7adec9640 1 -- 172.21.15.159:0/3119575630 learned_addr learned my addr 172.21.15.159:0/3119575630 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.388+0000 7fa7acec7640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7a8104f10 0x7fa7a81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa7adec9640 1 -- 172.21.15.159:0/3119575630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7a8104f10 msgr2=0x7fa7a81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa7adec9640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7a8104f10 0x7fa7a81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa7adec9640 1 -- 172.21.15.159:0/3119575630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81025e0 msgr2=0x7fa7a8197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa7adec9640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81025e0 0x7fa7a8197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa7adec9640 1 -- 172.21.15.159:0/3119575630 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a819fad0 con 0x7fa7a8107840 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa7adec9640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8107840 0x7fa7a819f460 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000eb40 tx=0x7fa7a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa79e7fc640 1 -- 172.21.15.159:0/3119575630 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0004b20 con 0x7fa7a8107840 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a819fdc0 con 0x7fa7a8107840 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa79e7fc640 1 -- 172.21.15.159:0/3119575630 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7a0004cc0 con 0x7fa7a8107840 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa79e7fc640 1 -- 172.21.15.159:0/3119575630 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0010850 con 0x7fa7a8107840 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.389+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a81a0230 con 0x7fa7a8107840 2024-09-19T06:47:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.390+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a80fdc30 con 0x7fa7a8107840 2024-09-19T06:47:01.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.392+0000 7fa79e7fc640 1 -- 172.21.15.159:0/3119575630 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7fa7a0005000 con 0x7fa7a8107840 2024-09-19T06:47:01.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.393+0000 7fa79e7fc640 1 -- 172.21.15.159:0/3119575630 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa7a00cfbd0 con 0x7fa7a8107840 2024-09-19T06:47:01.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.400+0000 7fa79e7fc640 1 -- 172.21.15.159:0/3119575630 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7a009cba0 con 0x7fa7a8107840 2024-09-19T06:47:01.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.550+0000 7fa79e7fc640 1 -- 172.21.15.159:0/3119575630 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7fa7a00052f0 con 0x7fa7a8107840 2024-09-19T06:47:01.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.550+0000 7fa79e7fc640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa7940aa090 0x7fa7940ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.552+0000 7fa7ad6c8640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa7940aa090 0x7fa7940ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.554+0000 7fa7ad6c8640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa7940aa090 0x7fa7940ac480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40314e0 tx=0x7fa7a4000bc0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:01.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.599+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa7a8062e90 con 0x7fa7a8107840 2024-09-19T06:47:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.599+0000 7fa79e7fc640 1 -- 172.21.15.159:0/3119575630 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7fa7a0023c40 con 0x7fa7a8107840 2024-09-19T06:47:01.601 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-09-19T06:47:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.601+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa7940aa090 msgr2=0x7fa7940ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.601+0000 7fa7af92c640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa7940aa090 0x7fa7940ac480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40314e0 tx=0x7fa7a4000bc0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.601+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8107840 msgr2=0x7fa7a819f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.601+0000 7fa7af92c640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8107840 0x7fa7a819f460 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000eb40 tx=0x7fa7a000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.602+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 shutdown_connections 2024-09-19T06:47:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.602+0000 7fa7af92c640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa7940aa090 0x7fa7940ac480 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.602+0000 7fa7af92c640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8107840 0x7fa7a819f460 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.602+0000 7fa7af92c640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7a8104f10 0x7fa7a81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.602+0000 7fa7af92c640 1 --2- 172.21.15.159:0/3119575630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81025e0 0x7fa7a8197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.602+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 >> 172.21.15.159:0/3119575630 conn(0x7fa7a80fc140 msgr2=0x7fa7a81030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.602+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 shutdown_connections 2024-09-19T06:47:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.602+0000 7fa7af92c640 1 -- 172.21.15.159:0/3119575630 wait complete. 2024-09-19T06:47:01.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T06:47:01.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: Active manager daemon x restarted 2024-09-19T06:47:01.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: Activating manager daemon x 2024-09-19T06:47:01.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:47:01.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: mgrmap e20: x(active, starting, since 0.0120967s), standbys: y, z 2024-09-19T06:47:01.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:47:01.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:47:01.614 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:47:01.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:47:01.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:47:01.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:47:01.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:47:01.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:47:01.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:47:01.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:47:01.615 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:47:01.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: Manager daemon x is now available 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:01.617 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:47:01.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:47:01.618 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2361258373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:47:01.717 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T06:47:01.717 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: Active manager daemon x restarted 2024-09-19T06:47:01.717 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: Activating manager daemon x 2024-09-19T06:47:01.717 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: mgrmap e20: x(active, starting, since 0.0120967s), standbys: y, z 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:47:01.718 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:47:01.719 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: Manager daemon x is now available 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:47:01.720 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:01 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2361258373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:47:01.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.720+0000 7fa12e3a6640 1 -- 172.21.15.159:0/3563315028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa128100a00 msgr2=0x7fa128100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.720+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/3563315028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa128100a00 0x7fa128100e00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa118009900 tx=0x7fa11802a410 comp rx=0 tx=0).stop 2024-09-19T06:47:01.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 -- 172.21.15.159:0/3563315028 shutdown_connections 2024-09-19T06:47:01.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/3563315028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa1281025b0 0x7fa128108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/3563315028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa128101bf0 0x7fa128102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/3563315028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa128100a00 0x7fa128100e00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 -- 172.21.15.159:0/3563315028 >> 172.21.15.159:0/3563315028 conn(0x7fa1280fc140 msgr2=0x7fa1280fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:01.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 -- 172.21.15.159:0/3563315028 shutdown_connections 2024-09-19T06:47:01.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 -- 172.21.15.159:0/3563315028 wait complete. 2024-09-19T06:47:01.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 Processor -- start 2024-09-19T06:47:01.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 -- start start 2024-09-19T06:47:01.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa128100a00 0x7fa128197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa128101bf0 0x7fa128198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.721+0000 7fa12e3a6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1281025b0 0x7fa12819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa12e3a6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa12810c680 con 0x7fa1281025b0 2024-09-19T06:47:01.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa12e3a6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa12810c500 con 0x7fa128101bf0 2024-09-19T06:47:01.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa12e3a6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa12810c800 con 0x7fa128100a00 2024-09-19T06:47:01.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa12c943640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1281025b0 0x7fa12819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1277fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa128101bf0 0x7fa128198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa12c943640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1281025b0 0x7fa12819f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57272/0 (socket says 172.21.15.159:57272) 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa12c943640 1 -- 172.21.15.159:0/1319110241 learned_addr learned my addr 172.21.15.159:0/1319110241 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1277fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa128101bf0 0x7fa128198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:56856/0 (socket says 172.21.15.159:56856) 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa127fff640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa128100a00 0x7fa128197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1277fe640 1 -- 172.21.15.159:0/1319110241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa128100a00 msgr2=0x7fa128197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1277fe640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa128100a00 0x7fa128197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1277fe640 1 -- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1281025b0 msgr2=0x7fa12819f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1277fe640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1281025b0 0x7fa12819f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1277fe640 1 -- 172.21.15.159:0/1319110241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12819fae0 con 0x7fa128101bf0 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa12c943640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1281025b0 0x7fa12819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1277fe640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa128101bf0 0x7fa128198400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00e9f0 tx=0x7fa11c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1257fa640 1 -- 172.21.15.159:0/1319110241 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00ccc0 con 0x7fa128101bf0 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1257fa640 1 -- 172.21.15.159:0/1319110241 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa11c005020 con 0x7fa128101bf0 2024-09-19T06:47:01.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12819fdd0 con 0x7fa128101bf0 2024-09-19T06:47:01.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa1257fa640 1 -- 172.21.15.159:0/1319110241 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0049e0 con 0x7fa128101bf0 2024-09-19T06:47:01.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.722+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1281a0240 con 0x7fa128101bf0 2024-09-19T06:47:01.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.723+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1281a04d0 con 0x7fa128101bf0 2024-09-19T06:47:01.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.724+0000 7fa1257fa640 1 -- 172.21.15.159:0/1319110241 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7fa11c005560 con 0x7fa128101bf0 2024-09-19T06:47:01.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.725+0000 7fa1257fa640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1100a3050 0x7fa1100a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:01.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.725+0000 7fa127fff640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1100a3050 0x7fa1100a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:01.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.725+0000 7fa1257fa640 1 -- 172.21.15.159:0/1319110241 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa11c0cf940 con 0x7fa128101bf0 2024-09-19T06:47:01.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.726+0000 7fa127fff640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1100a3050 0x7fa1100a5510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa118005ab0 tx=0x7fa118000bc0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:01.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.728+0000 7fa1257fa640 1 -- 172.21.15.159:0/1319110241 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa11c0051d0 con 0x7fa128101bf0 2024-09-19T06:47:01.735 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T06:47:01.735 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: Active manager daemon x restarted 2024-09-19T06:47:01.735 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: Activating manager daemon x 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: mgrmap e20: x(active, starting, since 0.0120967s), standbys: y, z 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:47:01.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:47:01.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: Manager daemon x is now available 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:47:01.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:01 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2361258373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:47:01.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.907+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa1281a06a0 con 0x7fa128101bf0 2024-09-19T06:47:01.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.908+0000 7fa1257fa640 1 -- 172.21.15.159:0/1319110241 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7fa11c09c7c0 con 0x7fa128101bf0 2024-09-19T06:47:01.909 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-09-19T06:47:01.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1100a3050 msgr2=0x7fa1100a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1100a3050 0x7fa1100a5510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa118005ab0 tx=0x7fa118000bc0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa128101bf0 msgr2=0x7fa128198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa128101bf0 0x7fa128198400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00e9f0 tx=0x7fa11c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 shutdown_connections 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1100a3050 0x7fa1100a5510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1281025b0 0x7fa12819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa128101bf0 0x7fa128198400 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 --2- 172.21.15.159:0/1319110241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa128100a00 0x7fa128197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 >> 172.21.15.159:0/1319110241 conn(0x7fa1280fc140 msgr2=0x7fa128069360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 shutdown_connections 2024-09-19T06:47:01.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:01.910+0000 7fa12e3a6640 1 -- 172.21.15.159:0/1319110241 wait complete. 2024-09-19T06:47:01.922 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:47:02.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 -- 172.21.15.159:0/2885004573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 msgr2=0x7f593c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:02.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 --2- 172.21.15.159:0/2885004573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 0x7f593c108e40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5934009ca0 tx=0x7f593402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 -- 172.21.15.159:0/2885004573 shutdown_connections 2024-09-19T06:47:02.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 --2- 172.21.15.159:0/2885004573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 0x7f593c108e40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 --2- 172.21.15.159:0/2885004573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f593c101bf0 0x7f593c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 --2- 172.21.15.159:0/2885004573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f593c100a00 0x7f593c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 -- 172.21.15.159:0/2885004573 >> 172.21.15.159:0/2885004573 conn(0x7f593c0fc140 msgr2=0x7f593c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:02.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 -- 172.21.15.159:0/2885004573 shutdown_connections 2024-09-19T06:47:02.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 -- 172.21.15.159:0/2885004573 wait complete. 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.026+0000 7f5941e77640 1 Processor -- start 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f5941e77640 1 -- start start 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f5941e77640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f593c100a00 0x7f593c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f5941e77640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f593c101bf0 0x7f593c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f5941e77640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 0x7f593c19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f5941e77640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f593c10c680 con 0x7f593c1025b0 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f5941e77640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f593c10c500 con 0x7f593c100a00 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f5941e77640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f593c10c800 con 0x7f593c101bf0 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 0x7f593c19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:02.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 0x7f593c19f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57278/0 (socket says 172.21.15.159:57278) 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593bfff640 1 -- 172.21.15.159:0/1760815404 learned_addr learned my addr 172.21.15.159:0/1760815404 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593b7fe640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f593c100a00 0x7f593c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f5933fff640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f593c101bf0 0x7f593c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593bfff640 1 -- 172.21.15.159:0/1760815404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f593c101bf0 msgr2=0x7f593c19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593bfff640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f593c101bf0 0x7f593c19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593bfff640 1 -- 172.21.15.159:0/1760815404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f593c100a00 msgr2=0x7f593c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593bfff640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f593c100a00 0x7f593c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593bfff640 1 -- 172.21.15.159:0/1760815404 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c19fab0 con 0x7f593c1025b0 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f5933fff640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f593c101bf0 0x7f593c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f593bfff640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 0x7f593c19f1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5934031ae0 tx=0x7f5934031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.027+0000 7f59397fa640 1 -- 172.21.15.159:0/1760815404 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934003c30 con 0x7f593c1025b0 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.028+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c19fce0 con 0x7f593c1025b0 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.028+0000 7f59397fa640 1 -- 172.21.15.159:0/1760815404 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5934003dd0 con 0x7f593c1025b0 2024-09-19T06:47:02.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.028+0000 7f59397fa640 1 -- 172.21.15.159:0/1760815404 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593402fcb0 con 0x7f593c1025b0 2024-09-19T06:47:02.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.028+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c1a01d0 con 0x7f593c1025b0 2024-09-19T06:47:02.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.028+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593c107df0 con 0x7f593c1025b0 2024-09-19T06:47:02.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.030+0000 7f59397fa640 1 -- 172.21.15.159:0/1760815404 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f5934004050 con 0x7f593c1025b0 2024-09-19T06:47:02.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.030+0000 7f59397fa640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59280a3050 0x7f59280a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:02.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.030+0000 7f593b7fe640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59280a3050 0x7f59280a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:02.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.030+0000 7f59397fa640 1 -- 172.21.15.159:0/1760815404 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f59340f0b60 con 0x7f593c1025b0 2024-09-19T06:47:02.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.031+0000 7f593b7fe640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59280a3050 0x7f59280a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f593c101a50 tx=0x7f592c005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:02.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.034+0000 7f59397fa640 1 -- 172.21.15.159:0/1760815404 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f59340bda20 con 0x7f593c1025b0 2024-09-19T06:47:02.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.200+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f593c02da10 con 0x7f593c1025b0 2024-09-19T06:47:02.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.201+0000 7f59397fa640 1 -- 172.21.15.159:0/1760815404 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f59340bd320 con 0x7f593c1025b0 2024-09-19T06:47:02.202 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 64 2024-09-19T06:47:02.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59280a3050 msgr2=0x7f59280a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:02.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59280a3050 0x7f59280a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f593c101a50 tx=0x7f592c005f90 comp rx=0 tx=0).stop 2024-09-19T06:47:02.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 msgr2=0x7f593c19f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:02.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 0x7f593c19f1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5934031ae0 tx=0x7f5934031ee0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 shutdown_connections 2024-09-19T06:47:02.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59280a3050 0x7f59280a5510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f593c1025b0 0x7f593c19f1a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f593c101bf0 0x7f593c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 --2- 172.21.15.159:0/1760815404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f593c100a00 0x7f593c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:02.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 >> 172.21.15.159:0/1760815404 conn(0x7f593c0fc140 msgr2=0x7f593c104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:02.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 shutdown_connections 2024-09-19T06:47:02.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:02.203+0000 7f5941e77640 1 -- 172.21.15.159:0/1760815404 wait complete. 2024-09-19T06:47:02.215 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:01.915+0000 7f9d17bd8640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:47:01] ENGINE Error in HTTPServer.serve 2024-09-19T06:47:02.215 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: Traceback (most recent call last): 2024-09-19T06:47:02.215 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:47:02.215 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self._connections.run(self.expiration_interval) 2024-09-19T06:47:02.215 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:47:02.215 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self._run(expiration_interval) 2024-09-19T06:47:02.215 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:47:02.215 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: s = self.context.wrap_socket( 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: return self.sslsocket_class._create( 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self.do_handshake() 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: self._sslobj.do_handshake() 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:47:02.216 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:47:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:47:02.217 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T06:47:02.217 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:02.502 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:02.812 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:02 smithi159 ceph-mon[30935]: mgrmap e21: x(active, since 1.01883s), standbys: y, z 2024-09-19T06:47:02.813 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:02 smithi159 ceph-mon[30935]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:47:02.813 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:02 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3119575630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:47:02.813 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:02 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1319110241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:47:02.813 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:02 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1760815404' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:47:02.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:02 smithi203 ceph-mon[35473]: mgrmap e21: x(active, since 1.01883s), standbys: y, z 2024-09-19T06:47:02.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:02 smithi203 ceph-mon[35473]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:47:02.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:02 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3119575630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:47:02.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:02 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1319110241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:47:02.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:02 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1760815404' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:47:02.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:02 smithi189 ceph-mon[34880]: mgrmap e21: x(active, since 1.01883s), standbys: y, z 2024-09-19T06:47:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:02 smithi189 ceph-mon[34880]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:47:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:02 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3119575630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:47:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:02 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1319110241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:47:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:02 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1760815404' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:47:03.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.027+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/1912534241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c34105ec0 msgr2=0x7f0c34106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:03.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.027+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/1912534241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c34105ec0 0x7f0c34106340 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009ca0 tx=0x7f0c2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.027+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/1912534241 shutdown_connections 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.027+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/1912534241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c34105ec0 0x7f0c34106340 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.027+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/1912534241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c341011e0 0x7f0c34105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.027+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/1912534241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c341008c0 0x7f0c34100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.027+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/1912534241 >> 172.21.15.159:0/1912534241 conn(0x7f0c340fc7d0 msgr2=0x7f0c340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.027+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/1912534241 shutdown_connections 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.027+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/1912534241 wait complete. 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.028+0000 7f0c3b4f8640 1 Processor -- start 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.028+0000 7f0c3b4f8640 1 -- start start 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.028+0000 7f0c3b4f8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c341008c0 0x7f0c341a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.028+0000 7f0c3b4f8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c341011e0 0x7f0c341a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.028+0000 7f0c3b4f8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c34105ec0 0x7f0c3419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.028+0000 7f0c3b4f8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34118630 con 0x7f0c341008c0 2024-09-19T06:47:03.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.028+0000 7f0c3b4f8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341184b0 con 0x7f0c341011e0 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.028+0000 7f0c3b4f8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341187b0 con 0x7f0c34105ec0 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.028+0000 7f0c39294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c341008c0 0x7f0c341a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c39294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c341008c0 0x7f0c341a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57318/0 (socket says 172.21.15.159:57318) 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c39294640 1 -- 172.21.15.159:0/3964698048 learned_addr learned my addr 172.21.15.159:0/3964698048 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c38a93640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c341011e0 0x7f0c341a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c39a95640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c34105ec0 0x7f0c3419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c39294640 1 -- 172.21.15.159:0/3964698048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c34105ec0 msgr2=0x7f0c3419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c39294640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c34105ec0 0x7f0c3419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c39294640 1 -- 172.21.15.159:0/3964698048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c341011e0 msgr2=0x7f0c341a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c39294640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c341011e0 0x7f0c341a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c39294640 1 -- 172.21.15.159:0/3964698048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3419f030 con 0x7f0c341008c0 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c39294640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c341008c0 0x7f0c341a4740 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000e9f0 tx=0x7f0c3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:03.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c2a7fc640 1 -- 172.21.15.159:0/3964698048 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000cd80 con 0x7f0c341008c0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c2a7fc640 1 -- 172.21.15.159:0/3964698048 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c30005500 con 0x7f0c341008c0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3419f320 con 0x7f0c341008c0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c2a7fc640 1 -- 172.21.15.159:0/3964698048 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30010690 con 0x7f0c341008c0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.029+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c341ab610 con 0x7f0c341008c0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.030+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c34105980 con 0x7f0c341008c0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.032+0000 7f0c2a7fc640 1 -- 172.21.15.159:0/3964698048 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7f0c300046c0 con 0x7f0c341008c0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.032+0000 7f0c2a7fc640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0c200a3430 0x7f0c200a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.032+0000 7f0c38a93640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0c200a3430 0x7f0c200a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.032+0000 7f0c2a7fc640 1 -- 172.21.15.159:0/3964698048 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f0c300d0350 con 0x7f0c341008c0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.033+0000 7f0c38a93640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0c200a3430 0x7f0c200a58f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ffed0 tx=0x7f0c24005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:03.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.036+0000 7f0c2a7fc640 1 -- 172.21.15.159:0/3964698048 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c30054210 con 0x7f0c341008c0 2024-09-19T06:47:03.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.255+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c3419fe30 con 0x7f0c341008c0 2024-09-19T06:47:03.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.256+0000 7f0c2a7fc640 1 -- 172.21.15.159:0/3964698048 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f0c3009cd00 con 0x7f0c341008c0 2024-09-19T06:47:03.257 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:03.258 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:47:03.258 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:47:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.259+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0c200a3430 msgr2=0x7f0c200a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.259+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0c200a3430 0x7f0c200a58f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ffed0 tx=0x7f0c24005f90 comp rx=0 tx=0).stop 2024-09-19T06:47:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.259+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c341008c0 msgr2=0x7f0c341a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.259+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c341008c0 0x7f0c341a4740 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000e9f0 tx=0x7f0c3000edf0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.259+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 shutdown_connections 2024-09-19T06:47:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.259+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0c200a3430 0x7f0c200a58f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.260+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c34105ec0 0x7f0c3419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.260+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c341011e0 0x7f0c341a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.260+0000 7f0c3b4f8640 1 --2- 172.21.15.159:0/3964698048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c341008c0 0x7f0c341a4740 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:03.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.260+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 >> 172.21.15.159:0/3964698048 conn(0x7f0c340fc7d0 msgr2=0x7f0c34103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:03.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.260+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 shutdown_connections 2024-09-19T06:47:03.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:03.260+0000 7f0c3b4f8640 1 -- 172.21.15.159:0/3964698048 wait complete. 2024-09-19T06:47:03.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: [19/Sep/2024:06:47:01] ENGINE Bus STARTING 2024-09-19T06:47:03.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: [19/Sep/2024:06:47:01] ENGINE Serving on https://172.21.15.159:7150 2024-09-19T06:47:03.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: [19/Sep/2024:06:47:01] ENGINE Error in HTTPServer.serve 2024-09-19T06:47:03.842 INFO:journalctl@ceph.mon.c.smithi203.stdout: Traceback (most recent call last): 2024-09-19T06:47:03.842 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:47:03.842 INFO:journalctl@ceph.mon.c.smithi203.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:47:03.842 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: self._run(expiration_interval) 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: s = self.context.wrap_socket( 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: return self.sslsocket_class._create( 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:47:03.843 INFO:journalctl@ceph.mon.c.smithi203.stdout: self.do_handshake() 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout: self._sslobj.do_handshake() 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: [19/Sep/2024:06:47:02] ENGINE Serving on http://172.21.15.159:8765 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: [19/Sep/2024:06:47:02] ENGINE Bus STARTED 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3964698048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:03 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: [19/Sep/2024:06:47:01] ENGINE Bus STARTING 2024-09-19T06:47:03.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: [19/Sep/2024:06:47:01] ENGINE Serving on https://172.21.15.159:7150 2024-09-19T06:47:03.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: [19/Sep/2024:06:47:01] ENGINE Error in HTTPServer.serve 2024-09-19T06:47:03.889 INFO:journalctl@ceph.mon.b.smithi189.stdout: Traceback (most recent call last): 2024-09-19T06:47:03.889 INFO:journalctl@ceph.mon.b.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:47:03.890 INFO:journalctl@ceph.mon.b.smithi189.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:47:03.890 INFO:journalctl@ceph.mon.b.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:47:03.890 INFO:journalctl@ceph.mon.b.smithi189.stdout: self._run(expiration_interval) 2024-09-19T06:47:03.890 INFO:journalctl@ceph.mon.b.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:47:03.890 INFO:journalctl@ceph.mon.b.smithi189.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:47:03.891 INFO:journalctl@ceph.mon.b.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:47:03.891 INFO:journalctl@ceph.mon.b.smithi189.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:47:03.891 INFO:journalctl@ceph.mon.b.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:47:03.891 INFO:journalctl@ceph.mon.b.smithi189.stdout: s = self.context.wrap_socket( 2024-09-19T06:47:03.891 INFO:journalctl@ceph.mon.b.smithi189.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:47:03.892 INFO:journalctl@ceph.mon.b.smithi189.stdout: return self.sslsocket_class._create( 2024-09-19T06:47:03.892 INFO:journalctl@ceph.mon.b.smithi189.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:47:03.892 INFO:journalctl@ceph.mon.b.smithi189.stdout: self.do_handshake() 2024-09-19T06:47:03.892 INFO:journalctl@ceph.mon.b.smithi189.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:47:03.892 INFO:journalctl@ceph.mon.b.smithi189.stdout: self._sslobj.do_handshake() 2024-09-19T06:47:03.893 INFO:journalctl@ceph.mon.b.smithi189.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:47:03.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: [19/Sep/2024:06:47:02] ENGINE Serving on http://172.21.15.159:8765 2024-09-19T06:47:03.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: [19/Sep/2024:06:47:02] ENGINE Bus STARTED 2024-09-19T06:47:03.893 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:47:03.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T06:47:03.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.894 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3964698048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:03.895 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.896 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.897 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:03 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: [19/Sep/2024:06:47:01] ENGINE Bus STARTING 2024-09-19T06:47:03.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: [19/Sep/2024:06:47:01] ENGINE Serving on https://172.21.15.159:7150 2024-09-19T06:47:03.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: [19/Sep/2024:06:47:01] ENGINE Error in HTTPServer.serve 2024-09-19T06:47:03.899 INFO:journalctl@ceph.mon.a.smithi159.stdout: Traceback (most recent call last): 2024-09-19T06:47:03.899 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:47:03.899 INFO:journalctl@ceph.mon.a.smithi159.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:47:03.899 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:47:03.899 INFO:journalctl@ceph.mon.a.smithi159.stdout: self._run(expiration_interval) 2024-09-19T06:47:03.899 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:47:03.900 INFO:journalctl@ceph.mon.a.smithi159.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:47:03.900 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:47:03.900 INFO:journalctl@ceph.mon.a.smithi159.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:47:03.900 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:47:03.900 INFO:journalctl@ceph.mon.a.smithi159.stdout: s = self.context.wrap_socket( 2024-09-19T06:47:03.900 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:47:03.901 INFO:journalctl@ceph.mon.a.smithi159.stdout: return self.sslsocket_class._create( 2024-09-19T06:47:03.901 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:47:03.901 INFO:journalctl@ceph.mon.a.smithi159.stdout: self.do_handshake() 2024-09-19T06:47:03.901 INFO:journalctl@ceph.mon.a.smithi159.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:47:03.901 INFO:journalctl@ceph.mon.a.smithi159.stdout: self._sslobj.do_handshake() 2024-09-19T06:47:03.901 INFO:journalctl@ceph.mon.a.smithi159.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:47:03.902 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: [19/Sep/2024:06:47:02] ENGINE Serving on http://172.21.15.159:8765 2024-09-19T06:47:03.902 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: [19/Sep/2024:06:47:02] ENGINE Bus STARTED 2024-09-19T06:47:03.902 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:47:03.902 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T06:47:03.902 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.902 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.903 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.903 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.903 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.903 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.903 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3964698048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:03.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:03.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.905 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.905 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.905 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:03.905 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:03 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.130 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T06:47:04.130 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T06:47:04.131 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:47:04.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.243+0000 7f8fb6474640 1 -- 172.21.15.159:0/3876293890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb0104ec0 msgr2=0x7f8fb01072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.243+0000 7f8fb6474640 1 --2- 172.21.15.159:0/3876293890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb0104ec0 0x7f8fb01072b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa402a410 comp rx=0 tx=0).stop 2024-09-19T06:47:04.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.243+0000 7f8fb6474640 1 -- 172.21.15.159:0/3876293890 shutdown_connections 2024-09-19T06:47:04.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.243+0000 7f8fb6474640 1 --2- 172.21.15.159:0/3876293890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8fb01077f0 0x7f8fb0109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.243+0000 7f8fb6474640 1 --2- 172.21.15.159:0/3876293890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb0104ec0 0x7f8fb01072b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.243+0000 7f8fb6474640 1 --2- 172.21.15.159:0/3876293890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0102590 0x7f8fb0104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.243+0000 7f8fb6474640 1 -- 172.21.15.159:0/3876293890 >> 172.21.15.159:0/3876293890 conn(0x7f8fb00fc170 msgr2=0x7f8fb00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.243+0000 7f8fb6474640 1 -- 172.21.15.159:0/3876293890 shutdown_connections 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.243+0000 7f8fb6474640 1 -- 172.21.15.159:0/3876293890 wait complete. 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb6474640 1 Processor -- start 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb6474640 1 -- start start 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb6474640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0102590 0x7f8fb0101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb6474640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8fb0104ec0 0x7f8fb0100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb6474640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb01077f0 0x7f8fb0100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb6474640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010d820 con 0x7f8fb01077f0 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb6474640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010d6a0 con 0x7f8fb0102590 2024-09-19T06:47:04.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb6474640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010d9a0 con 0x7f8fb0104ec0 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb4a11640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb01077f0 0x7f8fb0100a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb4a11640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb01077f0 0x7f8fb0100a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57340/0 (socket says 172.21.15.159:57340) 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8fb4a11640 1 -- 172.21.15.159:0/2978240781 learned_addr learned my addr 172.21.15.159:0/2978240781 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8faffff640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0102590 0x7f8fb0101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.244+0000 7f8faf7fe640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8fb0104ec0 0x7f8fb0100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.245+0000 7f8fb4a11640 1 -- 172.21.15.159:0/2978240781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8fb0104ec0 msgr2=0x7f8fb0100540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.245+0000 7f8fb4a11640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8fb0104ec0 0x7f8fb0100540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.245+0000 7f8fb4a11640 1 -- 172.21.15.159:0/2978240781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0102590 msgr2=0x7f8fb0101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.245+0000 7f8fb4a11640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0102590 0x7f8fb0101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.245+0000 7f8fb4a11640 1 -- 172.21.15.159:0/2978240781 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb0101310 con 0x7f8fb01077f0 2024-09-19T06:47:04.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.245+0000 7f8fb4a11640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb01077f0 0x7f8fb0100a80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800eb40 tx=0x7f8fa800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:04.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.246+0000 7f8fad7fa640 1 -- 172.21.15.159:0/2978240781 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8004b20 con 0x7f8fb01077f0 2024-09-19T06:47:04.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.246+0000 7f8fad7fa640 1 -- 172.21.15.159:0/2978240781 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fa8004cc0 con 0x7f8fb01077f0 2024-09-19T06:47:04.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.246+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb01a1fd0 con 0x7f8fb01077f0 2024-09-19T06:47:04.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.246+0000 7f8fad7fa640 1 -- 172.21.15.159:0/2978240781 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8010850 con 0x7f8fb01077f0 2024-09-19T06:47:04.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.246+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb01a2490 con 0x7f8fb01077f0 2024-09-19T06:47:04.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.247+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb00fdc60 con 0x7f8fb01077f0 2024-09-19T06:47:04.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.248+0000 7f8fad7fa640 1 -- 172.21.15.159:0/2978240781 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7f8fa8005000 con 0x7f8fb01077f0 2024-09-19T06:47:04.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.249+0000 7f8fad7fa640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8f980a3440 0x7f8f980a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:04.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.249+0000 7f8faffff640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8f980a3440 0x7f8f980a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:04.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.249+0000 7f8fad7fa640 1 -- 172.21.15.159:0/2978240781 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f8fa80d0400 con 0x7f8fb01077f0 2024-09-19T06:47:04.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.249+0000 7f8faffff640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8f980a3440 0x7f8f980a5900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009bd0 tx=0x7f8fa0005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:04.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.252+0000 7f8fad7fa640 1 -- 172.21.15.159:0/2978240781 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8fa809cdb0 con 0x7f8fb01077f0 2024-09-19T06:47:04.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.446+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fb0062630 con 0x7f8f980a3440 2024-09-19T06:47:04.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.453+0000 7f8fad7fa640 1 -- 172.21.15.159:0/2978240781 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258093 (secure 0 0 0) 0x7f8fb0062630 con 0x7f8f980a3440 2024-09-19T06:47:04.457 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:04.458 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:47:04.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8f980a3440 msgr2=0x7f8f980a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8f980a3440 0x7f8f980a5900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009bd0 tx=0x7f8fa0005f90 comp rx=0 tx=0).stop 2024-09-19T06:47:04.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb01077f0 msgr2=0x7f8fb0100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb01077f0 0x7f8fb0100a80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800eb40 tx=0x7f8fa800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 shutdown_connections 2024-09-19T06:47:04.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8f980a3440 0x7f8f980a5900 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fb01077f0 0x7f8fb0100a80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8fb0104ec0 0x7f8fb0100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 --2- 172.21.15.159:0/2978240781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb0102590 0x7f8fb0101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 >> 172.21.15.159:0/2978240781 conn(0x7f8fb00fc170 msgr2=0x7f8fb0102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:04.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 shutdown_connections 2024-09-19T06:47:04.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.456+0000 7f8fb6474640 1 -- 172.21.15.159:0/2978240781 wait complete. 2024-09-19T06:47:04.469 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T06:47:02.552777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":426,"num_read_kb":368,"num_write":383,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372748,"kb_used_data":10972,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569076,"statfs":{"total":1151940427776,"available":1151558733824,"internally_reserved":0,"allocated":11235328,"data_stored":8716867,"data_compressed":286398,"data_compressed_allocated":385024,"data_compressed_original":3514368,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.993322"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596299+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:47:00.596299+0000","last_peered":"2024-09-19T06:47:00.596299+0000","last_clean":"2024-09-19T06:47:00.596299+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:47:00.596299+0000","last_undegraded":"2024-09-19T06:47:00.596299+0000","last_fullsized":"2024-09-19T06:47:00.596299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590995+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:47:00.590995+0000","last_peered":"2024-09-19T06:47:00.590995+0000","last_clean":"2024-09-19T06:47:00.590995+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:47:00.590995+0000","last_undegraded":"2024-09-19T06:47:00.590995+0000","last_fullsized":"2024-09-19T06:47:00.590995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595558+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:47:00.595558+0000","last_peered":"2024-09-19T06:47:00.595558+0000","last_clean":"2024-09-19T06:47:00.595558+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:47:00.595558+0000","last_undegraded":"2024-09-19T06:47:00.595558+0000","last_fullsized":"2024-09-19T06:47:00.595558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.575726+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:47:00.575726+0000","last_peered":"2024-09-19T06:47:00.575726+0000","last_clean":"2024-09-19T06:47:00.575726+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:47:00.575726+0000","last_undegraded":"2024-09-19T06:47:00.575726+0000","last_fullsized":"2024-09-19T06:47:00.575726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594145+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:47:00.594145+0000","last_peered":"2024-09-19T06:47:00.594145+0000","last_clean":"2024-09-19T06:47:00.594145+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:47:00.594145+0000","last_undegraded":"2024-09-19T06:47:00.594145+0000","last_fullsized":"2024-09-19T06:47:00.594145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592217+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:47:00.592217+0000","last_peered":"2024-09-19T06:47:00.592217+0000","last_clean":"2024-09-19T06:47:00.592217+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:47:00.592217+0000","last_undegraded":"2024-09-19T06:47:00.592217+0000","last_fullsized":"2024-09-19T06:47:00.592217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581506+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:47:00.581506+0000","last_peered":"2024-09-19T06:47:00.581506+0000","last_clean":"2024-09-19T06:47:00.581506+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:47:00.581506+0000","last_undegraded":"2024-09-19T06:47:00.581506+0000","last_fullsized":"2024-09-19T06:47:00.581506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594128+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:47:00.594128+0000","last_peered":"2024-09-19T06:47:00.594128+0000","last_clean":"2024-09-19T06:47:00.594128+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:47:00.594128+0000","last_undegraded":"2024-09-19T06:47:00.594128+0000","last_fullsized":"2024-09-19T06:47:00.594128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587594+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:47:00.587594+0000","last_peered":"2024-09-19T06:47:00.587594+0000","last_clean":"2024-09-19T06:47:00.587594+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:47:00.587594+0000","last_undegraded":"2024-09-19T06:47:00.587594+0000","last_fullsized":"2024-09-19T06:47:00.587594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585123+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:47:00.585123+0000","last_peered":"2024-09-19T06:47:00.585123+0000","last_clean":"2024-09-19T06:47:00.585123+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:47:00.585123+0000","last_undegraded":"2024-09-19T06:47:00.585123+0000","last_fullsized":"2024-09-19T06:47:00.585123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585680+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:47:00.585680+0000","last_peered":"2024-09-19T06:47:00.585680+0000","last_clean":"2024-09-19T06:47:00.585680+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:47:00.585680+0000","last_undegraded":"2024-09-19T06:47:00.585680+0000","last_fullsized":"2024-09-19T06:47:00.585680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580960+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:47:00.580960+0000","last_peered":"2024-09-19T06:47:00.580960+0000","last_clean":"2024-09-19T06:47:00.580960+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:47:00.580960+0000","last_undegraded":"2024-09-19T06:47:00.580960+0000","last_fullsized":"2024-09-19T06:47:00.580960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590511+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:47:00.590511+0000","last_peered":"2024-09-19T06:47:00.590511+0000","last_clean":"2024-09-19T06:47:00.590511+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:47:00.590511+0000","last_undegraded":"2024-09-19T06:47:00.590511+0000","last_fullsized":"2024-09-19T06:47:00.590511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594823+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:47:00.594823+0000","last_peered":"2024-09-19T06:47:00.594823+0000","last_clean":"2024-09-19T06:47:00.594823+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:47:00.594823+0000","last_undegraded":"2024-09-19T06:47:00.594823+0000","last_fullsized":"2024-09-19T06:47:00.594823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590707+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:47:00.590707+0000","last_peered":"2024-09-19T06:47:00.590707+0000","last_clean":"2024-09-19T06:47:00.590707+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:47:00.590707+0000","last_undegraded":"2024-09-19T06:47:00.590707+0000","last_fullsized":"2024-09-19T06:47:00.590707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595272+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:47:00.595272+0000","last_peered":"2024-09-19T06:47:00.595272+0000","last_clean":"2024-09-19T06:47:00.595272+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:47:00.595272+0000","last_undegraded":"2024-09-19T06:47:00.595272+0000","last_fullsized":"2024-09-19T06:47:00.595272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596210+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:47:00.596210+0000","last_peered":"2024-09-19T06:47:00.596210+0000","last_clean":"2024-09-19T06:47:00.596210+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:47:00.596210+0000","last_undegraded":"2024-09-19T06:47:00.596210+0000","last_fullsized":"2024-09-19T06:47:00.596210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585734+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:47:00.585734+0000","last_peered":"2024-09-19T06:47:00.585734+0000","last_clean":"2024-09-19T06:47:00.585734+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:47:00.585734+0000","last_undegraded":"2024-09-19T06:47:00.585734+0000","last_fullsized":"2024-09-19T06:47:00.585734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.578454+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:47:00.578454+0000","last_peered":"2024-09-19T06:47:00.578454+0000","last_clean":"2024-09-19T06:47:00.578454+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:47:00.578454+0000","last_undegraded":"2024-09-19T06:47:00.578454+0000","last_fullsized":"2024-09-19T06:47:00.578454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580253+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:47:00.580253+0000","last_peered":"2024-09-19T06:47:00.580253+0000","last_clean":"2024-09-19T06:47:00.580253+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:47:00.580253+0000","last_undegraded":"2024-09-19T06:47:00.580253+0000","last_fullsized":"2024-09-19T06:47:00.580253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595663+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:47:00.595663+0000","last_peered":"2024-09-19T06:47:00.595663+0000","last_clean":"2024-09-19T06:47:00.595663+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:47:00.595663+0000","last_undegraded":"2024-09-19T06:47:00.595663+0000","last_fullsized":"2024-09-19T06:47:00.595663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586577+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:47:00.586577+0000","last_peered":"2024-09-19T06:47:00.586577+0000","last_clean":"2024-09-19T06:47:00.586577+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:47:00.586577+0000","last_undegraded":"2024-09-19T06:47:00.586577+0000","last_fullsized":"2024-09-19T06:47:00.586577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589497+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:47:00.589497+0000","last_peered":"2024-09-19T06:47:00.589497+0000","last_clean":"2024-09-19T06:47:00.589497+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:47:00.589497+0000","last_undegraded":"2024-09-19T06:47:00.589497+0000","last_fullsized":"2024-09-19T06:47:00.589497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586950+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:47:00.586950+0000","last_peered":"2024-09-19T06:47:00.586950+0000","last_clean":"2024-09-19T06:47:00.586950+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:47:00.586950+0000","last_undegraded":"2024-09-19T06:47:00.586950+0000","last_fullsized":"2024-09-19T06:47:00.586950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584482+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:47:00.584482+0000","last_peered":"2024-09-19T06:47:00.584482+0000","last_clean":"2024-09-19T06:47:00.584482+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:47:00.584482+0000","last_undegraded":"2024-09-19T06:47:00.584482+0000","last_fullsized":"2024-09-19T06:47:00.584482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.576867+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:47:00.576867+0000","last_peered":"2024-09-19T06:47:00.576867+0000","last_clean":"2024-09-19T06:47:00.576867+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:47:00.576867+0000","last_undegraded":"2024-09-19T06:47:00.576867+0000","last_fullsized":"2024-09-19T06:47:00.576867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582332+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:47:00.582332+0000","last_peered":"2024-09-19T06:47:00.582332+0000","last_clean":"2024-09-19T06:47:00.582332+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:47:00.582332+0000","last_undegraded":"2024-09-19T06:47:00.582332+0000","last_fullsized":"2024-09-19T06:47:00.582332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594980+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:47:00.594980+0000","last_peered":"2024-09-19T06:47:00.594980+0000","last_clean":"2024-09-19T06:47:00.594980+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:47:00.594980+0000","last_undegraded":"2024-09-19T06:47:00.594980+0000","last_fullsized":"2024-09-19T06:47:00.594980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596274+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:47:00.596274+0000","last_peered":"2024-09-19T06:47:00.596274+0000","last_clean":"2024-09-19T06:47:00.596274+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:47:00.596274+0000","last_undegraded":"2024-09-19T06:47:00.596274+0000","last_fullsized":"2024-09-19T06:47:00.596274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583987+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:47:00.583987+0000","last_peered":"2024-09-19T06:47:00.583987+0000","last_clean":"2024-09-19T06:47:00.583987+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:47:00.583987+0000","last_undegraded":"2024-09-19T06:47:00.583987+0000","last_fullsized":"2024-09-19T06:47:00.583987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577783+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:47:00.577783+0000","last_peered":"2024-09-19T06:47:00.577783+0000","last_clean":"2024-09-19T06:47:00.577783+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:47:00.577783+0000","last_undegraded":"2024-09-19T06:47:00.577783+0000","last_fullsized":"2024-09-19T06:47:00.577783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583197+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:47:00.583197+0000","last_peered":"2024-09-19T06:47:00.583197+0000","last_clean":"2024-09-19T06:47:00.583197+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:47:00.583197+0000","last_undegraded":"2024-09-19T06:47:00.583197+0000","last_fullsized":"2024-09-19T06:47:00.583197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587636+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:47:00.587636+0000","last_peered":"2024-09-19T06:47:00.587636+0000","last_clean":"2024-09-19T06:47:00.587636+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:47:00.587636+0000","last_undegraded":"2024-09-19T06:47:00.587636+0000","last_fullsized":"2024-09-19T06:47:00.587636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537764+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:47:00.537764+0000","last_peered":"2024-09-19T06:47:00.537764+0000","last_clean":"2024-09-19T06:47:00.537764+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:47:00.537764+0000","last_undegraded":"2024-09-19T06:47:00.537764+0000","last_fullsized":"2024-09-19T06:47:00.537764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594590+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:47:00.594590+0000","last_peered":"2024-09-19T06:47:00.594590+0000","last_clean":"2024-09-19T06:47:00.594590+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:47:00.594590+0000","last_undegraded":"2024-09-19T06:47:00.594590+0000","last_fullsized":"2024-09-19T06:47:00.594590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544151+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:47:00.544151+0000","last_peered":"2024-09-19T06:47:00.544151+0000","last_clean":"2024-09-19T06:47:00.544151+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:47:00.544151+0000","last_undegraded":"2024-09-19T06:47:00.544151+0000","last_fullsized":"2024-09-19T06:47:00.544151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536382+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:47:00.536382+0000","last_peered":"2024-09-19T06:47:00.536382+0000","last_clean":"2024-09-19T06:47:00.536382+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:47:00.536382+0000","last_undegraded":"2024-09-19T06:47:00.536382+0000","last_fullsized":"2024-09-19T06:47:00.536382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589344+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:47:00.589344+0000","last_peered":"2024-09-19T06:47:00.589344+0000","last_clean":"2024-09-19T06:47:00.589344+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:47:00.589344+0000","last_undegraded":"2024-09-19T06:47:00.589344+0000","last_fullsized":"2024-09-19T06:47:00.589344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.538035+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:47:00.538035+0000","last_peered":"2024-09-19T06:47:00.538035+0000","last_clean":"2024-09-19T06:47:00.538035+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:47:00.538035+0000","last_undegraded":"2024-09-19T06:47:00.538035+0000","last_fullsized":"2024-09-19T06:47:00.538035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592761+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:47:00.592761+0000","last_peered":"2024-09-19T06:47:00.592761+0000","last_clean":"2024-09-19T06:47:00.592761+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:47:00.592761+0000","last_undegraded":"2024-09-19T06:47:00.592761+0000","last_fullsized":"2024-09-19T06:47:00.592761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544365+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:47:00.544365+0000","last_peered":"2024-09-19T06:47:00.544365+0000","last_clean":"2024-09-19T06:47:00.544365+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:47:00.544365+0000","last_undegraded":"2024-09-19T06:47:00.544365+0000","last_fullsized":"2024-09-19T06:47:00.544365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587810+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:47:00.587810+0000","last_peered":"2024-09-19T06:47:00.587810+0000","last_clean":"2024-09-19T06:47:00.587810+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:47:00.587810+0000","last_undegraded":"2024-09-19T06:47:00.587810+0000","last_fullsized":"2024-09-19T06:47:00.587810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.548844+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:47:00.548844+0000","last_peered":"2024-09-19T06:47:00.548844+0000","last_clean":"2024-09-19T06:47:00.548844+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:47:00.548844+0000","last_undegraded":"2024-09-19T06:47:00.548844+0000","last_fullsized":"2024-09-19T06:47:00.548844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595196+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:47:00.595196+0000","last_peered":"2024-09-19T06:47:00.595196+0000","last_clean":"2024-09-19T06:47:00.595196+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:47:00.595196+0000","last_undegraded":"2024-09-19T06:47:00.595196+0000","last_fullsized":"2024-09-19T06:47:00.595196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537912+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:47:00.537912+0000","last_peered":"2024-09-19T06:47:00.537912+0000","last_clean":"2024-09-19T06:47:00.537912+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:47:00.537912+0000","last_undegraded":"2024-09-19T06:47:00.537912+0000","last_fullsized":"2024-09-19T06:47:00.537912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582419+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:47:00.582419+0000","last_peered":"2024-09-19T06:47:00.582419+0000","last_clean":"2024-09-19T06:47:00.582419+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:47:00.582419+0000","last_undegraded":"2024-09-19T06:47:00.582419+0000","last_fullsized":"2024-09-19T06:47:00.582419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":250,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.958103+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:47:00.958103+0000","last_peered":"2024-09-19T06:47:00.958103+0000","last_clean":"2024-09-19T06:47:00.958103+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:47:00.958103+0000","last_undegraded":"2024-09-19T06:47:00.958103+0000","last_fullsized":"2024-09-19T06:47:00.958103+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":164,"num_write":34,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577030+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:47:00.577030+0000","last_peered":"2024-09-19T06:47:00.577030+0000","last_clean":"2024-09-19T06:47:00.577030+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:47:00.577030+0000","last_undegraded":"2024-09-19T06:47:00.577030+0000","last_fullsized":"2024-09-19T06:47:00.577030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.545877+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:47:00.545877+0000","last_peered":"2024-09-19T06:47:00.545877+0000","last_clean":"2024-09-19T06:47:00.545877+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:47:00.545877+0000","last_undegraded":"2024-09-19T06:47:00.545877+0000","last_fullsized":"2024-09-19T06:47:00.545877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589299+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:47:00.589299+0000","last_peered":"2024-09-19T06:47:00.589299+0000","last_clean":"2024-09-19T06:47:00.589299+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:47:00.589299+0000","last_undegraded":"2024-09-19T06:47:00.589299+0000","last_fullsized":"2024-09-19T06:47:00.589299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537682+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:47:00.537682+0000","last_peered":"2024-09-19T06:47:00.537682+0000","last_clean":"2024-09-19T06:47:00.537682+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:47:00.537682+0000","last_undegraded":"2024-09-19T06:47:00.537682+0000","last_fullsized":"2024-09-19T06:47:00.537682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584015+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:47:00.584015+0000","last_peered":"2024-09-19T06:47:00.584015+0000","last_clean":"2024-09-19T06:47:00.584015+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:47:00.584015+0000","last_undegraded":"2024-09-19T06:47:00.584015+0000","last_fullsized":"2024-09-19T06:47:00.584015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549262+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:47:00.549262+0000","last_peered":"2024-09-19T06:47:00.549262+0000","last_clean":"2024-09-19T06:47:00.549262+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:47:00.549262+0000","last_undegraded":"2024-09-19T06:47:00.549262+0000","last_fullsized":"2024-09-19T06:47:00.549262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584090+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:47:00.584090+0000","last_peered":"2024-09-19T06:47:00.584090+0000","last_clean":"2024-09-19T06:47:00.584090+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:47:00.584090+0000","last_undegraded":"2024-09-19T06:47:00.584090+0000","last_fullsized":"2024-09-19T06:47:00.584090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.550930+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:47:00.550930+0000","last_peered":"2024-09-19T06:47:00.550930+0000","last_clean":"2024-09-19T06:47:00.550930+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:47:00.550930+0000","last_undegraded":"2024-09-19T06:47:00.550930+0000","last_fullsized":"2024-09-19T06:47:00.550930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580495+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:47:00.580495+0000","last_peered":"2024-09-19T06:47:00.580495+0000","last_clean":"2024-09-19T06:47:00.580495+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:47:00.580495+0000","last_undegraded":"2024-09-19T06:47:00.580495+0000","last_fullsized":"2024-09-19T06:47:00.580495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560644+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:47:00.560644+0000","last_peered":"2024-09-19T06:47:00.560644+0000","last_clean":"2024-09-19T06:47:00.560644+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:47:00.560644+0000","last_undegraded":"2024-09-19T06:47:00.560644+0000","last_fullsized":"2024-09-19T06:47:00.560644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581982+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:47:00.581982+0000","last_peered":"2024-09-19T06:47:00.581982+0000","last_clean":"2024-09-19T06:47:00.581982+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:47:00.581982+0000","last_undegraded":"2024-09-19T06:47:00.581982+0000","last_fullsized":"2024-09-19T06:47:00.581982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536735+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:47:00.536735+0000","last_peered":"2024-09-19T06:47:00.536735+0000","last_clean":"2024-09-19T06:47:00.536735+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:47:00.536735+0000","last_undegraded":"2024-09-19T06:47:00.536735+0000","last_fullsized":"2024-09-19T06:47:00.536735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579492+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:47:00.579492+0000","last_peered":"2024-09-19T06:47:00.579492+0000","last_clean":"2024-09-19T06:47:00.579492+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:47:00.579492+0000","last_undegraded":"2024-09-19T06:47:00.579492+0000","last_fullsized":"2024-09-19T06:47:00.579492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'39","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.770707+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:47:00.770707+0000","last_peered":"2024-09-19T06:47:00.770707+0000","last_clean":"2024-09-19T06:47:00.770707+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:47:00.770707+0000","last_undegraded":"2024-09-19T06:47:00.770707+0000","last_fullsized":"2024-09-19T06:47:00.770707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594237+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:47:00.594237+0000","last_peered":"2024-09-19T06:47:00.594237+0000","last_clean":"2024-09-19T06:47:00.594237+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:47:00.594237+0000","last_undegraded":"2024-09-19T06:47:00.594237+0000","last_fullsized":"2024-09-19T06:47:00.594237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.546255+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:47:00.546255+0000","last_peered":"2024-09-19T06:47:00.546255+0000","last_clean":"2024-09-19T06:47:00.546255+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:47:00.546255+0000","last_undegraded":"2024-09-19T06:47:00.546255+0000","last_fullsized":"2024-09-19T06:47:00.546255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585679+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:47:00.585679+0000","last_peered":"2024-09-19T06:47:00.585679+0000","last_clean":"2024-09-19T06:47:00.585679+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:47:00.585679+0000","last_undegraded":"2024-09-19T06:47:00.585679+0000","last_fullsized":"2024-09-19T06:47:00.585679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":349,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549300+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:47:00.549300+0000","last_peered":"2024-09-19T06:47:00.549300+0000","last_clean":"2024-09-19T06:47:00.549300+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:47:00.549300+0000","last_undegraded":"2024-09-19T06:47:00.549300+0000","last_fullsized":"2024-09-19T06:47:00.549300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549180+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:47:00.549180+0000","last_peered":"2024-09-19T06:47:00.549180+0000","last_clean":"2024-09-19T06:47:00.549180+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:47:00.549180+0000","last_undegraded":"2024-09-19T06:47:00.549180+0000","last_fullsized":"2024-09-19T06:47:00.549180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593914+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:47:00.593914+0000","last_peered":"2024-09-19T06:47:00.593914+0000","last_clean":"2024-09-19T06:47:00.593914+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:47:00.593914+0000","last_undegraded":"2024-09-19T06:47:00.593914+0000","last_fullsized":"2024-09-19T06:47:00.593914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549165+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:47:00.549165+0000","last_peered":"2024-09-19T06:47:00.549165+0000","last_clean":"2024-09-19T06:47:00.549165+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:47:00.549165+0000","last_undegraded":"2024-09-19T06:47:00.549165+0000","last_fullsized":"2024-09-19T06:47:00.549165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577578+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:47:00.577578+0000","last_peered":"2024-09-19T06:47:00.577578+0000","last_clean":"2024-09-19T06:47:00.577578+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:47:00.577578+0000","last_undegraded":"2024-09-19T06:47:00.577578+0000","last_fullsized":"2024-09-19T06:47:00.577578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536478+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:47:00.536478+0000","last_peered":"2024-09-19T06:47:00.536478+0000","last_clean":"2024-09-19T06:47:00.536478+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:47:00.536478+0000","last_undegraded":"2024-09-19T06:47:00.536478+0000","last_fullsized":"2024-09-19T06:47:00.536478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579472+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:47:00.579472+0000","last_peered":"2024-09-19T06:47:00.579472+0000","last_clean":"2024-09-19T06:47:00.579472+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:47:00.579472+0000","last_undegraded":"2024-09-19T06:47:00.579472+0000","last_fullsized":"2024-09-19T06:47:00.579472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549300+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:47:00.549300+0000","last_peered":"2024-09-19T06:47:00.549300+0000","last_clean":"2024-09-19T06:47:00.549300+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:47:00.549300+0000","last_undegraded":"2024-09-19T06:47:00.549300+0000","last_fullsized":"2024-09-19T06:47:00.549300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579645+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:47:00.579645+0000","last_peered":"2024-09-19T06:47:00.579645+0000","last_clean":"2024-09-19T06:47:00.579645+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:47:00.579645+0000","last_undegraded":"2024-09-19T06:47:00.579645+0000","last_fullsized":"2024-09-19T06:47:00.579645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556514+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:47:00.556514+0000","last_peered":"2024-09-19T06:47:00.556514+0000","last_clean":"2024-09-19T06:47:00.556514+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:47:00.556514+0000","last_undegraded":"2024-09-19T06:47:00.556514+0000","last_fullsized":"2024-09-19T06:47:00.556514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587136+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:47:00.587136+0000","last_peered":"2024-09-19T06:47:00.587136+0000","last_clean":"2024-09-19T06:47:00.587136+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:47:00.587136+0000","last_undegraded":"2024-09-19T06:47:00.587136+0000","last_fullsized":"2024-09-19T06:47:00.587136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552471+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:47:00.552471+0000","last_peered":"2024-09-19T06:47:00.552471+0000","last_clean":"2024-09-19T06:47:00.552471+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:47:00.552471+0000","last_undegraded":"2024-09-19T06:47:00.552471+0000","last_fullsized":"2024-09-19T06:47:00.552471+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579287+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:47:00.579287+0000","last_peered":"2024-09-19T06:47:00.579287+0000","last_clean":"2024-09-19T06:47:00.579287+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:47:00.579287+0000","last_undegraded":"2024-09-19T06:47:00.579287+0000","last_fullsized":"2024-09-19T06:47:00.579287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'44","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.780520+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:47:00.780520+0000","last_peered":"2024-09-19T06:47:00.780520+0000","last_clean":"2024-09-19T06:47:00.780520+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:47:00.780520+0000","last_undegraded":"2024-09-19T06:47:00.780520+0000","last_fullsized":"2024-09-19T06:47:00.780520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":80,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593306+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:47:00.593306+0000","last_peered":"2024-09-19T06:47:00.593306+0000","last_clean":"2024-09-19T06:47:00.593306+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:47:00.593306+0000","last_undegraded":"2024-09-19T06:47:00.593306+0000","last_fullsized":"2024-09-19T06:47:00.593306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549571+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:47:00.549571+0000","last_peered":"2024-09-19T06:47:00.549571+0000","last_clean":"2024-09-19T06:47:00.549571+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:47:00.549571+0000","last_undegraded":"2024-09-19T06:47:00.549571+0000","last_fullsized":"2024-09-19T06:47:00.549571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596329+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:47:00.596329+0000","last_peered":"2024-09-19T06:47:00.596329+0000","last_clean":"2024-09-19T06:47:00.596329+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:47:00.596329+0000","last_undegraded":"2024-09-19T06:47:00.596329+0000","last_fullsized":"2024-09-19T06:47:00.596329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536872+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:47:00.536872+0000","last_peered":"2024-09-19T06:47:00.536872+0000","last_clean":"2024-09-19T06:47:00.536872+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:47:00.536872+0000","last_undegraded":"2024-09-19T06:47:00.536872+0000","last_fullsized":"2024-09-19T06:47:00.536872+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.573059+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:47:00.573059+0000","last_peered":"2024-09-19T06:47:00.573059+0000","last_clean":"2024-09-19T06:47:00.573059+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:47:00.573059+0000","last_undegraded":"2024-09-19T06:47:00.573059+0000","last_fullsized":"2024-09-19T06:47:00.573059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.551180+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:47:00.551180+0000","last_peered":"2024-09-19T06:47:00.551180+0000","last_clean":"2024-09-19T06:47:00.551180+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:47:00.551180+0000","last_undegraded":"2024-09-19T06:47:00.551180+0000","last_fullsized":"2024-09-19T06:47:00.551180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595812+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:47:00.595812+0000","last_peered":"2024-09-19T06:47:00.595812+0000","last_clean":"2024-09-19T06:47:00.595812+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:47:00.595812+0000","last_undegraded":"2024-09-19T06:47:00.595812+0000","last_fullsized":"2024-09-19T06:47:00.595812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.555196+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:47:00.555196+0000","last_peered":"2024-09-19T06:47:00.555196+0000","last_clean":"2024-09-19T06:47:00.555196+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:47:00.555196+0000","last_undegraded":"2024-09-19T06:47:00.555196+0000","last_fullsized":"2024-09-19T06:47:00.555196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.597003+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:47:00.597003+0000","last_peered":"2024-09-19T06:47:00.597003+0000","last_clean":"2024-09-19T06:47:00.597003+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:47:00.597003+0000","last_undegraded":"2024-09-19T06:47:00.597003+0000","last_fullsized":"2024-09-19T06:47:00.597003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560958+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:47:00.560958+0000","last_peered":"2024-09-19T06:47:00.560958+0000","last_clean":"2024-09-19T06:47:00.560958+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:47:00.560958+0000","last_undegraded":"2024-09-19T06:47:00.560958+0000","last_fullsized":"2024-09-19T06:47:00.560958+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585140+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:47:00.585140+0000","last_peered":"2024-09-19T06:47:00.585140+0000","last_clean":"2024-09-19T06:47:00.585140+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:47:00.585140+0000","last_undegraded":"2024-09-19T06:47:00.585140+0000","last_fullsized":"2024-09-19T06:47:00.585140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587229+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:47:00.587229+0000","last_peered":"2024-09-19T06:47:00.587229+0000","last_clean":"2024-09-19T06:47:00.587229+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:47:00.587229+0000","last_undegraded":"2024-09-19T06:47:00.587229+0000","last_fullsized":"2024-09-19T06:47:00.587229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556945+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:47:00.556945+0000","last_peered":"2024-09-19T06:47:00.556945+0000","last_clean":"2024-09-19T06:47:00.556945+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:47:00.556945+0000","last_undegraded":"2024-09-19T06:47:00.556945+0000","last_fullsized":"2024-09-19T06:47:00.556945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587670+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:47:00.587670+0000","last_peered":"2024-09-19T06:47:00.587670+0000","last_clean":"2024-09-19T06:47:00.587670+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:47:00.587670+0000","last_undegraded":"2024-09-19T06:47:00.587670+0000","last_fullsized":"2024-09-19T06:47:00.587670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552359+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:47:00.552359+0000","last_peered":"2024-09-19T06:47:00.552359+0000","last_clean":"2024-09-19T06:47:00.552359+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:47:00.552359+0000","last_undegraded":"2024-09-19T06:47:00.552359+0000","last_fullsized":"2024-09-19T06:47:00.552359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596914+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:47:00.596914+0000","last_peered":"2024-09-19T06:47:00.596914+0000","last_clean":"2024-09-19T06:47:00.596914+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:47:00.596914+0000","last_undegraded":"2024-09-19T06:47:00.596914+0000","last_fullsized":"2024-09-19T06:47:00.596914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552705+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:47:00.552705+0000","last_peered":"2024-09-19T06:47:00.552705+0000","last_clean":"2024-09-19T06:47:00.552705+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:47:00.552705+0000","last_undegraded":"2024-09-19T06:47:00.552705+0000","last_fullsized":"2024-09-19T06:47:00.552705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592794+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:47:00.592794+0000","last_peered":"2024-09-19T06:47:00.592794+0000","last_clean":"2024-09-19T06:47:00.592794+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:47:00.592794+0000","last_undegraded":"2024-09-19T06:47:00.592794+0000","last_fullsized":"2024-09-19T06:47:00.592794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556333+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:47:00.556333+0000","last_peered":"2024-09-19T06:47:00.556333+0000","last_clean":"2024-09-19T06:47:00.556333+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:47:00.556333+0000","last_undegraded":"2024-09-19T06:47:00.556333+0000","last_fullsized":"2024-09-19T06:47:00.556333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":290,"num_read_kb":249,"num_write":200,"num_write_kb":1405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1785447,"data_compressed":81345,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107385,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612640,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":441000,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841573,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":1100428,"data_compressed":46260,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005099,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":834798,"data_compressed":27798,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234031,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":834820,"data_compressed":27798,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1032067,"data_compressed":44447,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626488,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":441117,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855422,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":974848,"data_stored":1163267,"data_compressed":50603,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441022,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":966154,"data_compressed":33954,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476814,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":510569,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":962560,"data_stored":510535,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441090,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":69535,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69569,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":524920,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":131782,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":201329,"data_compressed":7969,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:47:04.477 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:47:04.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.619+0000 7ff9cc20e640 1 -- 172.21.15.159:0/1723564532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 msgr2=0x7ff9c4100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.619+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/1723564532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 0x7ff9c4100e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009900 tx=0x7ff9bc02a410 comp rx=0 tx=0).stop 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.619+0000 7ff9cc20e640 1 -- 172.21.15.159:0/1723564532 shutdown_connections 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.619+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/1723564532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9c41025c0 0x7ff9c4108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.619+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/1723564532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9c4101c00 0x7ff9c4102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.619+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/1723564532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 0x7ff9c4100e10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.619+0000 7ff9cc20e640 1 -- 172.21.15.159:0/1723564532 >> 172.21.15.159:0/1723564532 conn(0x7ff9c40fc170 msgr2=0x7ff9c40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.619+0000 7ff9cc20e640 1 -- 172.21.15.159:0/1723564532 shutdown_connections 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.619+0000 7ff9cc20e640 1 -- 172.21.15.159:0/1723564532 wait complete. 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9cc20e640 1 Processor -- start 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9cc20e640 1 -- start start 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9cc20e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 0x7ff9c4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:04.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9cc20e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9c4101c00 0x7ff9c41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9cc20e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9c41025c0 0x7ff9c419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9cc20e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c410c6e0 con 0x7ff9c4100a10 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9cc20e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c410c560 con 0x7ff9c41025c0 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9cc20e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c410c860 con 0x7ff9c4101c00 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9c9faa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 0x7ff9c4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9c9faa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 0x7ff9c4197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57364/0 (socket says 172.21.15.159:57364) 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9c9faa640 1 -- 172.21.15.159:0/459847368 learned_addr learned my addr 172.21.15.159:0/459847368 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9c97a9640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9c4101c00 0x7ff9c41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9ca7ab640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9c41025c0 0x7ff9c419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:04.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9c9faa640 1 -- 172.21.15.159:0/459847368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9c4101c00 msgr2=0x7ff9c41983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9c9faa640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9c4101c00 0x7ff9c41983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9c9faa640 1 -- 172.21.15.159:0/459847368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9c41025c0 msgr2=0x7ff9c419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9c9faa640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9c41025c0 0x7ff9c419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.620+0000 7ff9c9faa640 1 -- 172.21.15.159:0/459847368 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c419fa80 con 0x7ff9c4100a10 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.621+0000 7ff9c9faa640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 0x7ff9c4197e60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc031440 tx=0x7ff9bc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.621+0000 7ff9baffd640 1 -- 172.21.15.159:0/459847368 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc03f030 con 0x7ff9c4100a10 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.621+0000 7ff9baffd640 1 -- 172.21.15.159:0/459847368 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9bc003ce0 con 0x7ff9c4100a10 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.621+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c419fd10 con 0x7ff9c4100a10 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.621+0000 7ff9baffd640 1 -- 172.21.15.159:0/459847368 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc035070 con 0x7ff9c4100a10 2024-09-19T06:47:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.621+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c41a01b0 con 0x7ff9c4100a10 2024-09-19T06:47:04.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.622+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c41a0380 con 0x7ff9c4100a10 2024-09-19T06:47:04.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.624+0000 7ff9baffd640 1 -- 172.21.15.159:0/459847368 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7ff9bc042030 con 0x7ff9c4100a10 2024-09-19T06:47:04.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.624+0000 7ff9baffd640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9b00a33c0 0x7ff9b00a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:04.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.625+0000 7ff9c97a9640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9b00a33c0 0x7ff9b00a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:04.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.625+0000 7ff9baffd640 1 -- 172.21.15.159:0/459847368 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff9bc0f0660 con 0x7ff9c4100a10 2024-09-19T06:47:04.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.625+0000 7ff9c97a9640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9b00a33c0 0x7ff9b00a5880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4199370 tx=0x7ff9b400b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.628+0000 7ff9baffd640 1 -- 172.21.15.159:0/459847368 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9bc0bc9c0 con 0x7ff9c4100a10 2024-09-19T06:47:04.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.837+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9c41a0550 con 0x7ff9b00a33c0 2024-09-19T06:47:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-19T06:47:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: Unable to set osd_memory_target on smithi189 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-09-19T06:47:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T06:47:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T06:47:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:04.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.844+0000 7ff9baffd640 1 -- 172.21.15.159:0/459847368 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258093 (secure 0 0 0) 0x7ff9c41a0550 con 0x7ff9b00a33c0 2024-09-19T06:47:04.847 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:04.849 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:47:04.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9b00a33c0 msgr2=0x7ff9b00a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9b00a33c0 0x7ff9b00a5880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4199370 tx=0x7ff9b400b390 comp rx=0 tx=0).stop 2024-09-19T06:47:04.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 msgr2=0x7ff9c4197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:04.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 0x7ff9c4197e60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc031440 tx=0x7ff9bc032ce0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 shutdown_connections 2024-09-19T06:47:04.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9b00a33c0 0x7ff9b00a5880 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9c41025c0 0x7ff9c419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9c4101c00 0x7ff9c41983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 --2- 172.21.15.159:0/459847368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4100a10 0x7ff9c4197e60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:04.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 >> 172.21.15.159:0/459847368 conn(0x7ff9c40fc170 msgr2=0x7ff9c4069380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:04.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 shutdown_connections 2024-09-19T06:47:04.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:04.847+0000 7ff9cc20e640 1 -- 172.21.15.159:0/459847368 wait complete. 2024-09-19T06:47:04.860 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-19T06:47:04.860 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: Unable to set osd_memory_target on smithi189 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-09-19T06:47:04.860 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T06:47:04.860 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T06:47:04.860 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:04.860 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:04.860 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.860 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.861 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.861 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.861 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:04.861 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:04.862 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T06:47:04.553197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":426,"num_read_kb":368,"num_write":383,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372748,"kb_used_data":10972,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569076,"statfs":{"total":1151940427776,"available":1151558733824,"internally_reserved":0,"allocated":11235328,"data_stored":8716867,"data_compressed":286398,"data_compressed_allocated":385024,"data_compressed_original":3514368,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.993743"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596299+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:47:00.596299+0000","last_peered":"2024-09-19T06:47:00.596299+0000","last_clean":"2024-09-19T06:47:00.596299+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:47:00.596299+0000","last_undegraded":"2024-09-19T06:47:00.596299+0000","last_fullsized":"2024-09-19T06:47:00.596299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590995+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:47:00.590995+0000","last_peered":"2024-09-19T06:47:00.590995+0000","last_clean":"2024-09-19T06:47:00.590995+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:47:00.590995+0000","last_undegraded":"2024-09-19T06:47:00.590995+0000","last_fullsized":"2024-09-19T06:47:00.590995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595558+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:47:00.595558+0000","last_peered":"2024-09-19T06:47:00.595558+0000","last_clean":"2024-09-19T06:47:00.595558+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:47:00.595558+0000","last_undegraded":"2024-09-19T06:47:00.595558+0000","last_fullsized":"2024-09-19T06:47:00.595558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.575726+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:47:00.575726+0000","last_peered":"2024-09-19T06:47:00.575726+0000","last_clean":"2024-09-19T06:47:00.575726+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:47:00.575726+0000","last_undegraded":"2024-09-19T06:47:00.575726+0000","last_fullsized":"2024-09-19T06:47:00.575726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594145+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:47:00.594145+0000","last_peered":"2024-09-19T06:47:00.594145+0000","last_clean":"2024-09-19T06:47:00.594145+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:47:00.594145+0000","last_undegraded":"2024-09-19T06:47:00.594145+0000","last_fullsized":"2024-09-19T06:47:00.594145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592217+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:47:00.592217+0000","last_peered":"2024-09-19T06:47:00.592217+0000","last_clean":"2024-09-19T06:47:00.592217+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:47:00.592217+0000","last_undegraded":"2024-09-19T06:47:00.592217+0000","last_fullsized":"2024-09-19T06:47:00.592217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581506+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:47:00.581506+0000","last_peered":"2024-09-19T06:47:00.581506+0000","last_clean":"2024-09-19T06:47:00.581506+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:47:00.581506+0000","last_undegraded":"2024-09-19T06:47:00.581506+0000","last_fullsized":"2024-09-19T06:47:00.581506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594128+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:47:00.594128+0000","last_peered":"2024-09-19T06:47:00.594128+0000","last_clean":"2024-09-19T06:47:00.594128+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:47:00.594128+0000","last_undegraded":"2024-09-19T06:47:00.594128+0000","last_fullsized":"2024-09-19T06:47:00.594128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587594+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:47:00.587594+0000","last_peered":"2024-09-19T06:47:00.587594+0000","last_clean":"2024-09-19T06:47:00.587594+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:47:00.587594+0000","last_undegraded":"2024-09-19T06:47:00.587594+0000","last_fullsized":"2024-09-19T06:47:00.587594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585123+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:47:00.585123+0000","last_peered":"2024-09-19T06:47:00.585123+0000","last_clean":"2024-09-19T06:47:00.585123+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:47:00.585123+0000","last_undegraded":"2024-09-19T06:47:00.585123+0000","last_fullsized":"2024-09-19T06:47:00.585123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585680+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:47:00.585680+0000","last_peered":"2024-09-19T06:47:00.585680+0000","last_clean":"2024-09-19T06:47:00.585680+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:47:00.585680+0000","last_undegraded":"2024-09-19T06:47:00.585680+0000","last_fullsized":"2024-09-19T06:47:00.585680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580960+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:47:00.580960+0000","last_peered":"2024-09-19T06:47:00.580960+0000","last_clean":"2024-09-19T06:47:00.580960+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:47:00.580960+0000","last_undegraded":"2024-09-19T06:47:00.580960+0000","last_fullsized":"2024-09-19T06:47:00.580960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590511+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:47:00.590511+0000","last_peered":"2024-09-19T06:47:00.590511+0000","last_clean":"2024-09-19T06:47:00.590511+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:47:00.590511+0000","last_undegraded":"2024-09-19T06:47:00.590511+0000","last_fullsized":"2024-09-19T06:47:00.590511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594823+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:47:00.594823+0000","last_peered":"2024-09-19T06:47:00.594823+0000","last_clean":"2024-09-19T06:47:00.594823+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:47:00.594823+0000","last_undegraded":"2024-09-19T06:47:00.594823+0000","last_fullsized":"2024-09-19T06:47:00.594823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590707+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:47:00.590707+0000","last_peered":"2024-09-19T06:47:00.590707+0000","last_clean":"2024-09-19T06:47:00.590707+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:47:00.590707+0000","last_undegraded":"2024-09-19T06:47:00.590707+0000","last_fullsized":"2024-09-19T06:47:00.590707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595272+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:47:00.595272+0000","last_peered":"2024-09-19T06:47:00.595272+0000","last_clean":"2024-09-19T06:47:00.595272+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:47:00.595272+0000","last_undegraded":"2024-09-19T06:47:00.595272+0000","last_fullsized":"2024-09-19T06:47:00.595272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596210+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:47:00.596210+0000","last_peered":"2024-09-19T06:47:00.596210+0000","last_clean":"2024-09-19T06:47:00.596210+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:47:00.596210+0000","last_undegraded":"2024-09-19T06:47:00.596210+0000","last_fullsized":"2024-09-19T06:47:00.596210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585734+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:47:00.585734+0000","last_peered":"2024-09-19T06:47:00.585734+0000","last_clean":"2024-09-19T06:47:00.585734+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:47:00.585734+0000","last_undegraded":"2024-09-19T06:47:00.585734+0000","last_fullsized":"2024-09-19T06:47:00.585734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.578454+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:47:00.578454+0000","last_peered":"2024-09-19T06:47:00.578454+0000","last_clean":"2024-09-19T06:47:00.578454+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:47:00.578454+0000","last_undegraded":"2024-09-19T06:47:00.578454+0000","last_fullsized":"2024-09-19T06:47:00.578454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580253+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:47:00.580253+0000","last_peered":"2024-09-19T06:47:00.580253+0000","last_clean":"2024-09-19T06:47:00.580253+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:47:00.580253+0000","last_undegraded":"2024-09-19T06:47:00.580253+0000","last_fullsized":"2024-09-19T06:47:00.580253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595663+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:47:00.595663+0000","last_peered":"2024-09-19T06:47:00.595663+0000","last_clean":"2024-09-19T06:47:00.595663+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:47:00.595663+0000","last_undegraded":"2024-09-19T06:47:00.595663+0000","last_fullsized":"2024-09-19T06:47:00.595663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586577+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:47:00.586577+0000","last_peered":"2024-09-19T06:47:00.586577+0000","last_clean":"2024-09-19T06:47:00.586577+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:47:00.586577+0000","last_undegraded":"2024-09-19T06:47:00.586577+0000","last_fullsized":"2024-09-19T06:47:00.586577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589497+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:47:00.589497+0000","last_peered":"2024-09-19T06:47:00.589497+0000","last_clean":"2024-09-19T06:47:00.589497+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:47:00.589497+0000","last_undegraded":"2024-09-19T06:47:00.589497+0000","last_fullsized":"2024-09-19T06:47:00.589497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586950+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:47:00.586950+0000","last_peered":"2024-09-19T06:47:00.586950+0000","last_clean":"2024-09-19T06:47:00.586950+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:47:00.586950+0000","last_undegraded":"2024-09-19T06:47:00.586950+0000","last_fullsized":"2024-09-19T06:47:00.586950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584482+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:47:00.584482+0000","last_peered":"2024-09-19T06:47:00.584482+0000","last_clean":"2024-09-19T06:47:00.584482+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:47:00.584482+0000","last_undegraded":"2024-09-19T06:47:00.584482+0000","last_fullsized":"2024-09-19T06:47:00.584482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.576867+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:47:00.576867+0000","last_peered":"2024-09-19T06:47:00.576867+0000","last_clean":"2024-09-19T06:47:00.576867+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:47:00.576867+0000","last_undegraded":"2024-09-19T06:47:00.576867+0000","last_fullsized":"2024-09-19T06:47:00.576867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582332+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:47:00.582332+0000","last_peered":"2024-09-19T06:47:00.582332+0000","last_clean":"2024-09-19T06:47:00.582332+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:47:00.582332+0000","last_undegraded":"2024-09-19T06:47:00.582332+0000","last_fullsized":"2024-09-19T06:47:00.582332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594980+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:47:00.594980+0000","last_peered":"2024-09-19T06:47:00.594980+0000","last_clean":"2024-09-19T06:47:00.594980+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:47:00.594980+0000","last_undegraded":"2024-09-19T06:47:00.594980+0000","last_fullsized":"2024-09-19T06:47:00.594980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596274+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:47:00.596274+0000","last_peered":"2024-09-19T06:47:00.596274+0000","last_clean":"2024-09-19T06:47:00.596274+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:47:00.596274+0000","last_undegraded":"2024-09-19T06:47:00.596274+0000","last_fullsized":"2024-09-19T06:47:00.596274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583987+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:47:00.583987+0000","last_peered":"2024-09-19T06:47:00.583987+0000","last_clean":"2024-09-19T06:47:00.583987+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:47:00.583987+0000","last_undegraded":"2024-09-19T06:47:00.583987+0000","last_fullsized":"2024-09-19T06:47:00.583987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577783+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:47:00.577783+0000","last_peered":"2024-09-19T06:47:00.577783+0000","last_clean":"2024-09-19T06:47:00.577783+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:47:00.577783+0000","last_undegraded":"2024-09-19T06:47:00.577783+0000","last_fullsized":"2024-09-19T06:47:00.577783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583197+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:47:00.583197+0000","last_peered":"2024-09-19T06:47:00.583197+0000","last_clean":"2024-09-19T06:47:00.583197+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:47:00.583197+0000","last_undegraded":"2024-09-19T06:47:00.583197+0000","last_fullsized":"2024-09-19T06:47:00.583197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587636+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:47:00.587636+0000","last_peered":"2024-09-19T06:47:00.587636+0000","last_clean":"2024-09-19T06:47:00.587636+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:47:00.587636+0000","last_undegraded":"2024-09-19T06:47:00.587636+0000","last_fullsized":"2024-09-19T06:47:00.587636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537764+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:47:00.537764+0000","last_peered":"2024-09-19T06:47:00.537764+0000","last_clean":"2024-09-19T06:47:00.537764+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:47:00.537764+0000","last_undegraded":"2024-09-19T06:47:00.537764+0000","last_fullsized":"2024-09-19T06:47:00.537764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594590+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:47:00.594590+0000","last_peered":"2024-09-19T06:47:00.594590+0000","last_clean":"2024-09-19T06:47:00.594590+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:47:00.594590+0000","last_undegraded":"2024-09-19T06:47:00.594590+0000","last_fullsized":"2024-09-19T06:47:00.594590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544151+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:47:00.544151+0000","last_peered":"2024-09-19T06:47:00.544151+0000","last_clean":"2024-09-19T06:47:00.544151+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:47:00.544151+0000","last_undegraded":"2024-09-19T06:47:00.544151+0000","last_fullsized":"2024-09-19T06:47:00.544151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536382+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:47:00.536382+0000","last_peered":"2024-09-19T06:47:00.536382+0000","last_clean":"2024-09-19T06:47:00.536382+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:47:00.536382+0000","last_undegraded":"2024-09-19T06:47:00.536382+0000","last_fullsized":"2024-09-19T06:47:00.536382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589344+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:47:00.589344+0000","last_peered":"2024-09-19T06:47:00.589344+0000","last_clean":"2024-09-19T06:47:00.589344+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:47:00.589344+0000","last_undegraded":"2024-09-19T06:47:00.589344+0000","last_fullsized":"2024-09-19T06:47:00.589344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.538035+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:47:00.538035+0000","last_peered":"2024-09-19T06:47:00.538035+0000","last_clean":"2024-09-19T06:47:00.538035+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:47:00.538035+0000","last_undegraded":"2024-09-19T06:47:00.538035+0000","last_fullsized":"2024-09-19T06:47:00.538035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592761+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:47:00.592761+0000","last_peered":"2024-09-19T06:47:00.592761+0000","last_clean":"2024-09-19T06:47:00.592761+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:47:00.592761+0000","last_undegraded":"2024-09-19T06:47:00.592761+0000","last_fullsized":"2024-09-19T06:47:00.592761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544365+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:47:00.544365+0000","last_peered":"2024-09-19T06:47:00.544365+0000","last_clean":"2024-09-19T06:47:00.544365+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:47:00.544365+0000","last_undegraded":"2024-09-19T06:47:00.544365+0000","last_fullsized":"2024-09-19T06:47:00.544365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587810+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:47:00.587810+0000","last_peered":"2024-09-19T06:47:00.587810+0000","last_clean":"2024-09-19T06:47:00.587810+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:47:00.587810+0000","last_undegraded":"2024-09-19T06:47:00.587810+0000","last_fullsized":"2024-09-19T06:47:00.587810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.548844+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:47:00.548844+0000","last_peered":"2024-09-19T06:47:00.548844+0000","last_clean":"2024-09-19T06:47:00.548844+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:47:00.548844+0000","last_undegraded":"2024-09-19T06:47:00.548844+0000","last_fullsized":"2024-09-19T06:47:00.548844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595196+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:47:00.595196+0000","last_peered":"2024-09-19T06:47:00.595196+0000","last_clean":"2024-09-19T06:47:00.595196+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:47:00.595196+0000","last_undegraded":"2024-09-19T06:47:00.595196+0000","last_fullsized":"2024-09-19T06:47:00.595196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537912+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:47:00.537912+0000","last_peered":"2024-09-19T06:47:00.537912+0000","last_clean":"2024-09-19T06:47:00.537912+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:47:00.537912+0000","last_undegraded":"2024-09-19T06:47:00.537912+0000","last_fullsized":"2024-09-19T06:47:00.537912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582419+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:47:00.582419+0000","last_peered":"2024-09-19T06:47:00.582419+0000","last_clean":"2024-09-19T06:47:00.582419+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:47:00.582419+0000","last_undegraded":"2024-09-19T06:47:00.582419+0000","last_fullsized":"2024-09-19T06:47:00.582419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":250,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.958103+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:47:00.958103+0000","last_peered":"2024-09-19T06:47:00.958103+0000","last_clean":"2024-09-19T06:47:00.958103+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:47:00.958103+0000","last_undegraded":"2024-09-19T06:47:00.958103+0000","last_fullsized":"2024-09-19T06:47:00.958103+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":164,"num_write":34,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577030+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:47:00.577030+0000","last_peered":"2024-09-19T06:47:00.577030+0000","last_clean":"2024-09-19T06:47:00.577030+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:47:00.577030+0000","last_undegraded":"2024-09-19T06:47:00.577030+0000","last_fullsized":"2024-09-19T06:47:00.577030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.545877+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:47:00.545877+0000","last_peered":"2024-09-19T06:47:00.545877+0000","last_clean":"2024-09-19T06:47:00.545877+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:47:00.545877+0000","last_undegraded":"2024-09-19T06:47:00.545877+0000","last_fullsized":"2024-09-19T06:47:00.545877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589299+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:47:00.589299+0000","last_peered":"2024-09-19T06:47:00.589299+0000","last_clean":"2024-09-19T06:47:00.589299+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:47:00.589299+0000","last_undegraded":"2024-09-19T06:47:00.589299+0000","last_fullsized":"2024-09-19T06:47:00.589299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537682+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:47:00.537682+0000","last_peered":"2024-09-19T06:47:00.537682+0000","last_clean":"2024-09-19T06:47:00.537682+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:47:00.537682+0000","last_undegraded":"2024-09-19T06:47:00.537682+0000","last_fullsized":"2024-09-19T06:47:00.537682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584015+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:47:00.584015+0000","last_peered":"2024-09-19T06:47:00.584015+0000","last_clean":"2024-09-19T06:47:00.584015+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:47:00.584015+0000","last_undegraded":"2024-09-19T06:47:00.584015+0000","last_fullsized":"2024-09-19T06:47:00.584015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549262+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:47:00.549262+0000","last_peered":"2024-09-19T06:47:00.549262+0000","last_clean":"2024-09-19T06:47:00.549262+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:47:00.549262+0000","last_undegraded":"2024-09-19T06:47:00.549262+0000","last_fullsized":"2024-09-19T06:47:00.549262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584090+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:47:00.584090+0000","last_peered":"2024-09-19T06:47:00.584090+0000","last_clean":"2024-09-19T06:47:00.584090+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:47:00.584090+0000","last_undegraded":"2024-09-19T06:47:00.584090+0000","last_fullsized":"2024-09-19T06:47:00.584090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.550930+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:47:00.550930+0000","last_peered":"2024-09-19T06:47:00.550930+0000","last_clean":"2024-09-19T06:47:00.550930+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:47:00.550930+0000","last_undegraded":"2024-09-19T06:47:00.550930+0000","last_fullsized":"2024-09-19T06:47:00.550930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580495+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:47:00.580495+0000","last_peered":"2024-09-19T06:47:00.580495+0000","last_clean":"2024-09-19T06:47:00.580495+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:47:00.580495+0000","last_undegraded":"2024-09-19T06:47:00.580495+0000","last_fullsized":"2024-09-19T06:47:00.580495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560644+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:47:00.560644+0000","last_peered":"2024-09-19T06:47:00.560644+0000","last_clean":"2024-09-19T06:47:00.560644+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:47:00.560644+0000","last_undegraded":"2024-09-19T06:47:00.560644+0000","last_fullsized":"2024-09-19T06:47:00.560644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581982+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:47:00.581982+0000","last_peered":"2024-09-19T06:47:00.581982+0000","last_clean":"2024-09-19T06:47:00.581982+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:47:00.581982+0000","last_undegraded":"2024-09-19T06:47:00.581982+0000","last_fullsized":"2024-09-19T06:47:00.581982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536735+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:47:00.536735+0000","last_peered":"2024-09-19T06:47:00.536735+0000","last_clean":"2024-09-19T06:47:00.536735+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:47:00.536735+0000","last_undegraded":"2024-09-19T06:47:00.536735+0000","last_fullsized":"2024-09-19T06:47:00.536735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579492+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:47:00.579492+0000","last_peered":"2024-09-19T06:47:00.579492+0000","last_clean":"2024-09-19T06:47:00.579492+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:47:00.579492+0000","last_undegraded":"2024-09-19T06:47:00.579492+0000","last_fullsized":"2024-09-19T06:47:00.579492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'39","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.770707+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:47:00.770707+0000","last_peered":"2024-09-19T06:47:00.770707+0000","last_clean":"2024-09-19T06:47:00.770707+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:47:00.770707+0000","last_undegraded":"2024-09-19T06:47:00.770707+0000","last_fullsized":"2024-09-19T06:47:00.770707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594237+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:47:00.594237+0000","last_peered":"2024-09-19T06:47:00.594237+0000","last_clean":"2024-09-19T06:47:00.594237+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:47:00.594237+0000","last_undegraded":"2024-09-19T06:47:00.594237+0000","last_fullsized":"2024-09-19T06:47:00.594237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.546255+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:47:00.546255+0000","last_peered":"2024-09-19T06:47:00.546255+0000","last_clean":"2024-09-19T06:47:00.546255+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:47:00.546255+0000","last_undegraded":"2024-09-19T06:47:00.546255+0000","last_fullsized":"2024-09-19T06:47:00.546255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585679+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:47:00.585679+0000","last_peered":"2024-09-19T06:47:00.585679+0000","last_clean":"2024-09-19T06:47:00.585679+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:47:00.585679+0000","last_undegraded":"2024-09-19T06:47:00.585679+0000","last_fullsized":"2024-09-19T06:47:00.585679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":349,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549300+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:47:00.549300+0000","last_peered":"2024-09-19T06:47:00.549300+0000","last_clean":"2024-09-19T06:47:00.549300+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:47:00.549300+0000","last_undegraded":"2024-09-19T06:47:00.549300+0000","last_fullsized":"2024-09-19T06:47:00.549300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549180+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:47:00.549180+0000","last_peered":"2024-09-19T06:47:00.549180+0000","last_clean":"2024-09-19T06:47:00.549180+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:47:00.549180+0000","last_undegraded":"2024-09-19T06:47:00.549180+0000","last_fullsized":"2024-09-19T06:47:00.549180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593914+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:47:00.593914+0000","last_peered":"2024-09-19T06:47:00.593914+0000","last_clean":"2024-09-19T06:47:00.593914+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:47:00.593914+0000","last_undegraded":"2024-09-19T06:47:00.593914+0000","last_fullsized":"2024-09-19T06:47:00.593914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549165+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:47:00.549165+0000","last_peered":"2024-09-19T06:47:00.549165+0000","last_clean":"2024-09-19T06:47:00.549165+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:47:00.549165+0000","last_undegraded":"2024-09-19T06:47:00.549165+0000","last_fullsized":"2024-09-19T06:47:00.549165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577578+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:47:00.577578+0000","last_peered":"2024-09-19T06:47:00.577578+0000","last_clean":"2024-09-19T06:47:00.577578+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:47:00.577578+0000","last_undegraded":"2024-09-19T06:47:00.577578+0000","last_fullsized":"2024-09-19T06:47:00.577578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536478+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:47:00.536478+0000","last_peered":"2024-09-19T06:47:00.536478+0000","last_clean":"2024-09-19T06:47:00.536478+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:47:00.536478+0000","last_undegraded":"2024-09-19T06:47:00.536478+0000","last_fullsized":"2024-09-19T06:47:00.536478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579472+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:47:00.579472+0000","last_peered":"2024-09-19T06:47:00.579472+0000","last_clean":"2024-09-19T06:47:00.579472+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:47:00.579472+0000","last_undegraded":"2024-09-19T06:47:00.579472+0000","last_fullsized":"2024-09-19T06:47:00.579472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549300+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:47:00.549300+0000","last_peered":"2024-09-19T06:47:00.549300+0000","last_clean":"2024-09-19T06:47:00.549300+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:47:00.549300+0000","last_undegraded":"2024-09-19T06:47:00.549300+0000","last_fullsized":"2024-09-19T06:47:00.549300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579645+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:47:00.579645+0000","last_peered":"2024-09-19T06:47:00.579645+0000","last_clean":"2024-09-19T06:47:00.579645+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:47:00.579645+0000","last_undegraded":"2024-09-19T06:47:00.579645+0000","last_fullsized":"2024-09-19T06:47:00.579645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556514+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:47:00.556514+0000","last_peered":"2024-09-19T06:47:00.556514+0000","last_clean":"2024-09-19T06:47:00.556514+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:47:00.556514+0000","last_undegraded":"2024-09-19T06:47:00.556514+0000","last_fullsized":"2024-09-19T06:47:00.556514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587136+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:47:00.587136+0000","last_peered":"2024-09-19T06:47:00.587136+0000","last_clean":"2024-09-19T06:47:00.587136+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:47:00.587136+0000","last_undegraded":"2024-09-19T06:47:00.587136+0000","last_fullsized":"2024-09-19T06:47:00.587136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552471+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:47:00.552471+0000","last_peered":"2024-09-19T06:47:00.552471+0000","last_clean":"2024-09-19T06:47:00.552471+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:47:00.552471+0000","last_undegraded":"2024-09-19T06:47:00.552471+0000","last_fullsized":"2024-09-19T06:47:00.552471+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579287+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:47:00.579287+0000","last_peered":"2024-09-19T06:47:00.579287+0000","last_clean":"2024-09-19T06:47:00.579287+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:47:00.579287+0000","last_undegraded":"2024-09-19T06:47:00.579287+0000","last_fullsized":"2024-09-19T06:47:00.579287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'44","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.780520+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:47:00.780520+0000","last_peered":"2024-09-19T06:47:00.780520+0000","last_clean":"2024-09-19T06:47:00.780520+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:47:00.780520+0000","last_undegraded":"2024-09-19T06:47:00.780520+0000","last_fullsized":"2024-09-19T06:47:00.780520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":80,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593306+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:47:00.593306+0000","last_peered":"2024-09-19T06:47:00.593306+0000","last_clean":"2024-09-19T06:47:00.593306+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:47:00.593306+0000","last_undegraded":"2024-09-19T06:47:00.593306+0000","last_fullsized":"2024-09-19T06:47:00.593306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549571+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:47:00.549571+0000","last_peered":"2024-09-19T06:47:00.549571+0000","last_clean":"2024-09-19T06:47:00.549571+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:47:00.549571+0000","last_undegraded":"2024-09-19T06:47:00.549571+0000","last_fullsized":"2024-09-19T06:47:00.549571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596329+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:47:00.596329+0000","last_peered":"2024-09-19T06:47:00.596329+0000","last_clean":"2024-09-19T06:47:00.596329+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:47:00.596329+0000","last_undegraded":"2024-09-19T06:47:00.596329+0000","last_fullsized":"2024-09-19T06:47:00.596329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536872+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:47:00.536872+0000","last_peered":"2024-09-19T06:47:00.536872+0000","last_clean":"2024-09-19T06:47:00.536872+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:47:00.536872+0000","last_undegraded":"2024-09-19T06:47:00.536872+0000","last_fullsized":"2024-09-19T06:47:00.536872+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.573059+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:47:00.573059+0000","last_peered":"2024-09-19T06:47:00.573059+0000","last_clean":"2024-09-19T06:47:00.573059+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:47:00.573059+0000","last_undegraded":"2024-09-19T06:47:00.573059+0000","last_fullsized":"2024-09-19T06:47:00.573059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.551180+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:47:00.551180+0000","last_peered":"2024-09-19T06:47:00.551180+0000","last_clean":"2024-09-19T06:47:00.551180+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:47:00.551180+0000","last_undegraded":"2024-09-19T06:47:00.551180+0000","last_fullsized":"2024-09-19T06:47:00.551180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595812+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:47:00.595812+0000","last_peered":"2024-09-19T06:47:00.595812+0000","last_clean":"2024-09-19T06:47:00.595812+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:47:00.595812+0000","last_undegraded":"2024-09-19T06:47:00.595812+0000","last_fullsized":"2024-09-19T06:47:00.595812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.555196+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:47:00.555196+0000","last_peered":"2024-09-19T06:47:00.555196+0000","last_clean":"2024-09-19T06:47:00.555196+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:47:00.555196+0000","last_undegraded":"2024-09-19T06:47:00.555196+0000","last_fullsized":"2024-09-19T06:47:00.555196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.597003+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:47:00.597003+0000","last_peered":"2024-09-19T06:47:00.597003+0000","last_clean":"2024-09-19T06:47:00.597003+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:47:00.597003+0000","last_undegraded":"2024-09-19T06:47:00.597003+0000","last_fullsized":"2024-09-19T06:47:00.597003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560958+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:47:00.560958+0000","last_peered":"2024-09-19T06:47:00.560958+0000","last_clean":"2024-09-19T06:47:00.560958+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:47:00.560958+0000","last_undegraded":"2024-09-19T06:47:00.560958+0000","last_fullsized":"2024-09-19T06:47:00.560958+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585140+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:47:00.585140+0000","last_peered":"2024-09-19T06:47:00.585140+0000","last_clean":"2024-09-19T06:47:00.585140+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:47:00.585140+0000","last_undegraded":"2024-09-19T06:47:00.585140+0000","last_fullsized":"2024-09-19T06:47:00.585140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587229+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:47:00.587229+0000","last_peered":"2024-09-19T06:47:00.587229+0000","last_clean":"2024-09-19T06:47:00.587229+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:47:00.587229+0000","last_undegraded":"2024-09-19T06:47:00.587229+0000","last_fullsized":"2024-09-19T06:47:00.587229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556945+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:47:00.556945+0000","last_peered":"2024-09-19T06:47:00.556945+0000","last_clean":"2024-09-19T06:47:00.556945+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:47:00.556945+0000","last_undegraded":"2024-09-19T06:47:00.556945+0000","last_fullsized":"2024-09-19T06:47:00.556945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587670+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:47:00.587670+0000","last_peered":"2024-09-19T06:47:00.587670+0000","last_clean":"2024-09-19T06:47:00.587670+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:47:00.587670+0000","last_undegraded":"2024-09-19T06:47:00.587670+0000","last_fullsized":"2024-09-19T06:47:00.587670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552359+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:47:00.552359+0000","last_peered":"2024-09-19T06:47:00.552359+0000","last_clean":"2024-09-19T06:47:00.552359+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:47:00.552359+0000","last_undegraded":"2024-09-19T06:47:00.552359+0000","last_fullsized":"2024-09-19T06:47:00.552359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596914+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:47:00.596914+0000","last_peered":"2024-09-19T06:47:00.596914+0000","last_clean":"2024-09-19T06:47:00.596914+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:47:00.596914+0000","last_undegraded":"2024-09-19T06:47:00.596914+0000","last_fullsized":"2024-09-19T06:47:00.596914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552705+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:47:00.552705+0000","last_peered":"2024-09-19T06:47:00.552705+0000","last_clean":"2024-09-19T06:47:00.552705+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:47:00.552705+0000","last_undegraded":"2024-09-19T06:47:00.552705+0000","last_fullsized":"2024-09-19T06:47:00.552705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592794+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:47:00.592794+0000","last_peered":"2024-09-19T06:47:00.592794+0000","last_clean":"2024-09-19T06:47:00.592794+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:47:00.592794+0000","last_undegraded":"2024-09-19T06:47:00.592794+0000","last_fullsized":"2024-09-19T06:47:00.592794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556333+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:47:00.556333+0000","last_peered":"2024-09-19T06:47:00.556333+0000","last_clean":"2024-09-19T06:47:00.556333+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:47:00.556333+0000","last_undegraded":"2024-09-19T06:47:00.556333+0000","last_fullsized":"2024-09-19T06:47:00.556333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":290,"num_read_kb":249,"num_write":200,"num_write_kb":1405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1785447,"data_compressed":81345,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107385,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612640,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":441000,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841573,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":1100428,"data_compressed":46260,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005099,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":834798,"data_compressed":27798,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234031,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":834820,"data_compressed":27798,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1032067,"data_compressed":44447,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626488,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":441117,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855422,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":974848,"data_stored":1163267,"data_compressed":50603,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441022,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":966154,"data_compressed":33954,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476814,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":510569,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":962560,"data_stored":510535,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441090,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":69535,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69569,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":524920,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":131782,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":201329,"data_compressed":7969,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:47:04.866 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T06:47:04.866 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:47:04.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: Unable to set osd_memory_target on smithi189 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:05.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.009+0000 7f032d942640 1 -- 172.21.15.159:0/1439550088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328107ac0 msgr2=0x7f0328107ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:05.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.009+0000 7f032d942640 1 --2- 172.21.15.159:0/1439550088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328107ac0 0x7f0328107ea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0318009930 tx=0x7f031802a420 comp rx=0 tx=0).stop 2024-09-19T06:47:05.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.009+0000 7f032d942640 1 -- 172.21.15.159:0/1439550088 shutdown_connections 2024-09-19T06:47:05.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.009+0000 7f032d942640 1 --2- 172.21.15.159:0/1439550088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0328102450 0x7f032810e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.009+0000 7f032d942640 1 --2- 172.21.15.159:0/1439550088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0328101ab0 0x7f0328101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.009+0000 7f032d942640 1 --2- 172.21.15.159:0/1439550088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328107ac0 0x7f0328107ea0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.009+0000 7f032d942640 1 -- 172.21.15.159:0/1439550088 >> 172.21.15.159:0/1439550088 conn(0x7f03280fd7d0 msgr2=0x7f03280ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:05.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.009+0000 7f032d942640 1 -- 172.21.15.159:0/1439550088 shutdown_connections 2024-09-19T06:47:05.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.009+0000 7f032d942640 1 -- 172.21.15.159:0/1439550088 wait complete. 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.010+0000 7f032d942640 1 Processor -- start 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.010+0000 7f032d942640 1 -- start start 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f032d942640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0328101ab0 0x7f0328198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f032d942640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328102450 0x7f0328198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f032d942640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0328107ac0 0x7f032819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f032d942640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0328111f00 con 0x7f0328102450 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f032d942640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0328111d80 con 0x7f0328107ac0 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f032d942640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0328112080 con 0x7f0328101ab0 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03267fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328102450 0x7f0328198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03267fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328102450 0x7f0328198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57372/0 (socket says 172.21.15.159:57372) 2024-09-19T06:47:05.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03267fc640 1 -- 172.21.15.159:0/1128495158 learned_addr learned my addr 172.21.15.159:0/1128495158 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03277fe640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0328107ac0 0x7f032819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f0326ffd640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0328101ab0 0x7f0328198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03267fc640 1 -- 172.21.15.159:0/1128495158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0328101ab0 msgr2=0x7f0328198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03267fc640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0328101ab0 0x7f0328198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03267fc640 1 -- 172.21.15.159:0/1128495158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0328107ac0 msgr2=0x7f032819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03267fc640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0328107ac0 0x7f032819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03267fc640 1 -- 172.21.15.159:0/1128495158 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032819d440 con 0x7f0328102450 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03277fe640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0328107ac0 0x7f032819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f0326ffd640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0328101ab0 0x7f0328198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f03267fc640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328102450 0x7f0328198990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f031c00e9f0 tx=0x7f031c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f032c940640 1 -- 172.21.15.159:0/1128495158 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c00cd80 con 0x7f0328102450 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.011+0000 7f032c940640 1 -- 172.21.15.159:0/1128495158 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f031c005500 con 0x7f0328102450 2024-09-19T06:47:05.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.012+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032819d730 con 0x7f0328102450 2024-09-19T06:47:05.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.012+0000 7f032c940640 1 -- 172.21.15.159:0/1128495158 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c010690 con 0x7f0328102450 2024-09-19T06:47:05.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.012+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03281a4fc0 con 0x7f0328102450 2024-09-19T06:47:05.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.013+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0328101f10 con 0x7f0328102450 2024-09-19T06:47:05.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.014+0000 7f032c940640 1 -- 172.21.15.159:0/1128495158 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7f031c0046c0 con 0x7f0328102450 2024-09-19T06:47:05.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.015+0000 7f032c940640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f03100a3440 0x7f03100a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:05.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.015+0000 7f0326ffd640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f03100a3440 0x7f03100a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:05.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.015+0000 7f032c940640 1 -- 172.21.15.159:0/1128495158 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f031c0d0330 con 0x7f0328102450 2024-09-19T06:47:05.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.016+0000 7f0326ffd640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f03100a3440 0x7f03100a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0318000c00 tx=0x7f0318005a20 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:05.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.019+0000 7f032c940640 1 -- 172.21.15.159:0/1128495158 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f031c054210 con 0x7f0328102450 2024-09-19T06:47:05.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.199+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0328062630 con 0x7f03100a3440 2024-09-19T06:47:05.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.206+0000 7f032c940640 1 -- 172.21.15.159:0/1128495158 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258093 (secure 0 0 0) 0x7f0328062630 con 0x7f03100a3440 2024-09-19T06:47:05.209 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:05.211 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:47:05.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f03100a3440 msgr2=0x7f03100a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:05.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f03100a3440 0x7f03100a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0318000c00 tx=0x7f0318005a20 comp rx=0 tx=0).stop 2024-09-19T06:47:05.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328102450 msgr2=0x7f0328198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:05.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328102450 0x7f0328198990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f031c00e9f0 tx=0x7f031c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 shutdown_connections 2024-09-19T06:47:05.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f03100a3440 0x7f03100a5900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0328107ac0 0x7f032819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0328102450 0x7f0328198990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 --2- 172.21.15.159:0/1128495158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0328101ab0 0x7f0328198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:05.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.209+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 >> 172.21.15.159:0/1128495158 conn(0x7f03280fd7d0 msgr2=0x7f03280fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:05.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.210+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 shutdown_connections 2024-09-19T06:47:05.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:05.210+0000 7f032d942640 1 -- 172.21.15.159:0/1128495158 wait complete. 2024-09-19T06:47:05.223 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T06:47:04.553197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":426,"num_read_kb":368,"num_write":383,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372748,"kb_used_data":10972,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569076,"statfs":{"total":1151940427776,"available":1151558733824,"internally_reserved":0,"allocated":11235328,"data_stored":8716867,"data_compressed":286398,"data_compressed_allocated":385024,"data_compressed_original":3514368,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.993743"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596299+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:47:00.596299+0000","last_peered":"2024-09-19T06:47:00.596299+0000","last_clean":"2024-09-19T06:47:00.596299+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:47:00.596299+0000","last_undegraded":"2024-09-19T06:47:00.596299+0000","last_fullsized":"2024-09-19T06:47:00.596299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590995+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:47:00.590995+0000","last_peered":"2024-09-19T06:47:00.590995+0000","last_clean":"2024-09-19T06:47:00.590995+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:47:00.590995+0000","last_undegraded":"2024-09-19T06:47:00.590995+0000","last_fullsized":"2024-09-19T06:47:00.590995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595558+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:47:00.595558+0000","last_peered":"2024-09-19T06:47:00.595558+0000","last_clean":"2024-09-19T06:47:00.595558+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:47:00.595558+0000","last_undegraded":"2024-09-19T06:47:00.595558+0000","last_fullsized":"2024-09-19T06:47:00.595558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.575726+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:47:00.575726+0000","last_peered":"2024-09-19T06:47:00.575726+0000","last_clean":"2024-09-19T06:47:00.575726+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:47:00.575726+0000","last_undegraded":"2024-09-19T06:47:00.575726+0000","last_fullsized":"2024-09-19T06:47:00.575726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594145+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:47:00.594145+0000","last_peered":"2024-09-19T06:47:00.594145+0000","last_clean":"2024-09-19T06:47:00.594145+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:47:00.594145+0000","last_undegraded":"2024-09-19T06:47:00.594145+0000","last_fullsized":"2024-09-19T06:47:00.594145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592217+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:47:00.592217+0000","last_peered":"2024-09-19T06:47:00.592217+0000","last_clean":"2024-09-19T06:47:00.592217+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:47:00.592217+0000","last_undegraded":"2024-09-19T06:47:00.592217+0000","last_fullsized":"2024-09-19T06:47:00.592217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581506+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:47:00.581506+0000","last_peered":"2024-09-19T06:47:00.581506+0000","last_clean":"2024-09-19T06:47:00.581506+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:47:00.581506+0000","last_undegraded":"2024-09-19T06:47:00.581506+0000","last_fullsized":"2024-09-19T06:47:00.581506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594128+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:47:00.594128+0000","last_peered":"2024-09-19T06:47:00.594128+0000","last_clean":"2024-09-19T06:47:00.594128+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:47:00.594128+0000","last_undegraded":"2024-09-19T06:47:00.594128+0000","last_fullsized":"2024-09-19T06:47:00.594128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587594+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:47:00.587594+0000","last_peered":"2024-09-19T06:47:00.587594+0000","last_clean":"2024-09-19T06:47:00.587594+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:47:00.587594+0000","last_undegraded":"2024-09-19T06:47:00.587594+0000","last_fullsized":"2024-09-19T06:47:00.587594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585123+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:47:00.585123+0000","last_peered":"2024-09-19T06:47:00.585123+0000","last_clean":"2024-09-19T06:47:00.585123+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:47:00.585123+0000","last_undegraded":"2024-09-19T06:47:00.585123+0000","last_fullsized":"2024-09-19T06:47:00.585123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585680+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:47:00.585680+0000","last_peered":"2024-09-19T06:47:00.585680+0000","last_clean":"2024-09-19T06:47:00.585680+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:47:00.585680+0000","last_undegraded":"2024-09-19T06:47:00.585680+0000","last_fullsized":"2024-09-19T06:47:00.585680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580960+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:47:00.580960+0000","last_peered":"2024-09-19T06:47:00.580960+0000","last_clean":"2024-09-19T06:47:00.580960+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:47:00.580960+0000","last_undegraded":"2024-09-19T06:47:00.580960+0000","last_fullsized":"2024-09-19T06:47:00.580960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590511+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:47:00.590511+0000","last_peered":"2024-09-19T06:47:00.590511+0000","last_clean":"2024-09-19T06:47:00.590511+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:47:00.590511+0000","last_undegraded":"2024-09-19T06:47:00.590511+0000","last_fullsized":"2024-09-19T06:47:00.590511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594823+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:47:00.594823+0000","last_peered":"2024-09-19T06:47:00.594823+0000","last_clean":"2024-09-19T06:47:00.594823+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:47:00.594823+0000","last_undegraded":"2024-09-19T06:47:00.594823+0000","last_fullsized":"2024-09-19T06:47:00.594823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590707+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:47:00.590707+0000","last_peered":"2024-09-19T06:47:00.590707+0000","last_clean":"2024-09-19T06:47:00.590707+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:47:00.590707+0000","last_undegraded":"2024-09-19T06:47:00.590707+0000","last_fullsized":"2024-09-19T06:47:00.590707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595272+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:47:00.595272+0000","last_peered":"2024-09-19T06:47:00.595272+0000","last_clean":"2024-09-19T06:47:00.595272+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:47:00.595272+0000","last_undegraded":"2024-09-19T06:47:00.595272+0000","last_fullsized":"2024-09-19T06:47:00.595272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596210+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:47:00.596210+0000","last_peered":"2024-09-19T06:47:00.596210+0000","last_clean":"2024-09-19T06:47:00.596210+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:47:00.596210+0000","last_undegraded":"2024-09-19T06:47:00.596210+0000","last_fullsized":"2024-09-19T06:47:00.596210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585734+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:47:00.585734+0000","last_peered":"2024-09-19T06:47:00.585734+0000","last_clean":"2024-09-19T06:47:00.585734+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:47:00.585734+0000","last_undegraded":"2024-09-19T06:47:00.585734+0000","last_fullsized":"2024-09-19T06:47:00.585734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.578454+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:47:00.578454+0000","last_peered":"2024-09-19T06:47:00.578454+0000","last_clean":"2024-09-19T06:47:00.578454+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:47:00.578454+0000","last_undegraded":"2024-09-19T06:47:00.578454+0000","last_fullsized":"2024-09-19T06:47:00.578454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580253+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:47:00.580253+0000","last_peered":"2024-09-19T06:47:00.580253+0000","last_clean":"2024-09-19T06:47:00.580253+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:47:00.580253+0000","last_undegraded":"2024-09-19T06:47:00.580253+0000","last_fullsized":"2024-09-19T06:47:00.580253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595663+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:47:00.595663+0000","last_peered":"2024-09-19T06:47:00.595663+0000","last_clean":"2024-09-19T06:47:00.595663+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:47:00.595663+0000","last_undegraded":"2024-09-19T06:47:00.595663+0000","last_fullsized":"2024-09-19T06:47:00.595663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586577+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:47:00.586577+0000","last_peered":"2024-09-19T06:47:00.586577+0000","last_clean":"2024-09-19T06:47:00.586577+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:47:00.586577+0000","last_undegraded":"2024-09-19T06:47:00.586577+0000","last_fullsized":"2024-09-19T06:47:00.586577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589497+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:47:00.589497+0000","last_peered":"2024-09-19T06:47:00.589497+0000","last_clean":"2024-09-19T06:47:00.589497+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:47:00.589497+0000","last_undegraded":"2024-09-19T06:47:00.589497+0000","last_fullsized":"2024-09-19T06:47:00.589497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586950+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:47:00.586950+0000","last_peered":"2024-09-19T06:47:00.586950+0000","last_clean":"2024-09-19T06:47:00.586950+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:47:00.586950+0000","last_undegraded":"2024-09-19T06:47:00.586950+0000","last_fullsized":"2024-09-19T06:47:00.586950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584482+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:47:00.584482+0000","last_peered":"2024-09-19T06:47:00.584482+0000","last_clean":"2024-09-19T06:47:00.584482+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:47:00.584482+0000","last_undegraded":"2024-09-19T06:47:00.584482+0000","last_fullsized":"2024-09-19T06:47:00.584482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.576867+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:47:00.576867+0000","last_peered":"2024-09-19T06:47:00.576867+0000","last_clean":"2024-09-19T06:47:00.576867+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:47:00.576867+0000","last_undegraded":"2024-09-19T06:47:00.576867+0000","last_fullsized":"2024-09-19T06:47:00.576867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582332+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:47:00.582332+0000","last_peered":"2024-09-19T06:47:00.582332+0000","last_clean":"2024-09-19T06:47:00.582332+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:47:00.582332+0000","last_undegraded":"2024-09-19T06:47:00.582332+0000","last_fullsized":"2024-09-19T06:47:00.582332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594980+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:47:00.594980+0000","last_peered":"2024-09-19T06:47:00.594980+0000","last_clean":"2024-09-19T06:47:00.594980+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:47:00.594980+0000","last_undegraded":"2024-09-19T06:47:00.594980+0000","last_fullsized":"2024-09-19T06:47:00.594980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596274+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:47:00.596274+0000","last_peered":"2024-09-19T06:47:00.596274+0000","last_clean":"2024-09-19T06:47:00.596274+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:47:00.596274+0000","last_undegraded":"2024-09-19T06:47:00.596274+0000","last_fullsized":"2024-09-19T06:47:00.596274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583987+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:47:00.583987+0000","last_peered":"2024-09-19T06:47:00.583987+0000","last_clean":"2024-09-19T06:47:00.583987+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:47:00.583987+0000","last_undegraded":"2024-09-19T06:47:00.583987+0000","last_fullsized":"2024-09-19T06:47:00.583987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577783+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:47:00.577783+0000","last_peered":"2024-09-19T06:47:00.577783+0000","last_clean":"2024-09-19T06:47:00.577783+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:47:00.577783+0000","last_undegraded":"2024-09-19T06:47:00.577783+0000","last_fullsized":"2024-09-19T06:47:00.577783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583197+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:47:00.583197+0000","last_peered":"2024-09-19T06:47:00.583197+0000","last_clean":"2024-09-19T06:47:00.583197+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:47:00.583197+0000","last_undegraded":"2024-09-19T06:47:00.583197+0000","last_fullsized":"2024-09-19T06:47:00.583197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587636+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:47:00.587636+0000","last_peered":"2024-09-19T06:47:00.587636+0000","last_clean":"2024-09-19T06:47:00.587636+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:47:00.587636+0000","last_undegraded":"2024-09-19T06:47:00.587636+0000","last_fullsized":"2024-09-19T06:47:00.587636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537764+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:47:00.537764+0000","last_peered":"2024-09-19T06:47:00.537764+0000","last_clean":"2024-09-19T06:47:00.537764+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:47:00.537764+0000","last_undegraded":"2024-09-19T06:47:00.537764+0000","last_fullsized":"2024-09-19T06:47:00.537764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594590+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:47:00.594590+0000","last_peered":"2024-09-19T06:47:00.594590+0000","last_clean":"2024-09-19T06:47:00.594590+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:47:00.594590+0000","last_undegraded":"2024-09-19T06:47:00.594590+0000","last_fullsized":"2024-09-19T06:47:00.594590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544151+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:47:00.544151+0000","last_peered":"2024-09-19T06:47:00.544151+0000","last_clean":"2024-09-19T06:47:00.544151+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:47:00.544151+0000","last_undegraded":"2024-09-19T06:47:00.544151+0000","last_fullsized":"2024-09-19T06:47:00.544151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536382+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:47:00.536382+0000","last_peered":"2024-09-19T06:47:00.536382+0000","last_clean":"2024-09-19T06:47:00.536382+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:47:00.536382+0000","last_undegraded":"2024-09-19T06:47:00.536382+0000","last_fullsized":"2024-09-19T06:47:00.536382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589344+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:47:00.589344+0000","last_peered":"2024-09-19T06:47:00.589344+0000","last_clean":"2024-09-19T06:47:00.589344+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:47:00.589344+0000","last_undegraded":"2024-09-19T06:47:00.589344+0000","last_fullsized":"2024-09-19T06:47:00.589344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.538035+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:47:00.538035+0000","last_peered":"2024-09-19T06:47:00.538035+0000","last_clean":"2024-09-19T06:47:00.538035+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:47:00.538035+0000","last_undegraded":"2024-09-19T06:47:00.538035+0000","last_fullsized":"2024-09-19T06:47:00.538035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592761+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:47:00.592761+0000","last_peered":"2024-09-19T06:47:00.592761+0000","last_clean":"2024-09-19T06:47:00.592761+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:47:00.592761+0000","last_undegraded":"2024-09-19T06:47:00.592761+0000","last_fullsized":"2024-09-19T06:47:00.592761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544365+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:47:00.544365+0000","last_peered":"2024-09-19T06:47:00.544365+0000","last_clean":"2024-09-19T06:47:00.544365+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:47:00.544365+0000","last_undegraded":"2024-09-19T06:47:00.544365+0000","last_fullsized":"2024-09-19T06:47:00.544365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587810+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:47:00.587810+0000","last_peered":"2024-09-19T06:47:00.587810+0000","last_clean":"2024-09-19T06:47:00.587810+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:47:00.587810+0000","last_undegraded":"2024-09-19T06:47:00.587810+0000","last_fullsized":"2024-09-19T06:47:00.587810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.548844+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:47:00.548844+0000","last_peered":"2024-09-19T06:47:00.548844+0000","last_clean":"2024-09-19T06:47:00.548844+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:47:00.548844+0000","last_undegraded":"2024-09-19T06:47:00.548844+0000","last_fullsized":"2024-09-19T06:47:00.548844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595196+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:47:00.595196+0000","last_peered":"2024-09-19T06:47:00.595196+0000","last_clean":"2024-09-19T06:47:00.595196+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:47:00.595196+0000","last_undegraded":"2024-09-19T06:47:00.595196+0000","last_fullsized":"2024-09-19T06:47:00.595196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537912+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:47:00.537912+0000","last_peered":"2024-09-19T06:47:00.537912+0000","last_clean":"2024-09-19T06:47:00.537912+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:47:00.537912+0000","last_undegraded":"2024-09-19T06:47:00.537912+0000","last_fullsized":"2024-09-19T06:47:00.537912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582419+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:47:00.582419+0000","last_peered":"2024-09-19T06:47:00.582419+0000","last_clean":"2024-09-19T06:47:00.582419+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:47:00.582419+0000","last_undegraded":"2024-09-19T06:47:00.582419+0000","last_fullsized":"2024-09-19T06:47:00.582419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":250,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.958103+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:47:00.958103+0000","last_peered":"2024-09-19T06:47:00.958103+0000","last_clean":"2024-09-19T06:47:00.958103+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:47:00.958103+0000","last_undegraded":"2024-09-19T06:47:00.958103+0000","last_fullsized":"2024-09-19T06:47:00.958103+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":164,"num_write":34,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577030+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:47:00.577030+0000","last_peered":"2024-09-19T06:47:00.577030+0000","last_clean":"2024-09-19T06:47:00.577030+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:47:00.577030+0000","last_undegraded":"2024-09-19T06:47:00.577030+0000","last_fullsized":"2024-09-19T06:47:00.577030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.545877+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:47:00.545877+0000","last_peered":"2024-09-19T06:47:00.545877+0000","last_clean":"2024-09-19T06:47:00.545877+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:47:00.545877+0000","last_undegraded":"2024-09-19T06:47:00.545877+0000","last_fullsized":"2024-09-19T06:47:00.545877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589299+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:47:00.589299+0000","last_peered":"2024-09-19T06:47:00.589299+0000","last_clean":"2024-09-19T06:47:00.589299+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:47:00.589299+0000","last_undegraded":"2024-09-19T06:47:00.589299+0000","last_fullsized":"2024-09-19T06:47:00.589299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537682+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:47:00.537682+0000","last_peered":"2024-09-19T06:47:00.537682+0000","last_clean":"2024-09-19T06:47:00.537682+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:47:00.537682+0000","last_undegraded":"2024-09-19T06:47:00.537682+0000","last_fullsized":"2024-09-19T06:47:00.537682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584015+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:47:00.584015+0000","last_peered":"2024-09-19T06:47:00.584015+0000","last_clean":"2024-09-19T06:47:00.584015+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:47:00.584015+0000","last_undegraded":"2024-09-19T06:47:00.584015+0000","last_fullsized":"2024-09-19T06:47:00.584015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549262+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:47:00.549262+0000","last_peered":"2024-09-19T06:47:00.549262+0000","last_clean":"2024-09-19T06:47:00.549262+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:47:00.549262+0000","last_undegraded":"2024-09-19T06:47:00.549262+0000","last_fullsized":"2024-09-19T06:47:00.549262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584090+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:47:00.584090+0000","last_peered":"2024-09-19T06:47:00.584090+0000","last_clean":"2024-09-19T06:47:00.584090+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:47:00.584090+0000","last_undegraded":"2024-09-19T06:47:00.584090+0000","last_fullsized":"2024-09-19T06:47:00.584090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.550930+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:47:00.550930+0000","last_peered":"2024-09-19T06:47:00.550930+0000","last_clean":"2024-09-19T06:47:00.550930+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:47:00.550930+0000","last_undegraded":"2024-09-19T06:47:00.550930+0000","last_fullsized":"2024-09-19T06:47:00.550930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580495+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:47:00.580495+0000","last_peered":"2024-09-19T06:47:00.580495+0000","last_clean":"2024-09-19T06:47:00.580495+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:47:00.580495+0000","last_undegraded":"2024-09-19T06:47:00.580495+0000","last_fullsized":"2024-09-19T06:47:00.580495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560644+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:47:00.560644+0000","last_peered":"2024-09-19T06:47:00.560644+0000","last_clean":"2024-09-19T06:47:00.560644+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:47:00.560644+0000","last_undegraded":"2024-09-19T06:47:00.560644+0000","last_fullsized":"2024-09-19T06:47:00.560644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581982+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:47:00.581982+0000","last_peered":"2024-09-19T06:47:00.581982+0000","last_clean":"2024-09-19T06:47:00.581982+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:47:00.581982+0000","last_undegraded":"2024-09-19T06:47:00.581982+0000","last_fullsized":"2024-09-19T06:47:00.581982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536735+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:47:00.536735+0000","last_peered":"2024-09-19T06:47:00.536735+0000","last_clean":"2024-09-19T06:47:00.536735+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:47:00.536735+0000","last_undegraded":"2024-09-19T06:47:00.536735+0000","last_fullsized":"2024-09-19T06:47:00.536735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579492+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:47:00.579492+0000","last_peered":"2024-09-19T06:47:00.579492+0000","last_clean":"2024-09-19T06:47:00.579492+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:47:00.579492+0000","last_undegraded":"2024-09-19T06:47:00.579492+0000","last_fullsized":"2024-09-19T06:47:00.579492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'39","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.770707+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:47:00.770707+0000","last_peered":"2024-09-19T06:47:00.770707+0000","last_clean":"2024-09-19T06:47:00.770707+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:47:00.770707+0000","last_undegraded":"2024-09-19T06:47:00.770707+0000","last_fullsized":"2024-09-19T06:47:00.770707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594237+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:47:00.594237+0000","last_peered":"2024-09-19T06:47:00.594237+0000","last_clean":"2024-09-19T06:47:00.594237+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:47:00.594237+0000","last_undegraded":"2024-09-19T06:47:00.594237+0000","last_fullsized":"2024-09-19T06:47:00.594237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.546255+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:47:00.546255+0000","last_peered":"2024-09-19T06:47:00.546255+0000","last_clean":"2024-09-19T06:47:00.546255+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:47:00.546255+0000","last_undegraded":"2024-09-19T06:47:00.546255+0000","last_fullsized":"2024-09-19T06:47:00.546255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585679+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:47:00.585679+0000","last_peered":"2024-09-19T06:47:00.585679+0000","last_clean":"2024-09-19T06:47:00.585679+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:47:00.585679+0000","last_undegraded":"2024-09-19T06:47:00.585679+0000","last_fullsized":"2024-09-19T06:47:00.585679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":349,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549300+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:47:00.549300+0000","last_peered":"2024-09-19T06:47:00.549300+0000","last_clean":"2024-09-19T06:47:00.549300+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:47:00.549300+0000","last_undegraded":"2024-09-19T06:47:00.549300+0000","last_fullsized":"2024-09-19T06:47:00.549300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549180+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:47:00.549180+0000","last_peered":"2024-09-19T06:47:00.549180+0000","last_clean":"2024-09-19T06:47:00.549180+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:47:00.549180+0000","last_undegraded":"2024-09-19T06:47:00.549180+0000","last_fullsized":"2024-09-19T06:47:00.549180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593914+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:47:00.593914+0000","last_peered":"2024-09-19T06:47:00.593914+0000","last_clean":"2024-09-19T06:47:00.593914+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:47:00.593914+0000","last_undegraded":"2024-09-19T06:47:00.593914+0000","last_fullsized":"2024-09-19T06:47:00.593914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549165+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:47:00.549165+0000","last_peered":"2024-09-19T06:47:00.549165+0000","last_clean":"2024-09-19T06:47:00.549165+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:47:00.549165+0000","last_undegraded":"2024-09-19T06:47:00.549165+0000","last_fullsized":"2024-09-19T06:47:00.549165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577578+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:47:00.577578+0000","last_peered":"2024-09-19T06:47:00.577578+0000","last_clean":"2024-09-19T06:47:00.577578+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:47:00.577578+0000","last_undegraded":"2024-09-19T06:47:00.577578+0000","last_fullsized":"2024-09-19T06:47:00.577578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536478+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:47:00.536478+0000","last_peered":"2024-09-19T06:47:00.536478+0000","last_clean":"2024-09-19T06:47:00.536478+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:47:00.536478+0000","last_undegraded":"2024-09-19T06:47:00.536478+0000","last_fullsized":"2024-09-19T06:47:00.536478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579472+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:47:00.579472+0000","last_peered":"2024-09-19T06:47:00.579472+0000","last_clean":"2024-09-19T06:47:00.579472+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:47:00.579472+0000","last_undegraded":"2024-09-19T06:47:00.579472+0000","last_fullsized":"2024-09-19T06:47:00.579472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549300+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:47:00.549300+0000","last_peered":"2024-09-19T06:47:00.549300+0000","last_clean":"2024-09-19T06:47:00.549300+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:47:00.549300+0000","last_undegraded":"2024-09-19T06:47:00.549300+0000","last_fullsized":"2024-09-19T06:47:00.549300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579645+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:47:00.579645+0000","last_peered":"2024-09-19T06:47:00.579645+0000","last_clean":"2024-09-19T06:47:00.579645+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:47:00.579645+0000","last_undegraded":"2024-09-19T06:47:00.579645+0000","last_fullsized":"2024-09-19T06:47:00.579645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556514+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:47:00.556514+0000","last_peered":"2024-09-19T06:47:00.556514+0000","last_clean":"2024-09-19T06:47:00.556514+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:47:00.556514+0000","last_undegraded":"2024-09-19T06:47:00.556514+0000","last_fullsized":"2024-09-19T06:47:00.556514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587136+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:47:00.587136+0000","last_peered":"2024-09-19T06:47:00.587136+0000","last_clean":"2024-09-19T06:47:00.587136+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:47:00.587136+0000","last_undegraded":"2024-09-19T06:47:00.587136+0000","last_fullsized":"2024-09-19T06:47:00.587136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552471+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:47:00.552471+0000","last_peered":"2024-09-19T06:47:00.552471+0000","last_clean":"2024-09-19T06:47:00.552471+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:47:00.552471+0000","last_undegraded":"2024-09-19T06:47:00.552471+0000","last_fullsized":"2024-09-19T06:47:00.552471+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579287+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:47:00.579287+0000","last_peered":"2024-09-19T06:47:00.579287+0000","last_clean":"2024-09-19T06:47:00.579287+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:47:00.579287+0000","last_undegraded":"2024-09-19T06:47:00.579287+0000","last_fullsized":"2024-09-19T06:47:00.579287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'44","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.780520+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:47:00.780520+0000","last_peered":"2024-09-19T06:47:00.780520+0000","last_clean":"2024-09-19T06:47:00.780520+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:47:00.780520+0000","last_undegraded":"2024-09-19T06:47:00.780520+0000","last_fullsized":"2024-09-19T06:47:00.780520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":80,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593306+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:47:00.593306+0000","last_peered":"2024-09-19T06:47:00.593306+0000","last_clean":"2024-09-19T06:47:00.593306+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:47:00.593306+0000","last_undegraded":"2024-09-19T06:47:00.593306+0000","last_fullsized":"2024-09-19T06:47:00.593306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549571+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:47:00.549571+0000","last_peered":"2024-09-19T06:47:00.549571+0000","last_clean":"2024-09-19T06:47:00.549571+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:47:00.549571+0000","last_undegraded":"2024-09-19T06:47:00.549571+0000","last_fullsized":"2024-09-19T06:47:00.549571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596329+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:47:00.596329+0000","last_peered":"2024-09-19T06:47:00.596329+0000","last_clean":"2024-09-19T06:47:00.596329+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:47:00.596329+0000","last_undegraded":"2024-09-19T06:47:00.596329+0000","last_fullsized":"2024-09-19T06:47:00.596329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536872+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:47:00.536872+0000","last_peered":"2024-09-19T06:47:00.536872+0000","last_clean":"2024-09-19T06:47:00.536872+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:47:00.536872+0000","last_undegraded":"2024-09-19T06:47:00.536872+0000","last_fullsized":"2024-09-19T06:47:00.536872+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.573059+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:47:00.573059+0000","last_peered":"2024-09-19T06:47:00.573059+0000","last_clean":"2024-09-19T06:47:00.573059+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:47:00.573059+0000","last_undegraded":"2024-09-19T06:47:00.573059+0000","last_fullsized":"2024-09-19T06:47:00.573059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.551180+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:47:00.551180+0000","last_peered":"2024-09-19T06:47:00.551180+0000","last_clean":"2024-09-19T06:47:00.551180+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:47:00.551180+0000","last_undegraded":"2024-09-19T06:47:00.551180+0000","last_fullsized":"2024-09-19T06:47:00.551180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595812+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:47:00.595812+0000","last_peered":"2024-09-19T06:47:00.595812+0000","last_clean":"2024-09-19T06:47:00.595812+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:47:00.595812+0000","last_undegraded":"2024-09-19T06:47:00.595812+0000","last_fullsized":"2024-09-19T06:47:00.595812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.555196+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:47:00.555196+0000","last_peered":"2024-09-19T06:47:00.555196+0000","last_clean":"2024-09-19T06:47:00.555196+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:47:00.555196+0000","last_undegraded":"2024-09-19T06:47:00.555196+0000","last_fullsized":"2024-09-19T06:47:00.555196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.597003+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:47:00.597003+0000","last_peered":"2024-09-19T06:47:00.597003+0000","last_clean":"2024-09-19T06:47:00.597003+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:47:00.597003+0000","last_undegraded":"2024-09-19T06:47:00.597003+0000","last_fullsized":"2024-09-19T06:47:00.597003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560958+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:47:00.560958+0000","last_peered":"2024-09-19T06:47:00.560958+0000","last_clean":"2024-09-19T06:47:00.560958+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:47:00.560958+0000","last_undegraded":"2024-09-19T06:47:00.560958+0000","last_fullsized":"2024-09-19T06:47:00.560958+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585140+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:47:00.585140+0000","last_peered":"2024-09-19T06:47:00.585140+0000","last_clean":"2024-09-19T06:47:00.585140+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:47:00.585140+0000","last_undegraded":"2024-09-19T06:47:00.585140+0000","last_fullsized":"2024-09-19T06:47:00.585140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587229+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:47:00.587229+0000","last_peered":"2024-09-19T06:47:00.587229+0000","last_clean":"2024-09-19T06:47:00.587229+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:47:00.587229+0000","last_undegraded":"2024-09-19T06:47:00.587229+0000","last_fullsized":"2024-09-19T06:47:00.587229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556945+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:47:00.556945+0000","last_peered":"2024-09-19T06:47:00.556945+0000","last_clean":"2024-09-19T06:47:00.556945+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:47:00.556945+0000","last_undegraded":"2024-09-19T06:47:00.556945+0000","last_fullsized":"2024-09-19T06:47:00.556945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587670+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:47:00.587670+0000","last_peered":"2024-09-19T06:47:00.587670+0000","last_clean":"2024-09-19T06:47:00.587670+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:47:00.587670+0000","last_undegraded":"2024-09-19T06:47:00.587670+0000","last_fullsized":"2024-09-19T06:47:00.587670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552359+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:47:00.552359+0000","last_peered":"2024-09-19T06:47:00.552359+0000","last_clean":"2024-09-19T06:47:00.552359+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:47:00.552359+0000","last_undegraded":"2024-09-19T06:47:00.552359+0000","last_fullsized":"2024-09-19T06:47:00.552359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596914+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:47:00.596914+0000","last_peered":"2024-09-19T06:47:00.596914+0000","last_clean":"2024-09-19T06:47:00.596914+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:47:00.596914+0000","last_undegraded":"2024-09-19T06:47:00.596914+0000","last_fullsized":"2024-09-19T06:47:00.596914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552705+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:47:00.552705+0000","last_peered":"2024-09-19T06:47:00.552705+0000","last_clean":"2024-09-19T06:47:00.552705+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:47:00.552705+0000","last_undegraded":"2024-09-19T06:47:00.552705+0000","last_fullsized":"2024-09-19T06:47:00.552705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592794+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:47:00.592794+0000","last_peered":"2024-09-19T06:47:00.592794+0000","last_clean":"2024-09-19T06:47:00.592794+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:47:00.592794+0000","last_undegraded":"2024-09-19T06:47:00.592794+0000","last_fullsized":"2024-09-19T06:47:00.592794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556333+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:47:00.556333+0000","last_peered":"2024-09-19T06:47:00.556333+0000","last_clean":"2024-09-19T06:47:00.556333+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:47:00.556333+0000","last_undegraded":"2024-09-19T06:47:00.556333+0000","last_fullsized":"2024-09-19T06:47:00.556333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":290,"num_read_kb":249,"num_write":200,"num_write_kb":1405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":1785447,"data_compressed":81345,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107385,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612640,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":441000,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841573,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":1100428,"data_compressed":46260,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005099,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":834798,"data_compressed":27798,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234031,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":834820,"data_compressed":27798,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1032067,"data_compressed":44447,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626488,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":441117,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855422,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":974848,"data_stored":1163267,"data_compressed":50603,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441022,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":966154,"data_compressed":33954,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476814,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":510569,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":962560,"data_stored":510535,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441090,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":69535,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69569,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":524920,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":131782,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":201329,"data_compressed":7969,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:47:05.227 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:05.516 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:05.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-19T06:47:05.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: Unable to set osd_memory_target on smithi159 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T06:47:05.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-19T06:47:05.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-19T06:47:05.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T06:47:05.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:05.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:47:05.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:47:05.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:05.828 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:05 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: Unable to set osd_memory_target on smithi159 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:05.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:05 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-19T06:47:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: Unable to set osd_memory_target on smithi159 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T06:47:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-19T06:47:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-19T06:47:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T06:47:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:47:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:05.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:05 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.014+0000 7f95a3cde640 1 -- 172.21.15.159:0/557742213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c1000d0 msgr2=0x7f959c100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.014+0000 7f95a3cde640 1 --2- 172.21.15.159:0/557742213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c1000d0 0x7f959c100530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f958c009900 tx=0x7f958c02a410 comp rx=0 tx=0).stop 2024-09-19T06:47:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.014+0000 7f95a3cde640 1 -- 172.21.15.159:0/557742213 shutdown_connections 2024-09-19T06:47:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.014+0000 7f95a3cde640 1 --2- 172.21.15.159:0/557742213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c100a70 0x7f959c10ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.014+0000 7f95a3cde640 1 --2- 172.21.15.159:0/557742213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c1000d0 0x7f959c100530 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.014+0000 7f95a3cde640 1 --2- 172.21.15.159:0/557742213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f959c106ba0 0x7f959c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.014+0000 7f95a3cde640 1 -- 172.21.15.159:0/557742213 >> 172.21.15.159:0/557742213 conn(0x7f959c077220 msgr2=0x7f959c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.014+0000 7f95a3cde640 1 -- 172.21.15.159:0/557742213 shutdown_connections 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.014+0000 7f95a3cde640 1 -- 172.21.15.159:0/557742213 wait complete. 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a3cde640 1 Processor -- start 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a3cde640 1 -- start start 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a3cde640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f959c1000d0 0x7f959c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a3cde640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c100a70 0x7f959c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a3cde640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c106ba0 0x7f959c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a3cde640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f959c112050 con 0x7f959c100a70 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a3cde640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f959c111ed0 con 0x7f959c1000d0 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a3cde640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f959c1121d0 con 0x7f959c106ba0 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a1279640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c100a70 0x7f959c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a1279640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c100a70 0x7f959c1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57390/0 (socket says 172.21.15.159:57390) 2024-09-19T06:47:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a1279640 1 -- 172.21.15.159:0/2146587362 learned_addr learned my addr 172.21.15.159:0/2146587362 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a1a7a640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f959c1000d0 0x7f959c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a227b640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c106ba0 0x7f959c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a1279640 1 -- 172.21.15.159:0/2146587362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c106ba0 msgr2=0x7f959c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a1279640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c106ba0 0x7f959c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a1279640 1 -- 172.21.15.159:0/2146587362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f959c1000d0 msgr2=0x7f959c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a1279640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f959c1000d0 0x7f959c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.015+0000 7f95a1279640 1 -- 172.21.15.159:0/2146587362 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c19d440 con 0x7f959c100a70 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.016+0000 7f95a1279640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c100a70 0x7f959c1989d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f958c006010 tx=0x7f958c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.016+0000 7f9592ffd640 1 -- 172.21.15.159:0/2146587362 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c03f070 con 0x7f959c100a70 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.016+0000 7f9592ffd640 1 -- 172.21.15.159:0/2146587362 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f958c031c30 con 0x7f959c100a70 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.016+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c19d6d0 con 0x7f959c100a70 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.016+0000 7f9592ffd640 1 -- 172.21.15.159:0/2146587362 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c035030 con 0x7f959c100a70 2024-09-19T06:47:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.016+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c1a5010 con 0x7f959c100a70 2024-09-19T06:47:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.017+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c1033f0 con 0x7f959c100a70 2024-09-19T06:47:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.018+0000 7f9592ffd640 1 -- 172.21.15.159:0/2146587362 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f958c042070 con 0x7f959c100a70 2024-09-19T06:47:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.019+0000 7f9592ffd640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f95880a34c0 0x7f95880a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.019+0000 7f95a1a7a640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f95880a34c0 0x7f95880a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.019+0000 7f9592ffd640 1 -- 172.21.15.159:0/2146587362 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f958c0f05a0 con 0x7f959c100a70 2024-09-19T06:47:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.019+0000 7f95a1a7a640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f95880a34c0 0x7f95880a5980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f959800ab60 tx=0x7f959800a2d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.023+0000 7f9592ffd640 1 -- 172.21.15.159:0/2146587362 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f958c0bcde0 con 0x7f959c100a70 2024-09-19T06:47:06.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.226+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f959c10a0b0 con 0x7f959c100a70 2024-09-19T06:47:06.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.227+0000 7f9592ffd640 1 -- 172.21.15.159:0/2146587362 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f958c031de0 con 0x7f959c100a70 2024-09-19T06:47:06.228 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:06.228 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:47:06.228 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:47:06.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f95880a34c0 msgr2=0x7f95880a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:06.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f95880a34c0 0x7f95880a5980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f959800ab60 tx=0x7f959800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c100a70 msgr2=0x7f959c1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c100a70 0x7f959c1989d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f958c006010 tx=0x7f958c003c10 comp rx=0 tx=0).stop 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 shutdown_connections 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f95880a34c0 0x7f95880a5980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c106ba0 0x7f959c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f959c100a70 0x7f959c1989d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 --2- 172.21.15.159:0/2146587362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f959c1000d0 0x7f959c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 >> 172.21.15.159:0/2146587362 conn(0x7f959c077220 msgr2=0x7f959c104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 shutdown_connections 2024-09-19T06:47:06.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:06.229+0000 7f95a3cde640 1 -- 172.21.15.159:0/2146587362 wait complete. 2024-09-19T06:47:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:06 smithi203 ceph-mon[35473]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:47:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:06 smithi203 ceph-mon[35473]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:47:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:06 smithi203 ceph-mon[35473]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:47:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:06 smithi203 ceph-mon[35473]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:06 smithi203 ceph-mon[35473]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:47:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:06 smithi203 ceph-mon[35473]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:47:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:06 smithi203 ceph-mon[35473]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:47:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:06 smithi203 ceph-mon[35473]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:06.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:06 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2146587362' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:06 smithi189 ceph-mon[34880]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:47:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:06 smithi189 ceph-mon[34880]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:47:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:06 smithi189 ceph-mon[34880]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:47:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:06 smithi189 ceph-mon[34880]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:06 smithi189 ceph-mon[34880]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:47:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:06 smithi189 ceph-mon[34880]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:47:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:06 smithi189 ceph-mon[34880]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:47:06.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:06 smithi189 ceph-mon[34880]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:06.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:06 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2146587362' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:06.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:06 smithi159 ceph-mon[30935]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:47:06.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:06 smithi159 ceph-mon[30935]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:47:06.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:06 smithi159 ceph-mon[30935]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:47:06.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:06 smithi159 ceph-mon[30935]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:06.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:06 smithi159 ceph-mon[30935]: Updating smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:47:06.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:06 smithi159 ceph-mon[30935]: Updating smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:47:06.900 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:06 smithi159 ceph-mon[30935]: Updating smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:47:06.900 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:06 smithi159 ceph-mon[30935]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:06.900 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:06 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2146587362' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:06.935 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:47:07.182 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:07.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.656+0000 7fedd2ae3640 1 -- 172.21.15.159:0/2906818985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc1036f0 msgr2=0x7fedcc10bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.656+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/2906818985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc1036f0 0x7fedcc10bbe0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009900 tx=0x7fedb802a480 comp rx=0 tx=0).stop 2024-09-19T06:47:07.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 -- 172.21.15.159:0/2906818985 shutdown_connections 2024-09-19T06:47:07.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/2906818985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedcc10c170 0x7fedcc10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/2906818985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc1036f0 0x7fedcc10bbe0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/2906818985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedcc102dd0 0x7fedcc1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 -- 172.21.15.159:0/2906818985 >> 172.21.15.159:0/2906818985 conn(0x7fedcc0fc7d0 msgr2=0x7fedcc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 -- 172.21.15.159:0/2906818985 shutdown_connections 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 -- 172.21.15.159:0/2906818985 wait complete. 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 Processor -- start 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 -- start start 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedcc102dd0 0x7fedcc1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedcc1036f0 0x7fedcc198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc10c170 0x7fedcc19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc112020 con 0x7fedcc10c170 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc111ea0 con 0x7fedcc102dd0 2024-09-19T06:47:07.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.657+0000 7fedd2ae3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc1121a0 con 0x7fedcc1036f0 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd1080640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc10c170 0x7fedcc19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd1080640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc10c170 0x7fedcc19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57410/0 (socket says 172.21.15.159:57410) 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedcbfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedcc1036f0 0x7fedcc198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd1080640 1 -- 172.21.15.159:0/359727653 learned_addr learned my addr 172.21.15.159:0/359727653 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd087f640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedcc102dd0 0x7fedcc1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd1080640 1 -- 172.21.15.159:0/359727653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedcc1036f0 msgr2=0x7fedcc198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd1080640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedcc1036f0 0x7fedcc198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd1080640 1 -- 172.21.15.159:0/359727653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedcc102dd0 msgr2=0x7fedcc1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd1080640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedcc102dd0 0x7fedcc1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd1080640 1 -- 172.21.15.159:0/359727653 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc19d550 con 0x7fedcc10c170 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd1080640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc10c170 0x7fedcc19ce70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b970 tx=0x7fedc400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedc9ffb640 1 -- 172.21.15.159:0/359727653 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4019070 con 0x7fedcc10c170 2024-09-19T06:47:07.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedc9ffb640 1 -- 172.21.15.159:0/359727653 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedc4014440 con 0x7fedcc10c170 2024-09-19T06:47:07.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedcc19d840 con 0x7fedcc10c170 2024-09-19T06:47:07.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.658+0000 7fedc9ffb640 1 -- 172.21.15.159:0/359727653 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc40075d0 con 0x7fedcc10c170 2024-09-19T06:47:07.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.659+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedcc1a5120 con 0x7fedcc10c170 2024-09-19T06:47:07.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.659+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedcc103230 con 0x7fedcc10c170 2024-09-19T06:47:07.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.660+0000 7fedc9ffb640 1 -- 172.21.15.159:0/359727653 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fedc401c070 con 0x7fedcc10c170 2024-09-19T06:47:07.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.661+0000 7fedc9ffb640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fedbc0a3440 0x7fedbc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.661+0000 7fedd087f640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fedbc0a3440 0x7fedbc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.661+0000 7fedc9ffb640 1 -- 172.21.15.159:0/359727653 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fedc40cf380 con 0x7fedcc10c170 2024-09-19T06:47:07.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.662+0000 7fedd087f640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fedbc0a3440 0x7fedbc0a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009990 tx=0x7fedc0009110 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:07.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.665+0000 7fedc9ffb640 1 -- 172.21.15.159:0/359727653 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fedc409b680 con 0x7fedcc10c170 2024-09-19T06:47:07.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.836+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedcc107220 con 0x7fedcc10c170 2024-09-19T06:47:07.838 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:07 smithi159 ceph-mon[30935]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-19T06:47:07.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.838+0000 7fedc9ffb640 1 -- 172.21.15.159:0/359727653 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+23312 (secure 0 0 0) 0x7fedc409f980 con 0x7fedcc10c170 2024-09-19T06:47:07.839 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:07.839 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":82,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:47:00.531454+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:6800/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2156136647":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2526477703":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3276076186":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3424652308":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3763048477":"2024-09-20T06:47:00.531421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:47:07.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:07 smithi203 ceph-mon[35473]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-19T06:47:07.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.840+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fedbc0a3440 msgr2=0x7fedbc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.840+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fedbc0a3440 0x7fedbc0a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009990 tx=0x7fedc0009110 comp rx=0 tx=0).stop 2024-09-19T06:47:07.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.840+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc10c170 msgr2=0x7fedcc19ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.840+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc10c170 0x7fedcc19ce70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b970 tx=0x7fedc400bd70 comp rx=0 tx=0).stop 2024-09-19T06:47:07.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.840+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 shutdown_connections 2024-09-19T06:47:07.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.840+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fedbc0a3440 0x7fedbc0a5900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.840+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedcc10c170 0x7fedcc19ce70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.840+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedcc1036f0 0x7fedcc198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.840+0000 7fedd2ae3640 1 --2- 172.21.15.159:0/359727653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedcc102dd0 0x7fedcc1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.841+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 >> 172.21.15.159:0/359727653 conn(0x7fedcc0fc7d0 msgr2=0x7fedcc0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:07.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.841+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 shutdown_connections 2024-09-19T06:47:07.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:07.841+0000 7fedd2ae3640 1 -- 172.21.15.159:0/359727653 wait complete. 2024-09-19T06:47:07.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:07 smithi189 ceph-mon[34880]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-19T06:47:08.540 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T06:47:08.540 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:47:08.553 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:47:08.553 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T06:47:08.553 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T06:47:08.553 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T06:47:08.554 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:47:08.554 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:47:08.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.659+0000 7f590e2d7640 1 -- 172.21.15.159:0/3510169336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5908103600 msgr2=0x7f590810bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:08.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.659+0000 7f590e2d7640 1 --2- 172.21.15.159:0/3510169336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5908103600 0x7f590810bae0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009900 tx=0x7f58f002a480 comp rx=0 tx=0).stop 2024-09-19T06:47:08.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.660+0000 7f590e2d7640 1 -- 172.21.15.159:0/3510169336 shutdown_connections 2024-09-19T06:47:08.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.660+0000 7f590e2d7640 1 --2- 172.21.15.159:0/3510169336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f590810c0b0 0x7f590810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.660+0000 7f590e2d7640 1 --2- 172.21.15.159:0/3510169336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5908103600 0x7f590810bae0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.660+0000 7f590e2d7640 1 --2- 172.21.15.159:0/3510169336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5908102ce0 0x7f59081030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.660+0000 7f590e2d7640 1 -- 172.21.15.159:0/3510169336 >> 172.21.15.159:0/3510169336 conn(0x7f5908077990 msgr2=0x7f59080fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:08.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.660+0000 7f590e2d7640 1 -- 172.21.15.159:0/3510169336 shutdown_connections 2024-09-19T06:47:08.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.660+0000 7f590e2d7640 1 -- 172.21.15.159:0/3510169336 wait complete. 2024-09-19T06:47:08.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.660+0000 7f590e2d7640 1 Processor -- start 2024-09-19T06:47:08.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.660+0000 7f590e2d7640 1 -- start start 2024-09-19T06:47:08.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590e2d7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908102ce0 0x7f5908198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:08.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590e2d7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5908103600 0x7f59081988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:08.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590e2d7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590810c0b0 0x7f590819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:08.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590e2d7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5908111eb0 con 0x7f590810c0b0 2024-09-19T06:47:08.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590e2d7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5908111d30 con 0x7f5908102ce0 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590e2d7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5908112030 con 0x7f5908103600 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590c874640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590810c0b0 0x7f590819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590c874640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590810c0b0 0x7f590819cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57424/0 (socket says 172.21.15.159:57424) 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590c874640 1 -- 172.21.15.159:0/2287036922 learned_addr learned my addr 172.21.15.159:0/2287036922 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f59077fe640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5908103600 0x7f59081988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f5907fff640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908102ce0 0x7f5908198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590c874640 1 -- 172.21.15.159:0/2287036922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5908103600 msgr2=0x7f59081988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590c874640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5908103600 0x7f59081988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590c874640 1 -- 172.21.15.159:0/2287036922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908102ce0 msgr2=0x7f5908198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590c874640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908102ce0 0x7f5908198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590c874640 1 -- 172.21.15.159:0/2287036922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590819d370 con 0x7f590810c0b0 2024-09-19T06:47:08.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f590c874640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590810c0b0 0x7f590819cc40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f590000cad0 tx=0x7f590000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:08.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f59057fa640 1 -- 172.21.15.159:0/2287036922 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590000ae20 con 0x7f590810c0b0 2024-09-19T06:47:08.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.661+0000 7f59057fa640 1 -- 172.21.15.159:0/2287036922 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5900005020 con 0x7f590810c0b0 2024-09-19T06:47:08.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.662+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590819d660 con 0x7f590810c0b0 2024-09-19T06:47:08.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.662+0000 7f59057fa640 1 -- 172.21.15.159:0/2287036922 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590000f6f0 con 0x7f590810c0b0 2024-09-19T06:47:08.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.662+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59081a4ef0 con 0x7f590810c0b0 2024-09-19T06:47:08.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.663+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59081030c0 con 0x7f590810c0b0 2024-09-19T06:47:08.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.664+0000 7f59057fa640 1 -- 172.21.15.159:0/2287036922 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f59000051d0 con 0x7f590810c0b0 2024-09-19T06:47:08.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.665+0000 7f59057fa640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58f40a3500 0x7f58f40a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:08.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.665+0000 7f5907fff640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58f40a3500 0x7f58f40a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:08.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.665+0000 7f59057fa640 1 -- 172.21.15.159:0/2287036922 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f59000cfe30 con 0x7f590810c0b0 2024-09-19T06:47:08.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.665+0000 7f5907fff640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58f40a3500 0x7f58f40a59c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58f80058c0 tx=0x7f58f800a250 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:08.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.669+0000 7f59057fa640 1 -- 172.21.15.159:0/2287036922 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5900014030 con 0x7f590810c0b0 2024-09-19T06:47:08.830 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:08.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:08 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/359727653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:47:08.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.873+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f5908107160 con 0x7f590810c0b0 2024-09-19T06:47:08.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.877+0000 7f59057fa640 1 -- 172.21.15.159:0/2287036922 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7f590009c020 con 0x7f590810c0b0 2024-09-19T06:47:08.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58f40a3500 msgr2=0x7f58f40a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:08.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58f40a3500 0x7f58f40a59c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58f80058c0 tx=0x7f58f800a250 comp rx=0 tx=0).stop 2024-09-19T06:47:08.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590810c0b0 msgr2=0x7f590819cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:08.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590810c0b0 0x7f590819cc40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f590000cad0 tx=0x7f590000cf90 comp rx=0 tx=0).stop 2024-09-19T06:47:08.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 shutdown_connections 2024-09-19T06:47:08.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58f40a3500 0x7f58f40a59c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590810c0b0 0x7f590819cc40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5908103600 0x7f59081988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 --2- 172.21.15.159:0/2287036922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908102ce0 0x7f5908198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 >> 172.21.15.159:0/2287036922 conn(0x7f5908077990 msgr2=0x7f59080fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:08.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 shutdown_connections 2024-09-19T06:47:08.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.880+0000 7f590e2d7640 1 -- 172.21.15.159:0/2287036922 wait complete. 2024-09-19T06:47:08.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:08 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/359727653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:47:08.893 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:08 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/359727653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:47:08.894 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T06:47:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.996+0000 7f752e63c640 1 -- 172.21.15.159:0/2330849121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 msgr2=0x7f7528106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.996+0000 7f752e63c640 1 --2- 172.21.15.159:0/2330849121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 0x7f7528106da0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7518009930 tx=0x7f751802a420 comp rx=0 tx=0).stop 2024-09-19T06:47:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 -- 172.21.15.159:0/2330849121 shutdown_connections 2024-09-19T06:47:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 --2- 172.21.15.159:0/2330849121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7528101350 0x7f752810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 --2- 172.21.15.159:0/2330849121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75281009b0 0x7f7528100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 --2- 172.21.15.159:0/2330849121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 0x7f7528106da0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 -- 172.21.15.159:0/2330849121 >> 172.21.15.159:0/2330849121 conn(0x7f7528077990 msgr2=0x7f75280fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 -- 172.21.15.159:0/2330849121 shutdown_connections 2024-09-19T06:47:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 -- 172.21.15.159:0/2330849121 wait complete. 2024-09-19T06:47:09.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 Processor -- start 2024-09-19T06:47:09.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 -- start start 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.997+0000 7f752e63c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75281009b0 0x7f75281991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752e63c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7528101350 0x7f7528199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752e63c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 0x7f75281a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752e63c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7528110e00 con 0x7f75281069c0 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752e63c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7528110c80 con 0x7f7528101350 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752e63c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7528110f80 con 0x7f75281009b0 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752cbd9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 0x7f75281a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752cbd9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 0x7f75281a4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57452/0 (socket says 172.21.15.159:57452) 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752cbd9640 1 -- 172.21.15.159:0/1657809571 learned_addr learned my addr 172.21.15.159:0/1657809571 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f7527fff640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75281009b0 0x7f75281991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f75277fe640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7528101350 0x7f7528199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752cbd9640 1 -- 172.21.15.159:0/1657809571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75281009b0 msgr2=0x7f75281991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752cbd9640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75281009b0 0x7f75281991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752cbd9640 1 -- 172.21.15.159:0/1657809571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7528101350 msgr2=0x7f7528199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752cbd9640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7528101350 0x7f7528199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752cbd9640 1 -- 172.21.15.159:0/1657809571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75281a47b0 con 0x7f75281069c0 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f7527fff640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75281009b0 0x7f75281991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752cbd9640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 0x7f75281a4270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f752000eaa0 tx=0x7f752000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f75257fa640 1 -- 172.21.15.159:0/1657809571 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752000cdb0 con 0x7f75281069c0 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75281a4980 con 0x7f75281069c0 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f75257fa640 1 -- 172.21.15.159:0/1657809571 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7520005020 con 0x7f75281069c0 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75281a4ea0 con 0x7f75281069c0 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.998+0000 7f75257fa640 1 -- 172.21.15.159:0/1657809571 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752001f060 con 0x7f75281069c0 2024-09-19T06:47:09.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:08.999+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7528100e10 con 0x7f75281069c0 2024-09-19T06:47:09.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.001+0000 7f75257fa640 1 -- 172.21.15.159:0/1657809571 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f7520005560 con 0x7f75281069c0 2024-09-19T06:47:09.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.002+0000 7f75257fa640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f75100a3500 0x7f75100a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.002+0000 7f75257fa640 1 -- 172.21.15.159:0/1657809571 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f75200d04d0 con 0x7f75281069c0 2024-09-19T06:47:09.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.002+0000 7f7527fff640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f75100a3500 0x7f75100a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.002+0000 7f7527fff640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f75100a3500 0x7f75100a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7518000c00 tx=0x7f7518005a20 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.005+0000 7f75257fa640 1 -- 172.21.15.159:0/1657809571 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7520016030 con 0x7f75281069c0 2024-09-19T06:47:09.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.177+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f752802d7c0 con 0x7f75281069c0 2024-09-19T06:47:09.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.183+0000 7f75257fa640 1 -- 172.21.15.159:0/1657809571 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7f752009cda0 con 0x7f75281069c0 2024-09-19T06:47:09.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f75100a3500 msgr2=0x7f75100a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f75100a3500 0x7f75100a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7518000c00 tx=0x7f7518005a20 comp rx=0 tx=0).stop 2024-09-19T06:47:09.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 msgr2=0x7f75281a4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 0x7f75281a4270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f752000eaa0 tx=0x7f752000ef60 comp rx=0 tx=0).stop 2024-09-19T06:47:09.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 shutdown_connections 2024-09-19T06:47:09.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f75100a3500 0x7f75100a59c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75281069c0 0x7f75281a4270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7528101350 0x7f7528199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 --2- 172.21.15.159:0/1657809571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75281009b0 0x7f75281991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 >> 172.21.15.159:0/1657809571 conn(0x7f7528077990 msgr2=0x7f7528103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 shutdown_connections 2024-09-19T06:47:09.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.186+0000 7f752e63c640 1 -- 172.21.15.159:0/1657809571 wait complete. 2024-09-19T06:47:09.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T06:47:09.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.301+0000 7f7ada8e4640 1 -- 172.21.15.159:0/3589932716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad41069c0 msgr2=0x7f7ad4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.301+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/3589932716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad41069c0 0x7f7ad4106da0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009930 tx=0x7f7ac402a420 comp rx=0 tx=0).stop 2024-09-19T06:47:09.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.301+0000 7f7ada8e4640 1 -- 172.21.15.159:0/3589932716 shutdown_connections 2024-09-19T06:47:09.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.301+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/3589932716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ad4101350 0x7f7ad410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.301+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/3589932716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ad41009b0 0x7f7ad4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.301+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/3589932716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad41069c0 0x7f7ad4106da0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.301+0000 7f7ada8e4640 1 -- 172.21.15.159:0/3589932716 >> 172.21.15.159:0/3589932716 conn(0x7f7ad4077990 msgr2=0x7f7ad40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.301+0000 7f7ada8e4640 1 -- 172.21.15.159:0/3589932716 shutdown_connections 2024-09-19T06:47:09.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.301+0000 7f7ada8e4640 1 -- 172.21.15.159:0/3589932716 wait complete. 2024-09-19T06:47:09.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.302+0000 7f7ada8e4640 1 Processor -- start 2024-09-19T06:47:09.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.302+0000 7f7ada8e4640 1 -- start start 2024-09-19T06:47:09.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ada8e4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ad41009b0 0x7f7ad41971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ada8e4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad4101350 0x7f7ad41976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ada8e4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ad41069c0 0x7f7ad419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ada8e4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad4110e00 con 0x7f7ad4101350 2024-09-19T06:47:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ada8e4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad4110c80 con 0x7f7ad41009b0 2024-09-19T06:47:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ada8e4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad4110f80 con 0x7f7ad41069c0 2024-09-19T06:47:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad4101350 0x7f7ad41976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad4101350 0x7f7ad41976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45938/0 (socket says 172.21.15.159:45938) 2024-09-19T06:47:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad37fe640 1 -- 172.21.15.159:0/2571806837 learned_addr learned my addr 172.21.15.159:0/2571806837 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad3fff640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ad41009b0 0x7f7ad41971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad8e81640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ad41069c0 0x7f7ad419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad37fe640 1 -- 172.21.15.159:0/2571806837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ad41069c0 msgr2=0x7f7ad419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad37fe640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ad41069c0 0x7f7ad419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad37fe640 1 -- 172.21.15.159:0/2571806837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ad41009b0 msgr2=0x7f7ad41971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad37fe640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ad41009b0 0x7f7ad41971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad37fe640 1 -- 172.21.15.159:0/2571806837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad419c190 con 0x7f7ad4101350 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.303+0000 7f7ad37fe640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad4101350 0x7f7ad41976e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00c920 tx=0x7f7abc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.304+0000 7f7ad17fa640 1 -- 172.21.15.159:0/2571806837 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc007c70 con 0x7f7ad4101350 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.304+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad419c480 con 0x7f7ad4101350 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.304+0000 7f7ad17fa640 1 -- 172.21.15.159:0/2571806837 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7abc007e10 con 0x7f7ad4101350 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.304+0000 7f7ad17fa640 1 -- 172.21.15.159:0/2571806837 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc018890 con 0x7f7ad4101350 2024-09-19T06:47:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.304+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad41a3d10 con 0x7f7ad4101350 2024-09-19T06:47:09.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.305+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad4100e10 con 0x7f7ad4101350 2024-09-19T06:47:09.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.306+0000 7f7ad17fa640 1 -- 172.21.15.159:0/2571806837 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f7abc018a50 con 0x7f7ad4101350 2024-09-19T06:47:09.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.307+0000 7f7ad17fa640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7ac00a3500 0x7f7ac00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.307+0000 7f7ad3fff640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7ac00a3500 0x7f7ac00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.307+0000 7f7ad17fa640 1 -- 172.21.15.159:0/2571806837 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f7abc0cff70 con 0x7f7ad4101350 2024-09-19T06:47:09.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.307+0000 7f7ad3fff640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7ac00a3500 0x7f7ac00a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009900 tx=0x7f7ac40058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.312+0000 7f7ad17fa640 1 -- 172.21.15.159:0/2571806837 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7abc014030 con 0x7f7ad4101350 2024-09-19T06:47:09.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.488+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f7ad41a4100 con 0x7f7ad4101350 2024-09-19T06:47:09.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.494+0000 7f7ad17fa640 1 -- 172.21.15.159:0/2571806837 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7f7abc09c7b0 con 0x7f7ad4101350 2024-09-19T06:47:09.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7ac00a3500 msgr2=0x7f7ac00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7ac00a3500 0x7f7ac00a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009900 tx=0x7f7ac40058d0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad4101350 msgr2=0x7f7ad41976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad4101350 0x7f7ad41976e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00c920 tx=0x7f7abc00cde0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 shutdown_connections 2024-09-19T06:47:09.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7ac00a3500 0x7f7ac00a59c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ad41069c0 0x7f7ad419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ad4101350 0x7f7ad41976e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 --2- 172.21.15.159:0/2571806837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ad41009b0 0x7f7ad41971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 >> 172.21.15.159:0/2571806837 conn(0x7f7ad4077990 msgr2=0x7f7ad4103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 shutdown_connections 2024-09-19T06:47:09.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.498+0000 7f7ada8e4640 1 -- 172.21.15.159:0/2571806837 wait complete. 2024-09-19T06:47:09.515 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T06:47:09.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.559+0000 7f21faec9640 1 -- 172.21.15.159:0/2295373048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4106a90 msgr2=0x7f21f4106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.559+0000 7f21faec9640 1 --2- 172.21.15.159:0/2295373048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4106a90 0x7f21f4106e70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009930 tx=0x7f21e802a420 comp rx=0 tx=0).stop 2024-09-19T06:47:09.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.560+0000 7f21faec9640 1 -- 172.21.15.159:0/2295373048 shutdown_connections 2024-09-19T06:47:09.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.560+0000 7f21faec9640 1 --2- 172.21.15.159:0/2295373048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21f4101430 0x7f21f410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.560+0000 7f21faec9640 1 --2- 172.21.15.159:0/2295373048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21f4100a90 0x7f21f4100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.560+0000 7f21faec9640 1 --2- 172.21.15.159:0/2295373048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4106a90 0x7f21f4106e70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.560+0000 7f21faec9640 1 -- 172.21.15.159:0/2295373048 >> 172.21.15.159:0/2295373048 conn(0x7f21f40fc7d0 msgr2=0x7f21f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.560+0000 7f21faec9640 1 -- 172.21.15.159:0/2295373048 shutdown_connections 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.560+0000 7f21faec9640 1 -- 172.21.15.159:0/2295373048 wait complete. 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.560+0000 7f21faec9640 1 Processor -- start 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.560+0000 7f21faec9640 1 -- start start 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21faec9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4100a90 0x7f21f4197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21faec9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21f4101430 0x7f21f41978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21faec9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21f4106a90 0x7f21f419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21faec9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f21f4110e50 con 0x7f21f4100a90 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21faec9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f21f4110cd0 con 0x7f21f4106a90 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21faec9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f21f4110fd0 con 0x7f21f4101430 2024-09-19T06:47:09.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f8c65640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4100a90 0x7f21f4197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f8c65640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4100a90 0x7f21f4197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45958/0 (socket says 172.21.15.159:45958) 2024-09-19T06:47:09.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f8c65640 1 -- 172.21.15.159:0/4157060728 learned_addr learned my addr 172.21.15.159:0/4157060728 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:09.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f3fff640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21f4101430 0x7f21f41978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f9466640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21f4106a90 0x7f21f419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f8c65640 1 -- 172.21.15.159:0/4157060728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21f4101430 msgr2=0x7f21f41978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f8c65640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21f4101430 0x7f21f41978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f8c65640 1 -- 172.21.15.159:0/4157060728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21f4106a90 msgr2=0x7f21f419bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f8c65640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21f4106a90 0x7f21f419bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f8c65640 1 -- 172.21.15.159:0/4157060728 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f419c340 con 0x7f21f4100a90 2024-09-19T06:47:09.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f8c65640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4100a90 0x7f21f4197390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009230 tx=0x7f21e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.561+0000 7f21f1ffb640 1 -- 172.21.15.159:0/4157060728 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e8046070 con 0x7f21f4100a90 2024-09-19T06:47:09.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.562+0000 7f21f1ffb640 1 -- 172.21.15.159:0/4157060728 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21e8003ad0 con 0x7f21f4100a90 2024-09-19T06:47:09.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.562+0000 7f21faec9640 1 -- 172.21.15.159:0/4157060728 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f419c5d0 con 0x7f21f4100a90 2024-09-19T06:47:09.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.562+0000 7f21f1ffb640 1 -- 172.21.15.159:0/4157060728 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e8035050 con 0x7f21f4100a90 2024-09-19T06:47:09.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.562+0000 7f21faec9640 1 -- 172.21.15.159:0/4157060728 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f406a790 con 0x7f21f4100a90 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.564+0000 7f21f1ffb640 1 -- 172.21.15.159:0/4157060728 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f21e8049070 con 0x7f21f4100a90 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21fd2a2740 1 Processor -- start 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21fd2a2740 1 -- start start 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f48f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f53800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f53d40 0x55e6a9f56130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6a9eae280 con 0x55e6a9f49480 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e6a9e55b10 con 0x55e6a9f53d40 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e6a9eaa240 con 0x55e6a9f48b60 2024-09-19T06:47:09.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21f8c65640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f53800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21f8c65640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f53800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45964/0 (socket says 172.21.15.159:45964) 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21f8c65640 1 -- 172.21.15.159:0/2037972213 learned_addr learned my addr 172.21.15.159:0/2037972213 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21f3fff640 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f53d40 0x55e6a9f56130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21f9466640 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f48f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21f1ffb640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f21e40a34c0 0x7f21e40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21f8c65640 1 -- 172.21.15.159:0/2037972213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 msgr2=0x55e6a9f48f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.565+0000 7f21f8c65640 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f48f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21f8c65640 1 -- 172.21.15.159:0/2037972213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f53d40 msgr2=0x55e6a9f56130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21f8c65640 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f53d40 0x55e6a9f56130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21f8c65640 1 -- 172.21.15.159:0/2037972213 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a9e621f0 con 0x55e6a9f49480 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21f3fff640 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f53d40 0x55e6a9f56130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21f9466640 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f48f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21f9466640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f21e40a34c0 0x7f21e40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21f1ffb640 1 -- 172.21.15.159:0/4157060728 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f21e80f18c0 con 0x7f21f4100a90 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21f8c65640 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f53800 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21e80ef5e0 tx=0x7f21e80884a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed7a645246dbd02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21deffd640 1 -- 172.21.15.159:0/2037972213 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e80bd410 con 0x55e6a9f49480 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21deffd640 1 -- 172.21.15.159:0/2037972213 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21e8038450 con 0x55e6a9f49480 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21deffd640 1 -- 172.21.15.159:0/2037972213 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e808c810 con 0x55e6a9f49480 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.566+0000 7f21f9466640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f21e40a34c0 0x7f21e40a5980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009fd0 tx=0x7f21ec004a40 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2037972213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 msgr2=0x55e6a9f53800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f53800 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21e80ef5e0 tx=0x7f21e80884a0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2037972213 shutdown_connections 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f53d40 0x55e6a9f56130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f53800 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2037972213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f48f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2037972213 >> 172.21.15.159:0/2037972213 conn(0x55e6a9f450f0 msgr2=0x55e6a9f454d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2037972213 shutdown_connections 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2037972213 wait complete. 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.567+0000 7f21fd2a2740 1 -- start start 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21fd2a2740 1 Processor -- start 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 0x55e6a9f50bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f51100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 0x55e6a9f51640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6a9f5aae0 con 0x55e6a9f49480 2024-09-19T06:47:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e6a9e68f10 con 0x55e6a9f48b60 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e6a9f5ac60 con 0x55e6a9f53d40 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21fd2a2740 10 client.0 _ll_register_callbacks cb 0x55e6a9e31a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f51100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f51100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45974/0 (socket says 172.21.15.159:45974) 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21f3fff640 1 -- 172.21.15.159:0/102799542 learned_addr learned my addr 172.21.15.159:0/102799542 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21f8c65640 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 0x55e6a9f50bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.568+0000 7f21f9466640 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 0x55e6a9f51640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21f3fff640 1 -- 172.21.15.159:0/102799542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 msgr2=0x55e6a9f51640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21f3fff640 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 0x55e6a9f51640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21f3fff640 1 -- 172.21.15.159:0/102799542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 msgr2=0x55e6a9f50bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21f3fff640 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 0x55e6a9f50bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21f3fff640 1 -- 172.21.15.159:0/102799542 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a9c1f6a0 con 0x55e6a9f49480 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21f3fff640 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f51100 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21e000bad0 tx=0x7f21e000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1f34b877000868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21d3fff640 1 -- 172.21.15.159:0/102799542 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0003dc0 con 0x55e6a9f49480 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21d3fff640 1 -- 172.21.15.159:0/102799542 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f21e0011440 con 0x55e6a9f49480 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21fd2a2740 1 -- 172.21.15.159:0/102799542 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21e8038450 con 0x55e6a9f49480 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21d3fff640 1 -- 172.21.15.159:0/102799542 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f21e0011640 con 0x55e6a9f49480 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21fd2a2740 10 client.15216 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21fd2a2740 1 -- 172.21.15.159:0/102799542 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e6a9f66630 con 0x55e6a9f49480 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.569+0000 7f21d3fff640 1 -- 172.21.15.159:0/102799542 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21e8038450 con 0x55e6a9f49480 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.570+0000 7f21d3fff640 1 -- 172.21.15.159:0/102799542 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f21e0023990 con 0x55e6a9f49480 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.570+0000 7f21fd2a2740 10 client.15216 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.570+0000 7f21fd2a2740 10 client.15216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.570+0000 7f21fd2a2740 20 client.15216 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.570+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e6a9f67b40 0x55e6a9f69fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.570+0000 7f21fd2a2740 4 client.15216 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:09.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.570+0000 7f21fd2a2740 1 -- 172.21.15.159:0/102799542 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6a9ebb7f0 con 0x55e6a9f67b40 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.570+0000 7f21f8c65640 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e6a9f67b40 0x55e6a9f69fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.571+0000 7f21d3fff640 10 client.15216 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.571+0000 7f21f8c65640 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e6a9f67b40 0x55e6a9f69fe0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f0d7842fe70c686 server_cookie=73d1f7dc6c893a49 in_seq=0 out_seq=0 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.571+0000 7f21d3fff640 1 -- 172.21.15.159:0/102799542 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6a9ebb7f0 con 0x55e6a9f67b40 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.571+0000 7f21d3fff640 10 client.15216 handle_command_reply: tid=0 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.571+0000 7f21fd2a2740 1 client.15216 shutdown 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.571+0000 7f21fd2a2740 1 -- 172.21.15.159:0/102799542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 msgr2=0x55e6a9f51100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.571+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f51100 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21e000bad0 tx=0x7f21e000bf90 comp rx=0 tx=0).stop 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.571+0000 7f21fd2a2740 1 -- 172.21.15.159:0/102799542 shutdown_connections 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.571+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e6a9f67b40 0x55e6a9f69fe0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.572+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 0x55e6a9f51640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.572+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f51100 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.572+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/102799542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 0x55e6a9f50bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.572+0000 7f21fd2a2740 1 -- 172.21.15.159:0/102799542 >> 172.21.15.159:0/102799542 conn(0x55e6a9f450f0 msgr2=0x55e6a9f4ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.572+0000 7f21d3fff640 0 client.15216 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:09.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.572+0000 7f21fd2a2740 1 -- 172.21.15.159:0/102799542 shutdown_connections 2024-09-19T06:47:09.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.572+0000 7f21fd2a2740 1 -- 172.21.15.159:0/102799542 wait complete. 2024-09-19T06:47:09.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.572+0000 7f21fd2a2740 20 client.15216 trim_cache size 0 max 16384 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21fd2a2740 1 Processor -- start 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21fd2a2740 1 -- start start 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 0x55e6a9f52a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f6f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 0x55e6a9f6fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f21f41a9680 con 0x55e6a9f49480 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f21f41abf00 con 0x55e6a9f48b60 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f21f41a9cf0 con 0x55e6a9f53d40 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f6f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f6f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45980/0 (socket says 172.21.15.159:45980) 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21f3fff640 1 -- 172.21.15.159:0/2692867080 learned_addr learned my addr 172.21.15.159:0/2692867080 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.592+0000 7f21f8c65640 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 0x55e6a9f52a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21f9466640 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 0x55e6a9f6fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21f3fff640 1 -- 172.21.15.159:0/2692867080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 msgr2=0x55e6a9f6fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21f3fff640 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 0x55e6a9f6fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21f3fff640 1 -- 172.21.15.159:0/2692867080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 msgr2=0x55e6a9f52a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21f3fff640 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 0x55e6a9f52a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21f3fff640 1 -- 172.21.15.159:0/2692867080 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a9f4b9d0 con 0x55e6a9f49480 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21f9466640 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 0x55e6a9f6fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:09.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21f3fff640 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f6f8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f21e00058c0 tx=0x7f21e0004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26d38b1d798f233 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21de7fc640 1 -- 172.21.15.159:0/2692867080 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0011440 con 0x55e6a9f49480 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21de7fc640 1 -- 172.21.15.159:0/2692867080 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21e0003dc0 con 0x55e6a9f49480 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.593+0000 7f21de7fc640 1 -- 172.21.15.159:0/2692867080 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0023690 con 0x55e6a9f49480 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.594+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2692867080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 msgr2=0x55e6a9f6f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.594+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f6f8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f21e00058c0 tx=0x7f21e0004420 comp rx=0 tx=0).stop 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.594+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2692867080 shutdown_connections 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.594+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f53d40 0x55e6a9f6fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.594+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f49480 0x55e6a9f6f8b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.594+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2692867080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f48b60 0x55e6a9f52a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.594+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2692867080 >> 172.21.15.159:0/2692867080 conn(0x55e6a9f450f0 msgr2=0x55e6a9f52310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.594+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2692867080 shutdown_connections 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.594+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2692867080 wait complete. 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21fd2a2740 1 -- start start 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21fd2a2740 1 Processor -- start 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f60590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f49480 0x55e6a9f4da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21fd2a2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f53d40 0x55e6a9f4e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f21f41aa3c0 con 0x55e6a9f53d40 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f21f41ab830 con 0x55e6a9f49480 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21fd2a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f21f41aaa90 con 0x55e6a9f48b60 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21fd2a2740 10 client.0 _ll_register_callbacks cb 0x7f21e0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21f9466640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f53d40 0x55e6a9f4e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.595+0000 7f21f9466640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f53d40 0x55e6a9f4e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45986/0 (socket says 172.21.15.159:45986) 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f49480 0x55e6a9f4da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f9466640 1 -- 172.21.15.159:0/2363494036 learned_addr learned my addr 172.21.15.159:0/2363494036 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f8c65640 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f60590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f3fff640 1 -- 172.21.15.159:0/2363494036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 msgr2=0x55e6a9f60590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f3fff640 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f60590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f3fff640 1 -- 172.21.15.159:0/2363494036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f53d40 msgr2=0x55e6a9f4e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f3fff640 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f53d40 0x55e6a9f4e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f3fff640 1 -- 172.21.15.159:0/2363494036 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a9f4e830 con 0x55e6a9f49480 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f8c65640 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f60590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21f3fff640 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f49480 0x55e6a9f4da30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55e6a9f507c0 tx=0x7f21e000b700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec63fc037ef04e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21d3fff640 1 -- 172.21.15.159:0/2363494036 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e00119f0 con 0x55e6a9f49480 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21d3fff640 1 -- 172.21.15.159:0/2363494036 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f21e0005030 con 0x55e6a9f49480 2024-09-19T06:47:09.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.596+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2363494036 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21e0003dc0 con 0x55e6a9f49480 2024-09-19T06:47:09.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21d3fff640 1 -- 172.21.15.159:0/2363494036 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f21e0005250 con 0x55e6a9f49480 2024-09-19T06:47:09.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21fd2a2740 10 client.24851 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:09.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2363494036 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e6a9f566d0 con 0x55e6a9f49480 2024-09-19T06:47:09.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21d3fff640 1 -- 172.21.15.159:0/2363494036 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21e0003dc0 con 0x55e6a9f49480 2024-09-19T06:47:09.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21d3fff640 1 -- 172.21.15.159:0/2363494036 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f21e002b030 con 0x55e6a9f49480 2024-09-19T06:47:09.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21fd2a2740 10 client.24851 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:09.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21fd2a2740 10 client.24851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:09.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21fd2a2740 20 client.24851 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:09.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e6a9f56e40 0x55e6a9f59260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21fd2a2740 4 client.24851 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:47:09.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2363494036 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e6a9eb5d00 con 0x55e6a9f56e40 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.597+0000 7f21f8c65640 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e6a9f56e40 0x55e6a9f59260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.598+0000 7f21f8c65640 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e6a9f56e40 0x55e6a9f59260 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3270a01a36b6412 server_cookie=67719c8289efb793 in_seq=0 out_seq=0 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.598+0000 7f21d3fff640 10 client.24851 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21d3fff640 1 -- 172.21.15.159:0/2363494036 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e6a9eb5d00 con 0x55e6a9f56e40 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21d3fff640 10 client.24851 handle_command_reply: tid=0 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 client.24851 shutdown 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2363494036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f49480 msgr2=0x55e6a9f4da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f49480 0x55e6a9f4da30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55e6a9f507c0 tx=0x7f21e000b700 comp rx=0 tx=0).stop 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2363494036 shutdown_connections 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e6a9f56e40 0x55e6a9f59260 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21d3fff640 0 client.24851 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e6a9f53d40 0x55e6a9f4e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6a9f49480 0x55e6a9f4da30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 --2- 172.21.15.159:0/2363494036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a9f48b60 0x55e6a9f60590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2363494036 >> 172.21.15.159:0/2363494036 conn(0x55e6a9f450f0 msgr2=0x55e6a9f44270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.599+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2363494036 shutdown_connections 2024-09-19T06:47:09.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21fd2a2740 1 -- 172.21.15.159:0/2363494036 wait complete. 2024-09-19T06:47:09.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21fd2a2740 20 client.24851 trim_cache size 0 max 16384 2024-09-19T06:47:09.604 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:47:09.604 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:47:09.604 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "0bc96dbb-5be8-45b4-8c3e-c93ab473f850", 2024-09-19T06:47:09.604 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:47:09.604 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:47:09.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 -- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f21e40a34c0 msgr2=0x7f21e40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f21e40a34c0 0x7f21e40a5980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009fd0 tx=0x7f21ec004a40 comp rx=0 tx=0).stop 2024-09-19T06:47:09.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 -- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4100a90 msgr2=0x7f21f4197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4100a90 0x7f21f4197390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009230 tx=0x7f21e8004270 comp rx=0 tx=0).stop 2024-09-19T06:47:09.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 -- 172.21.15.159:0/4157060728 shutdown_connections 2024-09-19T06:47:09.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f21e40a34c0 0x7f21e40a5980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21f4106a90 0x7f21f419bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21f4101430 0x7f21f41978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 --2- 172.21.15.159:0/4157060728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4100a90 0x7f21f4197390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.600+0000 7f21faec9640 1 -- 172.21.15.159:0/4157060728 >> 172.21.15.159:0/4157060728 conn(0x7f21f40fc7d0 msgr2=0x7f21f40fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.601+0000 7f21faec9640 1 -- 172.21.15.159:0/4157060728 shutdown_connections 2024-09-19T06:47:09.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.601+0000 7f21faec9640 1 -- 172.21.15.159:0/4157060728 wait complete. 2024-09-19T06:47:09.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.633+0000 7f5860eaf640 1 -- 172.21.15.159:0/21972337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1069e0 msgr2=0x7f585c106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.633+0000 7f5860eaf640 1 --2- 172.21.15.159:0/21972337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1069e0 0x7f585c106dc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5854009cd0 tx=0x7f585402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.633+0000 7f5860eaf640 1 -- 172.21.15.159:0/21972337 shutdown_connections 2024-09-19T06:47:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.633+0000 7f5860eaf640 1 --2- 172.21.15.159:0/21972337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c101370 0x7f585c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.633+0000 7f5860eaf640 1 --2- 172.21.15.159:0/21972337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c1009d0 0x7f585c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.633+0000 7f5860eaf640 1 --2- 172.21.15.159:0/21972337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1069e0 0x7f585c106dc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.633+0000 7f5860eaf640 1 -- 172.21.15.159:0/21972337 >> 172.21.15.159:0/21972337 conn(0x7f585c0fc6b0 msgr2=0x7f585c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.633+0000 7f5860eaf640 1 -- 172.21.15.159:0/21972337 shutdown_connections 2024-09-19T06:47:09.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.633+0000 7f5860eaf640 1 -- 172.21.15.159:0/21972337 wait complete. 2024-09-19T06:47:09.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f5860eaf640 1 Processor -- start 2024-09-19T06:47:09.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f5860eaf640 1 -- start start 2024-09-19T06:47:09.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f5860eaf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1009d0 0x7f585c197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f5860eaf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c101370 0x7f585c1977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f5860eaf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c1069e0 0x7f585c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f5860eaf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f585c110e20 con 0x7f585c1009d0 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f5860eaf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f585c110ca0 con 0x7f585c1069e0 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f5860eaf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f585c110fa0 con 0x7f585c101370 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f585a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1009d0 0x7f585c197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f585a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1009d0 0x7f585c197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45996/0 (socket says 172.21.15.159:45996) 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.634+0000 7f585a59c640 1 -- 172.21.15.159:0/3758551554 learned_addr learned my addr 172.21.15.159:0/3758551554 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f5859d9b640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c101370 0x7f585c1977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f585ad9d640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c1069e0 0x7f585c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f585a59c640 1 -- 172.21.15.159:0/3758551554 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c101370 msgr2=0x7f585c1977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f585a59c640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c101370 0x7f585c1977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f585a59c640 1 -- 172.21.15.159:0/3758551554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c1069e0 msgr2=0x7f585c19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f585a59c640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c1069e0 0x7f585c19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f585a59c640 1 -- 172.21.15.159:0/3758551554 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c19c280 con 0x7f585c1009d0 2024-09-19T06:47:09.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f585a59c640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1009d0 0x7f585c197290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5854005e30 tx=0x7f5854032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f58537fe640 1 -- 172.21.15.159:0/3758551554 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854004040 con 0x7f585c1009d0 2024-09-19T06:47:09.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585c19c510 con 0x7f585c1009d0 2024-09-19T06:47:09.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f58537fe640 1 -- 172.21.15.159:0/3758551554 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58540046c0 con 0x7f585c1009d0 2024-09-19T06:47:09.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f58537fe640 1 -- 172.21.15.159:0/3758551554 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854046480 con 0x7f585c1009d0 2024-09-19T06:47:09.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.635+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c1a3e00 con 0x7f585c1009d0 2024-09-19T06:47:09.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.637+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585c100e30 con 0x7f585c1009d0 2024-09-19T06:47:09.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.637+0000 7f58537fe640 1 -- 172.21.15.159:0/3758551554 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f58540305a0 con 0x7f585c1009d0 2024-09-19T06:47:09.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.638+0000 7f58537fe640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58480a3500 0x7f58480a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.638+0000 7f5859d9b640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58480a3500 0x7f58480a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.638+0000 7f58537fe640 1 -- 172.21.15.159:0/3758551554 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f585402e030 con 0x7f585c1009d0 2024-09-19T06:47:09.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.639+0000 7f5859d9b640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58480a3500 0x7f58480a59c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f585c0fec20 tx=0x7f584400b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.645+0000 7f58537fe640 1 -- 172.21.15.159:0/3758551554 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f585404b060 con 0x7f585c1009d0 2024-09-19T06:47:09.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.833+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f585c0fd4f0 con 0x7f58480a3500 2024-09-19T06:47:09.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 146 B/s wr, 19 op/s 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2287036922' entity='client.admin' 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1657809571' entity='client.admin' 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2571806837' entity='client.admin' 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:09.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:09.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 146 B/s wr, 19 op/s 2024-09-19T06:47:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2287036922' entity='client.admin' 2024-09-19T06:47:09.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1657809571' entity='client.admin' 2024-09-19T06:47:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:09.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:09.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2571806837' entity='client.admin' 2024-09-19T06:47:09.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:09.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:09.890 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 146 B/s wr, 19 op/s 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2287036922' entity='client.admin' 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1657809571' entity='client.admin' 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2571806837' entity='client.admin' 2024-09-19T06:47:09.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:09.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:09.899 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:47:09.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.900+0000 7f58537fe640 1 -- 172.21.15.159:0/3758551554 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f585c0fd4f0 con 0x7f58480a3500 2024-09-19T06:47:09.901 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path / 2024-09-19T06:47:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58480a3500 msgr2=0x7f58480a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58480a3500 0x7f58480a59c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f585c0fec20 tx=0x7f584400b390 comp rx=0 tx=0).stop 2024-09-19T06:47:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1009d0 msgr2=0x7f585c197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1009d0 0x7f585c197290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5854005e30 tx=0x7f5854032fb0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 shutdown_connections 2024-09-19T06:47:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f58480a3500 0x7f58480a59c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c1069e0 0x7f585c19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c101370 0x7f585c1977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 --2- 172.21.15.159:0/3758551554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f585c1009d0 0x7f585c197290 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 >> 172.21.15.159:0/3758551554 conn(0x7f585c0fc6b0 msgr2=0x7f585c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 shutdown_connections 2024-09-19T06:47:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:09.902+0000 7f5860eaf640 1 -- 172.21.15.159:0/3758551554 wait complete. 2024-09-19T06:47:09.914 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T06:47:10.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 -- 172.21.15.159:0/1279604415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 msgr2=0x7f169410e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 --2- 172.21.15.159:0/1279604415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 0x7f169410e990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f168c009cd0 tx=0x7f168c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 -- 172.21.15.159:0/1279604415 shutdown_connections 2024-09-19T06:47:10.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 --2- 172.21.15.159:0/1279604415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 0x7f169410e990 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 --2- 172.21.15.159:0/1279604415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1694101ac0 0x7f1694101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 --2- 172.21.15.159:0/1279604415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1694107ad0 0x7f1694107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 -- 172.21.15.159:0/1279604415 >> 172.21.15.159:0/1279604415 conn(0x7f16940fd7e0 msgr2=0x7f16940ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 -- 172.21.15.159:0/1279604415 shutdown_connections 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 -- 172.21.15.159:0/1279604415 wait complete. 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 Processor -- start 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.018+0000 7f169aed0640 1 -- start start 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f169aed0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1694101ac0 0x7f1694198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f169aed0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 0x7f1694198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f169aed0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1694107ad0 0x7f169419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f169aed0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1694111f10 con 0x7f1694102460 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f169aed0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1694111d90 con 0x7f1694101ac0 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f169aed0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1694112090 con 0x7f1694107ad0 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1693fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 0x7f1694198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1693fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 0x7f1694198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46022/0 (socket says 172.21.15.159:46022) 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1693fff640 1 -- 172.21.15.159:0/24580194 learned_addr learned my addr 172.21.15.159:0/24580194 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1698c6c640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1694101ac0 0x7f1694198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f169946d640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1694107ad0 0x7f169419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1693fff640 1 -- 172.21.15.159:0/24580194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1694107ad0 msgr2=0x7f169419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1693fff640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1694107ad0 0x7f169419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1693fff640 1 -- 172.21.15.159:0/24580194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1694101ac0 msgr2=0x7f1694198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1693fff640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1694101ac0 0x7f1694198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1693fff640 1 -- 172.21.15.159:0/24580194 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169419d330 con 0x7f1694102460 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f169946d640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1694107ad0 0x7f169419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1693fff640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 0x7f1694198880 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f168000d950 tx=0x7f168000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1691ffb640 1 -- 172.21.15.159:0/24580194 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680017070 con 0x7f1694102460 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1691ffb640 1 -- 172.21.15.159:0/24580194 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1680009c30 con 0x7f1694102460 2024-09-19T06:47:10.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169419d620 con 0x7f1694102460 2024-09-19T06:47:10.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.019+0000 7f1691ffb640 1 -- 172.21.15.159:0/24580194 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168000f6b0 con 0x7f1694102460 2024-09-19T06:47:10.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.020+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16941a4eb0 con 0x7f1694102460 2024-09-19T06:47:10.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.021+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1694103200 con 0x7f1694102460 2024-09-19T06:47:10.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.022+0000 7f1691ffb640 1 -- 172.21.15.159:0/24580194 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f16800109d0 con 0x7f1694102460 2024-09-19T06:47:10.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.022+0000 7f1691ffb640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16840a3500 0x7f16840a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.023+0000 7f1698c6c640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16840a3500 0x7f16840a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.023+0000 7f1691ffb640 1 -- 172.21.15.159:0/24580194 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f16800cfb40 con 0x7f1694102460 2024-09-19T06:47:10.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.023+0000 7f1698c6c640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16840a3500 0x7f16840a59c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1688005fd0 tx=0x7f168800b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.026+0000 7f1691ffb640 1 -- 172.21.15.159:0/24580194 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1680009de0 con 0x7f1694102460 2024-09-19T06:47:10.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.220+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f16940fe6b0 con 0x7f16840a3500 2024-09-19T06:47:10.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.286+0000 7f1691ffb640 1 -- 172.21.15.159:0/24580194 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f16940fe6b0 con 0x7f16840a3500 2024-09-19T06:47:10.288 INFO:teuthology.orchestra.run.smithi159.stdout:Retention added to path / 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16840a3500 msgr2=0x7f16840a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16840a3500 0x7f16840a59c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1688005fd0 tx=0x7f168800b390 comp rx=0 tx=0).stop 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 msgr2=0x7f1694198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 0x7f1694198880 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f168000d950 tx=0x7f168000de10 comp rx=0 tx=0).stop 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 shutdown_connections 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16840a3500 0x7f16840a59c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1694107ad0 0x7f169419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1694102460 0x7f1694198880 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 --2- 172.21.15.159:0/24580194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1694101ac0 0x7f1694198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 >> 172.21.15.159:0/24580194 conn(0x7f16940fd7e0 msgr2=0x7f16940fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 shutdown_connections 2024-09-19T06:47:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.288+0000 7f169aed0640 1 -- 172.21.15.159:0/24580194 wait complete. 2024-09-19T06:47:10.300 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:47:10.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.401+0000 7fccfc9c6640 1 -- 172.21.15.159:0/3589885436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8101ae0 msgr2=0x7fccf8101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.401+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/3589885436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8101ae0 0x7fccf8101f40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009930 tx=0x7fcce002a420 comp rx=0 tx=0).stop 2024-09-19T06:47:10.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.401+0000 7fccfc9c6640 1 -- 172.21.15.159:0/3589885436 shutdown_connections 2024-09-19T06:47:10.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.401+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/3589885436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccf8102480 0x7fccf810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.401+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/3589885436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8101ae0 0x7fccf8101f40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.401+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/3589885436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf8107b80 0x7fccf8107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.401+0000 7fccfc9c6640 1 -- 172.21.15.159:0/3589885436 >> 172.21.15.159:0/3589885436 conn(0x7fccf80fd7e0 msgr2=0x7fccf80ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.401+0000 7fccfc9c6640 1 -- 172.21.15.159:0/3589885436 shutdown_connections 2024-09-19T06:47:10.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.401+0000 7fccfc9c6640 1 -- 172.21.15.159:0/3589885436 wait complete. 2024-09-19T06:47:10.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccfc9c6640 1 Processor -- start 2024-09-19T06:47:10.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccfc9c6640 1 -- start start 2024-09-19T06:47:10.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccfc9c6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccf8101ae0 0x7fccf819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccfc9c6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8102480 0x7fccf819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccfc9c6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf8107b80 0x7fccf819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccfc9c6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8111f30 con 0x7fccf8102480 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccfc9c6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8111db0 con 0x7fccf8101ae0 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccfc9c6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81120b0 con 0x7fccf8107b80 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8102480 0x7fccf819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8102480 0x7fccf819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46042/0 (socket says 172.21.15.159:46042) 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf5d9b640 1 -- 172.21.15.159:0/430310181 learned_addr learned my addr 172.21.15.159:0/430310181 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf659c640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccf8101ae0 0x7fccf819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf6d9d640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf8107b80 0x7fccf819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf5d9b640 1 -- 172.21.15.159:0/430310181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf8107b80 msgr2=0x7fccf819ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf5d9b640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf8107b80 0x7fccf819ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf5d9b640 1 -- 172.21.15.159:0/430310181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccf8101ae0 msgr2=0x7fccf819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf5d9b640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccf8101ae0 0x7fccf819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.402+0000 7fccf5d9b640 1 -- 172.21.15.159:0/430310181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf819f510 con 0x7fccf8102480 2024-09-19T06:47:10.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.403+0000 7fccf5d9b640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8102480 0x7fccf819aa60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009230 tx=0x7fcce0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.403+0000 7fccef7fe640 1 -- 172.21.15.159:0/430310181 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce003f030 con 0x7fccf8102480 2024-09-19T06:47:10.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.403+0000 7fccef7fe640 1 -- 172.21.15.159:0/430310181 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcce0003ad0 con 0x7fccf8102480 2024-09-19T06:47:10.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.403+0000 7fccef7fe640 1 -- 172.21.15.159:0/430310181 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0035070 con 0x7fccf8102480 2024-09-19T06:47:10.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.403+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf819f7a0 con 0x7fccf8102480 2024-09-19T06:47:10.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.403+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf81a7090 con 0x7fccf8102480 2024-09-19T06:47:10.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.404+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf8101f40 con 0x7fccf8102480 2024-09-19T06:47:10.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.405+0000 7fccef7fe640 1 -- 172.21.15.159:0/430310181 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fcce0042030 con 0x7fccf8102480 2024-09-19T06:47:10.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.405+0000 7fccef7fe640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcce40a3500 0x7fcce40a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.406+0000 7fccf659c640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcce40a3500 0x7fcce40a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.406+0000 7fccef7fe640 1 -- 172.21.15.159:0/430310181 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fcce00f03f0 con 0x7fccf8102480 2024-09-19T06:47:10.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.406+0000 7fccf659c640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcce40a3500 0x7fcce40a59c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fccf0005fd0 tx=0x7fccf0009680 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.410+0000 7fccef7fe640 1 -- 172.21.15.159:0/430310181 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcce00bcc30 con 0x7fccf8102480 2024-09-19T06:47:10.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.600+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fccf80feca0 con 0x7fcce40a3500 2024-09-19T06:47:10.608 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:47:10.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.608+0000 7fccef7fe640 1 -- 172.21.15.159:0/430310181 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fccf80feca0 con 0x7fcce40a3500 2024-09-19T06:47:10.609 INFO:teuthology.orchestra.run.smithi159.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:47:09", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T06:47:10.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcce40a3500 msgr2=0x7fcce40a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcce40a3500 0x7fcce40a59c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fccf0005fd0 tx=0x7fccf0009680 comp rx=0 tx=0).stop 2024-09-19T06:47:10.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8102480 msgr2=0x7fccf819aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8102480 0x7fccf819aa60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009230 tx=0x7fcce0004270 comp rx=0 tx=0).stop 2024-09-19T06:47:10.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 shutdown_connections 2024-09-19T06:47:10.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcce40a3500 0x7fcce40a59c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf8107b80 0x7fccf819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccf8102480 0x7fccf819aa60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 --2- 172.21.15.159:0/430310181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccf8101ae0 0x7fccf819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 >> 172.21.15.159:0/430310181 conn(0x7fccf80fd7e0 msgr2=0x7fccf810d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 shutdown_connections 2024-09-19T06:47:10.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.610+0000 7fccfc9c6640 1 -- 172.21.15.159:0/430310181 wait complete. 2024-09-19T06:47:10.622 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:47:10.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.765+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1440921496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44100a70 msgr2=0x7f0a44100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.765+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1440921496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44100a70 0x7f0a44100e50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009900 tx=0x7f0a4002a480 comp rx=0 tx=0).stop 2024-09-19T06:47:10.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.765+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1440921496 shutdown_connections 2024-09-19T06:47:10.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.765+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1440921496 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a44105ea0 0x7f0a44106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.765+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1440921496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a44101390 0x7f0a44105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.765+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1440921496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44100a70 0x7f0a44100e50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.765+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1440921496 >> 172.21.15.159:0/1440921496 conn(0x7f0a44077990 msgr2=0x7f0a440fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.765+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1440921496 shutdown_connections 2024-09-19T06:47:10.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.765+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1440921496 wait complete. 2024-09-19T06:47:10.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a4b7f6640 1 Processor -- start 2024-09-19T06:47:10.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a4b7f6640 1 -- start start 2024-09-19T06:47:10.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a4b7f6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a44100a70 0x7f0a441a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a4b7f6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44101390 0x7f0a441a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a4b7f6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a44105ea0 0x7f0a4419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a4b7f6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44118490 con 0x7f0a44101390 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a4b7f6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44118310 con 0x7f0a44105ea0 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a4b7f6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44118610 con 0x7f0a44100a70 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a48d91640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44101390 0x7f0a441a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a48d91640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44101390 0x7f0a441a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46056/0 (socket says 172.21.15.159:46056) 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.766+0000 7f0a48d91640 1 -- 172.21.15.159:0/1951524586 learned_addr learned my addr 172.21.15.159:0/1951524586 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a49592640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a44100a70 0x7f0a441a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a48d91640 1 -- 172.21.15.159:0/1951524586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a44100a70 msgr2=0x7f0a441a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a48d91640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a44100a70 0x7f0a441a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a48d91640 1 -- 172.21.15.159:0/1951524586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a44105ea0 msgr2=0x7f0a4419e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a48d91640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a44105ea0 0x7f0a4419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a48d91640 1 -- 172.21.15.159:0/1951524586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4419efe0 con 0x7f0a44101390 2024-09-19T06:47:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a48d91640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44101390 0x7f0a441a4ba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c970 tx=0x7f0a3400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a3a7fc640 1 -- 172.21.15.159:0/1951524586 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34007bb0 con 0x7f0a44101390 2024-09-19T06:47:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a3a7fc640 1 -- 172.21.15.159:0/1951524586 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a34007d50 con 0x7f0a44101390 2024-09-19T06:47:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a4419f2d0 con 0x7f0a44101390 2024-09-19T06:47:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a3a7fc640 1 -- 172.21.15.159:0/1951524586 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34018820 con 0x7f0a44101390 2024-09-19T06:47:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.767+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a441ab5e0 con 0x7f0a44101390 2024-09-19T06:47:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.768+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a4406a180 con 0x7f0a44101390 2024-09-19T06:47:10.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.770+0000 7f0a3a7fc640 1 -- 172.21.15.159:0/1951524586 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f0a340189c0 con 0x7f0a44101390 2024-09-19T06:47:10.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.770+0000 7f0a3a7fc640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0a300a3580 0x7f0a300a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.771+0000 7f0a49592640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0a300a3580 0x7f0a300a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.771+0000 7f0a3a7fc640 1 -- 172.21.15.159:0/1951524586 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f0a340d0290 con 0x7f0a44101390 2024-09-19T06:47:10.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.771+0000 7f0a49592640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0a300a3580 0x7f0a300a5a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a400096c0 tx=0x7f0a40000bc0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.774+0000 7f0a3a7fc640 1 -- 172.21.15.159:0/1951524586 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a34014030 con 0x7f0a44101390 2024-09-19T06:47:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:10 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:47:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:10 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:10 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:47:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:10 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:10.862 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:10 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:47:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:10 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:10 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:47:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:10 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:10 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:47:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:10 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:10 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:47:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:10 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:10.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.972+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f0a44104f20 con 0x7f0a300a3580 2024-09-19T06:47:10.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.978+0000 7f0a3a7fc640 1 -- 172.21.15.159:0/1951524586 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f0a44104f20 con 0x7f0a300a3580 2024-09-19T06:47:10.980 INFO:teuthology.orchestra.run.smithi159.stdout:/ 1m 6m3h 2024-09-19T06:47:10.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0a300a3580 msgr2=0x7f0a300a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0a300a3580 0x7f0a300a5a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a400096c0 tx=0x7f0a40000bc0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44101390 msgr2=0x7f0a441a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44101390 0x7f0a441a4ba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c970 tx=0x7f0a3400ce30 comp rx=0 tx=0).stop 2024-09-19T06:47:10.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 shutdown_connections 2024-09-19T06:47:10.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0a300a3580 0x7f0a300a5a40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a44105ea0 0x7f0a4419e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a44101390 0x7f0a441a4ba0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 --2- 172.21.15.159:0/1951524586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a44100a70 0x7f0a441a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 >> 172.21.15.159:0/1951524586 conn(0x7f0a44077990 msgr2=0x7f0a44103800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 shutdown_connections 2024-09-19T06:47:10.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:10.980+0000 7f0a4b7f6640 1 -- 172.21.15.159:0/1951524586 wait complete. 2024-09-19T06:47:10.993 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T06:47:11.019 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T06:47:11.032 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T06:47:11.044 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T06:47:11.044 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T06:47:11.061 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T06:47:11.075 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:47:11.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:47:11.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.349+0000 7fa247234640 1 -- 172.21.15.159:0/1050659260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102570 msgr2=0x7fa2401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.349+0000 7fa247234640 1 --2- 172.21.15.159:0/1050659260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102570 0x7fa2401029b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa228009900 tx=0x7fa22802a480 comp rx=0 tx=0).stop 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.350+0000 7fa247234640 1 -- 172.21.15.159:0/1050659260 shutdown_connections 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.350+0000 7fa247234640 1 --2- 172.21.15.159:0/1050659260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa240102ef0 0x7fa24010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.350+0000 7fa247234640 1 --2- 172.21.15.159:0/1050659260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102570 0x7fa2401029b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.350+0000 7fa247234640 1 --2- 172.21.15.159:0/1050659260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa240100e20 0x7fa240101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.350+0000 7fa247234640 1 -- 172.21.15.159:0/1050659260 >> 172.21.15.159:0/1050659260 conn(0x7fa2400fc7d0 msgr2=0x7fa2400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.350+0000 7fa247234640 1 -- 172.21.15.159:0/1050659260 shutdown_connections 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.350+0000 7fa247234640 1 -- 172.21.15.159:0/1050659260 wait complete. 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.350+0000 7fa247234640 1 Processor -- start 2024-09-19T06:47:11.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.350+0000 7fa247234640 1 -- start start 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa247234640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa240100e20 0x7fa240199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa247234640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa240102570 0x7fa2401998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa247234640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102ef0 0x7fa2401a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa247234640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa240110fa0 con 0x7fa240102ef0 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa247234640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa240110e20 con 0x7fa240100e20 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa247234640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa240111120 con 0x7fa240102570 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa2457d1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102ef0 0x7fa2401a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa2457d1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102ef0 0x7fa2401a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46084/0 (socket says 172.21.15.159:46084) 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa2457d1640 1 -- 172.21.15.159:0/2609430157 learned_addr learned my addr 172.21.15.159:0/2609430157 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa23ffff640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa240102570 0x7fa2401998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa244fd0640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa240100e20 0x7fa240199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa2457d1640 1 -- 172.21.15.159:0/2609430157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa240102570 msgr2=0x7fa2401998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa2457d1640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa240102570 0x7fa2401998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa2457d1640 1 -- 172.21.15.159:0/2609430157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa240100e20 msgr2=0x7fa240199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa2457d1640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa240100e20 0x7fa240199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa2457d1640 1 -- 172.21.15.159:0/2609430157 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2401a4950 con 0x7fa240102ef0 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa2457d1640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102ef0 0x7fa2401a4410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa238009fd0 tx=0x7fa23800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa23dffb640 1 -- 172.21.15.159:0/2609430157 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238011830 con 0x7fa240102ef0 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa23dffb640 1 -- 172.21.15.159:0/2609430157 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa238016070 con 0x7fa240102ef0 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa247234640 1 -- 172.21.15.159:0/2609430157 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2401a4b20 con 0x7fa240102ef0 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.351+0000 7fa23dffb640 1 -- 172.21.15.159:0/2609430157 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23800f2e0 con 0x7fa240102ef0 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.352+0000 7fa247234640 1 -- 172.21.15.159:0/2609430157 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2401a4fe0 con 0x7fa240102ef0 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.354+0000 7fa23dffb640 1 -- 172.21.15.159:0/2609430157 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fa2380119d0 con 0x7fa240102ef0 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.354+0000 7fa24960d740 1 Processor -- start 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.354+0000 7fa24960d740 1 -- start start 2024-09-19T06:47:11.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.354+0000 7fa24960d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757d7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.354+0000 7fa24960d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757e2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.354+0000 7fa24960d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.354+0000 7fa24960d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56187573d2e0 con 0x5618757d7dc0 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.354+0000 7fa24960d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5618756e4ce0 con 0x5618757d74a0 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.354+0000 7fa24960d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5618757392a0 con 0x5618757e2680 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa244fd0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa23dffb640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa22c0a3440 0x7fa22c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa244fd0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757e2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46092/0 (socket says 172.21.15.159:46092) 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa244fd0640 1 -- 172.21.15.159:0/1375938021 learned_addr learned my addr 172.21.15.159:0/1375938021 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa23ffff640 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757d7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa23ffff640 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa2457d1640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa22c0a3440 0x7fa22c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa244fd0640 1 -- 172.21.15.159:0/1375938021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 msgr2=0x5618757e4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa244fd0640 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757e4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa244fd0640 1 -- 172.21.15.159:0/1375938021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 msgr2=0x5618757d7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa244fd0640 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757d7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa23dffb640 1 -- 172.21.15.159:0/2609430157 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa2380cf540 con 0x7fa240102ef0 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa244fd0640 1 -- 172.21.15.159:0/1375938021 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618756c9440 con 0x5618757d7dc0 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa23ffff640 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757d7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa244fd0640 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757e2140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa230009fc0 tx=0x7fa23000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8c81665cd5390a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa236ffd640 1 -- 172.21.15.159:0/1375938021 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230004d20 con 0x5618757d7dc0 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa2457d1640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa22c0a3440 0x7fa22c0a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2380ccd10 tx=0x7fa23806a480 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa236ffd640 1 -- 172.21.15.159:0/1375938021 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2300119e0 con 0x5618757d7dc0 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.355+0000 7fa236ffd640 1 -- 172.21.15.159:0/1375938021 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230005580 con 0x5618757d7dc0 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 -- 172.21.15.159:0/1375938021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 msgr2=0x5618757e2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757e2140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa230009fc0 tx=0x7fa23000f7f0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 -- 172.21.15.159:0/1375938021 shutdown_connections 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757e4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757e2140 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 --2- 172.21.15.159:0/1375938021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757d7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 -- 172.21.15.159:0/1375938021 >> 172.21.15.159:0/1375938021 conn(0x5618757d3a30 msgr2=0x5618757d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 -- 172.21.15.159:0/1375938021 shutdown_connections 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 -- 172.21.15.159:0/1375938021 wait complete. 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.356+0000 7fa24960d740 1 -- start start 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa24960d740 1 Processor -- start 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa24960d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757e1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa24960d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757d7dc0 0x5618757df240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa24960d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757e2680 0x5618757df780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa24960d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5618757e5250 con 0x5618757e2680 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa24960d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5618756f8050 con 0x5618757d74a0 2024-09-19T06:47:11.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa24960d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5618757e53d0 con 0x5618757d7dc0 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa24960d740 10 client.0 _ll_register_callbacks cb 0x561875738160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757e2680 0x5618757df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757e2680 0x5618757df780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46108/0 (socket says 172.21.15.159:46108) 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa23ffff640 1 -- 172.21.15.159:0/2886264340 learned_addr learned my addr 172.21.15.159:0/2886264340 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.357+0000 7fa244fd0640 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757d7dc0 0x5618757df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa23ffff640 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757e1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa23ffff640 1 -- 172.21.15.159:0/2886264340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757d7dc0 msgr2=0x5618757df240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa23ffff640 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757d7dc0 0x5618757df240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa23ffff640 1 -- 172.21.15.159:0/2886264340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 msgr2=0x5618757e1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa23ffff640 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757e1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa23ffff640 1 -- 172.21.15.159:0/2886264340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618754ae3c0 con 0x5618757e2680 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa23ffff640 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757e2680 0x5618757df780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa2280314e0 tx=0x7fa228009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82091efbc17ff820 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa21ffff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa21ffff640 1 -- 172.21.15.159:0/2886264340 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228035040 con 0x5618757e2680 2024-09-19T06:47:11.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa21ffff640 1 -- 172.21.15.159:0/2886264340 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa228003da0 con 0x5618757e2680 2024-09-19T06:47:11.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.358+0000 7fa24960d740 1 -- 172.21.15.159:0/2886264340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2300119e0 con 0x5618757e2680 2024-09-19T06:47:11.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa21ffff640 1 -- 172.21.15.159:0/2886264340 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa228005030 con 0x5618757e2680 2024-09-19T06:47:11.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa24960d740 10 client.15258 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:11.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa24960d740 1 -- 172.21.15.159:0/2886264340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5618757f0bd0 con 0x5618757e2680 2024-09-19T06:47:11.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa21ffff640 1 -- 172.21.15.159:0/2886264340 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2300119e0 con 0x5618757e2680 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa21ffff640 1 -- 172.21.15.159:0/2886264340 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa228031540 con 0x5618757e2680 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa24960d740 10 client.15258 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa24960d740 10 client.15258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa24960d740 20 client.15258 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa24960d740 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5618757f1f20 0x5618757f4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa24960d740 4 client.15258 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa24960d740 1 -- 172.21.15.159:0/2886264340 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56187574a850 con 0x5618757f1f20 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.359+0000 7fa244fd0640 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5618757f1f20 0x5618757f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.360+0000 7fa21ffff640 10 client.15258 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.360+0000 7fa244fd0640 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5618757f1f20 0x5618757f4330 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be69046d47a220a8 server_cookie=55b3ae3c381ab17f in_seq=0 out_seq=0 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.360+0000 7fa21ffff640 1 -- 172.21.15.159:0/2886264340 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56187574a850 con 0x5618757f1f20 2024-09-19T06:47:11.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.360+0000 7fa21ffff640 10 client.15258 handle_command_reply: tid=0 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.360+0000 7fa24960d740 1 client.15258 shutdown 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 -- 172.21.15.159:0/2886264340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757e2680 msgr2=0x5618757df780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757e2680 0x5618757df780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa2280314e0 tx=0x7fa228009640 comp rx=0 tx=0).stop 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 -- 172.21.15.159:0/2886264340 shutdown_connections 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5618757f1f20 0x5618757f4330 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757e2680 0x5618757df780 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757d7dc0 0x5618757df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 --2- 172.21.15.159:0/2886264340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 -- 172.21.15.159:0/2886264340 >> 172.21.15.159:0/2886264340 conn(0x5618757d3a30 msgr2=0x5618757d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa21ffff640 0 client.15258 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 -- 172.21.15.159:0/2886264340 shutdown_connections 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 1 -- 172.21.15.159:0/2886264340 wait complete. 2024-09-19T06:47:11.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.361+0000 7fa24960d740 20 client.15258 trim_cache size 0 max 16384 2024-09-19T06:47:11.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa24960d740 1 Processor -- start 2024-09-19T06:47:11.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa24960d740 1 -- start start 2024-09-19T06:47:11.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa24960d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757ee4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa24960d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757d9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa24960d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa24960d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa2401adc30 con 0x5618757d7dc0 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa24960d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2401b04b0 con 0x5618757d74a0 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa24960d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa2401ae2a0 con 0x5618757e2680 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa244fd0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757d9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa244fd0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757d9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46112/0 (socket says 172.21.15.159:46112) 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa244fd0640 1 -- 172.21.15.159:0/497475532 learned_addr learned my addr 172.21.15.159:0/497475532 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa23ffff640 1 --2- 172.21.15.159:0/497475532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa23ffff640 1 --2- 172.21.15.159:0/497475532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757ee4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa244fd0640 1 -- 172.21.15.159:0/497475532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 msgr2=0x5618757f9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa244fd0640 1 --2- 172.21.15.159:0/497475532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757f9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa244fd0640 1 -- 172.21.15.159:0/497475532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 msgr2=0x5618757ee4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:11.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.380+0000 7fa244fd0640 1 --2- 172.21.15.159:0/497475532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757ee4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.381+0000 7fa244fd0640 1 -- 172.21.15.159:0/497475532 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618757d72d0 con 0x5618757d7dc0 2024-09-19T06:47:11.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.381+0000 7fa244fd0640 1 --2- 172.21.15.159:0/497475532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757d9650 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa230009320 tx=0x7fa2300098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9252bd20a2ef266 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.381+0000 7fa2367fc640 1 -- 172.21.15.159:0/497475532 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230003b70 con 0x5618757d7dc0 2024-09-19T06:47:11.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.381+0000 7fa2367fc640 1 -- 172.21.15.159:0/497475532 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2300119e0 con 0x5618757d7dc0 2024-09-19T06:47:11.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.381+0000 7fa2367fc640 1 -- 172.21.15.159:0/497475532 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230004e80 con 0x5618757d7dc0 2024-09-19T06:47:11.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 -- 172.21.15.159:0/497475532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 msgr2=0x5618757d9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 --2- 172.21.15.159:0/497475532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757d9650 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa230009320 tx=0x7fa2300098c0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 -- 172.21.15.159:0/497475532 shutdown_connections 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 --2- 172.21.15.159:0/497475532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757f9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 --2- 172.21.15.159:0/497475532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d7dc0 0x5618757d9650 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 --2- 172.21.15.159:0/497475532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d74a0 0x5618757ee4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 -- 172.21.15.159:0/497475532 >> 172.21.15.159:0/497475532 conn(0x5618757d3a30 msgr2=0x5618757d8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 -- 172.21.15.159:0/497475532 shutdown_connections 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 -- 172.21.15.159:0/497475532 wait complete. 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.382+0000 7fa24960d740 1 -- start start 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa24960d740 1 Processor -- start 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa24960d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d74a0 0x5618757eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa24960d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d7dc0 0x5618757e6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa24960d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757e6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa24960d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa2401ae970 con 0x5618757d74a0 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa24960d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2401afde0 con 0x5618757d7dc0 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa24960d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa2401af040 con 0x5618757e2680 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa24960d740 10 client.0 _ll_register_callbacks cb 0x7fa228009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d74a0 0x5618757eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d74a0 0x5618757eacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46126/0 (socket says 172.21.15.159:46126) 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa23ffff640 1 -- 172.21.15.159:0/2426216118 learned_addr learned my addr 172.21.15.159:0/2426216118 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa244fd0640 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d7dc0 0x5618757e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.383+0000 7fa23ffff640 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa23ffff640 1 -- 172.21.15.159:0/2426216118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 msgr2=0x5618757e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa23ffff640 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757e6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa23ffff640 1 -- 172.21.15.159:0/2426216118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d7dc0 msgr2=0x5618757e6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:11.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa23ffff640 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d7dc0 0x5618757e6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa23ffff640 1 -- 172.21.15.159:0/2426216118 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618757e6d40 con 0x5618757d74a0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa23ffff640 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d74a0 0x5618757eacd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5618757d4780 tx=0x7fa22802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9385874978d61a9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa21ffff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa21ffff640 1 -- 172.21.15.159:0/2426216118 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228035040 con 0x5618757d74a0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa21ffff640 1 -- 172.21.15.159:0/2426216118 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa228031ae0 con 0x5618757d74a0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa24960d740 1 -- 172.21.15.159:0/2426216118 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2300119e0 con 0x5618757d74a0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa21ffff640 1 -- 172.21.15.159:0/2426216118 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa228031ce0 con 0x5618757d74a0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa24960d740 10 client.15264 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa24960d740 1 -- 172.21.15.159:0/2426216118 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56187585cb50 con 0x5618757d74a0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.384+0000 7fa21ffff640 1 -- 172.21.15.159:0/2426216118 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2300119e0 con 0x5618757d74a0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa21ffff640 1 -- 172.21.15.159:0/2426216118 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa228004cd0 con 0x5618757d74a0 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa24960d740 10 client.15264 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa24960d740 10 client.15264 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:11.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa24960d740 20 client.15264 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa24960d740 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56187585d1b0 0x56187585f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa24960d740 4 client.15264 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa24960d740 1 -- 172.21.15.159:0/2426216118 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561875744d60 con 0x56187585d1b0 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa244fd0640 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56187585d1b0 0x56187585f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa244fd0640 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56187585d1b0 0x56187585f5d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7545cba49d644ef server_cookie=c98f1fa900960117 in_seq=0 out_seq=0 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.385+0000 7fa21ffff640 10 client.15264 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa21ffff640 1 -- 172.21.15.159:0/2426216118 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561875744d60 con 0x56187585d1b0 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa21ffff640 10 client.15264 handle_command_reply: tid=0 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 client.15264 shutdown 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 -- 172.21.15.159:0/2426216118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d74a0 msgr2=0x5618757eacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d74a0 0x5618757eacd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5618757d4780 tx=0x7fa22802a480 comp rx=0 tx=0).stop 2024-09-19T06:47:11.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 -- 172.21.15.159:0/2426216118 shutdown_connections 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56187585d1b0 0x56187585f5d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618757e2680 0x5618757e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618757d7dc0 0x5618757e6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 --2- 172.21.15.159:0/2426216118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618757d74a0 0x5618757eacd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa21ffff640 0 client.15264 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 -- 172.21.15.159:0/2426216118 >> 172.21.15.159:0/2426216118 conn(0x5618757d3a30 msgr2=0x5618757e12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 -- 172.21.15.159:0/2426216118 shutdown_connections 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 1 -- 172.21.15.159:0/2426216118 wait complete. 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.386+0000 7fa24960d740 20 client.15264 trim_cache size 0 max 16384 2024-09-19T06:47:11.393 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:47:11.394 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:47:11.394 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:47:11.394 INFO:teuthology.orchestra.run.smithi159.stdout: "0bc96dbb-5be8-45b4-8c3e-c93ab473f850": { 2024-09-19T06:47:11.394 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:47:11.394 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "0bc96dbb-5be8-45b4-8c3e-c93ab473f850", 2024-09-19T06:47:11.394 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:47:11.394 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:11.394 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:11.394 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 -- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa22c0a3440 msgr2=0x7fa22c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa22c0a3440 0x7fa22c0a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2380ccd10 tx=0x7fa23806a480 comp rx=0 tx=0).stop 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 -- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102ef0 msgr2=0x7fa2401a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102ef0 0x7fa2401a4410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa238009fd0 tx=0x7fa23800b8e0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 -- 172.21.15.159:0/2609430157 shutdown_connections 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa22c0a3440 0x7fa22c0a5900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa240102ef0 0x7fa2401a4410 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa240102570 0x7fa2401998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 --2- 172.21.15.159:0/2609430157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa240100e20 0x7fa240199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 -- 172.21.15.159:0/2609430157 >> 172.21.15.159:0/2609430157 conn(0x7fa2400fc7d0 msgr2=0x7fa2400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 -- 172.21.15.159:0/2609430157 shutdown_connections 2024-09-19T06:47:11.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:11.387+0000 7fa247234640 1 -- 172.21.15.159:0/2609430157 wait complete. 2024-09-19T06:47:11.599 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:11.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:11 smithi203 ceph-mon[35473]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:11 smithi203 ceph-mon[35473]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:11 smithi203 ceph-mon[35473]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 113 B/s wr, 14 op/s 2024-09-19T06:47:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:11 smithi189 ceph-mon[34880]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:11 smithi189 ceph-mon[34880]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:11 smithi189 ceph-mon[34880]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 113 B/s wr, 14 op/s 2024-09-19T06:47:11.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:11 smithi159 ceph-mon[30935]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:11.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:11 smithi159 ceph-mon[30935]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:11.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:11 smithi159 ceph-mon[30935]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 113 B/s wr, 14 op/s 2024-09-19T06:47:12.195 INFO:tasks.cephfs.filesystem:scrub status for tag:0bc96dbb-5be8-45b4-8c3e-c93ab473f850 - {'path': '/', 'tag': '0bc96dbb-5be8-45b4-8c3e-c93ab473f850', 'options': 'recursive,force'} 2024-09-19T06:47:12.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.689+0000 7f6b93f1f640 1 -- 172.21.15.159:0/4044135846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c108300 msgr2=0x7f6b8c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:12.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.689+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/4044135846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c108300 0x7f6b8c10ec70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009930 tx=0x7f6b8402a420 comp rx=0 tx=0).stop 2024-09-19T06:47:12.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.689+0000 7f6b93f1f640 1 -- 172.21.15.159:0/4044135846 shutdown_connections 2024-09-19T06:47:12.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.689+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/4044135846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c108300 0x7f6b8c10ec70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.689+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/4044135846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b8c103780 0x7f6b8c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.689+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/4044135846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b8c102dd0 0x7f6b8c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.689+0000 7f6b93f1f640 1 -- 172.21.15.159:0/4044135846 >> 172.21.15.159:0/4044135846 conn(0x7f6b8c0fc7d0 msgr2=0x7f6b8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.689+0000 7f6b93f1f640 1 -- 172.21.15.159:0/4044135846 shutdown_connections 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.689+0000 7f6b93f1f640 1 -- 172.21.15.159:0/4044135846 wait complete. 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b93f1f640 1 Processor -- start 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b93f1f640 1 -- start start 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b93f1f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c102dd0 0x7f6b8c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b93f1f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b8c103780 0x7f6b8c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b93f1f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b8c108300 0x7f6b8c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b93f1f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c112110 con 0x7f6b8c102dd0 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b93f1f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c111f90 con 0x7f6b8c103780 2024-09-19T06:47:12.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b93f1f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c112290 con 0x7f6b8c108300 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b91cbb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c102dd0 0x7f6b8c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b91cbb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c102dd0 0x7f6b8c198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46140/0 (socket says 172.21.15.159:46140) 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b91cbb640 1 -- 172.21.15.159:0/3924801513 learned_addr learned my addr 172.21.15.159:0/3924801513 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b914ba640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b8c103780 0x7f6b8c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b924bc640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b8c108300 0x7f6b8c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b91cbb640 1 -- 172.21.15.159:0/3924801513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b8c108300 msgr2=0x7f6b8c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b91cbb640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b8c108300 0x7f6b8c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b91cbb640 1 -- 172.21.15.159:0/3924801513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b8c103780 msgr2=0x7f6b8c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b91cbb640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b8c103780 0x7f6b8c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b91cbb640 1 -- 172.21.15.159:0/3924801513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c19d4f0 con 0x7f6b8c102dd0 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.690+0000 7f6b924bc640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b8c108300 0x7f6b8c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:12.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.691+0000 7f6b91cbb640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c102dd0 0x7f6b8c198540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00ba50 tx=0x7f6b7c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.691+0000 7f6b8affd640 1 -- 172.21.15.159:0/3924801513 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c019070 con 0x7f6b8c102dd0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.691+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8c19d7e0 con 0x7f6b8c102dd0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.691+0000 7f6b8affd640 1 -- 172.21.15.159:0/3924801513 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b7c00cbe0 con 0x7f6b8c102dd0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.691+0000 7f6b8affd640 1 -- 172.21.15.159:0/3924801513 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0076e0 con 0x7f6b8c102dd0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.691+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8c1a50c0 con 0x7f6b8c102dd0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.692+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b8c06a7b0 con 0x7f6b8c102dd0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.693+0000 7f6b8affd640 1 -- 172.21.15.159:0/3924801513 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f6b7c01c070 con 0x7f6b8c102dd0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.694+0000 7f6b8affd640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b740a3440 0x7f6b740a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.694+0000 7f6b914ba640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b740a3440 0x7f6b740a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.694+0000 7f6b8affd640 1 -- 172.21.15.159:0/3924801513 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f6b7c0cf920 con 0x7f6b8c102dd0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.694+0000 7f6b914ba640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b740a3440 0x7f6b740a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b80005e10 tx=0x7f6b80005da0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:12.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.697+0000 7f6b8affd640 1 -- 172.21.15.159:0/3924801513 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b7c09c270 con 0x7f6b8c102dd0 2024-09-19T06:47:12.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:12 smithi203 ceph-mon[35473]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:12.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:12 smithi203 ceph-mon[35473]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:12.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.861+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b8c062630 con 0x7f6b740a3440 2024-09-19T06:47:12.864 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:12 smithi159 ceph-mon[30935]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:12.864 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:12 smithi159 ceph-mon[30935]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:12.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.869+0000 7f6b8affd640 1 -- 172.21.15.159:0/3924801513 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257970 (secure 0 0 0) 0x7f6b8c062630 con 0x7f6b740a3440 2024-09-19T06:47:12.873 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:12.874 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:47:12.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b740a3440 msgr2=0x7f6b740a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:12.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b740a3440 0x7f6b740a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b80005e10 tx=0x7f6b80005da0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c102dd0 msgr2=0x7f6b8c198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:12.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c102dd0 0x7f6b8c198540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00ba50 tx=0x7f6b7c00bf10 comp rx=0 tx=0).stop 2024-09-19T06:47:12.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 shutdown_connections 2024-09-19T06:47:12.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b740a3440 0x7f6b740a5900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b8c108300 0x7f6b8c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b8c103780 0x7f6b8c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 --2- 172.21.15.159:0/3924801513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b8c102dd0 0x7f6b8c198540 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:12.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 >> 172.21.15.159:0/3924801513 conn(0x7f6b8c0fc7d0 msgr2=0x7f6b8c1063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:12.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 shutdown_connections 2024-09-19T06:47:12.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:12.872+0000 7f6b93f1f640 1 -- 172.21.15.159:0/3924801513 wait complete. 2024-09-19T06:47:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:12 smithi189 ceph-mon[34880]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:12 smithi189 ceph-mon[34880]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:13.678 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-19T06:47:12.554831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1382383,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":802,"num_read_kb":821,"num_write":531,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":878,"ondisk_log_size":878,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377004,"kb_used_data":11064,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564820,"statfs":{"total":1151940427776,"available":1151554375680,"internally_reserved":0,"allocated":11329536,"data_stored":9439149,"data_compressed":320121,"data_compressed_allocated":430080,"data_compressed_original":4190208,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":453,"num_write":148,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.995376"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596299+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:47:00.596299+0000","last_peered":"2024-09-19T06:47:00.596299+0000","last_clean":"2024-09-19T06:47:00.596299+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:47:00.596299+0000","last_undegraded":"2024-09-19T06:47:00.596299+0000","last_fullsized":"2024-09-19T06:47:00.596299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590995+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:47:00.590995+0000","last_peered":"2024-09-19T06:47:00.590995+0000","last_clean":"2024-09-19T06:47:00.590995+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:47:00.590995+0000","last_undegraded":"2024-09-19T06:47:00.590995+0000","last_fullsized":"2024-09-19T06:47:00.590995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595558+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:47:00.595558+0000","last_peered":"2024-09-19T06:47:00.595558+0000","last_clean":"2024-09-19T06:47:00.595558+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:47:00.595558+0000","last_undegraded":"2024-09-19T06:47:00.595558+0000","last_fullsized":"2024-09-19T06:47:00.595558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.575726+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:47:00.575726+0000","last_peered":"2024-09-19T06:47:00.575726+0000","last_clean":"2024-09-19T06:47:00.575726+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:47:00.575726+0000","last_undegraded":"2024-09-19T06:47:00.575726+0000","last_fullsized":"2024-09-19T06:47:00.575726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594145+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:47:00.594145+0000","last_peered":"2024-09-19T06:47:00.594145+0000","last_clean":"2024-09-19T06:47:00.594145+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:47:00.594145+0000","last_undegraded":"2024-09-19T06:47:00.594145+0000","last_fullsized":"2024-09-19T06:47:00.594145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592217+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:47:00.592217+0000","last_peered":"2024-09-19T06:47:00.592217+0000","last_clean":"2024-09-19T06:47:00.592217+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:47:00.592217+0000","last_undegraded":"2024-09-19T06:47:00.592217+0000","last_fullsized":"2024-09-19T06:47:00.592217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581506+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:47:00.581506+0000","last_peered":"2024-09-19T06:47:00.581506+0000","last_clean":"2024-09-19T06:47:00.581506+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:47:00.581506+0000","last_undegraded":"2024-09-19T06:47:00.581506+0000","last_fullsized":"2024-09-19T06:47:00.581506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594128+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:47:00.594128+0000","last_peered":"2024-09-19T06:47:00.594128+0000","last_clean":"2024-09-19T06:47:00.594128+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:47:00.594128+0000","last_undegraded":"2024-09-19T06:47:00.594128+0000","last_fullsized":"2024-09-19T06:47:00.594128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587594+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:47:00.587594+0000","last_peered":"2024-09-19T06:47:00.587594+0000","last_clean":"2024-09-19T06:47:00.587594+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:47:00.587594+0000","last_undegraded":"2024-09-19T06:47:00.587594+0000","last_fullsized":"2024-09-19T06:47:00.587594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585123+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:47:00.585123+0000","last_peered":"2024-09-19T06:47:00.585123+0000","last_clean":"2024-09-19T06:47:00.585123+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:47:00.585123+0000","last_undegraded":"2024-09-19T06:47:00.585123+0000","last_fullsized":"2024-09-19T06:47:00.585123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585680+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:47:00.585680+0000","last_peered":"2024-09-19T06:47:00.585680+0000","last_clean":"2024-09-19T06:47:00.585680+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:47:00.585680+0000","last_undegraded":"2024-09-19T06:47:00.585680+0000","last_fullsized":"2024-09-19T06:47:00.585680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580960+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:47:00.580960+0000","last_peered":"2024-09-19T06:47:00.580960+0000","last_clean":"2024-09-19T06:47:00.580960+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:47:00.580960+0000","last_undegraded":"2024-09-19T06:47:00.580960+0000","last_fullsized":"2024-09-19T06:47:00.580960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590511+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:47:00.590511+0000","last_peered":"2024-09-19T06:47:00.590511+0000","last_clean":"2024-09-19T06:47:00.590511+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:47:00.590511+0000","last_undegraded":"2024-09-19T06:47:00.590511+0000","last_fullsized":"2024-09-19T06:47:00.590511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594823+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:47:00.594823+0000","last_peered":"2024-09-19T06:47:00.594823+0000","last_clean":"2024-09-19T06:47:00.594823+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:47:00.594823+0000","last_undegraded":"2024-09-19T06:47:00.594823+0000","last_fullsized":"2024-09-19T06:47:00.594823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590707+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:47:00.590707+0000","last_peered":"2024-09-19T06:47:00.590707+0000","last_clean":"2024-09-19T06:47:00.590707+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:47:00.590707+0000","last_undegraded":"2024-09-19T06:47:00.590707+0000","last_fullsized":"2024-09-19T06:47:00.590707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595272+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:47:00.595272+0000","last_peered":"2024-09-19T06:47:00.595272+0000","last_clean":"2024-09-19T06:47:00.595272+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:47:00.595272+0000","last_undegraded":"2024-09-19T06:47:00.595272+0000","last_fullsized":"2024-09-19T06:47:00.595272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596210+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:47:00.596210+0000","last_peered":"2024-09-19T06:47:00.596210+0000","last_clean":"2024-09-19T06:47:00.596210+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:47:00.596210+0000","last_undegraded":"2024-09-19T06:47:00.596210+0000","last_fullsized":"2024-09-19T06:47:00.596210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585734+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:47:00.585734+0000","last_peered":"2024-09-19T06:47:00.585734+0000","last_clean":"2024-09-19T06:47:00.585734+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:47:00.585734+0000","last_undegraded":"2024-09-19T06:47:00.585734+0000","last_fullsized":"2024-09-19T06:47:00.585734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.578454+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:47:00.578454+0000","last_peered":"2024-09-19T06:47:00.578454+0000","last_clean":"2024-09-19T06:47:00.578454+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:47:00.578454+0000","last_undegraded":"2024-09-19T06:47:00.578454+0000","last_fullsized":"2024-09-19T06:47:00.578454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580253+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:47:00.580253+0000","last_peered":"2024-09-19T06:47:00.580253+0000","last_clean":"2024-09-19T06:47:00.580253+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:47:00.580253+0000","last_undegraded":"2024-09-19T06:47:00.580253+0000","last_fullsized":"2024-09-19T06:47:00.580253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595663+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:47:00.595663+0000","last_peered":"2024-09-19T06:47:00.595663+0000","last_clean":"2024-09-19T06:47:00.595663+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:47:00.595663+0000","last_undegraded":"2024-09-19T06:47:00.595663+0000","last_fullsized":"2024-09-19T06:47:00.595663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586577+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:47:00.586577+0000","last_peered":"2024-09-19T06:47:00.586577+0000","last_clean":"2024-09-19T06:47:00.586577+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:47:00.586577+0000","last_undegraded":"2024-09-19T06:47:00.586577+0000","last_fullsized":"2024-09-19T06:47:00.586577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589497+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:47:00.589497+0000","last_peered":"2024-09-19T06:47:00.589497+0000","last_clean":"2024-09-19T06:47:00.589497+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:47:00.589497+0000","last_undegraded":"2024-09-19T06:47:00.589497+0000","last_fullsized":"2024-09-19T06:47:00.589497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586950+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:47:00.586950+0000","last_peered":"2024-09-19T06:47:00.586950+0000","last_clean":"2024-09-19T06:47:00.586950+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:47:00.586950+0000","last_undegraded":"2024-09-19T06:47:00.586950+0000","last_fullsized":"2024-09-19T06:47:00.586950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584482+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:47:00.584482+0000","last_peered":"2024-09-19T06:47:00.584482+0000","last_clean":"2024-09-19T06:47:00.584482+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:47:00.584482+0000","last_undegraded":"2024-09-19T06:47:00.584482+0000","last_fullsized":"2024-09-19T06:47:00.584482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.576867+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:47:00.576867+0000","last_peered":"2024-09-19T06:47:00.576867+0000","last_clean":"2024-09-19T06:47:00.576867+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:47:00.576867+0000","last_undegraded":"2024-09-19T06:47:00.576867+0000","last_fullsized":"2024-09-19T06:47:00.576867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582332+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:47:00.582332+0000","last_peered":"2024-09-19T06:47:00.582332+0000","last_clean":"2024-09-19T06:47:00.582332+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:47:00.582332+0000","last_undegraded":"2024-09-19T06:47:00.582332+0000","last_fullsized":"2024-09-19T06:47:00.582332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594980+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:47:00.594980+0000","last_peered":"2024-09-19T06:47:00.594980+0000","last_clean":"2024-09-19T06:47:00.594980+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:47:00.594980+0000","last_undegraded":"2024-09-19T06:47:00.594980+0000","last_fullsized":"2024-09-19T06:47:00.594980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596274+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:47:00.596274+0000","last_peered":"2024-09-19T06:47:00.596274+0000","last_clean":"2024-09-19T06:47:00.596274+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:47:00.596274+0000","last_undegraded":"2024-09-19T06:47:00.596274+0000","last_fullsized":"2024-09-19T06:47:00.596274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583987+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:47:00.583987+0000","last_peered":"2024-09-19T06:47:00.583987+0000","last_clean":"2024-09-19T06:47:00.583987+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:47:00.583987+0000","last_undegraded":"2024-09-19T06:47:00.583987+0000","last_fullsized":"2024-09-19T06:47:00.583987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577783+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:47:00.577783+0000","last_peered":"2024-09-19T06:47:00.577783+0000","last_clean":"2024-09-19T06:47:00.577783+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:47:00.577783+0000","last_undegraded":"2024-09-19T06:47:00.577783+0000","last_fullsized":"2024-09-19T06:47:00.577783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583197+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:47:00.583197+0000","last_peered":"2024-09-19T06:47:00.583197+0000","last_clean":"2024-09-19T06:47:00.583197+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:47:00.583197+0000","last_undegraded":"2024-09-19T06:47:00.583197+0000","last_fullsized":"2024-09-19T06:47:00.583197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587636+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:47:00.587636+0000","last_peered":"2024-09-19T06:47:00.587636+0000","last_clean":"2024-09-19T06:47:00.587636+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:47:00.587636+0000","last_undegraded":"2024-09-19T06:47:00.587636+0000","last_fullsized":"2024-09-19T06:47:00.587636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537764+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:47:00.537764+0000","last_peered":"2024-09-19T06:47:00.537764+0000","last_clean":"2024-09-19T06:47:00.537764+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:47:00.537764+0000","last_undegraded":"2024-09-19T06:47:00.537764+0000","last_fullsized":"2024-09-19T06:47:00.537764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594590+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:47:00.594590+0000","last_peered":"2024-09-19T06:47:00.594590+0000","last_clean":"2024-09-19T06:47:00.594590+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:47:00.594590+0000","last_undegraded":"2024-09-19T06:47:00.594590+0000","last_fullsized":"2024-09-19T06:47:00.594590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544151+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:47:00.544151+0000","last_peered":"2024-09-19T06:47:00.544151+0000","last_clean":"2024-09-19T06:47:00.544151+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:47:00.544151+0000","last_undegraded":"2024-09-19T06:47:00.544151+0000","last_fullsized":"2024-09-19T06:47:00.544151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536382+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:47:00.536382+0000","last_peered":"2024-09-19T06:47:00.536382+0000","last_clean":"2024-09-19T06:47:00.536382+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:47:00.536382+0000","last_undegraded":"2024-09-19T06:47:00.536382+0000","last_fullsized":"2024-09-19T06:47:00.536382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589344+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:47:00.589344+0000","last_peered":"2024-09-19T06:47:00.589344+0000","last_clean":"2024-09-19T06:47:00.589344+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:47:00.589344+0000","last_undegraded":"2024-09-19T06:47:00.589344+0000","last_fullsized":"2024-09-19T06:47:00.589344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.538035+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:47:00.538035+0000","last_peered":"2024-09-19T06:47:00.538035+0000","last_clean":"2024-09-19T06:47:00.538035+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:47:00.538035+0000","last_undegraded":"2024-09-19T06:47:00.538035+0000","last_fullsized":"2024-09-19T06:47:00.538035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592761+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:47:00.592761+0000","last_peered":"2024-09-19T06:47:00.592761+0000","last_clean":"2024-09-19T06:47:00.592761+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:47:00.592761+0000","last_undegraded":"2024-09-19T06:47:00.592761+0000","last_fullsized":"2024-09-19T06:47:00.592761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544365+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:47:00.544365+0000","last_peered":"2024-09-19T06:47:00.544365+0000","last_clean":"2024-09-19T06:47:00.544365+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:47:00.544365+0000","last_undegraded":"2024-09-19T06:47:00.544365+0000","last_fullsized":"2024-09-19T06:47:00.544365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587810+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:47:00.587810+0000","last_peered":"2024-09-19T06:47:00.587810+0000","last_clean":"2024-09-19T06:47:00.587810+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:47:00.587810+0000","last_undegraded":"2024-09-19T06:47:00.587810+0000","last_fullsized":"2024-09-19T06:47:00.587810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.548844+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:47:00.548844+0000","last_peered":"2024-09-19T06:47:00.548844+0000","last_clean":"2024-09-19T06:47:00.548844+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:47:00.548844+0000","last_undegraded":"2024-09-19T06:47:00.548844+0000","last_fullsized":"2024-09-19T06:47:00.548844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595196+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:47:00.595196+0000","last_peered":"2024-09-19T06:47:00.595196+0000","last_clean":"2024-09-19T06:47:00.595196+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:47:00.595196+0000","last_undegraded":"2024-09-19T06:47:00.595196+0000","last_fullsized":"2024-09-19T06:47:00.595196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537912+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:47:00.537912+0000","last_peered":"2024-09-19T06:47:00.537912+0000","last_clean":"2024-09-19T06:47:00.537912+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:47:00.537912+0000","last_undegraded":"2024-09-19T06:47:00.537912+0000","last_fullsized":"2024-09-19T06:47:00.537912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582419+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:47:00.582419+0000","last_peered":"2024-09-19T06:47:00.582419+0000","last_clean":"2024-09-19T06:47:00.582419+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:47:00.582419+0000","last_undegraded":"2024-09-19T06:47:00.582419+0000","last_fullsized":"2024-09-19T06:47:00.582419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":271,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:10.972189+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:47:10.972189+0000","last_peered":"2024-09-19T06:47:10.972189+0000","last_clean":"2024-09-19T06:47:10.972189+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:47:10.972189+0000","last_undegraded":"2024-09-19T06:47:10.972189+0000","last_fullsized":"2024-09-19T06:47:10.972189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":175,"num_write":34,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577030+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:47:00.577030+0000","last_peered":"2024-09-19T06:47:00.577030+0000","last_clean":"2024-09-19T06:47:00.577030+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:47:00.577030+0000","last_undegraded":"2024-09-19T06:47:00.577030+0000","last_fullsized":"2024-09-19T06:47:00.577030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.545877+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:47:00.545877+0000","last_peered":"2024-09-19T06:47:00.545877+0000","last_clean":"2024-09-19T06:47:00.545877+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:47:00.545877+0000","last_undegraded":"2024-09-19T06:47:00.545877+0000","last_fullsized":"2024-09-19T06:47:00.545877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589299+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:47:00.589299+0000","last_peered":"2024-09-19T06:47:00.589299+0000","last_clean":"2024-09-19T06:47:00.589299+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:47:00.589299+0000","last_undegraded":"2024-09-19T06:47:00.589299+0000","last_fullsized":"2024-09-19T06:47:00.589299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537682+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:47:00.537682+0000","last_peered":"2024-09-19T06:47:00.537682+0000","last_clean":"2024-09-19T06:47:00.537682+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:47:00.537682+0000","last_undegraded":"2024-09-19T06:47:00.537682+0000","last_fullsized":"2024-09-19T06:47:00.537682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584015+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:47:00.584015+0000","last_peered":"2024-09-19T06:47:00.584015+0000","last_clean":"2024-09-19T06:47:00.584015+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:47:00.584015+0000","last_undegraded":"2024-09-19T06:47:00.584015+0000","last_fullsized":"2024-09-19T06:47:00.584015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549262+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:47:00.549262+0000","last_peered":"2024-09-19T06:47:00.549262+0000","last_clean":"2024-09-19T06:47:00.549262+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:47:00.549262+0000","last_undegraded":"2024-09-19T06:47:00.549262+0000","last_fullsized":"2024-09-19T06:47:00.549262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584090+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:47:00.584090+0000","last_peered":"2024-09-19T06:47:00.584090+0000","last_clean":"2024-09-19T06:47:00.584090+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:47:00.584090+0000","last_undegraded":"2024-09-19T06:47:00.584090+0000","last_fullsized":"2024-09-19T06:47:00.584090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.550930+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:47:00.550930+0000","last_peered":"2024-09-19T06:47:00.550930+0000","last_clean":"2024-09-19T06:47:00.550930+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:47:00.550930+0000","last_undegraded":"2024-09-19T06:47:00.550930+0000","last_fullsized":"2024-09-19T06:47:00.550930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580495+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:47:00.580495+0000","last_peered":"2024-09-19T06:47:00.580495+0000","last_clean":"2024-09-19T06:47:00.580495+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:47:00.580495+0000","last_undegraded":"2024-09-19T06:47:00.580495+0000","last_fullsized":"2024-09-19T06:47:00.580495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560644+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:47:00.560644+0000","last_peered":"2024-09-19T06:47:00.560644+0000","last_clean":"2024-09-19T06:47:00.560644+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:47:00.560644+0000","last_undegraded":"2024-09-19T06:47:00.560644+0000","last_fullsized":"2024-09-19T06:47:00.560644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581982+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:47:00.581982+0000","last_peered":"2024-09-19T06:47:00.581982+0000","last_clean":"2024-09-19T06:47:00.581982+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:47:00.581982+0000","last_undegraded":"2024-09-19T06:47:00.581982+0000","last_fullsized":"2024-09-19T06:47:00.581982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536735+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:47:00.536735+0000","last_peered":"2024-09-19T06:47:00.536735+0000","last_clean":"2024-09-19T06:47:00.536735+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:47:00.536735+0000","last_undegraded":"2024-09-19T06:47:00.536735+0000","last_fullsized":"2024-09-19T06:47:00.536735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579492+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:47:00.579492+0000","last_peered":"2024-09-19T06:47:00.579492+0000","last_clean":"2024-09-19T06:47:00.579492+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:47:00.579492+0000","last_undegraded":"2024-09-19T06:47:00.579492+0000","last_fullsized":"2024-09-19T06:47:00.579492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'65","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:10.606059+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:47:10.606059+0000","last_peered":"2024-09-19T06:47:10.606059+0000","last_clean":"2024-09-19T06:47:10.606059+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:47:10.606059+0000","last_undegraded":"2024-09-19T06:47:10.606059+0000","last_fullsized":"2024-09-19T06:47:10.606059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594237+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:47:00.594237+0000","last_peered":"2024-09-19T06:47:00.594237+0000","last_clean":"2024-09-19T06:47:00.594237+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:47:00.594237+0000","last_undegraded":"2024-09-19T06:47:00.594237+0000","last_fullsized":"2024-09-19T06:47:00.594237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.546255+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:47:00.546255+0000","last_peered":"2024-09-19T06:47:00.546255+0000","last_clean":"2024-09-19T06:47:00.546255+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:47:00.546255+0000","last_undegraded":"2024-09-19T06:47:00.546255+0000","last_fullsized":"2024-09-19T06:47:00.546255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585679+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:47:00.585679+0000","last_peered":"2024-09-19T06:47:00.585679+0000","last_clean":"2024-09-19T06:47:00.585679+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:47:00.585679+0000","last_undegraded":"2024-09-19T06:47:00.585679+0000","last_fullsized":"2024-09-19T06:47:00.585679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"82'148","reported_seq":393,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:02.663640+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:47:02.663640+0000","last_peered":"2024-09-19T06:47:02.663640+0000","last_clean":"2024-09-19T06:47:02.663640+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:47:02.663640+0000","last_undegraded":"2024-09-19T06:47:02.663640+0000","last_fullsized":"2024-09-19T06:47:02.663640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549180+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:47:00.549180+0000","last_peered":"2024-09-19T06:47:00.549180+0000","last_clean":"2024-09-19T06:47:00.549180+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:47:00.549180+0000","last_undegraded":"2024-09-19T06:47:00.549180+0000","last_fullsized":"2024-09-19T06:47:00.549180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593914+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:47:00.593914+0000","last_peered":"2024-09-19T06:47:00.593914+0000","last_clean":"2024-09-19T06:47:00.593914+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:47:00.593914+0000","last_undegraded":"2024-09-19T06:47:00.593914+0000","last_fullsized":"2024-09-19T06:47:00.593914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549165+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:47:00.549165+0000","last_peered":"2024-09-19T06:47:00.549165+0000","last_clean":"2024-09-19T06:47:00.549165+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:47:00.549165+0000","last_undegraded":"2024-09-19T06:47:00.549165+0000","last_fullsized":"2024-09-19T06:47:00.549165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577578+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:47:00.577578+0000","last_peered":"2024-09-19T06:47:00.577578+0000","last_clean":"2024-09-19T06:47:00.577578+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:47:00.577578+0000","last_undegraded":"2024-09-19T06:47:00.577578+0000","last_fullsized":"2024-09-19T06:47:00.577578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536478+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:47:00.536478+0000","last_peered":"2024-09-19T06:47:00.536478+0000","last_clean":"2024-09-19T06:47:00.536478+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:47:00.536478+0000","last_undegraded":"2024-09-19T06:47:00.536478+0000","last_fullsized":"2024-09-19T06:47:00.536478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579472+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:47:00.579472+0000","last_peered":"2024-09-19T06:47:00.579472+0000","last_clean":"2024-09-19T06:47:00.579472+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:47:00.579472+0000","last_undegraded":"2024-09-19T06:47:00.579472+0000","last_fullsized":"2024-09-19T06:47:00.579472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549300+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:47:00.549300+0000","last_peered":"2024-09-19T06:47:00.549300+0000","last_clean":"2024-09-19T06:47:00.549300+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:47:00.549300+0000","last_undegraded":"2024-09-19T06:47:00.549300+0000","last_fullsized":"2024-09-19T06:47:00.549300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579645+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:47:00.579645+0000","last_peered":"2024-09-19T06:47:00.579645+0000","last_clean":"2024-09-19T06:47:00.579645+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:47:00.579645+0000","last_undegraded":"2024-09-19T06:47:00.579645+0000","last_fullsized":"2024-09-19T06:47:00.579645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556514+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:47:00.556514+0000","last_peered":"2024-09-19T06:47:00.556514+0000","last_clean":"2024-09-19T06:47:00.556514+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:47:00.556514+0000","last_undegraded":"2024-09-19T06:47:00.556514+0000","last_fullsized":"2024-09-19T06:47:00.556514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587136+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:47:00.587136+0000","last_peered":"2024-09-19T06:47:00.587136+0000","last_clean":"2024-09-19T06:47:00.587136+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:47:00.587136+0000","last_undegraded":"2024-09-19T06:47:00.587136+0000","last_fullsized":"2024-09-19T06:47:00.587136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552471+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:47:00.552471+0000","last_peered":"2024-09-19T06:47:00.552471+0000","last_clean":"2024-09-19T06:47:00.552471+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:47:00.552471+0000","last_undegraded":"2024-09-19T06:47:00.552471+0000","last_fullsized":"2024-09-19T06:47:00.552471+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579287+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:47:00.579287+0000","last_peered":"2024-09-19T06:47:00.579287+0000","last_clean":"2024-09-19T06:47:00.579287+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:47:00.579287+0000","last_undegraded":"2024-09-19T06:47:00.579287+0000","last_fullsized":"2024-09-19T06:47:00.579287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'98","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:10.978228+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:47:10.978228+0000","last_peered":"2024-09-19T06:47:10.978228+0000","last_clean":"2024-09-19T06:47:10.978228+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:47:10.978228+0000","last_undegraded":"2024-09-19T06:47:10.978228+0000","last_fullsized":"2024-09-19T06:47:10.978228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":181,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593306+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:47:00.593306+0000","last_peered":"2024-09-19T06:47:00.593306+0000","last_clean":"2024-09-19T06:47:00.593306+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:47:00.593306+0000","last_undegraded":"2024-09-19T06:47:00.593306+0000","last_fullsized":"2024-09-19T06:47:00.593306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549571+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:47:00.549571+0000","last_peered":"2024-09-19T06:47:00.549571+0000","last_clean":"2024-09-19T06:47:00.549571+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:47:00.549571+0000","last_undegraded":"2024-09-19T06:47:00.549571+0000","last_fullsized":"2024-09-19T06:47:00.549571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596329+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:47:00.596329+0000","last_peered":"2024-09-19T06:47:00.596329+0000","last_clean":"2024-09-19T06:47:00.596329+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:47:00.596329+0000","last_undegraded":"2024-09-19T06:47:00.596329+0000","last_fullsized":"2024-09-19T06:47:00.596329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536872+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:47:00.536872+0000","last_peered":"2024-09-19T06:47:00.536872+0000","last_clean":"2024-09-19T06:47:00.536872+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:47:00.536872+0000","last_undegraded":"2024-09-19T06:47:00.536872+0000","last_fullsized":"2024-09-19T06:47:00.536872+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.573059+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:47:00.573059+0000","last_peered":"2024-09-19T06:47:00.573059+0000","last_clean":"2024-09-19T06:47:00.573059+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:47:00.573059+0000","last_undegraded":"2024-09-19T06:47:00.573059+0000","last_fullsized":"2024-09-19T06:47:00.573059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.551180+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:47:00.551180+0000","last_peered":"2024-09-19T06:47:00.551180+0000","last_clean":"2024-09-19T06:47:00.551180+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:47:00.551180+0000","last_undegraded":"2024-09-19T06:47:00.551180+0000","last_fullsized":"2024-09-19T06:47:00.551180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595812+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:47:00.595812+0000","last_peered":"2024-09-19T06:47:00.595812+0000","last_clean":"2024-09-19T06:47:00.595812+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:47:00.595812+0000","last_undegraded":"2024-09-19T06:47:00.595812+0000","last_fullsized":"2024-09-19T06:47:00.595812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.555196+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:47:00.555196+0000","last_peered":"2024-09-19T06:47:00.555196+0000","last_clean":"2024-09-19T06:47:00.555196+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:47:00.555196+0000","last_undegraded":"2024-09-19T06:47:00.555196+0000","last_fullsized":"2024-09-19T06:47:00.555196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.597003+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:47:00.597003+0000","last_peered":"2024-09-19T06:47:00.597003+0000","last_clean":"2024-09-19T06:47:00.597003+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:47:00.597003+0000","last_undegraded":"2024-09-19T06:47:00.597003+0000","last_fullsized":"2024-09-19T06:47:00.597003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560958+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:47:00.560958+0000","last_peered":"2024-09-19T06:47:00.560958+0000","last_clean":"2024-09-19T06:47:00.560958+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:47:00.560958+0000","last_undegraded":"2024-09-19T06:47:00.560958+0000","last_fullsized":"2024-09-19T06:47:00.560958+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585140+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:47:00.585140+0000","last_peered":"2024-09-19T06:47:00.585140+0000","last_clean":"2024-09-19T06:47:00.585140+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:47:00.585140+0000","last_undegraded":"2024-09-19T06:47:00.585140+0000","last_fullsized":"2024-09-19T06:47:00.585140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587229+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:47:00.587229+0000","last_peered":"2024-09-19T06:47:00.587229+0000","last_clean":"2024-09-19T06:47:00.587229+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:47:00.587229+0000","last_undegraded":"2024-09-19T06:47:00.587229+0000","last_fullsized":"2024-09-19T06:47:00.587229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556945+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:47:00.556945+0000","last_peered":"2024-09-19T06:47:00.556945+0000","last_clean":"2024-09-19T06:47:00.556945+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:47:00.556945+0000","last_undegraded":"2024-09-19T06:47:00.556945+0000","last_fullsized":"2024-09-19T06:47:00.556945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587670+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:47:00.587670+0000","last_peered":"2024-09-19T06:47:00.587670+0000","last_clean":"2024-09-19T06:47:00.587670+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:47:00.587670+0000","last_undegraded":"2024-09-19T06:47:00.587670+0000","last_fullsized":"2024-09-19T06:47:00.587670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552359+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:47:00.552359+0000","last_peered":"2024-09-19T06:47:00.552359+0000","last_clean":"2024-09-19T06:47:00.552359+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:47:00.552359+0000","last_undegraded":"2024-09-19T06:47:00.552359+0000","last_fullsized":"2024-09-19T06:47:00.552359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596914+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:47:00.596914+0000","last_peered":"2024-09-19T06:47:00.596914+0000","last_clean":"2024-09-19T06:47:00.596914+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:47:00.596914+0000","last_undegraded":"2024-09-19T06:47:00.596914+0000","last_fullsized":"2024-09-19T06:47:00.596914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552705+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:47:00.552705+0000","last_peered":"2024-09-19T06:47:00.552705+0000","last_clean":"2024-09-19T06:47:00.552705+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:47:00.552705+0000","last_undegraded":"2024-09-19T06:47:00.552705+0000","last_fullsized":"2024-09-19T06:47:00.552705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592794+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:47:00.592794+0000","last_peered":"2024-09-19T06:47:00.592794+0000","last_clean":"2024-09-19T06:47:00.592794+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:47:00.592794+0000","last_undegraded":"2024-09-19T06:47:00.592794+0000","last_fullsized":"2024-09-19T06:47:00.592794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556381+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:47:00.556381+0000","last_peered":"2024-09-19T06:47:00.556381+0000","last_clean":"2024-09-19T06:47:00.556381+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:47:00.556381+0000","last_undegraded":"2024-09-19T06:47:00.556381+0000","last_fullsized":"2024-09-19T06:47:00.556381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":791781,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":565,"num_read_kb":491,"num_write":328,"num_write_kb":2320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":2375343,"data_compressed":108912,"data_compressed_allocated":147456,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107385,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612642,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":441000,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":1429446,"data_compressed":61462,"data_compressed_allocated":81920,"data_compressed_original":929792,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005101,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":834798,"data_compressed":27941,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":834820,"data_compressed":27941,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1032067,"data_compressed":44447,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":441117,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":1359899,"data_compressed":59649,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441022,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":1162786,"data_compressed":43143,"data_compressed_allocated":57344,"data_compressed_original":724992,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476816,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":510569,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":962560,"data_stored":510535,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441090,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":69535,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69569,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":721552,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":328414,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":397961,"data_compressed":17015,"data_compressed_allocated":24576,"data_compressed_original":315392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:47:13.683 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:47:13.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:13 smithi203 ceph-mon[35473]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 47 op/s 2024-09-19T06:47:13.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:13 smithi189 ceph-mon[34880]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 47 op/s 2024-09-19T06:47:13.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:13 smithi159 ceph-mon[30935]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 47 op/s 2024-09-19T06:47:13.930 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.382+0000 7f5d68a44640 1 -- 172.21.15.159:0/3101324982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64101420 msgr2=0x7f5d6410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.382+0000 7f5d68a44640 1 --2- 172.21.15.159:0/3101324982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64101420 0x7f5d6410d950 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009930 tx=0x7f5d5402a420 comp rx=0 tx=0).stop 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.383+0000 7f5d68a44640 1 -- 172.21.15.159:0/3101324982 shutdown_connections 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.383+0000 7f5d68a44640 1 --2- 172.21.15.159:0/3101324982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64101420 0x7f5d6410d950 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.383+0000 7f5d68a44640 1 --2- 172.21.15.159:0/3101324982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d64100a80 0x7f5d64100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.383+0000 7f5d68a44640 1 --2- 172.21.15.159:0/3101324982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d64106a80 0x7f5d64106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.383+0000 7f5d68a44640 1 -- 172.21.15.159:0/3101324982 >> 172.21.15.159:0/3101324982 conn(0x7f5d640fc7a0 msgr2=0x7f5d640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.383+0000 7f5d68a44640 1 -- 172.21.15.159:0/3101324982 shutdown_connections 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.383+0000 7f5d68a44640 1 -- 172.21.15.159:0/3101324982 wait complete. 2024-09-19T06:47:14.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d68a44640 1 Processor -- start 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d68a44640 1 -- start start 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d68a44640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d64100a80 0x7f5d64199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d68a44640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d64101420 0x7f5d641997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d68a44640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64106a80 0x7f5d641a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d68a44640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5d64110e80 con 0x7f5d64106a80 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d68a44640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d64110d00 con 0x7f5d64100a80 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d68a44640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d64111000 con 0x7f5d64101420 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d62d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64106a80 0x7f5d641a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d62d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64106a80 0x7f5d641a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46150/0 (socket says 172.21.15.159:46150) 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d62d9d640 1 -- 172.21.15.159:0/4222765397 learned_addr learned my addr 172.21.15.159:0/4222765397 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d6259c640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d64100a80 0x7f5d64199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d61d9b640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d64101420 0x7f5d641997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:14.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d62d9d640 1 -- 172.21.15.159:0/4222765397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d64101420 msgr2=0x7f5d641997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d62d9d640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d64101420 0x7f5d641997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d62d9d640 1 -- 172.21.15.159:0/4222765397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d64100a80 msgr2=0x7f5d64199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d62d9d640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d64100a80 0x7f5d64199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d62d9d640 1 -- 172.21.15.159:0/4222765397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d641a4850 con 0x7f5d64106a80 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.384+0000 7f5d61d9b640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d64101420 0x7f5d641997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.385+0000 7f5d62d9d640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64106a80 0x7f5d641a4310 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d54005ab0 tx=0x7f5d540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.385+0000 7f5d5b7fe640 1 -- 172.21.15.159:0/4222765397 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5403f030 con 0x7f5d64106a80 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.385+0000 7f5d5b7fe640 1 -- 172.21.15.159:0/4222765397 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d54003ce0 con 0x7f5d64106a80 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.385+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d641a4a20 con 0x7f5d64106a80 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.385+0000 7f5d5b7fe640 1 -- 172.21.15.159:0/4222765397 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54035070 con 0x7f5d64106a80 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.385+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d641a4e70 con 0x7f5d64106a80 2024-09-19T06:47:14.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.386+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d64100ee0 con 0x7f5d64106a80 2024-09-19T06:47:14.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.387+0000 7f5d5b7fe640 1 -- 172.21.15.159:0/4222765397 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f5d54042030 con 0x7f5d64106a80 2024-09-19T06:47:14.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.387+0000 7f5d5b7fe640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5d500a3440 0x7f5d500a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:14.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.388+0000 7f5d6259c640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5d500a3440 0x7f5d500a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:14.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.388+0000 7f5d5b7fe640 1 -- 172.21.15.159:0/4222765397 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f5d540f0390 con 0x7f5d64106a80 2024-09-19T06:47:14.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.388+0000 7f5d6259c640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5d500a3440 0x7f5d500a5900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005c40 tx=0x7f5d5c00a590 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:14.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.392+0000 7f5d5b7fe640 1 -- 172.21.15.159:0/4222765397 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d540bcbd0 con 0x7f5d64106a80 2024-09-19T06:47:14.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.555+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d64062630 con 0x7f5d500a3440 2024-09-19T06:47:14.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.561+0000 7f5d5b7fe640 1 -- 172.21.15.159:0/4222765397 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257971 (secure 0 0 0) 0x7f5d64062630 con 0x7f5d500a3440 2024-09-19T06:47:14.564 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:14.565 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:47:14.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5d500a3440 msgr2=0x7f5d500a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:14.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5d500a3440 0x7f5d500a5900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005c40 tx=0x7f5d5c00a590 comp rx=0 tx=0).stop 2024-09-19T06:47:14.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64106a80 msgr2=0x7f5d641a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:14.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64106a80 0x7f5d641a4310 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d54005ab0 tx=0x7f5d540042f0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 shutdown_connections 2024-09-19T06:47:14.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5d500a3440 0x7f5d500a5900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d64106a80 0x7f5d641a4310 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d64101420 0x7f5d641997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 --2- 172.21.15.159:0/4222765397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d64100a80 0x7f5d64199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:14.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 >> 172.21.15.159:0/4222765397 conn(0x7f5d640fc7a0 msgr2=0x7f5d640fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:14.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 shutdown_connections 2024-09-19T06:47:14.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:14.564+0000 7f5d68a44640 1 -- 172.21.15.159:0/4222765397 wait complete. 2024-09-19T06:47:14.876 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:14 smithi159 ceph-mon[30935]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:14.876 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:14 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:47:14.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:14 smithi189 ceph-mon[34880]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:14 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:47:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:14 smithi203 ceph-mon[35473]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:15.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:14 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:47:15.337 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-19T06:47:14.555347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1382383,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":802,"num_read_kb":821,"num_write":531,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":878,"ondisk_log_size":878,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377004,"kb_used_data":11064,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564820,"statfs":{"total":1151940427776,"available":1151554375680,"internally_reserved":0,"allocated":11329536,"data_stored":9439149,"data_compressed":320121,"data_compressed_allocated":430080,"data_compressed_original":4190208,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":453,"num_write":148,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002570"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596299+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:47:00.596299+0000","last_peered":"2024-09-19T06:47:00.596299+0000","last_clean":"2024-09-19T06:47:00.596299+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:47:00.596299+0000","last_undegraded":"2024-09-19T06:47:00.596299+0000","last_fullsized":"2024-09-19T06:47:00.596299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590995+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:47:00.590995+0000","last_peered":"2024-09-19T06:47:00.590995+0000","last_clean":"2024-09-19T06:47:00.590995+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:47:00.590995+0000","last_undegraded":"2024-09-19T06:47:00.590995+0000","last_fullsized":"2024-09-19T06:47:00.590995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595558+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:47:00.595558+0000","last_peered":"2024-09-19T06:47:00.595558+0000","last_clean":"2024-09-19T06:47:00.595558+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:47:00.595558+0000","last_undegraded":"2024-09-19T06:47:00.595558+0000","last_fullsized":"2024-09-19T06:47:00.595558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.575726+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:47:00.575726+0000","last_peered":"2024-09-19T06:47:00.575726+0000","last_clean":"2024-09-19T06:47:00.575726+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:47:00.575726+0000","last_undegraded":"2024-09-19T06:47:00.575726+0000","last_fullsized":"2024-09-19T06:47:00.575726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594145+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:47:00.594145+0000","last_peered":"2024-09-19T06:47:00.594145+0000","last_clean":"2024-09-19T06:47:00.594145+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:47:00.594145+0000","last_undegraded":"2024-09-19T06:47:00.594145+0000","last_fullsized":"2024-09-19T06:47:00.594145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592217+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:47:00.592217+0000","last_peered":"2024-09-19T06:47:00.592217+0000","last_clean":"2024-09-19T06:47:00.592217+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:47:00.592217+0000","last_undegraded":"2024-09-19T06:47:00.592217+0000","last_fullsized":"2024-09-19T06:47:00.592217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581506+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:47:00.581506+0000","last_peered":"2024-09-19T06:47:00.581506+0000","last_clean":"2024-09-19T06:47:00.581506+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:47:00.581506+0000","last_undegraded":"2024-09-19T06:47:00.581506+0000","last_fullsized":"2024-09-19T06:47:00.581506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594128+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:47:00.594128+0000","last_peered":"2024-09-19T06:47:00.594128+0000","last_clean":"2024-09-19T06:47:00.594128+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:47:00.594128+0000","last_undegraded":"2024-09-19T06:47:00.594128+0000","last_fullsized":"2024-09-19T06:47:00.594128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587594+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:47:00.587594+0000","last_peered":"2024-09-19T06:47:00.587594+0000","last_clean":"2024-09-19T06:47:00.587594+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:47:00.587594+0000","last_undegraded":"2024-09-19T06:47:00.587594+0000","last_fullsized":"2024-09-19T06:47:00.587594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585123+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:47:00.585123+0000","last_peered":"2024-09-19T06:47:00.585123+0000","last_clean":"2024-09-19T06:47:00.585123+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:47:00.585123+0000","last_undegraded":"2024-09-19T06:47:00.585123+0000","last_fullsized":"2024-09-19T06:47:00.585123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585680+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:47:00.585680+0000","last_peered":"2024-09-19T06:47:00.585680+0000","last_clean":"2024-09-19T06:47:00.585680+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:47:00.585680+0000","last_undegraded":"2024-09-19T06:47:00.585680+0000","last_fullsized":"2024-09-19T06:47:00.585680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580960+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:47:00.580960+0000","last_peered":"2024-09-19T06:47:00.580960+0000","last_clean":"2024-09-19T06:47:00.580960+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:47:00.580960+0000","last_undegraded":"2024-09-19T06:47:00.580960+0000","last_fullsized":"2024-09-19T06:47:00.580960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590511+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:47:00.590511+0000","last_peered":"2024-09-19T06:47:00.590511+0000","last_clean":"2024-09-19T06:47:00.590511+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:47:00.590511+0000","last_undegraded":"2024-09-19T06:47:00.590511+0000","last_fullsized":"2024-09-19T06:47:00.590511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594823+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:47:00.594823+0000","last_peered":"2024-09-19T06:47:00.594823+0000","last_clean":"2024-09-19T06:47:00.594823+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:47:00.594823+0000","last_undegraded":"2024-09-19T06:47:00.594823+0000","last_fullsized":"2024-09-19T06:47:00.594823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590707+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:47:00.590707+0000","last_peered":"2024-09-19T06:47:00.590707+0000","last_clean":"2024-09-19T06:47:00.590707+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:47:00.590707+0000","last_undegraded":"2024-09-19T06:47:00.590707+0000","last_fullsized":"2024-09-19T06:47:00.590707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595272+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:47:00.595272+0000","last_peered":"2024-09-19T06:47:00.595272+0000","last_clean":"2024-09-19T06:47:00.595272+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:47:00.595272+0000","last_undegraded":"2024-09-19T06:47:00.595272+0000","last_fullsized":"2024-09-19T06:47:00.595272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596210+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:47:00.596210+0000","last_peered":"2024-09-19T06:47:00.596210+0000","last_clean":"2024-09-19T06:47:00.596210+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:47:00.596210+0000","last_undegraded":"2024-09-19T06:47:00.596210+0000","last_fullsized":"2024-09-19T06:47:00.596210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585734+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:47:00.585734+0000","last_peered":"2024-09-19T06:47:00.585734+0000","last_clean":"2024-09-19T06:47:00.585734+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:47:00.585734+0000","last_undegraded":"2024-09-19T06:47:00.585734+0000","last_fullsized":"2024-09-19T06:47:00.585734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.578454+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:47:00.578454+0000","last_peered":"2024-09-19T06:47:00.578454+0000","last_clean":"2024-09-19T06:47:00.578454+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:47:00.578454+0000","last_undegraded":"2024-09-19T06:47:00.578454+0000","last_fullsized":"2024-09-19T06:47:00.578454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580253+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:47:00.580253+0000","last_peered":"2024-09-19T06:47:00.580253+0000","last_clean":"2024-09-19T06:47:00.580253+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:47:00.580253+0000","last_undegraded":"2024-09-19T06:47:00.580253+0000","last_fullsized":"2024-09-19T06:47:00.580253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595663+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:47:00.595663+0000","last_peered":"2024-09-19T06:47:00.595663+0000","last_clean":"2024-09-19T06:47:00.595663+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:47:00.595663+0000","last_undegraded":"2024-09-19T06:47:00.595663+0000","last_fullsized":"2024-09-19T06:47:00.595663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586577+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:47:00.586577+0000","last_peered":"2024-09-19T06:47:00.586577+0000","last_clean":"2024-09-19T06:47:00.586577+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:47:00.586577+0000","last_undegraded":"2024-09-19T06:47:00.586577+0000","last_fullsized":"2024-09-19T06:47:00.586577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589497+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:47:00.589497+0000","last_peered":"2024-09-19T06:47:00.589497+0000","last_clean":"2024-09-19T06:47:00.589497+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:47:00.589497+0000","last_undegraded":"2024-09-19T06:47:00.589497+0000","last_fullsized":"2024-09-19T06:47:00.589497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586950+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:47:00.586950+0000","last_peered":"2024-09-19T06:47:00.586950+0000","last_clean":"2024-09-19T06:47:00.586950+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:47:00.586950+0000","last_undegraded":"2024-09-19T06:47:00.586950+0000","last_fullsized":"2024-09-19T06:47:00.586950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584482+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:47:00.584482+0000","last_peered":"2024-09-19T06:47:00.584482+0000","last_clean":"2024-09-19T06:47:00.584482+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:47:00.584482+0000","last_undegraded":"2024-09-19T06:47:00.584482+0000","last_fullsized":"2024-09-19T06:47:00.584482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.576867+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:47:00.576867+0000","last_peered":"2024-09-19T06:47:00.576867+0000","last_clean":"2024-09-19T06:47:00.576867+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:47:00.576867+0000","last_undegraded":"2024-09-19T06:47:00.576867+0000","last_fullsized":"2024-09-19T06:47:00.576867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582332+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:47:00.582332+0000","last_peered":"2024-09-19T06:47:00.582332+0000","last_clean":"2024-09-19T06:47:00.582332+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:47:00.582332+0000","last_undegraded":"2024-09-19T06:47:00.582332+0000","last_fullsized":"2024-09-19T06:47:00.582332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594980+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:47:00.594980+0000","last_peered":"2024-09-19T06:47:00.594980+0000","last_clean":"2024-09-19T06:47:00.594980+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:47:00.594980+0000","last_undegraded":"2024-09-19T06:47:00.594980+0000","last_fullsized":"2024-09-19T06:47:00.594980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596274+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:47:00.596274+0000","last_peered":"2024-09-19T06:47:00.596274+0000","last_clean":"2024-09-19T06:47:00.596274+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:47:00.596274+0000","last_undegraded":"2024-09-19T06:47:00.596274+0000","last_fullsized":"2024-09-19T06:47:00.596274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583987+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:47:00.583987+0000","last_peered":"2024-09-19T06:47:00.583987+0000","last_clean":"2024-09-19T06:47:00.583987+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:47:00.583987+0000","last_undegraded":"2024-09-19T06:47:00.583987+0000","last_fullsized":"2024-09-19T06:47:00.583987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577783+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:47:00.577783+0000","last_peered":"2024-09-19T06:47:00.577783+0000","last_clean":"2024-09-19T06:47:00.577783+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:47:00.577783+0000","last_undegraded":"2024-09-19T06:47:00.577783+0000","last_fullsized":"2024-09-19T06:47:00.577783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583197+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:47:00.583197+0000","last_peered":"2024-09-19T06:47:00.583197+0000","last_clean":"2024-09-19T06:47:00.583197+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:47:00.583197+0000","last_undegraded":"2024-09-19T06:47:00.583197+0000","last_fullsized":"2024-09-19T06:47:00.583197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587636+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:47:00.587636+0000","last_peered":"2024-09-19T06:47:00.587636+0000","last_clean":"2024-09-19T06:47:00.587636+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:47:00.587636+0000","last_undegraded":"2024-09-19T06:47:00.587636+0000","last_fullsized":"2024-09-19T06:47:00.587636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537764+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:47:00.537764+0000","last_peered":"2024-09-19T06:47:00.537764+0000","last_clean":"2024-09-19T06:47:00.537764+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:47:00.537764+0000","last_undegraded":"2024-09-19T06:47:00.537764+0000","last_fullsized":"2024-09-19T06:47:00.537764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594590+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:47:00.594590+0000","last_peered":"2024-09-19T06:47:00.594590+0000","last_clean":"2024-09-19T06:47:00.594590+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:47:00.594590+0000","last_undegraded":"2024-09-19T06:47:00.594590+0000","last_fullsized":"2024-09-19T06:47:00.594590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544151+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:47:00.544151+0000","last_peered":"2024-09-19T06:47:00.544151+0000","last_clean":"2024-09-19T06:47:00.544151+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:47:00.544151+0000","last_undegraded":"2024-09-19T06:47:00.544151+0000","last_fullsized":"2024-09-19T06:47:00.544151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536382+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:47:00.536382+0000","last_peered":"2024-09-19T06:47:00.536382+0000","last_clean":"2024-09-19T06:47:00.536382+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:47:00.536382+0000","last_undegraded":"2024-09-19T06:47:00.536382+0000","last_fullsized":"2024-09-19T06:47:00.536382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589344+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:47:00.589344+0000","last_peered":"2024-09-19T06:47:00.589344+0000","last_clean":"2024-09-19T06:47:00.589344+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:47:00.589344+0000","last_undegraded":"2024-09-19T06:47:00.589344+0000","last_fullsized":"2024-09-19T06:47:00.589344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.538035+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:47:00.538035+0000","last_peered":"2024-09-19T06:47:00.538035+0000","last_clean":"2024-09-19T06:47:00.538035+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:47:00.538035+0000","last_undegraded":"2024-09-19T06:47:00.538035+0000","last_fullsized":"2024-09-19T06:47:00.538035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592761+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:47:00.592761+0000","last_peered":"2024-09-19T06:47:00.592761+0000","last_clean":"2024-09-19T06:47:00.592761+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:47:00.592761+0000","last_undegraded":"2024-09-19T06:47:00.592761+0000","last_fullsized":"2024-09-19T06:47:00.592761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544365+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:47:00.544365+0000","last_peered":"2024-09-19T06:47:00.544365+0000","last_clean":"2024-09-19T06:47:00.544365+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:47:00.544365+0000","last_undegraded":"2024-09-19T06:47:00.544365+0000","last_fullsized":"2024-09-19T06:47:00.544365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587810+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:47:00.587810+0000","last_peered":"2024-09-19T06:47:00.587810+0000","last_clean":"2024-09-19T06:47:00.587810+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:47:00.587810+0000","last_undegraded":"2024-09-19T06:47:00.587810+0000","last_fullsized":"2024-09-19T06:47:00.587810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.548844+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:47:00.548844+0000","last_peered":"2024-09-19T06:47:00.548844+0000","last_clean":"2024-09-19T06:47:00.548844+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:47:00.548844+0000","last_undegraded":"2024-09-19T06:47:00.548844+0000","last_fullsized":"2024-09-19T06:47:00.548844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595196+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:47:00.595196+0000","last_peered":"2024-09-19T06:47:00.595196+0000","last_clean":"2024-09-19T06:47:00.595196+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:47:00.595196+0000","last_undegraded":"2024-09-19T06:47:00.595196+0000","last_fullsized":"2024-09-19T06:47:00.595196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537912+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:47:00.537912+0000","last_peered":"2024-09-19T06:47:00.537912+0000","last_clean":"2024-09-19T06:47:00.537912+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:47:00.537912+0000","last_undegraded":"2024-09-19T06:47:00.537912+0000","last_fullsized":"2024-09-19T06:47:00.537912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582419+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:47:00.582419+0000","last_peered":"2024-09-19T06:47:00.582419+0000","last_clean":"2024-09-19T06:47:00.582419+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:47:00.582419+0000","last_undegraded":"2024-09-19T06:47:00.582419+0000","last_fullsized":"2024-09-19T06:47:00.582419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":271,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:10.972189+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:47:10.972189+0000","last_peered":"2024-09-19T06:47:10.972189+0000","last_clean":"2024-09-19T06:47:10.972189+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:47:10.972189+0000","last_undegraded":"2024-09-19T06:47:10.972189+0000","last_fullsized":"2024-09-19T06:47:10.972189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":175,"num_write":34,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577030+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:47:00.577030+0000","last_peered":"2024-09-19T06:47:00.577030+0000","last_clean":"2024-09-19T06:47:00.577030+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:47:00.577030+0000","last_undegraded":"2024-09-19T06:47:00.577030+0000","last_fullsized":"2024-09-19T06:47:00.577030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.545877+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:47:00.545877+0000","last_peered":"2024-09-19T06:47:00.545877+0000","last_clean":"2024-09-19T06:47:00.545877+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:47:00.545877+0000","last_undegraded":"2024-09-19T06:47:00.545877+0000","last_fullsized":"2024-09-19T06:47:00.545877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589299+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:47:00.589299+0000","last_peered":"2024-09-19T06:47:00.589299+0000","last_clean":"2024-09-19T06:47:00.589299+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:47:00.589299+0000","last_undegraded":"2024-09-19T06:47:00.589299+0000","last_fullsized":"2024-09-19T06:47:00.589299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537682+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:47:00.537682+0000","last_peered":"2024-09-19T06:47:00.537682+0000","last_clean":"2024-09-19T06:47:00.537682+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:47:00.537682+0000","last_undegraded":"2024-09-19T06:47:00.537682+0000","last_fullsized":"2024-09-19T06:47:00.537682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584015+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:47:00.584015+0000","last_peered":"2024-09-19T06:47:00.584015+0000","last_clean":"2024-09-19T06:47:00.584015+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:47:00.584015+0000","last_undegraded":"2024-09-19T06:47:00.584015+0000","last_fullsized":"2024-09-19T06:47:00.584015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549262+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:47:00.549262+0000","last_peered":"2024-09-19T06:47:00.549262+0000","last_clean":"2024-09-19T06:47:00.549262+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:47:00.549262+0000","last_undegraded":"2024-09-19T06:47:00.549262+0000","last_fullsized":"2024-09-19T06:47:00.549262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584090+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:47:00.584090+0000","last_peered":"2024-09-19T06:47:00.584090+0000","last_clean":"2024-09-19T06:47:00.584090+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:47:00.584090+0000","last_undegraded":"2024-09-19T06:47:00.584090+0000","last_fullsized":"2024-09-19T06:47:00.584090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.550930+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:47:00.550930+0000","last_peered":"2024-09-19T06:47:00.550930+0000","last_clean":"2024-09-19T06:47:00.550930+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:47:00.550930+0000","last_undegraded":"2024-09-19T06:47:00.550930+0000","last_fullsized":"2024-09-19T06:47:00.550930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580495+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:47:00.580495+0000","last_peered":"2024-09-19T06:47:00.580495+0000","last_clean":"2024-09-19T06:47:00.580495+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:47:00.580495+0000","last_undegraded":"2024-09-19T06:47:00.580495+0000","last_fullsized":"2024-09-19T06:47:00.580495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560644+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:47:00.560644+0000","last_peered":"2024-09-19T06:47:00.560644+0000","last_clean":"2024-09-19T06:47:00.560644+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:47:00.560644+0000","last_undegraded":"2024-09-19T06:47:00.560644+0000","last_fullsized":"2024-09-19T06:47:00.560644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581982+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:47:00.581982+0000","last_peered":"2024-09-19T06:47:00.581982+0000","last_clean":"2024-09-19T06:47:00.581982+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:47:00.581982+0000","last_undegraded":"2024-09-19T06:47:00.581982+0000","last_fullsized":"2024-09-19T06:47:00.581982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536735+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:47:00.536735+0000","last_peered":"2024-09-19T06:47:00.536735+0000","last_clean":"2024-09-19T06:47:00.536735+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:47:00.536735+0000","last_undegraded":"2024-09-19T06:47:00.536735+0000","last_fullsized":"2024-09-19T06:47:00.536735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579492+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:47:00.579492+0000","last_peered":"2024-09-19T06:47:00.579492+0000","last_clean":"2024-09-19T06:47:00.579492+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:47:00.579492+0000","last_undegraded":"2024-09-19T06:47:00.579492+0000","last_fullsized":"2024-09-19T06:47:00.579492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'65","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:10.606059+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:47:10.606059+0000","last_peered":"2024-09-19T06:47:10.606059+0000","last_clean":"2024-09-19T06:47:10.606059+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:47:10.606059+0000","last_undegraded":"2024-09-19T06:47:10.606059+0000","last_fullsized":"2024-09-19T06:47:10.606059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594237+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:47:00.594237+0000","last_peered":"2024-09-19T06:47:00.594237+0000","last_clean":"2024-09-19T06:47:00.594237+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:47:00.594237+0000","last_undegraded":"2024-09-19T06:47:00.594237+0000","last_fullsized":"2024-09-19T06:47:00.594237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.546255+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:47:00.546255+0000","last_peered":"2024-09-19T06:47:00.546255+0000","last_clean":"2024-09-19T06:47:00.546255+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:47:00.546255+0000","last_undegraded":"2024-09-19T06:47:00.546255+0000","last_fullsized":"2024-09-19T06:47:00.546255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585679+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:47:00.585679+0000","last_peered":"2024-09-19T06:47:00.585679+0000","last_clean":"2024-09-19T06:47:00.585679+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:47:00.585679+0000","last_undegraded":"2024-09-19T06:47:00.585679+0000","last_fullsized":"2024-09-19T06:47:00.585679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"82'148","reported_seq":393,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:02.663640+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:47:02.663640+0000","last_peered":"2024-09-19T06:47:02.663640+0000","last_clean":"2024-09-19T06:47:02.663640+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:47:02.663640+0000","last_undegraded":"2024-09-19T06:47:02.663640+0000","last_fullsized":"2024-09-19T06:47:02.663640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549180+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:47:00.549180+0000","last_peered":"2024-09-19T06:47:00.549180+0000","last_clean":"2024-09-19T06:47:00.549180+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:47:00.549180+0000","last_undegraded":"2024-09-19T06:47:00.549180+0000","last_fullsized":"2024-09-19T06:47:00.549180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593914+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:47:00.593914+0000","last_peered":"2024-09-19T06:47:00.593914+0000","last_clean":"2024-09-19T06:47:00.593914+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:47:00.593914+0000","last_undegraded":"2024-09-19T06:47:00.593914+0000","last_fullsized":"2024-09-19T06:47:00.593914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549165+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:47:00.549165+0000","last_peered":"2024-09-19T06:47:00.549165+0000","last_clean":"2024-09-19T06:47:00.549165+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:47:00.549165+0000","last_undegraded":"2024-09-19T06:47:00.549165+0000","last_fullsized":"2024-09-19T06:47:00.549165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577578+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:47:00.577578+0000","last_peered":"2024-09-19T06:47:00.577578+0000","last_clean":"2024-09-19T06:47:00.577578+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:47:00.577578+0000","last_undegraded":"2024-09-19T06:47:00.577578+0000","last_fullsized":"2024-09-19T06:47:00.577578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536478+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:47:00.536478+0000","last_peered":"2024-09-19T06:47:00.536478+0000","last_clean":"2024-09-19T06:47:00.536478+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:47:00.536478+0000","last_undegraded":"2024-09-19T06:47:00.536478+0000","last_fullsized":"2024-09-19T06:47:00.536478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579472+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:47:00.579472+0000","last_peered":"2024-09-19T06:47:00.579472+0000","last_clean":"2024-09-19T06:47:00.579472+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:47:00.579472+0000","last_undegraded":"2024-09-19T06:47:00.579472+0000","last_fullsized":"2024-09-19T06:47:00.579472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549300+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:47:00.549300+0000","last_peered":"2024-09-19T06:47:00.549300+0000","last_clean":"2024-09-19T06:47:00.549300+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:47:00.549300+0000","last_undegraded":"2024-09-19T06:47:00.549300+0000","last_fullsized":"2024-09-19T06:47:00.549300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579645+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:47:00.579645+0000","last_peered":"2024-09-19T06:47:00.579645+0000","last_clean":"2024-09-19T06:47:00.579645+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:47:00.579645+0000","last_undegraded":"2024-09-19T06:47:00.579645+0000","last_fullsized":"2024-09-19T06:47:00.579645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556514+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:47:00.556514+0000","last_peered":"2024-09-19T06:47:00.556514+0000","last_clean":"2024-09-19T06:47:00.556514+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:47:00.556514+0000","last_undegraded":"2024-09-19T06:47:00.556514+0000","last_fullsized":"2024-09-19T06:47:00.556514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587136+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:47:00.587136+0000","last_peered":"2024-09-19T06:47:00.587136+0000","last_clean":"2024-09-19T06:47:00.587136+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:47:00.587136+0000","last_undegraded":"2024-09-19T06:47:00.587136+0000","last_fullsized":"2024-09-19T06:47:00.587136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552471+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:47:00.552471+0000","last_peered":"2024-09-19T06:47:00.552471+0000","last_clean":"2024-09-19T06:47:00.552471+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:47:00.552471+0000","last_undegraded":"2024-09-19T06:47:00.552471+0000","last_fullsized":"2024-09-19T06:47:00.552471+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579287+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:47:00.579287+0000","last_peered":"2024-09-19T06:47:00.579287+0000","last_clean":"2024-09-19T06:47:00.579287+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:47:00.579287+0000","last_undegraded":"2024-09-19T06:47:00.579287+0000","last_fullsized":"2024-09-19T06:47:00.579287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'98","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:10.978228+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:47:10.978228+0000","last_peered":"2024-09-19T06:47:10.978228+0000","last_clean":"2024-09-19T06:47:10.978228+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:47:10.978228+0000","last_undegraded":"2024-09-19T06:47:10.978228+0000","last_fullsized":"2024-09-19T06:47:10.978228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":181,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593306+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:47:00.593306+0000","last_peered":"2024-09-19T06:47:00.593306+0000","last_clean":"2024-09-19T06:47:00.593306+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:47:00.593306+0000","last_undegraded":"2024-09-19T06:47:00.593306+0000","last_fullsized":"2024-09-19T06:47:00.593306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549571+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:47:00.549571+0000","last_peered":"2024-09-19T06:47:00.549571+0000","last_clean":"2024-09-19T06:47:00.549571+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:47:00.549571+0000","last_undegraded":"2024-09-19T06:47:00.549571+0000","last_fullsized":"2024-09-19T06:47:00.549571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596329+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:47:00.596329+0000","last_peered":"2024-09-19T06:47:00.596329+0000","last_clean":"2024-09-19T06:47:00.596329+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:47:00.596329+0000","last_undegraded":"2024-09-19T06:47:00.596329+0000","last_fullsized":"2024-09-19T06:47:00.596329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536872+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:47:00.536872+0000","last_peered":"2024-09-19T06:47:00.536872+0000","last_clean":"2024-09-19T06:47:00.536872+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:47:00.536872+0000","last_undegraded":"2024-09-19T06:47:00.536872+0000","last_fullsized":"2024-09-19T06:47:00.536872+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.573059+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:47:00.573059+0000","last_peered":"2024-09-19T06:47:00.573059+0000","last_clean":"2024-09-19T06:47:00.573059+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:47:00.573059+0000","last_undegraded":"2024-09-19T06:47:00.573059+0000","last_fullsized":"2024-09-19T06:47:00.573059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.551180+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:47:00.551180+0000","last_peered":"2024-09-19T06:47:00.551180+0000","last_clean":"2024-09-19T06:47:00.551180+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:47:00.551180+0000","last_undegraded":"2024-09-19T06:47:00.551180+0000","last_fullsized":"2024-09-19T06:47:00.551180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595812+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:47:00.595812+0000","last_peered":"2024-09-19T06:47:00.595812+0000","last_clean":"2024-09-19T06:47:00.595812+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:47:00.595812+0000","last_undegraded":"2024-09-19T06:47:00.595812+0000","last_fullsized":"2024-09-19T06:47:00.595812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.555196+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:47:00.555196+0000","last_peered":"2024-09-19T06:47:00.555196+0000","last_clean":"2024-09-19T06:47:00.555196+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:47:00.555196+0000","last_undegraded":"2024-09-19T06:47:00.555196+0000","last_fullsized":"2024-09-19T06:47:00.555196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.597003+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:47:00.597003+0000","last_peered":"2024-09-19T06:47:00.597003+0000","last_clean":"2024-09-19T06:47:00.597003+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:47:00.597003+0000","last_undegraded":"2024-09-19T06:47:00.597003+0000","last_fullsized":"2024-09-19T06:47:00.597003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560958+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:47:00.560958+0000","last_peered":"2024-09-19T06:47:00.560958+0000","last_clean":"2024-09-19T06:47:00.560958+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:47:00.560958+0000","last_undegraded":"2024-09-19T06:47:00.560958+0000","last_fullsized":"2024-09-19T06:47:00.560958+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585140+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:47:00.585140+0000","last_peered":"2024-09-19T06:47:00.585140+0000","last_clean":"2024-09-19T06:47:00.585140+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:47:00.585140+0000","last_undegraded":"2024-09-19T06:47:00.585140+0000","last_fullsized":"2024-09-19T06:47:00.585140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587229+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:47:00.587229+0000","last_peered":"2024-09-19T06:47:00.587229+0000","last_clean":"2024-09-19T06:47:00.587229+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:47:00.587229+0000","last_undegraded":"2024-09-19T06:47:00.587229+0000","last_fullsized":"2024-09-19T06:47:00.587229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556945+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:47:00.556945+0000","last_peered":"2024-09-19T06:47:00.556945+0000","last_clean":"2024-09-19T06:47:00.556945+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:47:00.556945+0000","last_undegraded":"2024-09-19T06:47:00.556945+0000","last_fullsized":"2024-09-19T06:47:00.556945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587670+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:47:00.587670+0000","last_peered":"2024-09-19T06:47:00.587670+0000","last_clean":"2024-09-19T06:47:00.587670+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:47:00.587670+0000","last_undegraded":"2024-09-19T06:47:00.587670+0000","last_fullsized":"2024-09-19T06:47:00.587670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552359+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:47:00.552359+0000","last_peered":"2024-09-19T06:47:00.552359+0000","last_clean":"2024-09-19T06:47:00.552359+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:47:00.552359+0000","last_undegraded":"2024-09-19T06:47:00.552359+0000","last_fullsized":"2024-09-19T06:47:00.552359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596914+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:47:00.596914+0000","last_peered":"2024-09-19T06:47:00.596914+0000","last_clean":"2024-09-19T06:47:00.596914+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:47:00.596914+0000","last_undegraded":"2024-09-19T06:47:00.596914+0000","last_fullsized":"2024-09-19T06:47:00.596914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552705+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:47:00.552705+0000","last_peered":"2024-09-19T06:47:00.552705+0000","last_clean":"2024-09-19T06:47:00.552705+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:47:00.552705+0000","last_undegraded":"2024-09-19T06:47:00.552705+0000","last_fullsized":"2024-09-19T06:47:00.552705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592794+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:47:00.592794+0000","last_peered":"2024-09-19T06:47:00.592794+0000","last_clean":"2024-09-19T06:47:00.592794+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:47:00.592794+0000","last_undegraded":"2024-09-19T06:47:00.592794+0000","last_fullsized":"2024-09-19T06:47:00.592794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556381+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:47:00.556381+0000","last_peered":"2024-09-19T06:47:00.556381+0000","last_clean":"2024-09-19T06:47:00.556381+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:47:00.556381+0000","last_undegraded":"2024-09-19T06:47:00.556381+0000","last_fullsized":"2024-09-19T06:47:00.556381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":791781,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":565,"num_read_kb":491,"num_write":328,"num_write_kb":2320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":2375343,"data_compressed":108912,"data_compressed_allocated":147456,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107385,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612642,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":441000,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":1429446,"data_compressed":61462,"data_compressed_allocated":81920,"data_compressed_original":929792,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005101,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":834798,"data_compressed":27941,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":834820,"data_compressed":27941,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1032067,"data_compressed":44447,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":441117,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":1359899,"data_compressed":59649,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441022,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":1162786,"data_compressed":43143,"data_compressed_allocated":57344,"data_compressed_original":724992,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476816,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":510569,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":962560,"data_stored":510535,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441090,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":69535,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69569,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":721552,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":328414,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":397961,"data_compressed":17015,"data_compressed_allocated":24576,"data_compressed_original":315392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:47:15.341 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:47:15.341 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:47:15.588 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:15.844 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:15 smithi159 ceph-mon[30935]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T06:47:15.844 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:15 smithi159 ceph-mon[30935]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:15.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:15 smithi189 ceph-mon[34880]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T06:47:15.889 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:15 smithi189 ceph-mon[34880]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:16.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:15 smithi203 ceph-mon[35473]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T06:47:16.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:15 smithi203 ceph-mon[35473]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.073+0000 7f1a8bccb640 1 -- 172.21.15.159:0/1384215104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 msgr2=0x7f1a841008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.073+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/1384215104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 0x7f1a841008e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009900 tx=0x7f1a8002a410 comp rx=0 tx=0).stop 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.073+0000 7f1a8bccb640 1 -- 172.21.15.159:0/1384215104 shutdown_connections 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.073+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/1384215104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a84106f70 0x7f1a8410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.073+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/1384215104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a84100eb0 0x7f1a84106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.073+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/1384215104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 0x7f1a841008e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.073+0000 7f1a8bccb640 1 -- 172.21.15.159:0/1384215104 >> 172.21.15.159:0/1384215104 conn(0x7f1a840fc5c0 msgr2=0x7f1a840fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.073+0000 7f1a8bccb640 1 -- 172.21.15.159:0/1384215104 shutdown_connections 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.073+0000 7f1a8bccb640 1 -- 172.21.15.159:0/1384215104 wait complete. 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a8bccb640 1 Processor -- start 2024-09-19T06:47:16.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a8bccb640 1 -- start start 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a8bccb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 0x7f1a841984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a8bccb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a84100eb0 0x7f1a84198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a8bccb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a84106f70 0x7f1a8419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a8bccb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1a84111ff0 con 0x7f1a84100500 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a8bccb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a84111e70 con 0x7f1a84100eb0 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a8bccb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a84112170 con 0x7f1a84106f70 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a89a67640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 0x7f1a841984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a89a67640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 0x7f1a841984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46164/0 (socket says 172.21.15.159:46164) 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a89a67640 1 -- 172.21.15.159:0/2338820588 learned_addr learned my addr 172.21.15.159:0/2338820588 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a89a67640 1 -- 172.21.15.159:0/2338820588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a84106f70 msgr2=0x7f1a8419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a89a67640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a84106f70 0x7f1a8419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a89a67640 1 -- 172.21.15.159:0/2338820588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a84100eb0 msgr2=0x7f1a84198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:16.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a89a67640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a84100eb0 0x7f1a84198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.074+0000 7f1a89a67640 1 -- 172.21.15.159:0/2338820588 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8419d480 con 0x7f1a84100500 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.075+0000 7f1a89a67640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 0x7f1a841984d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1a80005940 tx=0x7f1a800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.075+0000 7f1a7affd640 1 -- 172.21.15.159:0/2338820588 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8003f030 con 0x7f1a84100500 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.075+0000 7f1a7affd640 1 -- 172.21.15.159:0/2338820588 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a80003ce0 con 0x7f1a84100500 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.075+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8419d710 con 0x7f1a84100500 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.075+0000 7f1a7affd640 1 -- 172.21.15.159:0/2338820588 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80035070 con 0x7f1a84100500 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.075+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a841a5050 con 0x7f1a84100500 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.076+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a841008e0 con 0x7f1a84100500 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.077+0000 7f1a7affd640 1 -- 172.21.15.159:0/2338820588 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f1a80042030 con 0x7f1a84100500 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.078+0000 7f1a7affd640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a700a34c0 0x7f1a700a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.078+0000 7f1a89266640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a700a34c0 0x7f1a700a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.078+0000 7f1a7affd640 1 -- 172.21.15.159:0/2338820588 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f1a800f0450 con 0x7f1a84100500 2024-09-19T06:47:16.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.078+0000 7f1a89266640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a700a34c0 0x7f1a700a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a841047c0 tx=0x7f1a74006c90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:16.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.082+0000 7f1a7affd640 1 -- 172.21.15.159:0/2338820588 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a800bcc90 con 0x7f1a84100500 2024-09-19T06:47:16.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.245+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a84062630 con 0x7f1a700a34c0 2024-09-19T06:47:16.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.251+0000 7f1a7affd640 1 -- 172.21.15.159:0/2338820588 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257971 (secure 0 0 0) 0x7f1a84062630 con 0x7f1a700a34c0 2024-09-19T06:47:16.255 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:16.256 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a700a34c0 msgr2=0x7f1a700a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a700a34c0 0x7f1a700a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a841047c0 tx=0x7f1a74006c90 comp rx=0 tx=0).stop 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 msgr2=0x7f1a841984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 0x7f1a841984d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1a80005940 tx=0x7f1a800042f0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 shutdown_connections 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a700a34c0 0x7f1a700a5980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a84106f70 0x7f1a8419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a84100eb0 0x7f1a84198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 --2- 172.21.15.159:0/2338820588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84100500 0x7f1a841984d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 >> 172.21.15.159:0/2338820588 conn(0x7f1a840fc5c0 msgr2=0x7f1a84105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 shutdown_connections 2024-09-19T06:47:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:16.254+0000 7f1a8bccb640 1 -- 172.21.15.159:0/2338820588 wait complete. 2024-09-19T06:47:17.008 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-19T06:47:14.555347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1382383,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":802,"num_read_kb":821,"num_write":531,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":878,"ondisk_log_size":878,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377004,"kb_used_data":11064,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564820,"statfs":{"total":1151940427776,"available":1151554375680,"internally_reserved":0,"allocated":11329536,"data_stored":9439149,"data_compressed":320121,"data_compressed_allocated":430080,"data_compressed_original":4190208,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":453,"num_write":148,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002570"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596299+0000","last_change":"2024-09-19T06:45:22.788660+0000","last_active":"2024-09-19T06:47:00.596299+0000","last_peered":"2024-09-19T06:47:00.596299+0000","last_clean":"2024-09-19T06:47:00.596299+0000","last_became_active":"2024-09-19T06:45:22.788286+0000","last_became_peered":"2024-09-19T06:45:22.788286+0000","last_unstale":"2024-09-19T06:47:00.596299+0000","last_undegraded":"2024-09-19T06:47:00.596299+0000","last_fullsized":"2024-09-19T06:47:00.596299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:32.542361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590995+0000","last_change":"2024-09-19T06:45:22.777274+0000","last_active":"2024-09-19T06:47:00.590995+0000","last_peered":"2024-09-19T06:47:00.590995+0000","last_clean":"2024-09-19T06:47:00.590995+0000","last_became_active":"2024-09-19T06:45:22.776845+0000","last_became_peered":"2024-09-19T06:45:22.776845+0000","last_unstale":"2024-09-19T06:47:00.590995+0000","last_undegraded":"2024-09-19T06:47:00.590995+0000","last_fullsized":"2024-09-19T06:47:00.590995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:39.774591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595558+0000","last_change":"2024-09-19T06:45:22.779061+0000","last_active":"2024-09-19T06:47:00.595558+0000","last_peered":"2024-09-19T06:47:00.595558+0000","last_clean":"2024-09-19T06:47:00.595558+0000","last_became_active":"2024-09-19T06:45:22.778743+0000","last_became_peered":"2024-09-19T06:45:22.778743+0000","last_unstale":"2024-09-19T06:47:00.595558+0000","last_undegraded":"2024-09-19T06:47:00.595558+0000","last_fullsized":"2024-09-19T06:47:00.595558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:48.915830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.575726+0000","last_change":"2024-09-19T06:45:22.791157+0000","last_active":"2024-09-19T06:47:00.575726+0000","last_peered":"2024-09-19T06:47:00.575726+0000","last_clean":"2024-09-19T06:47:00.575726+0000","last_became_active":"2024-09-19T06:45:22.788752+0000","last_became_peered":"2024-09-19T06:45:22.788752+0000","last_unstale":"2024-09-19T06:47:00.575726+0000","last_undegraded":"2024-09-19T06:47:00.575726+0000","last_fullsized":"2024-09-19T06:47:00.575726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:11.661279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594145+0000","last_change":"2024-09-19T06:45:22.771995+0000","last_active":"2024-09-19T06:47:00.594145+0000","last_peered":"2024-09-19T06:47:00.594145+0000","last_clean":"2024-09-19T06:47:00.594145+0000","last_became_active":"2024-09-19T06:45:22.771352+0000","last_became_peered":"2024-09-19T06:45:22.771352+0000","last_unstale":"2024-09-19T06:47:00.594145+0000","last_undegraded":"2024-09-19T06:47:00.594145+0000","last_fullsized":"2024-09-19T06:47:00.594145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:43.133377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592217+0000","last_change":"2024-09-19T06:45:22.785506+0000","last_active":"2024-09-19T06:47:00.592217+0000","last_peered":"2024-09-19T06:47:00.592217+0000","last_clean":"2024-09-19T06:47:00.592217+0000","last_became_active":"2024-09-19T06:45:22.785154+0000","last_became_peered":"2024-09-19T06:45:22.785154+0000","last_unstale":"2024-09-19T06:47:00.592217+0000","last_undegraded":"2024-09-19T06:47:00.592217+0000","last_fullsized":"2024-09-19T06:47:00.592217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:54.849183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581506+0000","last_change":"2024-09-19T06:45:22.779470+0000","last_active":"2024-09-19T06:47:00.581506+0000","last_peered":"2024-09-19T06:47:00.581506+0000","last_clean":"2024-09-19T06:47:00.581506+0000","last_became_active":"2024-09-19T06:45:22.779117+0000","last_became_peered":"2024-09-19T06:45:22.779117+0000","last_unstale":"2024-09-19T06:47:00.581506+0000","last_undegraded":"2024-09-19T06:47:00.581506+0000","last_fullsized":"2024-09-19T06:47:00.581506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:29.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594128+0000","last_change":"2024-09-19T06:45:22.775626+0000","last_active":"2024-09-19T06:47:00.594128+0000","last_peered":"2024-09-19T06:47:00.594128+0000","last_clean":"2024-09-19T06:47:00.594128+0000","last_became_active":"2024-09-19T06:45:22.774976+0000","last_became_peered":"2024-09-19T06:45:22.774976+0000","last_unstale":"2024-09-19T06:47:00.594128+0000","last_undegraded":"2024-09-19T06:47:00.594128+0000","last_fullsized":"2024-09-19T06:47:00.594128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:38.649046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587594+0000","last_change":"2024-09-19T06:45:22.776509+0000","last_active":"2024-09-19T06:47:00.587594+0000","last_peered":"2024-09-19T06:47:00.587594+0000","last_clean":"2024-09-19T06:47:00.587594+0000","last_became_active":"2024-09-19T06:45:22.775499+0000","last_became_peered":"2024-09-19T06:45:22.775499+0000","last_unstale":"2024-09-19T06:47:00.587594+0000","last_undegraded":"2024-09-19T06:47:00.587594+0000","last_fullsized":"2024-09-19T06:47:00.587594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:24.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585123+0000","last_change":"2024-09-19T06:45:22.785381+0000","last_active":"2024-09-19T06:47:00.585123+0000","last_peered":"2024-09-19T06:47:00.585123+0000","last_clean":"2024-09-19T06:47:00.585123+0000","last_became_active":"2024-09-19T06:45:22.784642+0000","last_became_peered":"2024-09-19T06:45:22.784642+0000","last_unstale":"2024-09-19T06:47:00.585123+0000","last_undegraded":"2024-09-19T06:47:00.585123+0000","last_fullsized":"2024-09-19T06:47:00.585123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:46.601361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585680+0000","last_change":"2024-09-19T06:45:22.789722+0000","last_active":"2024-09-19T06:47:00.585680+0000","last_peered":"2024-09-19T06:47:00.585680+0000","last_clean":"2024-09-19T06:47:00.585680+0000","last_became_active":"2024-09-19T06:45:22.789421+0000","last_became_peered":"2024-09-19T06:45:22.789421+0000","last_unstale":"2024-09-19T06:47:00.585680+0000","last_undegraded":"2024-09-19T06:47:00.585680+0000","last_fullsized":"2024-09-19T06:47:00.585680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:01.535266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580960+0000","last_change":"2024-09-19T06:45:34.973287+0000","last_active":"2024-09-19T06:47:00.580960+0000","last_peered":"2024-09-19T06:47:00.580960+0000","last_clean":"2024-09-19T06:47:00.580960+0000","last_became_active":"2024-09-19T06:45:34.972927+0000","last_became_peered":"2024-09-19T06:45:34.972927+0000","last_unstale":"2024-09-19T06:47:00.580960+0000","last_undegraded":"2024-09-19T06:47:00.580960+0000","last_fullsized":"2024-09-19T06:47:00.580960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:47.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590511+0000","last_change":"2024-09-19T06:45:22.775363+0000","last_active":"2024-09-19T06:47:00.590511+0000","last_peered":"2024-09-19T06:47:00.590511+0000","last_clean":"2024-09-19T06:47:00.590511+0000","last_became_active":"2024-09-19T06:45:22.775053+0000","last_became_peered":"2024-09-19T06:45:22.775053+0000","last_unstale":"2024-09-19T06:47:00.590511+0000","last_undegraded":"2024-09-19T06:47:00.590511+0000","last_fullsized":"2024-09-19T06:47:00.590511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:33.200891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594823+0000","last_change":"2024-09-19T06:45:22.775854+0000","last_active":"2024-09-19T06:47:00.594823+0000","last_peered":"2024-09-19T06:47:00.594823+0000","last_clean":"2024-09-19T06:47:00.594823+0000","last_became_active":"2024-09-19T06:45:22.775411+0000","last_became_peered":"2024-09-19T06:45:22.775411+0000","last_unstale":"2024-09-19T06:47:00.594823+0000","last_undegraded":"2024-09-19T06:47:00.594823+0000","last_fullsized":"2024-09-19T06:47:00.594823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:38.973126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.590707+0000","last_change":"2024-09-19T06:45:22.782381+0000","last_active":"2024-09-19T06:47:00.590707+0000","last_peered":"2024-09-19T06:47:00.590707+0000","last_clean":"2024-09-19T06:47:00.590707+0000","last_became_active":"2024-09-19T06:45:22.782082+0000","last_became_peered":"2024-09-19T06:45:22.782082+0000","last_unstale":"2024-09-19T06:47:00.590707+0000","last_undegraded":"2024-09-19T06:47:00.590707+0000","last_fullsized":"2024-09-19T06:47:00.590707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:51.419526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595272+0000","last_change":"2024-09-19T06:45:22.778181+0000","last_active":"2024-09-19T06:47:00.595272+0000","last_peered":"2024-09-19T06:47:00.595272+0000","last_clean":"2024-09-19T06:47:00.595272+0000","last_became_active":"2024-09-19T06:45:22.777811+0000","last_became_peered":"2024-09-19T06:45:22.777811+0000","last_unstale":"2024-09-19T06:47:00.595272+0000","last_undegraded":"2024-09-19T06:47:00.595272+0000","last_fullsized":"2024-09-19T06:47:00.595272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:10.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596210+0000","last_change":"2024-09-19T06:45:22.779763+0000","last_active":"2024-09-19T06:47:00.596210+0000","last_peered":"2024-09-19T06:47:00.596210+0000","last_clean":"2024-09-19T06:47:00.596210+0000","last_became_active":"2024-09-19T06:45:22.779235+0000","last_became_peered":"2024-09-19T06:45:22.779235+0000","last_unstale":"2024-09-19T06:47:00.596210+0000","last_undegraded":"2024-09-19T06:47:00.596210+0000","last_fullsized":"2024-09-19T06:47:00.596210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:43.112403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585734+0000","last_change":"2024-09-19T06:45:22.779857+0000","last_active":"2024-09-19T06:47:00.585734+0000","last_peered":"2024-09-19T06:47:00.585734+0000","last_clean":"2024-09-19T06:47:00.585734+0000","last_became_active":"2024-09-19T06:45:22.779383+0000","last_became_peered":"2024-09-19T06:45:22.779383+0000","last_unstale":"2024-09-19T06:47:00.585734+0000","last_undegraded":"2024-09-19T06:47:00.585734+0000","last_fullsized":"2024-09-19T06:47:00.585734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:42.992390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.578454+0000","last_change":"2024-09-19T06:45:22.780987+0000","last_active":"2024-09-19T06:47:00.578454+0000","last_peered":"2024-09-19T06:47:00.578454+0000","last_clean":"2024-09-19T06:47:00.578454+0000","last_became_active":"2024-09-19T06:45:22.780673+0000","last_became_peered":"2024-09-19T06:45:22.780673+0000","last_unstale":"2024-09-19T06:47:00.578454+0000","last_undegraded":"2024-09-19T06:47:00.578454+0000","last_fullsized":"2024-09-19T06:47:00.578454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.998134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580253+0000","last_change":"2024-09-19T06:45:22.782570+0000","last_active":"2024-09-19T06:47:00.580253+0000","last_peered":"2024-09-19T06:47:00.580253+0000","last_clean":"2024-09-19T06:47:00.580253+0000","last_became_active":"2024-09-19T06:45:22.782213+0000","last_became_peered":"2024-09-19T06:45:22.782213+0000","last_unstale":"2024-09-19T06:47:00.580253+0000","last_undegraded":"2024-09-19T06:47:00.580253+0000","last_fullsized":"2024-09-19T06:47:00.580253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:20.348406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595663+0000","last_change":"2024-09-19T06:45:22.779242+0000","last_active":"2024-09-19T06:47:00.595663+0000","last_peered":"2024-09-19T06:47:00.595663+0000","last_clean":"2024-09-19T06:47:00.595663+0000","last_became_active":"2024-09-19T06:45:22.778956+0000","last_became_peered":"2024-09-19T06:45:22.778956+0000","last_unstale":"2024-09-19T06:47:00.595663+0000","last_undegraded":"2024-09-19T06:47:00.595663+0000","last_fullsized":"2024-09-19T06:47:00.595663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:12.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586577+0000","last_change":"2024-09-19T06:45:22.779888+0000","last_active":"2024-09-19T06:47:00.586577+0000","last_peered":"2024-09-19T06:47:00.586577+0000","last_clean":"2024-09-19T06:47:00.586577+0000","last_became_active":"2024-09-19T06:45:22.779563+0000","last_became_peered":"2024-09-19T06:45:22.779563+0000","last_unstale":"2024-09-19T06:47:00.586577+0000","last_undegraded":"2024-09-19T06:47:00.586577+0000","last_fullsized":"2024-09-19T06:47:00.586577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:12.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589497+0000","last_change":"2024-09-19T06:45:22.781288+0000","last_active":"2024-09-19T06:47:00.589497+0000","last_peered":"2024-09-19T06:47:00.589497+0000","last_clean":"2024-09-19T06:47:00.589497+0000","last_became_active":"2024-09-19T06:45:22.780796+0000","last_became_peered":"2024-09-19T06:45:22.780796+0000","last_unstale":"2024-09-19T06:47:00.589497+0000","last_undegraded":"2024-09-19T06:47:00.589497+0000","last_fullsized":"2024-09-19T06:47:00.589497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:28.223329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.586950+0000","last_change":"2024-09-19T06:45:34.843683+0000","last_active":"2024-09-19T06:47:00.586950+0000","last_peered":"2024-09-19T06:47:00.586950+0000","last_clean":"2024-09-19T06:47:00.586950+0000","last_became_active":"2024-09-19T06:45:34.843202+0000","last_became_peered":"2024-09-19T06:45:34.843202+0000","last_unstale":"2024-09-19T06:47:00.586950+0000","last_undegraded":"2024-09-19T06:47:00.586950+0000","last_fullsized":"2024-09-19T06:47:00.586950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:09.555521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584482+0000","last_change":"2024-09-19T06:45:22.784855+0000","last_active":"2024-09-19T06:47:00.584482+0000","last_peered":"2024-09-19T06:47:00.584482+0000","last_clean":"2024-09-19T06:47:00.584482+0000","last_became_active":"2024-09-19T06:45:22.784554+0000","last_became_peered":"2024-09-19T06:45:22.784554+0000","last_unstale":"2024-09-19T06:47:00.584482+0000","last_undegraded":"2024-09-19T06:47:00.584482+0000","last_fullsized":"2024-09-19T06:47:00.584482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:50.180611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.576867+0000","last_change":"2024-09-19T06:45:22.788563+0000","last_active":"2024-09-19T06:47:00.576867+0000","last_peered":"2024-09-19T06:47:00.576867+0000","last_clean":"2024-09-19T06:47:00.576867+0000","last_became_active":"2024-09-19T06:45:22.787797+0000","last_became_peered":"2024-09-19T06:45:22.787797+0000","last_unstale":"2024-09-19T06:47:00.576867+0000","last_undegraded":"2024-09-19T06:47:00.576867+0000","last_fullsized":"2024-09-19T06:47:00.576867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:08.545979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582332+0000","last_change":"2024-09-19T06:45:22.781291+0000","last_active":"2024-09-19T06:47:00.582332+0000","last_peered":"2024-09-19T06:47:00.582332+0000","last_clean":"2024-09-19T06:47:00.582332+0000","last_became_active":"2024-09-19T06:45:22.779622+0000","last_became_peered":"2024-09-19T06:45:22.779622+0000","last_unstale":"2024-09-19T06:47:00.582332+0000","last_undegraded":"2024-09-19T06:47:00.582332+0000","last_fullsized":"2024-09-19T06:47:00.582332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.063989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594980+0000","last_change":"2024-09-19T06:45:22.778230+0000","last_active":"2024-09-19T06:47:00.594980+0000","last_peered":"2024-09-19T06:47:00.594980+0000","last_clean":"2024-09-19T06:47:00.594980+0000","last_became_active":"2024-09-19T06:45:22.777885+0000","last_became_peered":"2024-09-19T06:45:22.777885+0000","last_unstale":"2024-09-19T06:47:00.594980+0000","last_undegraded":"2024-09-19T06:47:00.594980+0000","last_fullsized":"2024-09-19T06:47:00.594980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:18.307498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596274+0000","last_change":"2024-09-19T06:45:34.843370+0000","last_active":"2024-09-19T06:47:00.596274+0000","last_peered":"2024-09-19T06:47:00.596274+0000","last_clean":"2024-09-19T06:47:00.596274+0000","last_became_active":"2024-09-19T06:45:34.842971+0000","last_became_peered":"2024-09-19T06:45:34.842971+0000","last_unstale":"2024-09-19T06:47:00.596274+0000","last_undegraded":"2024-09-19T06:47:00.596274+0000","last_fullsized":"2024-09-19T06:47:00.596274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:56.850176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583987+0000","last_change":"2024-09-19T06:45:22.779785+0000","last_active":"2024-09-19T06:47:00.583987+0000","last_peered":"2024-09-19T06:47:00.583987+0000","last_clean":"2024-09-19T06:47:00.583987+0000","last_became_active":"2024-09-19T06:45:22.779474+0000","last_became_peered":"2024-09-19T06:45:22.779474+0000","last_unstale":"2024-09-19T06:47:00.583987+0000","last_undegraded":"2024-09-19T06:47:00.583987+0000","last_fullsized":"2024-09-19T06:47:00.583987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:17.406955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577783+0000","last_change":"2024-09-19T06:45:22.784088+0000","last_active":"2024-09-19T06:47:00.577783+0000","last_peered":"2024-09-19T06:47:00.577783+0000","last_clean":"2024-09-19T06:47:00.577783+0000","last_became_active":"2024-09-19T06:45:22.783756+0000","last_became_peered":"2024-09-19T06:45:22.783756+0000","last_unstale":"2024-09-19T06:47:00.577783+0000","last_undegraded":"2024-09-19T06:47:00.577783+0000","last_fullsized":"2024-09-19T06:47:00.577783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:43.419235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.583197+0000","last_change":"2024-09-19T06:45:34.841201+0000","last_active":"2024-09-19T06:47:00.583197+0000","last_peered":"2024-09-19T06:47:00.583197+0000","last_clean":"2024-09-19T06:47:00.583197+0000","last_became_active":"2024-09-19T06:45:34.840791+0000","last_became_peered":"2024-09-19T06:45:34.840791+0000","last_unstale":"2024-09-19T06:47:00.583197+0000","last_undegraded":"2024-09-19T06:47:00.583197+0000","last_fullsized":"2024-09-19T06:47:00.583197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:17.077650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587636+0000","last_change":"2024-09-19T06:45:22.778074+0000","last_active":"2024-09-19T06:47:00.587636+0000","last_peered":"2024-09-19T06:47:00.587636+0000","last_clean":"2024-09-19T06:47:00.587636+0000","last_became_active":"2024-09-19T06:45:22.777764+0000","last_became_peered":"2024-09-19T06:45:22.777764+0000","last_unstale":"2024-09-19T06:47:00.587636+0000","last_undegraded":"2024-09-19T06:47:00.587636+0000","last_fullsized":"2024-09-19T06:47:00.587636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:07.763380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537764+0000","last_change":"2024-09-19T06:45:34.846845+0000","last_active":"2024-09-19T06:47:00.537764+0000","last_peered":"2024-09-19T06:47:00.537764+0000","last_clean":"2024-09-19T06:47:00.537764+0000","last_became_active":"2024-09-19T06:45:34.846483+0000","last_became_peered":"2024-09-19T06:45:34.846483+0000","last_unstale":"2024-09-19T06:47:00.537764+0000","last_undegraded":"2024-09-19T06:47:00.537764+0000","last_fullsized":"2024-09-19T06:47:00.537764+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:19.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594590+0000","last_change":"2024-09-19T06:45:22.777342+0000","last_active":"2024-09-19T06:47:00.594590+0000","last_peered":"2024-09-19T06:47:00.594590+0000","last_clean":"2024-09-19T06:47:00.594590+0000","last_became_active":"2024-09-19T06:45:22.777015+0000","last_became_peered":"2024-09-19T06:45:22.777015+0000","last_unstale":"2024-09-19T06:47:00.594590+0000","last_undegraded":"2024-09-19T06:47:00.594590+0000","last_fullsized":"2024-09-19T06:47:00.594590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:28.119450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544151+0000","last_change":"2024-09-19T06:45:20.758356+0000","last_active":"2024-09-19T06:47:00.544151+0000","last_peered":"2024-09-19T06:47:00.544151+0000","last_clean":"2024-09-19T06:47:00.544151+0000","last_became_active":"2024-09-19T06:45:20.758015+0000","last_became_peered":"2024-09-19T06:45:20.758015+0000","last_unstale":"2024-09-19T06:47:00.544151+0000","last_undegraded":"2024-09-19T06:47:00.544151+0000","last_fullsized":"2024-09-19T06:47:00.544151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:59.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536382+0000","last_change":"2024-09-19T06:45:20.753277+0000","last_active":"2024-09-19T06:47:00.536382+0000","last_peered":"2024-09-19T06:47:00.536382+0000","last_clean":"2024-09-19T06:47:00.536382+0000","last_became_active":"2024-09-19T06:45:20.752984+0000","last_became_peered":"2024-09-19T06:45:20.752984+0000","last_unstale":"2024-09-19T06:47:00.536382+0000","last_undegraded":"2024-09-19T06:47:00.536382+0000","last_fullsized":"2024-09-19T06:47:00.536382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:28.647876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589344+0000","last_change":"2024-09-19T06:45:22.775871+0000","last_active":"2024-09-19T06:47:00.589344+0000","last_peered":"2024-09-19T06:47:00.589344+0000","last_clean":"2024-09-19T06:47:00.589344+0000","last_became_active":"2024-09-19T06:45:22.775331+0000","last_became_peered":"2024-09-19T06:45:22.775331+0000","last_unstale":"2024-09-19T06:47:00.589344+0000","last_undegraded":"2024-09-19T06:47:00.589344+0000","last_fullsized":"2024-09-19T06:47:00.589344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:06.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.538035+0000","last_change":"2024-09-19T06:45:20.759836+0000","last_active":"2024-09-19T06:47:00.538035+0000","last_peered":"2024-09-19T06:47:00.538035+0000","last_clean":"2024-09-19T06:47:00.538035+0000","last_became_active":"2024-09-19T06:45:20.759303+0000","last_became_peered":"2024-09-19T06:45:20.759303+0000","last_unstale":"2024-09-19T06:47:00.538035+0000","last_undegraded":"2024-09-19T06:47:00.538035+0000","last_fullsized":"2024-09-19T06:47:00.538035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:46.044025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592761+0000","last_change":"2024-09-19T06:45:22.772665+0000","last_active":"2024-09-19T06:47:00.592761+0000","last_peered":"2024-09-19T06:47:00.592761+0000","last_clean":"2024-09-19T06:47:00.592761+0000","last_became_active":"2024-09-19T06:45:22.772335+0000","last_became_peered":"2024-09-19T06:45:22.772335+0000","last_unstale":"2024-09-19T06:47:00.592761+0000","last_undegraded":"2024-09-19T06:47:00.592761+0000","last_fullsized":"2024-09-19T06:47:00.592761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:33.167962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.544365+0000","last_change":"2024-09-19T06:45:20.760905+0000","last_active":"2024-09-19T06:47:00.544365+0000","last_peered":"2024-09-19T06:47:00.544365+0000","last_clean":"2024-09-19T06:47:00.544365+0000","last_became_active":"2024-09-19T06:45:20.760546+0000","last_became_peered":"2024-09-19T06:45:20.760546+0000","last_unstale":"2024-09-19T06:47:00.544365+0000","last_undegraded":"2024-09-19T06:47:00.544365+0000","last_fullsized":"2024-09-19T06:47:00.544365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:42.112755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587810+0000","last_change":"2024-09-19T06:45:22.782394+0000","last_active":"2024-09-19T06:47:00.587810+0000","last_peered":"2024-09-19T06:47:00.587810+0000","last_clean":"2024-09-19T06:47:00.587810+0000","last_became_active":"2024-09-19T06:45:22.781203+0000","last_became_peered":"2024-09-19T06:45:22.781203+0000","last_unstale":"2024-09-19T06:47:00.587810+0000","last_undegraded":"2024-09-19T06:47:00.587810+0000","last_fullsized":"2024-09-19T06:47:00.587810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:21.689788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.548844+0000","last_change":"2024-09-19T06:45:20.757502+0000","last_active":"2024-09-19T06:47:00.548844+0000","last_peered":"2024-09-19T06:47:00.548844+0000","last_clean":"2024-09-19T06:47:00.548844+0000","last_became_active":"2024-09-19T06:45:20.757151+0000","last_became_peered":"2024-09-19T06:45:20.757151+0000","last_unstale":"2024-09-19T06:47:00.548844+0000","last_undegraded":"2024-09-19T06:47:00.548844+0000","last_fullsized":"2024-09-19T06:47:00.548844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:54.857363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595196+0000","last_change":"2024-09-19T06:45:34.847063+0000","last_active":"2024-09-19T06:47:00.595196+0000","last_peered":"2024-09-19T06:47:00.595196+0000","last_clean":"2024-09-19T06:47:00.595196+0000","last_became_active":"2024-09-19T06:45:34.846746+0000","last_became_peered":"2024-09-19T06:45:34.846746+0000","last_unstale":"2024-09-19T06:47:00.595196+0000","last_undegraded":"2024-09-19T06:47:00.595196+0000","last_fullsized":"2024-09-19T06:47:00.595196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:26.687143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537912+0000","last_change":"2024-09-19T06:45:21.327762+0000","last_active":"2024-09-19T06:47:00.537912+0000","last_peered":"2024-09-19T06:47:00.537912+0000","last_clean":"2024-09-19T06:47:00.537912+0000","last_became_active":"2024-09-19T06:45:21.327057+0000","last_became_peered":"2024-09-19T06:45:21.327057+0000","last_unstale":"2024-09-19T06:47:00.537912+0000","last_undegraded":"2024-09-19T06:47:00.537912+0000","last_fullsized":"2024-09-19T06:47:00.537912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:48.246377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.582419+0000","last_change":"2024-09-19T06:45:22.785781+0000","last_active":"2024-09-19T06:47:00.582419+0000","last_peered":"2024-09-19T06:47:00.582419+0000","last_clean":"2024-09-19T06:47:00.582419+0000","last_became_active":"2024-09-19T06:45:22.785428+0000","last_became_peered":"2024-09-19T06:45:22.785428+0000","last_unstale":"2024-09-19T06:47:00.582419+0000","last_undegraded":"2024-09-19T06:47:00.582419+0000","last_fullsized":"2024-09-19T06:47:00.582419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:04.882970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":271,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:10.972189+0000","last_change":"2024-09-19T06:45:20.758915+0000","last_active":"2024-09-19T06:47:10.972189+0000","last_peered":"2024-09-19T06:47:10.972189+0000","last_clean":"2024-09-19T06:47:10.972189+0000","last_became_active":"2024-09-19T06:45:20.758541+0000","last_became_peered":"2024-09-19T06:45:20.758541+0000","last_unstale":"2024-09-19T06:47:10.972189+0000","last_undegraded":"2024-09-19T06:47:10.972189+0000","last_fullsized":"2024-09-19T06:47:10.972189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:17.283734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":175,"num_write":34,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577030+0000","last_change":"2024-09-19T06:45:22.780616+0000","last_active":"2024-09-19T06:47:00.577030+0000","last_peered":"2024-09-19T06:47:00.577030+0000","last_clean":"2024-09-19T06:47:00.577030+0000","last_became_active":"2024-09-19T06:45:22.780279+0000","last_became_peered":"2024-09-19T06:45:22.780279+0000","last_unstale":"2024-09-19T06:47:00.577030+0000","last_undegraded":"2024-09-19T06:47:00.577030+0000","last_fullsized":"2024-09-19T06:47:00.577030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.378395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.545877+0000","last_change":"2024-09-19T06:45:20.756629+0000","last_active":"2024-09-19T06:47:00.545877+0000","last_peered":"2024-09-19T06:47:00.545877+0000","last_clean":"2024-09-19T06:47:00.545877+0000","last_became_active":"2024-09-19T06:45:20.755501+0000","last_became_peered":"2024-09-19T06:45:20.755501+0000","last_unstale":"2024-09-19T06:47:00.545877+0000","last_undegraded":"2024-09-19T06:47:00.545877+0000","last_fullsized":"2024-09-19T06:47:00.545877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:43.987820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.589299+0000","last_change":"2024-09-19T06:45:22.779247+0000","last_active":"2024-09-19T06:47:00.589299+0000","last_peered":"2024-09-19T06:47:00.589299+0000","last_clean":"2024-09-19T06:47:00.589299+0000","last_became_active":"2024-09-19T06:45:22.778965+0000","last_became_peered":"2024-09-19T06:45:22.778965+0000","last_unstale":"2024-09-19T06:47:00.589299+0000","last_undegraded":"2024-09-19T06:47:00.589299+0000","last_fullsized":"2024-09-19T06:47:00.589299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:53.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.537682+0000","last_change":"2024-09-19T06:45:20.757634+0000","last_active":"2024-09-19T06:47:00.537682+0000","last_peered":"2024-09-19T06:47:00.537682+0000","last_clean":"2024-09-19T06:47:00.537682+0000","last_became_active":"2024-09-19T06:45:20.756950+0000","last_became_peered":"2024-09-19T06:45:20.756950+0000","last_unstale":"2024-09-19T06:47:00.537682+0000","last_undegraded":"2024-09-19T06:47:00.537682+0000","last_fullsized":"2024-09-19T06:47:00.537682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:46.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584015+0000","last_change":"2024-09-19T06:45:22.787095+0000","last_active":"2024-09-19T06:47:00.584015+0000","last_peered":"2024-09-19T06:47:00.584015+0000","last_clean":"2024-09-19T06:47:00.584015+0000","last_became_active":"2024-09-19T06:45:22.786694+0000","last_became_peered":"2024-09-19T06:45:22.786694+0000","last_unstale":"2024-09-19T06:47:00.584015+0000","last_undegraded":"2024-09-19T06:47:00.584015+0000","last_fullsized":"2024-09-19T06:47:00.584015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:31.095850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549262+0000","last_change":"2024-09-19T06:45:20.756389+0000","last_active":"2024-09-19T06:47:00.549262+0000","last_peered":"2024-09-19T06:47:00.549262+0000","last_clean":"2024-09-19T06:47:00.549262+0000","last_became_active":"2024-09-19T06:45:20.756033+0000","last_became_peered":"2024-09-19T06:45:20.756033+0000","last_unstale":"2024-09-19T06:47:00.549262+0000","last_undegraded":"2024-09-19T06:47:00.549262+0000","last_fullsized":"2024-09-19T06:47:00.549262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:33.526133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.584090+0000","last_change":"2024-09-19T06:45:34.973152+0000","last_active":"2024-09-19T06:47:00.584090+0000","last_peered":"2024-09-19T06:47:00.584090+0000","last_clean":"2024-09-19T06:47:00.584090+0000","last_became_active":"2024-09-19T06:45:34.972765+0000","last_became_peered":"2024-09-19T06:45:34.972765+0000","last_unstale":"2024-09-19T06:47:00.584090+0000","last_undegraded":"2024-09-19T06:47:00.584090+0000","last_fullsized":"2024-09-19T06:47:00.584090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:30.320445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.550930+0000","last_change":"2024-09-19T06:45:21.327486+0000","last_active":"2024-09-19T06:47:00.550930+0000","last_peered":"2024-09-19T06:47:00.550930+0000","last_clean":"2024-09-19T06:47:00.550930+0000","last_became_active":"2024-09-19T06:45:21.327040+0000","last_became_peered":"2024-09-19T06:45:21.327040+0000","last_unstale":"2024-09-19T06:47:00.550930+0000","last_undegraded":"2024-09-19T06:47:00.550930+0000","last_fullsized":"2024-09-19T06:47:00.550930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:56.368487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.580495+0000","last_change":"2024-09-19T06:45:22.787281+0000","last_active":"2024-09-19T06:47:00.580495+0000","last_peered":"2024-09-19T06:47:00.580495+0000","last_clean":"2024-09-19T06:47:00.580495+0000","last_became_active":"2024-09-19T06:45:22.786607+0000","last_became_peered":"2024-09-19T06:45:22.786607+0000","last_unstale":"2024-09-19T06:47:00.580495+0000","last_undegraded":"2024-09-19T06:47:00.580495+0000","last_fullsized":"2024-09-19T06:47:00.580495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:51.115752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560644+0000","last_change":"2024-09-19T06:45:20.754432+0000","last_active":"2024-09-19T06:47:00.560644+0000","last_peered":"2024-09-19T06:47:00.560644+0000","last_clean":"2024-09-19T06:47:00.560644+0000","last_became_active":"2024-09-19T06:45:20.754060+0000","last_became_peered":"2024-09-19T06:45:20.754060+0000","last_unstale":"2024-09-19T06:47:00.560644+0000","last_undegraded":"2024-09-19T06:47:00.560644+0000","last_fullsized":"2024-09-19T06:47:00.560644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:58.618579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.581982+0000","last_change":"2024-09-19T06:45:22.783104+0000","last_active":"2024-09-19T06:47:00.581982+0000","last_peered":"2024-09-19T06:47:00.581982+0000","last_clean":"2024-09-19T06:47:00.581982+0000","last_became_active":"2024-09-19T06:45:22.782783+0000","last_became_peered":"2024-09-19T06:45:22.782783+0000","last_unstale":"2024-09-19T06:47:00.581982+0000","last_undegraded":"2024-09-19T06:47:00.581982+0000","last_fullsized":"2024-09-19T06:47:00.581982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:18.870046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536735+0000","last_change":"2024-09-19T06:45:20.754933+0000","last_active":"2024-09-19T06:47:00.536735+0000","last_peered":"2024-09-19T06:47:00.536735+0000","last_clean":"2024-09-19T06:47:00.536735+0000","last_became_active":"2024-09-19T06:45:20.754595+0000","last_became_peered":"2024-09-19T06:45:20.754595+0000","last_unstale":"2024-09-19T06:47:00.536735+0000","last_undegraded":"2024-09-19T06:47:00.536735+0000","last_fullsized":"2024-09-19T06:47:00.536735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:38:01.285102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579492+0000","last_change":"2024-09-19T06:45:22.784056+0000","last_active":"2024-09-19T06:47:00.579492+0000","last_peered":"2024-09-19T06:47:00.579492+0000","last_clean":"2024-09-19T06:47:00.579492+0000","last_became_active":"2024-09-19T06:45:22.783667+0000","last_became_peered":"2024-09-19T06:45:22.783667+0000","last_unstale":"2024-09-19T06:47:00.579492+0000","last_undegraded":"2024-09-19T06:47:00.579492+0000","last_fullsized":"2024-09-19T06:47:00.579492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:26.082951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'65","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:10.606059+0000","last_change":"2024-09-19T06:45:20.756019+0000","last_active":"2024-09-19T06:47:10.606059+0000","last_peered":"2024-09-19T06:47:10.606059+0000","last_clean":"2024-09-19T06:47:10.606059+0000","last_became_active":"2024-09-19T06:45:20.755645+0000","last_became_peered":"2024-09-19T06:45:20.755645+0000","last_unstale":"2024-09-19T06:47:10.606059+0000","last_undegraded":"2024-09-19T06:47:10.606059+0000","last_fullsized":"2024-09-19T06:47:10.606059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:47.986943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.594237+0000","last_change":"2024-09-19T06:45:22.779814+0000","last_active":"2024-09-19T06:47:00.594237+0000","last_peered":"2024-09-19T06:47:00.594237+0000","last_clean":"2024-09-19T06:47:00.594237+0000","last_became_active":"2024-09-19T06:45:22.779489+0000","last_became_peered":"2024-09-19T06:45:22.779489+0000","last_unstale":"2024-09-19T06:47:00.594237+0000","last_undegraded":"2024-09-19T06:47:00.594237+0000","last_fullsized":"2024-09-19T06:47:00.594237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:54:30.691323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.546255+0000","last_change":"2024-09-19T06:45:21.328066+0000","last_active":"2024-09-19T06:47:00.546255+0000","last_peered":"2024-09-19T06:47:00.546255+0000","last_clean":"2024-09-19T06:47:00.546255+0000","last_became_active":"2024-09-19T06:45:21.327676+0000","last_became_peered":"2024-09-19T06:45:21.327676+0000","last_unstale":"2024-09-19T06:47:00.546255+0000","last_undegraded":"2024-09-19T06:47:00.546255+0000","last_fullsized":"2024-09-19T06:47:00.546255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:05.666238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585679+0000","last_change":"2024-09-19T06:45:22.788631+0000","last_active":"2024-09-19T06:47:00.585679+0000","last_peered":"2024-09-19T06:47:00.585679+0000","last_clean":"2024-09-19T06:47:00.585679+0000","last_became_active":"2024-09-19T06:45:22.788265+0000","last_became_peered":"2024-09-19T06:45:22.788265+0000","last_unstale":"2024-09-19T06:47:00.585679+0000","last_undegraded":"2024-09-19T06:47:00.585679+0000","last_fullsized":"2024-09-19T06:47:00.585679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:00:21.873325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"82'148","reported_seq":393,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:02.663640+0000","last_change":"2024-09-19T06:44:13.172872+0000","last_active":"2024-09-19T06:47:02.663640+0000","last_peered":"2024-09-19T06:47:02.663640+0000","last_clean":"2024-09-19T06:47:02.663640+0000","last_became_active":"2024-09-19T06:44:13.172432+0000","last_became_peered":"2024-09-19T06:44:13.172432+0000","last_unstale":"2024-09-19T06:47:02.663640+0000","last_undegraded":"2024-09-19T06:47:02.663640+0000","last_fullsized":"2024-09-19T06:47:02.663640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:40:47.908986+0000","last_clean_scrub_stamp":"2024-09-19T06:40:47.908986+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:02.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549180+0000","last_change":"2024-09-19T06:45:20.755329+0000","last_active":"2024-09-19T06:47:00.549180+0000","last_peered":"2024-09-19T06:47:00.549180+0000","last_clean":"2024-09-19T06:47:00.549180+0000","last_became_active":"2024-09-19T06:45:20.755008+0000","last_became_peered":"2024-09-19T06:45:20.755008+0000","last_unstale":"2024-09-19T06:47:00.549180+0000","last_undegraded":"2024-09-19T06:47:00.549180+0000","last_fullsized":"2024-09-19T06:47:00.549180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:03.925897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593914+0000","last_change":"2024-09-19T06:45:22.780360+0000","last_active":"2024-09-19T06:47:00.593914+0000","last_peered":"2024-09-19T06:47:00.593914+0000","last_clean":"2024-09-19T06:47:00.593914+0000","last_became_active":"2024-09-19T06:45:22.779913+0000","last_became_peered":"2024-09-19T06:45:22.779913+0000","last_unstale":"2024-09-19T06:47:00.593914+0000","last_undegraded":"2024-09-19T06:47:00.593914+0000","last_fullsized":"2024-09-19T06:47:00.593914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:16.629407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549165+0000","last_change":"2024-09-19T06:45:20.758844+0000","last_active":"2024-09-19T06:47:00.549165+0000","last_peered":"2024-09-19T06:47:00.549165+0000","last_clean":"2024-09-19T06:47:00.549165+0000","last_became_active":"2024-09-19T06:45:20.758496+0000","last_became_peered":"2024-09-19T06:45:20.758496+0000","last_unstale":"2024-09-19T06:47:00.549165+0000","last_undegraded":"2024-09-19T06:47:00.549165+0000","last_fullsized":"2024-09-19T06:47:00.549165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:17:02.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.577578+0000","last_change":"2024-09-19T06:45:22.784609+0000","last_active":"2024-09-19T06:47:00.577578+0000","last_peered":"2024-09-19T06:47:00.577578+0000","last_clean":"2024-09-19T06:47:00.577578+0000","last_became_active":"2024-09-19T06:45:22.784274+0000","last_became_peered":"2024-09-19T06:45:22.784274+0000","last_unstale":"2024-09-19T06:47:00.577578+0000","last_undegraded":"2024-09-19T06:47:00.577578+0000","last_fullsized":"2024-09-19T06:47:00.577578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:44.701793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536478+0000","last_change":"2024-09-19T06:45:21.326327+0000","last_active":"2024-09-19T06:47:00.536478+0000","last_peered":"2024-09-19T06:47:00.536478+0000","last_clean":"2024-09-19T06:47:00.536478+0000","last_became_active":"2024-09-19T06:45:21.325990+0000","last_became_peered":"2024-09-19T06:45:21.325990+0000","last_unstale":"2024-09-19T06:47:00.536478+0000","last_undegraded":"2024-09-19T06:47:00.536478+0000","last_fullsized":"2024-09-19T06:47:00.536478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:26.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579472+0000","last_change":"2024-09-19T06:45:22.786338+0000","last_active":"2024-09-19T06:47:00.579472+0000","last_peered":"2024-09-19T06:47:00.579472+0000","last_clean":"2024-09-19T06:47:00.579472+0000","last_became_active":"2024-09-19T06:45:22.786020+0000","last_became_peered":"2024-09-19T06:45:22.786020+0000","last_unstale":"2024-09-19T06:47:00.579472+0000","last_undegraded":"2024-09-19T06:47:00.579472+0000","last_fullsized":"2024-09-19T06:47:00.579472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:41.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549300+0000","last_change":"2024-09-19T06:45:20.754032+0000","last_active":"2024-09-19T06:47:00.549300+0000","last_peered":"2024-09-19T06:47:00.549300+0000","last_clean":"2024-09-19T06:47:00.549300+0000","last_became_active":"2024-09-19T06:45:20.753670+0000","last_became_peered":"2024-09-19T06:45:20.753670+0000","last_unstale":"2024-09-19T06:47:00.549300+0000","last_undegraded":"2024-09-19T06:47:00.549300+0000","last_fullsized":"2024-09-19T06:47:00.549300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:10.237056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579645+0000","last_change":"2024-09-19T06:45:22.786612+0000","last_active":"2024-09-19T06:47:00.579645+0000","last_peered":"2024-09-19T06:47:00.579645+0000","last_clean":"2024-09-19T06:47:00.579645+0000","last_became_active":"2024-09-19T06:45:22.786200+0000","last_became_peered":"2024-09-19T06:45:22.786200+0000","last_unstale":"2024-09-19T06:47:00.579645+0000","last_undegraded":"2024-09-19T06:47:00.579645+0000","last_fullsized":"2024-09-19T06:47:00.579645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:28.546067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556514+0000","last_change":"2024-09-19T06:45:21.328011+0000","last_active":"2024-09-19T06:47:00.556514+0000","last_peered":"2024-09-19T06:47:00.556514+0000","last_clean":"2024-09-19T06:47:00.556514+0000","last_became_active":"2024-09-19T06:45:21.327703+0000","last_became_peered":"2024-09-19T06:45:21.327703+0000","last_unstale":"2024-09-19T06:47:00.556514+0000","last_undegraded":"2024-09-19T06:47:00.556514+0000","last_fullsized":"2024-09-19T06:47:00.556514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:54.880001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587136+0000","last_change":"2024-09-19T06:45:22.775965+0000","last_active":"2024-09-19T06:47:00.587136+0000","last_peered":"2024-09-19T06:47:00.587136+0000","last_clean":"2024-09-19T06:47:00.587136+0000","last_became_active":"2024-09-19T06:45:22.775609+0000","last_became_peered":"2024-09-19T06:45:22.775609+0000","last_unstale":"2024-09-19T06:47:00.587136+0000","last_undegraded":"2024-09-19T06:47:00.587136+0000","last_fullsized":"2024-09-19T06:47:00.587136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:49.937964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552471+0000","last_change":"2024-09-19T06:45:21.326629+0000","last_active":"2024-09-19T06:47:00.552471+0000","last_peered":"2024-09-19T06:47:00.552471+0000","last_clean":"2024-09-19T06:47:00.552471+0000","last_became_active":"2024-09-19T06:45:21.326234+0000","last_became_peered":"2024-09-19T06:45:21.326234+0000","last_unstale":"2024-09-19T06:47:00.552471+0000","last_undegraded":"2024-09-19T06:47:00.552471+0000","last_fullsized":"2024-09-19T06:47:00.552471+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:55.521662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.579287+0000","last_change":"2024-09-19T06:45:22.780983+0000","last_active":"2024-09-19T06:47:00.579287+0000","last_peered":"2024-09-19T06:47:00.579287+0000","last_clean":"2024-09-19T06:47:00.579287+0000","last_became_active":"2024-09-19T06:45:22.780627+0000","last_became_peered":"2024-09-19T06:45:22.780627+0000","last_unstale":"2024-09-19T06:47:00.579287+0000","last_undegraded":"2024-09-19T06:47:00.579287+0000","last_fullsized":"2024-09-19T06:47:00.579287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:37.136170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'98","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:10.978228+0000","last_change":"2024-09-19T06:45:20.754784+0000","last_active":"2024-09-19T06:47:10.978228+0000","last_peered":"2024-09-19T06:47:10.978228+0000","last_clean":"2024-09-19T06:47:10.978228+0000","last_became_active":"2024-09-19T06:45:20.754450+0000","last_became_peered":"2024-09-19T06:45:20.754450+0000","last_unstale":"2024-09-19T06:47:10.978228+0000","last_undegraded":"2024-09-19T06:47:10.978228+0000","last_fullsized":"2024-09-19T06:47:10.978228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:49.591664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":181,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.593306+0000","last_change":"2024-09-19T06:45:22.778821+0000","last_active":"2024-09-19T06:47:00.593306+0000","last_peered":"2024-09-19T06:47:00.593306+0000","last_clean":"2024-09-19T06:47:00.593306+0000","last_became_active":"2024-09-19T06:45:22.778492+0000","last_became_peered":"2024-09-19T06:45:22.778492+0000","last_unstale":"2024-09-19T06:47:00.593306+0000","last_undegraded":"2024-09-19T06:47:00.593306+0000","last_fullsized":"2024-09-19T06:47:00.593306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:31.851587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.549571+0000","last_change":"2024-09-19T06:45:21.267871+0000","last_active":"2024-09-19T06:47:00.549571+0000","last_peered":"2024-09-19T06:47:00.549571+0000","last_clean":"2024-09-19T06:47:00.549571+0000","last_became_active":"2024-09-19T06:45:21.267343+0000","last_became_peered":"2024-09-19T06:45:21.267343+0000","last_unstale":"2024-09-19T06:47:00.549571+0000","last_undegraded":"2024-09-19T06:47:00.549571+0000","last_fullsized":"2024-09-19T06:47:00.549571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:22.162881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596329+0000","last_change":"2024-09-19T06:45:34.972922+0000","last_active":"2024-09-19T06:47:00.596329+0000","last_peered":"2024-09-19T06:47:00.596329+0000","last_clean":"2024-09-19T06:47:00.596329+0000","last_became_active":"2024-09-19T06:45:34.972490+0000","last_became_peered":"2024-09-19T06:45:34.972490+0000","last_unstale":"2024-09-19T06:47:00.596329+0000","last_undegraded":"2024-09-19T06:47:00.596329+0000","last_fullsized":"2024-09-19T06:47:00.596329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:19.588899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.536872+0000","last_change":"2024-09-19T06:45:21.327534+0000","last_active":"2024-09-19T06:47:00.536872+0000","last_peered":"2024-09-19T06:47:00.536872+0000","last_clean":"2024-09-19T06:47:00.536872+0000","last_became_active":"2024-09-19T06:45:21.327152+0000","last_became_peered":"2024-09-19T06:45:21.327152+0000","last_unstale":"2024-09-19T06:47:00.536872+0000","last_undegraded":"2024-09-19T06:47:00.536872+0000","last_fullsized":"2024-09-19T06:47:00.536872+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:09.378600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.573059+0000","last_change":"2024-09-19T06:45:22.776095+0000","last_active":"2024-09-19T06:47:00.573059+0000","last_peered":"2024-09-19T06:47:00.573059+0000","last_clean":"2024-09-19T06:47:00.573059+0000","last_became_active":"2024-09-19T06:45:22.775334+0000","last_became_peered":"2024-09-19T06:45:22.775334+0000","last_unstale":"2024-09-19T06:47:00.573059+0000","last_undegraded":"2024-09-19T06:47:00.573059+0000","last_fullsized":"2024-09-19T06:47:00.573059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:57.656113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.551180+0000","last_change":"2024-09-19T06:45:20.754237+0000","last_active":"2024-09-19T06:47:00.551180+0000","last_peered":"2024-09-19T06:47:00.551180+0000","last_clean":"2024-09-19T06:47:00.551180+0000","last_became_active":"2024-09-19T06:45:20.753887+0000","last_became_peered":"2024-09-19T06:45:20.753887+0000","last_unstale":"2024-09-19T06:47:00.551180+0000","last_undegraded":"2024-09-19T06:47:00.551180+0000","last_fullsized":"2024-09-19T06:47:00.551180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:07:43.538453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.595812+0000","last_change":"2024-09-19T06:45:22.780907+0000","last_active":"2024-09-19T06:47:00.595812+0000","last_peered":"2024-09-19T06:47:00.595812+0000","last_clean":"2024-09-19T06:47:00.595812+0000","last_became_active":"2024-09-19T06:45:22.780286+0000","last_became_peered":"2024-09-19T06:45:22.780286+0000","last_unstale":"2024-09-19T06:47:00.595812+0000","last_undegraded":"2024-09-19T06:47:00.595812+0000","last_fullsized":"2024-09-19T06:47:00.595812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:13.907806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.555196+0000","last_change":"2024-09-19T06:45:34.972570+0000","last_active":"2024-09-19T06:47:00.555196+0000","last_peered":"2024-09-19T06:47:00.555196+0000","last_clean":"2024-09-19T06:47:00.555196+0000","last_became_active":"2024-09-19T06:45:34.972218+0000","last_became_peered":"2024-09-19T06:45:34.972218+0000","last_unstale":"2024-09-19T06:47:00.555196+0000","last_undegraded":"2024-09-19T06:47:00.555196+0000","last_fullsized":"2024-09-19T06:47:00.555196+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:49.044480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.597003+0000","last_change":"2024-09-19T06:45:22.777122+0000","last_active":"2024-09-19T06:47:00.597003+0000","last_peered":"2024-09-19T06:47:00.597003+0000","last_clean":"2024-09-19T06:47:00.597003+0000","last_became_active":"2024-09-19T06:45:22.776805+0000","last_became_peered":"2024-09-19T06:45:22.776805+0000","last_unstale":"2024-09-19T06:47:00.597003+0000","last_undegraded":"2024-09-19T06:47:00.597003+0000","last_fullsized":"2024-09-19T06:47:00.597003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:46.116716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.560958+0000","last_change":"2024-09-19T06:45:20.757109+0000","last_active":"2024-09-19T06:47:00.560958+0000","last_peered":"2024-09-19T06:47:00.560958+0000","last_clean":"2024-09-19T06:47:00.560958+0000","last_became_active":"2024-09-19T06:45:20.756726+0000","last_became_peered":"2024-09-19T06:45:20.756726+0000","last_unstale":"2024-09-19T06:47:00.560958+0000","last_undegraded":"2024-09-19T06:47:00.560958+0000","last_fullsized":"2024-09-19T06:47:00.560958+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:06.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.585140+0000","last_change":"2024-09-19T06:45:22.788965+0000","last_active":"2024-09-19T06:47:00.585140+0000","last_peered":"2024-09-19T06:47:00.585140+0000","last_clean":"2024-09-19T06:47:00.585140+0000","last_became_active":"2024-09-19T06:45:22.788635+0000","last_became_peered":"2024-09-19T06:45:22.788635+0000","last_unstale":"2024-09-19T06:47:00.585140+0000","last_undegraded":"2024-09-19T06:47:00.585140+0000","last_fullsized":"2024-09-19T06:47:00.585140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:38.952786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587229+0000","last_change":"2024-09-19T06:45:22.778351+0000","last_active":"2024-09-19T06:47:00.587229+0000","last_peered":"2024-09-19T06:47:00.587229+0000","last_clean":"2024-09-19T06:47:00.587229+0000","last_became_active":"2024-09-19T06:45:22.777993+0000","last_became_peered":"2024-09-19T06:45:22.777993+0000","last_unstale":"2024-09-19T06:47:00.587229+0000","last_undegraded":"2024-09-19T06:47:00.587229+0000","last_fullsized":"2024-09-19T06:47:00.587229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:42.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556945+0000","last_change":"2024-09-19T06:45:34.847185+0000","last_active":"2024-09-19T06:47:00.556945+0000","last_peered":"2024-09-19T06:47:00.556945+0000","last_clean":"2024-09-19T06:47:00.556945+0000","last_became_active":"2024-09-19T06:45:34.843196+0000","last_became_peered":"2024-09-19T06:45:34.843196+0000","last_unstale":"2024-09-19T06:47:00.556945+0000","last_undegraded":"2024-09-19T06:47:00.556945+0000","last_fullsized":"2024-09-19T06:47:00.556945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:35.037010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.587670+0000","last_change":"2024-09-19T06:45:22.777196+0000","last_active":"2024-09-19T06:47:00.587670+0000","last_peered":"2024-09-19T06:47:00.587670+0000","last_clean":"2024-09-19T06:47:00.587670+0000","last_became_active":"2024-09-19T06:45:22.774442+0000","last_became_peered":"2024-09-19T06:45:22.774442+0000","last_unstale":"2024-09-19T06:47:00.587670+0000","last_undegraded":"2024-09-19T06:47:00.587670+0000","last_fullsized":"2024-09-19T06:47:00.587670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:02.603316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552359+0000","last_change":"2024-09-19T06:45:20.756476+0000","last_active":"2024-09-19T06:47:00.552359+0000","last_peered":"2024-09-19T06:47:00.552359+0000","last_clean":"2024-09-19T06:47:00.552359+0000","last_became_active":"2024-09-19T06:45:20.756054+0000","last_became_peered":"2024-09-19T06:45:20.756054+0000","last_unstale":"2024-09-19T06:47:00.552359+0000","last_undegraded":"2024-09-19T06:47:00.552359+0000","last_fullsized":"2024-09-19T06:47:00.552359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:40.550796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.596914+0000","last_change":"2024-09-19T06:45:22.788260+0000","last_active":"2024-09-19T06:47:00.596914+0000","last_peered":"2024-09-19T06:47:00.596914+0000","last_clean":"2024-09-19T06:47:00.596914+0000","last_became_active":"2024-09-19T06:45:22.787974+0000","last_became_peered":"2024-09-19T06:45:22.787974+0000","last_unstale":"2024-09-19T06:47:00.596914+0000","last_undegraded":"2024-09-19T06:47:00.596914+0000","last_fullsized":"2024-09-19T06:47:00.596914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:03.885539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.552705+0000","last_change":"2024-09-19T06:45:21.326345+0000","last_active":"2024-09-19T06:47:00.552705+0000","last_peered":"2024-09-19T06:47:00.552705+0000","last_clean":"2024-09-19T06:47:00.552705+0000","last_became_active":"2024-09-19T06:45:21.326022+0000","last_became_peered":"2024-09-19T06:45:21.326022+0000","last_unstale":"2024-09-19T06:47:00.552705+0000","last_undegraded":"2024-09-19T06:47:00.552705+0000","last_fullsized":"2024-09-19T06:47:00.552705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:06.059885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.592794+0000","last_change":"2024-09-19T06:45:22.781954+0000","last_active":"2024-09-19T06:47:00.592794+0000","last_peered":"2024-09-19T06:47:00.592794+0000","last_clean":"2024-09-19T06:47:00.592794+0000","last_became_active":"2024-09-19T06:45:22.781726+0000","last_became_peered":"2024-09-19T06:45:22.781726+0000","last_unstale":"2024-09-19T06:47:00.592794+0000","last_undegraded":"2024-09-19T06:47:00.592794+0000","last_fullsized":"2024-09-19T06:47:00.592794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:21.748607+0000","last_clean_scrub_stamp":"2024-09-19T06:45:21.748607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:05.276358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:47:00.556381+0000","last_change":"2024-09-19T06:45:20.756212+0000","last_active":"2024-09-19T06:47:00.556381+0000","last_peered":"2024-09-19T06:47:00.556381+0000","last_clean":"2024-09-19T06:47:00.556381+0000","last_became_active":"2024-09-19T06:45:20.755864+0000","last_became_peered":"2024-09-19T06:45:20.755864+0000","last_unstale":"2024-09-19T06:47:00.556381+0000","last_undegraded":"2024-09-19T06:47:00.556381+0000","last_fullsized":"2024-09-19T06:47:00.556381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:45:19.735662+0000","last_clean_scrub_stamp":"2024-09-19T06:45:19.735662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:02.231034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":791781,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":565,"num_read_kb":491,"num_write":328,"num_write_kb":2320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":2375343,"data_compressed":108912,"data_compressed_allocated":147456,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107385,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612642,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":441000,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":1429446,"data_compressed":61462,"data_compressed_allocated":81920,"data_compressed_original":929792,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005101,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":834798,"data_compressed":27941,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":834820,"data_compressed":27941,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":1032067,"data_compressed":44447,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":441117,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":1359899,"data_compressed":59649,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441022,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":1162786,"data_compressed":43143,"data_compressed_allocated":57344,"data_compressed_original":724992,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476816,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":510569,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":962560,"data_stored":510535,"data_compressed":10465,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441090,"data_compressed":8652,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":69535,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69569,"data_compressed":1813,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":721552,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":328414,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":397961,"data_compressed":17015,"data_compressed_allocated":24576,"data_compressed_original":315392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:47:17.012 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:17.261 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:17.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:17 smithi159 ceph-mon[30935]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:17.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:17 smithi159 ceph-mon[30935]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-19T06:47:17.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.770+0000 7f6befbfb640 1 -- 172.21.15.159:0/3592671974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102570 msgr2=0x7f6be81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:17.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.770+0000 7f6befbfb640 1 --2- 172.21.15.159:0/3592671974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102570 0x7f6be81029b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009900 tx=0x7f6bd802a480 comp rx=0 tx=0).stop 2024-09-19T06:47:17.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.770+0000 7f6befbfb640 1 -- 172.21.15.159:0/3592671974 shutdown_connections 2024-09-19T06:47:17.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.770+0000 7f6befbfb640 1 --2- 172.21.15.159:0/3592671974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6be8102ef0 0x7f6be810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.770+0000 7f6befbfb640 1 --2- 172.21.15.159:0/3592671974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102570 0x7f6be81029b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.770+0000 7f6befbfb640 1 --2- 172.21.15.159:0/3592671974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be8100e20 0x7f6be8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.770+0000 7f6befbfb640 1 -- 172.21.15.159:0/3592671974 >> 172.21.15.159:0/3592671974 conn(0x7f6be80fc7d0 msgr2=0x7f6be80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.770+0000 7f6befbfb640 1 -- 172.21.15.159:0/3592671974 shutdown_connections 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.770+0000 7f6befbfb640 1 -- 172.21.15.159:0/3592671974 wait complete. 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6befbfb640 1 Processor -- start 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6befbfb640 1 -- start start 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6befbfb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6be8100e20 0x7f6be81973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6befbfb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be8102570 0x7f6be8197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6befbfb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102ef0 0x7f6be819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6befbfb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6be8110f80 con 0x7f6be8102ef0 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6befbfb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6be8110e00 con 0x7f6be8102570 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6befbfb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6be8111100 con 0x7f6be8100e20 2024-09-19T06:47:17.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bee198640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102ef0 0x7f6be819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bee198640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102ef0 0x7f6be819bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46190/0 (socket says 172.21.15.159:46190) 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bee198640 1 -- 172.21.15.159:0/929677358 learned_addr learned my addr 172.21.15.159:0/929677358 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bed997640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6be8100e20 0x7f6be81973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bed196640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be8102570 0x7f6be8197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bee198640 1 -- 172.21.15.159:0/929677358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6be8100e20 msgr2=0x7f6be81973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bee198640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6be8100e20 0x7f6be81973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bee198640 1 -- 172.21.15.159:0/929677358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be8102570 msgr2=0x7f6be8197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bee198640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be8102570 0x7f6be8197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bee198640 1 -- 172.21.15.159:0/929677358 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be819c390 con 0x7f6be8102ef0 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bed997640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6be8100e20 0x7f6be81973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bed196640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be8102570 0x7f6be8197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.771+0000 7f6bee198640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102ef0 0x7f6be819bcb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6be000eb10 tx=0x7f6be000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:17.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.772+0000 7f6bdeffd640 1 -- 172.21.15.159:0/929677358 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0004b20 con 0x7f6be8102ef0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.772+0000 7f6bdeffd640 1 -- 172.21.15.159:0/929677358 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6be0004cc0 con 0x7f6be8102ef0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.772+0000 7f6bdeffd640 1 -- 172.21.15.159:0/929677358 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0010760 con 0x7f6be8102ef0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.772+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be819c680 con 0x7f6be8102ef0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.772+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be81a3f60 con 0x7f6be8102ef0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.773+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be8101200 con 0x7f6be8102ef0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.774+0000 7f6bdeffd640 1 -- 172.21.15.159:0/929677358 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f6be0005020 con 0x7f6be8102ef0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.774+0000 7f6bdeffd640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6bd40a34c0 0x7f6bd40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.775+0000 7f6bdeffd640 1 -- 172.21.15.159:0/929677358 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f6be00d06a0 con 0x7f6be8102ef0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.775+0000 7f6bed997640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6bd40a34c0 0x7f6bd40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.775+0000 7f6bed997640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6bd40a34c0 0x7f6bd40a5980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009b50 tx=0x7f6be4005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:17.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.779+0000 7f6bdeffd640 1 -- 172.21.15.159:0/929677358 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6be009cee0 con 0x7f6be8102ef0 2024-09-19T06:47:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:17 smithi189 ceph-mon[34880]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:17.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:17 smithi189 ceph-mon[34880]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-19T06:47:17.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.978+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6be8109090 con 0x7f6be8102ef0 2024-09-19T06:47:17.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.979+0000 7f6bdeffd640 1 -- 172.21.15.159:0/929677358 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f6be009c7e0 con 0x7f6be8102ef0 2024-09-19T06:47:17.980 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:17.981 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:47:17.981 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:47:17.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6bd40a34c0 msgr2=0x7f6bd40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:17.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6bd40a34c0 0x7f6bd40a5980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009b50 tx=0x7f6be4005f90 comp rx=0 tx=0).stop 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102ef0 msgr2=0x7f6be819bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102ef0 0x7f6be819bcb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6be000eb10 tx=0x7f6be000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 shutdown_connections 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6bd40a34c0 0x7f6bd40a5980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8102ef0 0x7f6be819bcb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be8102570 0x7f6be8197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 --2- 172.21.15.159:0/929677358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6be8100e20 0x7f6be81973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.981+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 >> 172.21.15.159:0/929677358 conn(0x7f6be80fc7d0 msgr2=0x7f6be81068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.982+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 shutdown_connections 2024-09-19T06:47:17.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:17.982+0000 7f6befbfb640 1 -- 172.21.15.159:0/929677358 wait complete. 2024-09-19T06:47:18.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:17 smithi203 ceph-mon[35473]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:47:18.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:17 smithi203 ceph-mon[35473]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-19T06:47:18.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:18 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/929677358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:18.799 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:18.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:18 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/929677358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:19.049 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:19.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:18 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/929677358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:19.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.549+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/155213183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 msgr2=0x7f5e9c10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:19.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.549+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/155213183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 0x7f5e9c10d910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009ca0 tx=0x7f5e9402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/155213183 shutdown_connections 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/155213183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 0x7f5e9c10d910 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/155213183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e9c101240 0x7f5e9c101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/155213183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e9c105a90 0x7f5e9c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/155213183 >> 172.21.15.159:0/155213183 conn(0x7f5e9c077210 msgr2=0x7f5e9c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/155213183 shutdown_connections 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/155213183 wait complete. 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 Processor -- start 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 -- start start 2024-09-19T06:47:19.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e9c101240 0x7f5e9c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:19.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 0x7f5e9c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:19.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e9c105a90 0x7f5e9c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:19.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c112090 con 0x7f5e9c101bc0 2024-09-19T06:47:19.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c111f10 con 0x7f5e9c105a90 2024-09-19T06:47:19.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.550+0000 7f5ea2e7d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c112210 con 0x7f5e9c101240 2024-09-19T06:47:19.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e9bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 0x7f5e9c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e9bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 0x7f5e9c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45184/0 (socket says 172.21.15.159:45184) 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e9bfff640 1 -- 172.21.15.159:0/395335056 learned_addr learned my addr 172.21.15.159:0/395335056 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5ea0c19640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e9c101240 0x7f5e9c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5ea141a640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e9c105a90 0x7f5e9c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e9bfff640 1 -- 172.21.15.159:0/395335056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e9c101240 msgr2=0x7f5e9c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e9bfff640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e9c101240 0x7f5e9c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e9bfff640 1 -- 172.21.15.159:0/395335056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e9c105a90 msgr2=0x7f5e9c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e9bfff640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e9c105a90 0x7f5e9c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e9bfff640 1 -- 172.21.15.159:0/395335056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c19d3e0 con 0x7f5e9c101bc0 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e9bfff640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 0x7f5e9c198970 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d770 tx=0x7f5e8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e99ffb640 1 -- 172.21.15.159:0/395335056 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e88017070 con 0x7f5e9c101bc0 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9c19d6d0 con 0x7f5e9c101bc0 2024-09-19T06:47:19.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e99ffb640 1 -- 172.21.15.159:0/395335056 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e88005500 con 0x7f5e9c101bc0 2024-09-19T06:47:19.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5e99ffb640 1 -- 172.21.15.159:0/395335056 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e88004e40 con 0x7f5e9c101bc0 2024-09-19T06:47:19.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.551+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9c1a4fb0 con 0x7f5e9c101bc0 2024-09-19T06:47:19.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.552+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e9c101680 con 0x7f5e9c101bc0 2024-09-19T06:47:19.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.553+0000 7f5e99ffb640 1 -- 172.21.15.159:0/395335056 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f5e88009c30 con 0x7f5e9c101bc0 2024-09-19T06:47:19.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.554+0000 7f5e99ffb640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5e8c0a3440 0x7f5e8c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:19.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.554+0000 7f5ea0c19640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5e8c0a3440 0x7f5e8c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:19.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.554+0000 7f5e99ffb640 1 -- 172.21.15.159:0/395335056 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f5e880cf9f0 con 0x7f5e9c101bc0 2024-09-19T06:47:19.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.555+0000 7f5ea0c19640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5e8c0a3440 0x7f5e8c0a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000bbe0 tx=0x7f5e9000b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:19.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.558+0000 7f5e99ffb640 1 -- 172.21.15.159:0/395335056 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5e8809c1d0 con 0x7f5e9c101bc0 2024-09-19T06:47:19.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.761+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e9c1a5180 con 0x7f5e9c101bc0 2024-09-19T06:47:19.763 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:19 smithi159 ceph-mon[30935]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T06:47:19.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.762+0000 7f5e99ffb640 1 -- 172.21.15.159:0/395335056 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f5e8809bad0 con 0x7f5e9c101bc0 2024-09-19T06:47:19.763 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:19.764 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:47:19.764 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:47:19.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5e8c0a3440 msgr2=0x7f5e8c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:19.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5e8c0a3440 0x7f5e8c0a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000bbe0 tx=0x7f5e9000b390 comp rx=0 tx=0).stop 2024-09-19T06:47:19.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 msgr2=0x7f5e9c198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:19.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 0x7f5e9c198970 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d770 tx=0x7f5e8800dc30 comp rx=0 tx=0).stop 2024-09-19T06:47:19.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 shutdown_connections 2024-09-19T06:47:19.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5e8c0a3440 0x7f5e8c0a5900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e9c105a90 0x7f5e9c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c101bc0 0x7f5e9c198970 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 --2- 172.21.15.159:0/395335056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e9c101240 0x7f5e9c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:19.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 >> 172.21.15.159:0/395335056 conn(0x7f5e9c077210 msgr2=0x7f5e9c103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:19.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 shutdown_connections 2024-09-19T06:47:19.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:19.765+0000 7f5ea2e7d640 1 -- 172.21.15.159:0/395335056 wait complete. 2024-09-19T06:47:19.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:19 smithi189 ceph-mon[34880]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T06:47:20.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:19 smithi203 ceph-mon[35473]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-19T06:47:20.525 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:47:20.777 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:20.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:20 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/395335056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:20.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:20 smithi189 ceph-mon[34880]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-19T06:47:20.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:20 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/395335056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:20 smithi159 ceph-mon[30935]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-19T06:47:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:20 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/395335056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:21.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:20 smithi203 ceph-mon[35473]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-19T06:47:21.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 -- 172.21.15.159:0/3013845985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a01008f0 msgr2=0x7f47a0100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 --2- 172.21.15.159:0/3013845985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a01008f0 0x7f47a0100cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4790009ca0 tx=0x7f479002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 -- 172.21.15.159:0/3013845985 shutdown_connections 2024-09-19T06:47:21.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 --2- 172.21.15.159:0/3013845985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47a010e4a0 0x7f47a0110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 --2- 172.21.15.159:0/3013845985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47a01012a0 0x7f47a010df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 --2- 172.21.15.159:0/3013845985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a01008f0 0x7f47a0100cd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 -- 172.21.15.159:0/3013845985 >> 172.21.15.159:0/3013845985 conn(0x7f47a00fc7a0 msgr2=0x7f47a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:21.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 -- 172.21.15.159:0/3013845985 shutdown_connections 2024-09-19T06:47:21.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 -- 172.21.15.159:0/3013845985 wait complete. 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.261+0000 7f47a518c640 1 Processor -- start 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f47a518c640 1 -- start start 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f47a518c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47a01008f0 0x7f47a019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f47a518c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47a01012a0 0x7f47a019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f47a518c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a010e4a0 0x7f47a019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f47a518c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f47a01141d0 con 0x7f47a010e4a0 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f47a518c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0114050 con 0x7f47a01008f0 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f47a518c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0114350 con 0x7f47a01012a0 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a010e4a0 0x7f47a019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a010e4a0 0x7f47a019ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45196/0 (socket says 172.21.15.159:45196) 2024-09-19T06:47:21.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479f59e640 1 -- 172.21.15.159:0/467302271 learned_addr learned my addr 172.21.15.159:0/467302271 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479ed9d640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47a01008f0 0x7f47a019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479659c640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47a01012a0 0x7f47a019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479f59e640 1 -- 172.21.15.159:0/467302271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47a01012a0 msgr2=0x7f47a019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479f59e640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47a01012a0 0x7f47a019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479f59e640 1 -- 172.21.15.159:0/467302271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47a01008f0 msgr2=0x7f47a019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479f59e640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47a01008f0 0x7f47a019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479f59e640 1 -- 172.21.15.159:0/467302271 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a019f640 con 0x7f47a010e4a0 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.262+0000 7f479ed9d640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47a01008f0 0x7f47a019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.263+0000 7f479f59e640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a010e4a0 0x7f47a019ef60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f479800b3f0 tx=0x7f479800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.263+0000 7f479cd99640 1 -- 172.21.15.159:0/467302271 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798015020 con 0x7f47a010e4a0 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.263+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a019f930 con 0x7f47a010e4a0 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.263+0000 7f479cd99640 1 -- 172.21.15.159:0/467302271 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4798011d10 con 0x7f47a010e4a0 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.263+0000 7f479cd99640 1 -- 172.21.15.159:0/467302271 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479800f2e0 con 0x7f47a010e4a0 2024-09-19T06:47:21.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.263+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a01a7210 con 0x7f47a010e4a0 2024-09-19T06:47:21.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.264+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a0100cd0 con 0x7f47a010e4a0 2024-09-19T06:47:21.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.265+0000 7f479cd99640 1 -- 172.21.15.159:0/467302271 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f4798018020 con 0x7f47a010e4a0 2024-09-19T06:47:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.266+0000 7f479cd99640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f478c0a3440 0x7f478c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.266+0000 7f479ed9d640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f478c0a3440 0x7f478c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.266+0000 7f479cd99640 1 -- 172.21.15.159:0/467302271 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f47980cfc90 con 0x7f47a010e4a0 2024-09-19T06:47:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.267+0000 7f479ed9d640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f478c0a3440 0x7f478c0a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4790006010 tx=0x7f47900093f0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:21.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.269+0000 7f479cd99640 1 -- 172.21.15.159:0/467302271 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f479801f020 con 0x7f47a010e4a0 2024-09-19T06:47:21.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.440+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47a0109690 con 0x7f47a010e4a0 2024-09-19T06:47:21.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.442+0000 7f479cd99640 1 -- 172.21.15.159:0/467302271 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+23312 (secure 0 0 0) 0x7f479809c5e0 con 0x7f47a010e4a0 2024-09-19T06:47:21.443 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:21.443 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":82,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:47:00.531454+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:6800/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2156136647":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2526477703":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3276076186":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3424652308":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3763048477":"2024-09-20T06:47:00.531421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:47:21.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f478c0a3440 msgr2=0x7f478c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f478c0a3440 0x7f478c0a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4790006010 tx=0x7f47900093f0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a010e4a0 msgr2=0x7f47a019ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:21.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a010e4a0 0x7f47a019ef60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f479800b3f0 tx=0x7f479800b8b0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 shutdown_connections 2024-09-19T06:47:21.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f478c0a3440 0x7f478c0a5900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a010e4a0 0x7f47a019ef60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47a01012a0 0x7f47a019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 --2- 172.21.15.159:0/467302271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47a01008f0 0x7f47a019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:21.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 >> 172.21.15.159:0/467302271 conn(0x7f47a00fc7a0 msgr2=0x7f47a00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:21.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 shutdown_connections 2024-09-19T06:47:21.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:21.444+0000 7f47a518c640 1 -- 172.21.15.159:0/467302271 wait complete. 2024-09-19T06:47:21.762 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:21 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/467302271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:47:21.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:21 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/467302271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:47:22.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:21 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/467302271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:47:22.110 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T06:47:22.357 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:22.759 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:22 smithi159 ceph-mon[30935]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-19T06:47:22.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:22 smithi189 ceph-mon[34880]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-19T06:47:23.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:22 smithi203 ceph-mon[35473]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-19T06:47:23.672 INFO:teuthology.orchestra.run.smithi159.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T06:47:23.672 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T06:47:23.673 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T06:47:23.673 DEBUG:tasks.quiescer:Yielding 2024-09-19T06:47:23.673 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T06:47:23.697 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:47:23.698 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T06:47:23.698 INFO:tasks.workunit:timeout=3h 2024-09-19T06:47:23.698 INFO:tasks.workunit:cleanup=True 2024-09-19T06:47:23.698 DEBUG:teuthology.orchestra.run.smithi159:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:47:23.699 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:23.716 INFO:teuthology.orchestra.run.smithi159.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T06:47:23.717 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T06:47:23.717 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T06:47:23.717 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:47:23.717 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T06:47:23.717 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-19 06:45:39.463172019 +0000 2024-09-19T06:47:23.717 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-19 06:45:39.463172019 +0000 2024-09-19T06:47:23.717 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-19 06:47:00.554191664 +0000 2024-09-19T06:47:23.718 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-19 06:45:39.463172019 +0000 2024-09-19T06:47:23.718 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T06:47:23.718 DEBUG:teuthology.orchestra.run.smithi159:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T06:47:23.787 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:47:23.844 INFO:tasks.workunit.client.0.smithi159.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T06:47:23.959 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/956874950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a44102c80 msgr2=0x7f6a44103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/956874950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a44102c80 0x7f6a44103060 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009900 tx=0x7f6a3402a480 comp rx=0 tx=0).stop 2024-09-19T06:47:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/956874950 shutdown_connections 2024-09-19T06:47:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/956874950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a4410c0d0 0x7f6a4410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/956874950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a441035a0 0x7f6a4410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/956874950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a44102c80 0x7f6a44103060 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/956874950 >> 172.21.15.159:0/956874950 conn(0x7f6a44077990 msgr2=0x7f6a440fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/956874950 shutdown_connections 2024-09-19T06:47:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/956874950 wait complete. 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.191+0000 7f6a4a4ba640 1 Processor -- start 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a4a4ba640 1 -- start start 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a4a4ba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a44102c80 0x7f6a44198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a4a4ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a441035a0 0x7f6a441988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a4a4ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4410c0d0 0x7f6a4419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a4a4ba640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6a44111ef0 con 0x7f6a4410c0d0 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a4a4ba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a44111d70 con 0x7f6a44102c80 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a4a4ba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a44112070 con 0x7f6a441035a0 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a48a57640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4410c0d0 0x7f6a4419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a48a57640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4410c0d0 0x7f6a4419cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45218/0 (socket says 172.21.15.159:45218) 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a48a57640 1 -- 172.21.15.159:0/3352278837 learned_addr learned my addr 172.21.15.159:0/3352278837 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a43fff640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a44102c80 0x7f6a44198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a48a57640 1 -- 172.21.15.159:0/3352278837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a441035a0 msgr2=0x7f6a441988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a441035a0 0x7f6a441988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a48a57640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a441035a0 0x7f6a441988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a48a57640 1 -- 172.21.15.159:0/3352278837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a44102c80 msgr2=0x7f6a44198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a48a57640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a44102c80 0x7f6a44198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a48a57640 1 -- 172.21.15.159:0/3352278837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4419d350 con 0x7f6a4410c0d0 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a48a57640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4410c0d0 0x7f6a4419cc20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00b970 tx=0x7f6a3c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a41ffb640 1 -- 172.21.15.159:0/3352278837 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c019070 con 0x7f6a4410c0d0 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a41ffb640 1 -- 172.21.15.159:0/3352278837 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a3c00cb40 con 0x7f6a4410c0d0 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.192+0000 7f6a41ffb640 1 -- 172.21.15.159:0/3352278837 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c007650 con 0x7f6a4410c0d0 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.193+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/3352278837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4419d640 con 0x7f6a4410c0d0 2024-09-19T06:47:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.193+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/3352278837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a441a4ed0 con 0x7f6a4410c0d0 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a41ffb640 1 -- 172.21.15.159:0/3352278837 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f6a3c01c070 con 0x7f6a4410c0d0 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a4d255740 1 Processor -- start 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a4d255740 1 -- start start 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b587d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b596b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a41ffb640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6a300a3580 0x7f6a300a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b5994b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a4d255740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a03b4ec2f0 con 0x55a03b5879b0 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a4d255740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a03b494270 con 0x55a03b5882d0 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.195+0000 7f6a4d255740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a03b4e82b0 con 0x55a03b5970c0 2024-09-19T06:47:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b587d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b587d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45226/0 (socket says 172.21.15.159:45226) 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 -- 172.21.15.159:0/771386322 learned_addr learned my addr 172.21.15.159:0/771386322 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a43fff640 1 --2- 172.21.15.159:0/771386322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b596b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a41ffb640 1 -- 172.21.15.159:0/3352278837 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f6a3c0cf330 con 0x7f6a4410c0d0 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6a300a3580 0x7f6a300a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a48a57640 1 --2- 172.21.15.159:0/771386322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b5994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 -- 172.21.15.159:0/771386322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 msgr2=0x55a03b5994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/771386322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b5994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 -- 172.21.15.159:0/771386322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 msgr2=0x55a03b596b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/771386322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b596b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 -- 172.21.15.159:0/771386322 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a03b493340 con 0x55a03b5879b0 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/771386322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b587d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0129f0 tx=0x7f6a2c012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d336ea0d27a7b7e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6a300a3580 0x7f6a300a5a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00f730 tx=0x7f6a2c014000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3a7fc640 1 -- 172.21.15.159:0/771386322 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c020070 con 0x55a03b5879b0 2024-09-19T06:47:24.203 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3a7fc640 1 -- 172.21.15.159:0/771386322 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a2c01c3f0 con 0x55a03b5879b0 2024-09-19T06:47:24.203 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.196+0000 7f6a3a7fc640 1 -- 172.21.15.159:0/771386322 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c011640 con 0x55a03b5879b0 2024-09-19T06:47:24.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 -- 172.21.15.159:0/771386322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 msgr2=0x55a03b587d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 --2- 172.21.15.159:0/771386322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b587d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0129f0 tx=0x7f6a2c012eb0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 -- 172.21.15.159:0/771386322 shutdown_connections 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 --2- 172.21.15.159:0/771386322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b5994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 --2- 172.21.15.159:0/771386322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b596b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 --2- 172.21.15.159:0/771386322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b587d90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 -- 172.21.15.159:0/771386322 >> 172.21.15.159:0/771386322 conn(0x55a03b584060 msgr2=0x55a03b584440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 -- 172.21.15.159:0/771386322 shutdown_connections 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 -- 172.21.15.159:0/771386322 wait complete. 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 -- start start 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.197+0000 7f6a4d255740 1 Processor -- start 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5879b0 0x55a03b594090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5882d0 0x55a03b5945d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5970c0 0x55a03b594b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a4d255740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a03b599c30 con 0x55a03b5970c0 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a4d255740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a03b475290 con 0x55a03b5879b0 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a4d255740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a03b599db0 con 0x55a03b5882d0 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a4d255740 10 client.0 _ll_register_callbacks cb 0x55a03b4a6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a48a57640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5970c0 0x55a03b594b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a48a57640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5970c0 0x55a03b594b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45232/0 (socket says 172.21.15.159:45232) 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a48a57640 1 -- 172.21.15.159:0/2324467218 learned_addr learned my addr 172.21.15.159:0/2324467218 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5882d0 0x55a03b5945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a43fff640 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5879b0 0x55a03b594090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a48a57640 1 -- 172.21.15.159:0/2324467218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5882d0 msgr2=0x55a03b5945d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a48a57640 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5882d0 0x55a03b5945d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a48a57640 1 -- 172.21.15.159:0/2324467218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5879b0 msgr2=0x55a03b594090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a48a57640 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5879b0 0x55a03b594090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a48a57640 1 -- 172.21.15.159:0/2324467218 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a03b1ff210 con 0x55a03b5970c0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a43fff640 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5879b0 0x55a03b594090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a48a57640 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5970c0 0x55a03b594b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0ccb80 tx=0x7f6a3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8423b9807a6bbb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a237fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a237fe640 1 -- 172.21.15.159:0/2324467218 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c09f930 con 0x55a03b5970c0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a237fe640 1 -- 172.21.15.159:0/2324467218 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f6a3c0ccc40 con 0x55a03b5970c0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a4d255740 1 -- 172.21.15.159:0/2324467218 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a2c01c3f0 con 0x55a03b5970c0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a237fe640 1 -- 172.21.15.159:0/2324467218 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6a3c0a0860 con 0x55a03b5970c0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.198+0000 7f6a4d255740 10 client.15312 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a4d255740 1 -- 172.21.15.159:0/2324467218 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a03b2cb620 con 0x55a03b5970c0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a237fe640 1 -- 172.21.15.159:0/2324467218 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a2c01c3f0 con 0x55a03b5970c0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a237fe640 1 -- 172.21.15.159:0/2324467218 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6a3c0bbb80 con 0x55a03b5970c0 2024-09-19T06:47:24.210 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a4d255740 10 client.15312 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a4d255740 10 client.15312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a4d255740 20 client.15312 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a03b5a7030 0x55a03b5a9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a4d255740 4 client.15312 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a4d255740 1 -- 172.21.15.159:0/2324467218 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a03b4f9a20 con 0x55a03b5a7030 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a43fff640 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a03b5a7030 0x55a03b5a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a237fe640 10 client.15312 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.199+0000 7f6a43fff640 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a03b5a7030 0x55a03b5a9420 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=401b9d58a9810d70 server_cookie=8149550ae5b944b1 in_seq=0 out_seq=0 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a237fe640 1 -- 172.21.15.159:0/2324467218 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a03b4f9a20 con 0x55a03b5a7030 2024-09-19T06:47:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a237fe640 10 client.15312 handle_command_reply: tid=0 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 client.15312 shutdown 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 -- 172.21.15.159:0/2324467218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5970c0 msgr2=0x55a03b594b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5970c0 0x55a03b594b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0ccb80 tx=0x7f6a3c004a40 comp rx=0 tx=0).stop 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 -- 172.21.15.159:0/2324467218 shutdown_connections 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a03b5a7030 0x55a03b5a9420 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5970c0 0x55a03b594b10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5882d0 0x55a03b5945d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a237fe640 0 client.15312 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2324467218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5879b0 0x55a03b594090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 -- 172.21.15.159:0/2324467218 >> 172.21.15.159:0/2324467218 conn(0x55a03b584060 msgr2=0x55a03b5831c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 -- 172.21.15.159:0/2324467218 shutdown_connections 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.200+0000 7f6a4d255740 1 -- 172.21.15.159:0/2324467218 wait complete. 2024-09-19T06:47:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.201+0000 7f6a4d255740 20 client.15312 trim_cache size 0 max 16384 2024-09-19T06:47:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a4d255740 1 Processor -- start 2024-09-19T06:47:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a4d255740 1 -- start start 2024-09-19T06:47:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b5830b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b5aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b5af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a4d255740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6a441a9570 con 0x55a03b5879b0 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a4d255740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a441abdd0 con 0x55a03b5882d0 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a4d255740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a441a9bc0 con 0x55a03b5970c0 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a43fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b5830b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a43fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b5830b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45234/0 (socket says 172.21.15.159:45234) 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.216+0000 7f6a43fff640 1 -- 172.21.15.159:0/4030878346 learned_addr learned my addr 172.21.15.159:0/4030878346 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a48a57640 1 --2- 172.21.15.159:0/4030878346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b5af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/4030878346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b5aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a43fff640 1 -- 172.21.15.159:0/4030878346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 msgr2=0x55a03b5af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a43fff640 1 --2- 172.21.15.159:0/4030878346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b5af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a43fff640 1 -- 172.21.15.159:0/4030878346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 msgr2=0x55a03b5aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a43fff640 1 --2- 172.21.15.159:0/4030878346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b5aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a43fff640 1 -- 172.21.15.159:0/4030878346 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a03b588f50 con 0x55a03b5879b0 2024-09-19T06:47:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a43fff640 1 --2- 172.21.15.159:0/4030878346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b5830b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a3402a9a0 tx=0x7f6a340058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dba78fac3d132c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a39ffb640 1 -- 172.21.15.159:0/4030878346 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34049070 con 0x55a03b5879b0 2024-09-19T06:47:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a39ffb640 1 -- 172.21.15.159:0/4030878346 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a34005500 con 0x55a03b5879b0 2024-09-19T06:47:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.217+0000 7f6a39ffb640 1 -- 172.21.15.159:0/4030878346 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34035040 con 0x55a03b5879b0 2024-09-19T06:47:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 -- 172.21.15.159:0/4030878346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 msgr2=0x55a03b5830b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 --2- 172.21.15.159:0/4030878346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b5830b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a3402a9a0 tx=0x7f6a340058d0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 -- 172.21.15.159:0/4030878346 shutdown_connections 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 --2- 172.21.15.159:0/4030878346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b5af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 --2- 172.21.15.159:0/4030878346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b5aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 --2- 172.21.15.159:0/4030878346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b5830b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 -- 172.21.15.159:0/4030878346 >> 172.21.15.159:0/4030878346 conn(0x55a03b584060 msgr2=0x55a03b5829a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 -- 172.21.15.159:0/4030878346 shutdown_connections 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 -- 172.21.15.159:0/4030878346 wait complete. 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 -- start start 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.218+0000 7f6a4d255740 1 Processor -- start 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b591030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b591570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a4d255740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b591ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a4d255740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6a441aa290 con 0x55a03b5879b0 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a4d255740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a441ab700 con 0x55a03b5882d0 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a4d255740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a441aa960 con 0x55a03b5970c0 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a4d255740 10 client.0 _ll_register_callbacks cb 0x7f6a3c09b240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a43fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b591030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a43fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b591030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45248/0 (socket says 172.21.15.159:45248) 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a43fff640 1 -- 172.21.15.159:0/2772506110 learned_addr learned my addr 172.21.15.159:0/2772506110 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b591570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a43fff640 1 -- 172.21.15.159:0/2772506110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 msgr2=0x55a03b591ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a48a57640 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b591ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a43fff640 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b591ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a43fff640 1 -- 172.21.15.159:0/2772506110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 msgr2=0x55a03b591570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a43fff640 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b591570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a43fff640 1 -- 172.21.15.159:0/2772506110 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a03b610d10 con 0x55a03b5879b0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a43fff640 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b591030 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009850 tx=0x7f6a34004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02eeb1fefe51fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a237fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a237fe640 1 -- 172.21.15.159:0/2772506110 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34051070 con 0x55a03b5879b0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a237fe640 1 -- 172.21.15.159:0/2772506110 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f6a34004250 con 0x55a03b5879b0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.219+0000 7f6a4d255740 1 -- 172.21.15.159:0/2772506110 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a34005500 con 0x55a03b5879b0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a237fe640 1 -- 172.21.15.159:0/2772506110 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6a34035070 con 0x55a03b5879b0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a4d255740 10 client.15318 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a4d255740 1 -- 172.21.15.159:0/2772506110 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a03b611fc0 con 0x55a03b5879b0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a237fe640 1 -- 172.21.15.159:0/2772506110 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a34005500 con 0x55a03b5879b0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a237fe640 1 -- 172.21.15.159:0/2772506110 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6a3405c070 con 0x55a03b5879b0 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a4d255740 10 client.15318 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a4d255740 10 client.15318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a4d255740 20 client.15318 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a03b6126b0 0x55a03b614ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a4d255740 4 client.15318 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:47:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a4d255740 1 -- 172.21.15.159:0/2772506110 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a03b4f3d70 con 0x55a03b6126b0 2024-09-19T06:47:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.220+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a03b6126b0 0x55a03b614ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.221+0000 7f6a3bfff640 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a03b6126b0 0x55a03b614ad0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca8a542ad5117407 server_cookie=8b01061234695154 in_seq=0 out_seq=0 2024-09-19T06:47:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.221+0000 7f6a237fe640 10 client.15318 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.230+0000 7f6a237fe640 1 -- 172.21.15.159:0/2772506110 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a03b4f3d70 con 0x55a03b6126b0 2024-09-19T06:47:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.230+0000 7f6a237fe640 10 client.15318 handle_command_reply: tid=0 2024-09-19T06:47:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.230+0000 7f6a4d255740 1 client.15318 shutdown 2024-09-19T06:47:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.230+0000 7f6a4d255740 1 -- 172.21.15.159:0/2772506110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 msgr2=0x55a03b591030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.230+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b591030 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009850 tx=0x7f6a34004a50 comp rx=0 tx=0).stop 2024-09-19T06:47:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.230+0000 7f6a4d255740 1 -- 172.21.15.159:0/2772506110 shutdown_connections 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.230+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a03b6126b0 0x55a03b614ad0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a03b5970c0 0x55a03b591ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a237fe640 0 client.15318 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a03b5882d0 0x55a03b591570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4d255740 1 --2- 172.21.15.159:0/2772506110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a03b5879b0 0x55a03b591030 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4d255740 1 -- 172.21.15.159:0/2772506110 >> 172.21.15.159:0/2772506110 conn(0x55a03b584060 msgr2=0x55a03b592500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4d255740 1 -- 172.21.15.159:0/2772506110 shutdown_connections 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4d255740 1 -- 172.21.15.159:0/2772506110 wait complete. 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4d255740 20 client.15318 trim_cache size 0 max 16384 2024-09-19T06:47:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:47:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:47:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:47:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:47:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6a300a3580 msgr2=0x7f6a300a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6a300a3580 0x7f6a300a5a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00f730 tx=0x7f6a2c014000 comp rx=0 tx=0).stop 2024-09-19T06:47:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4410c0d0 msgr2=0x7f6a4419cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4410c0d0 0x7f6a4419cc20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00b970 tx=0x7f6a3c00be30 comp rx=0 tx=0).stop 2024-09-19T06:47:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/3352278837 shutdown_connections 2024-09-19T06:47:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6a300a3580 0x7f6a300a5a40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4410c0d0 0x7f6a4419cc20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a441035a0 0x7f6a441988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 --2- 172.21.15.159:0/3352278837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a44102c80 0x7f6a44198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.231+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/3352278837 >> 172.21.15.159:0/3352278837 conn(0x7f6a44077990 msgr2=0x7f6a440fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.232+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/3352278837 shutdown_connections 2024-09-19T06:47:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:24.232+0000 7f6a4a4ba640 1 -- 172.21.15.159:0/3352278837 wait complete. 2024-09-19T06:47:24.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.456+0000 7fbccaa31640 1 -- 172.21.15.159:0/1044452420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 msgr2=0x7fbcc410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.456+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1044452420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 0x7fbcc410da40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009ca0 tx=0x7fbcbc02a950 comp rx=0 tx=0).stop 2024-09-19T06:47:24.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.456+0000 7fbccaa31640 1 -- 172.21.15.159:0/1044452420 shutdown_connections 2024-09-19T06:47:24.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.456+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1044452420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 0x7fbcc410da40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.456+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1044452420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcc4102570 0x7fbcc41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.456+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1044452420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcc4100e20 0x7fbcc4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.456+0000 7fbccaa31640 1 -- 172.21.15.159:0/1044452420 >> 172.21.15.159:0/1044452420 conn(0x7fbcc40fc7d0 msgr2=0x7fbcc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.456+0000 7fbccaa31640 1 -- 172.21.15.159:0/1044452420 shutdown_connections 2024-09-19T06:47:24.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.456+0000 7fbccaa31640 1 -- 172.21.15.159:0/1044452420 wait complete. 2024-09-19T06:47:24.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.457+0000 7fbccaa31640 1 Processor -- start 2024-09-19T06:47:24.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.457+0000 7fbccaa31640 1 -- start start 2024-09-19T06:47:24.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.457+0000 7fbccaa31640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcc4100e20 0x7fbcc419d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.457+0000 7fbccaa31640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcc4102570 0x7fbcc419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.457+0000 7fbccaa31640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 0x7fbcc4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.457+0000 7fbccaa31640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4110f80 con 0x7fbcc4102ef0 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.457+0000 7fbccaa31640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4110e00 con 0x7fbcc4100e20 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.457+0000 7fbccaa31640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4111100 con 0x7fbcc4102570 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc8fce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 0x7fbcc4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc8fce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 0x7fbcc4198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45270/0 (socket says 172.21.15.159:45270) 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc8fce640 1 -- 172.21.15.159:0/1665220979 learned_addr learned my addr 172.21.15.159:0/1665220979 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc3fff640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcc4100e20 0x7fbcc419d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc37fe640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcc4102570 0x7fbcc419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc8fce640 1 -- 172.21.15.159:0/1665220979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcc4102570 msgr2=0x7fbcc419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc8fce640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcc4102570 0x7fbcc419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc8fce640 1 -- 172.21.15.159:0/1665220979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcc4100e20 msgr2=0x7fbcc419d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc8fce640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcc4100e20 0x7fbcc419d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc8fce640 1 -- 172.21.15.159:0/1665220979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4198ee0 con 0x7fbcc4102ef0 2024-09-19T06:47:24.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc8fce640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 0x7fbcc4198620 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc004af0 tx=0x7fbcbc02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc17fa640 1 -- 172.21.15.159:0/1665220979 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc034040 con 0x7fbcc4102ef0 2024-09-19T06:47:24.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc17fa640 1 -- 172.21.15.159:0/1665220979 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcbc030920 con 0x7fbcc4102ef0 2024-09-19T06:47:24.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc4199170 con 0x7fbcc4102ef0 2024-09-19T06:47:24.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.458+0000 7fbcc17fa640 1 -- 172.21.15.159:0/1665220979 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc004820 con 0x7fbcc4102ef0 2024-09-19T06:47:24.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.459+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc41a5010 con 0x7fbcc4102ef0 2024-09-19T06:47:24.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.459+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc4101200 con 0x7fbcc4102ef0 2024-09-19T06:47:24.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.461+0000 7fbcc17fa640 1 -- 172.21.15.159:0/1665220979 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fbcbc037020 con 0x7fbcc4102ef0 2024-09-19T06:47:24.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.461+0000 7fbcc17fa640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbcac0a3440 0x7fbcac0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.461+0000 7fbcc3fff640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbcac0a3440 0x7fbcac0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.461+0000 7fbcc17fa640 1 -- 172.21.15.159:0/1665220979 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fbcbc0f0c00 con 0x7fbcc4102ef0 2024-09-19T06:47:24.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.462+0000 7fbcc3fff640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbcac0a3440 0x7fbcac0a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4005fd0 tx=0x7fbcb400b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.466+0000 7fbcc17fa640 1 -- 172.21.15.159:0/1665220979 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcbc0f7080 con 0x7fbcc4102ef0 2024-09-19T06:47:24.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.676+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcc41a51e0 con 0x7fbcc4102ef0 2024-09-19T06:47:24.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.676+0000 7fbcc17fa640 1 -- 172.21.15.159:0/1665220979 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7fbcbc0bd550 con 0x7fbcc4102ef0 2024-09-19T06:47:24.678 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:24.678 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:47:24.678 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:47:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.678+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbcac0a3440 msgr2=0x7fbcac0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.678+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbcac0a3440 0x7fbcac0a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4005fd0 tx=0x7fbcb400b390 comp rx=0 tx=0).stop 2024-09-19T06:47:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.678+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 msgr2=0x7fbcc4198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.678+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 0x7fbcc4198620 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc004af0 tx=0x7fbcbc02f5b0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.679+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 shutdown_connections 2024-09-19T06:47:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.679+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbcac0a3440 0x7fbcac0a5900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.679+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcc4102ef0 0x7fbcc4198620 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.679+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbcc4102570 0x7fbcc419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.679+0000 7fbccaa31640 1 --2- 172.21.15.159:0/1665220979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcc4100e20 0x7fbcc419d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.679+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 >> 172.21.15.159:0/1665220979 conn(0x7fbcc40fc7d0 msgr2=0x7fbcc41038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.679+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 shutdown_connections 2024-09-19T06:47:24.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:24.679+0000 7fbccaa31640 1 -- 172.21.15.159:0/1665220979 wait complete. 2024-09-19T06:47:24.963 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:24 smithi159 ceph-mon[30935]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:47:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:24 smithi203 ceph-mon[35473]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:47:25.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:24 smithi189 ceph-mon[34880]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:47:25.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:45:23.401782+0000', 'modified': '2024-09-19T06:45:32.442633+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24487}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6839/1818858628', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 1818858628}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 1818858628}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.203:6839/3762709136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 3762709136}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 3762709136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24487, 'qdb_cluster': [24487]} 2024-09-19T06:47:25.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T06:47:25.479 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:47:25.773 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:25.894 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:25 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1665220979' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:26.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:25 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1665220979' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:26.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:25 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1665220979' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.269+0000 7ff3dd085640 1 -- 172.21.15.159:0/4185728878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 msgr2=0x7ff3d8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.269+0000 7ff3dd085640 1 --2- 172.21.15.159:0/4185728878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 0x7ff3d8106e60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009930 tx=0x7ff3c802a420 comp rx=0 tx=0).stop 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.269+0000 7ff3dd085640 1 -- 172.21.15.159:0/4185728878 shutdown_connections 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.269+0000 7ff3dd085640 1 --2- 172.21.15.159:0/4185728878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d8101420 0x7ff3d810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.269+0000 7ff3dd085640 1 --2- 172.21.15.159:0/4185728878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3d8100a80 0x7ff3d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.269+0000 7ff3dd085640 1 --2- 172.21.15.159:0/4185728878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 0x7ff3d8106e60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.269+0000 7ff3dd085640 1 -- 172.21.15.159:0/4185728878 >> 172.21.15.159:0/4185728878 conn(0x7ff3d80fc7a0 msgr2=0x7ff3d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.269+0000 7ff3dd085640 1 -- 172.21.15.159:0/4185728878 shutdown_connections 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.269+0000 7ff3dd085640 1 -- 172.21.15.159:0/4185728878 wait complete. 2024-09-19T06:47:26.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3dd085640 1 Processor -- start 2024-09-19T06:47:26.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3dd085640 1 -- start start 2024-09-19T06:47:26.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3dd085640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d8100a80 0x7ff3d81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3dd085640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3d8101420 0x7ff3d8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3dd085640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 0x7ff3d819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3dd085640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8110ea0 con 0x7ff3d8106a80 2024-09-19T06:47:26.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3dd085640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8110d20 con 0x7ff3d8100a80 2024-09-19T06:47:26.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3dd085640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8111020 con 0x7ff3d8101420 2024-09-19T06:47:26.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3d759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 0x7ff3d819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3d759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 0x7ff3d819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45282/0 (socket says 172.21.15.159:45282) 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3d759e640 1 -- 172.21.15.159:0/3086798046 learned_addr learned my addr 172.21.15.159:0/3086798046 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.270+0000 7ff3d659c640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3d8101420 0x7ff3d8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d8100a80 0x7ff3d81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3d759e640 1 -- 172.21.15.159:0/3086798046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3d8101420 msgr2=0x7ff3d8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3d759e640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3d8101420 0x7ff3d8198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3d759e640 1 -- 172.21.15.159:0/3086798046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d8100a80 msgr2=0x7ff3d81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3d759e640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d8100a80 0x7ff3d81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3d759e640 1 -- 172.21.15.159:0/3086798046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d819d4a0 con 0x7ff3d8106a80 2024-09-19T06:47:26.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3d759e640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 0x7ff3d819cdc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000cad0 tx=0x7ff3d000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3bffff640 1 -- 172.21.15.159:0/3086798046 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000ad60 con 0x7ff3d8106a80 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3dd085640 1 -- 172.21.15.159:0/3086798046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d819d790 con 0x7ff3d8106a80 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3bffff640 1 -- 172.21.15.159:0/3086798046 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3d0005020 con 0x7ff3d8106a80 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3bffff640 1 -- 172.21.15.159:0/3086798046 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000f6b0 con 0x7ff3d8106a80 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.271+0000 7ff3dd085640 1 -- 172.21.15.159:0/3086798046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d81a5070 con 0x7ff3d8106a80 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.273+0000 7ff3bffff640 1 -- 172.21.15.159:0/3086798046 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7ff3d0005560 con 0x7ff3d8106a80 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3df45e740 1 Processor -- start 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3df45e740 1 -- start start 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3bffff640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff3c00a3440 0x7ff3c00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe598bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe5996670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe5996bb0 0x563fe5998fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d659c640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff3c00a3440 0x7ff3c00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3df45e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563fe58f2090 con 0x563fe5996bb0 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3df45e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fe5899a70 con 0x563fe598c2f0 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3df45e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563fe58ee050 con 0x563fe598b9d0 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe5996bb0 0x563fe5998fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3bffff640 1 -- 172.21.15.159:0/3086798046 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff3d00cff60 con 0x7ff3d8106a80 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe5996bb0 0x563fe5998fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45294/0 (socket says 172.21.15.159:45294) 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d759e640 1 -- 172.21.15.159:0/101912794 learned_addr learned my addr 172.21.15.159:0/101912794 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/101912794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe598bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d659c640 1 --2- 172.21.15.159:0/101912794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe5996670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d759e640 1 -- 172.21.15.159:0/101912794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 msgr2=0x563fe598bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:26.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d759e640 1 --2- 172.21.15.159:0/101912794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe598bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d759e640 1 -- 172.21.15.159:0/101912794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 msgr2=0x563fe5996670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d759e640 1 --2- 172.21.15.159:0/101912794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe5996670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.274+0000 7ff3d759e640 1 -- 172.21.15.159:0/101912794 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe58a6130 con 0x563fe5996bb0 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.275+0000 7ff3d659c640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff3c00a3440 0x7ff3c00a5900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3d806b7e0 tx=0x7ff3cc009520 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.275+0000 7ff3d759e640 1 --2- 172.21.15.159:0/101912794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe5996bb0 0x563fe5998fa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0098500 tx=0x7ff3d0098470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf145b9b46e703c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.275+0000 7ff3bd7fa640 1 -- 172.21.15.159:0/101912794 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d001d040 con 0x563fe5996bb0 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.275+0000 7ff3bd7fa640 1 -- 172.21.15.159:0/101912794 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3d009c7a0 con 0x563fe5996bb0 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.275+0000 7ff3bd7fa640 1 -- 172.21.15.159:0/101912794 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d009a3a0 con 0x563fe5996bb0 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.275+0000 7ff3df45e740 1 -- 172.21.15.159:0/101912794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe5996bb0 msgr2=0x563fe5998fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.275+0000 7ff3df45e740 1 --2- 172.21.15.159:0/101912794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe5996bb0 0x563fe5998fa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0098500 tx=0x7ff3d0098470 comp rx=0 tx=0).stop 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 -- 172.21.15.159:0/101912794 shutdown_connections 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 --2- 172.21.15.159:0/101912794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe5996bb0 0x563fe5998fa0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 --2- 172.21.15.159:0/101912794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe5996670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 --2- 172.21.15.159:0/101912794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe598bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 -- 172.21.15.159:0/101912794 >> 172.21.15.159:0/101912794 conn(0x563fe5987f60 msgr2=0x563fe5988340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 -- 172.21.15.159:0/101912794 shutdown_connections 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 -- 172.21.15.159:0/101912794 wait complete. 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 -- start start 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 Processor -- start 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe5996450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe59937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 0x563fe5993ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563fe5999720 con 0x563fe598b9d0 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fe58acf20 con 0x563fe598c2f0 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563fe59998a0 con 0x563fe5996bb0 2024-09-19T06:47:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3df45e740 10 client.0 _ll_register_callbacks cb 0x563fe5876030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe5996450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe5996450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45300/0 (socket says 172.21.15.159:45300) 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/2078101757 learned_addr learned my addr 172.21.15.159:0/2078101757 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.276+0000 7ff3d759e640 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 0x563fe5993ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3d659c640 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe59937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/2078101757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 msgr2=0x563fe5993ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 0x563fe5993ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/2078101757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 msgr2=0x563fe59937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe59937a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/2078101757 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe56632b0 con 0x563fe598b9d0 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3d659c640 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe59937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe5996450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8031550 tx=0x7ff3c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adaad03a9c1798b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3baff5640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3baff5640 1 -- 172.21.15.159:0/2078101757 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8035070 con 0x563fe598b9d0 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3baff5640 1 -- 172.21.15.159:0/2078101757 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff3c80037f0 con 0x563fe598b9d0 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3df45e740 1 -- 172.21.15.159:0/2078101757 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3d009c7a0 con 0x563fe598b9d0 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3baff5640 1 -- 172.21.15.159:0/2078101757 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff3c8005d50 con 0x563fe598b9d0 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3df45e740 10 client.15336 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3df45e740 1 -- 172.21.15.159:0/2078101757 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563fe59a5040 con 0x563fe598b9d0 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.277+0000 7ff3baff5640 1 -- 172.21.15.159:0/2078101757 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3d009c7a0 con 0x563fe598b9d0 2024-09-19T06:47:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3baff5640 1 -- 172.21.15.159:0/2078101757 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff3c804c430 con 0x563fe598b9d0 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3df45e740 10 client.15336 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3df45e740 10 client.15336 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3df45e740 20 client.15336 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563fe59a7720 0x563fe59a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3df45e740 4 client.15336 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3df45e740 1 -- 172.21.15.159:0/2078101757 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fe58ff600 con 0x563fe59a7720 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3d659c640 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563fe59a7720 0x563fe59a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3baff5640 10 client.15336 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.278+0000 7ff3d659c640 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563fe59a7720 0x563fe59a8b90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=801dbdec40caf92d server_cookie=565b55f33363d211 in_seq=0 out_seq=0 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3baff5640 1 -- 172.21.15.159:0/2078101757 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563fe58ff600 con 0x563fe59a7720 2024-09-19T06:47:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3baff5640 10 client.15336 handle_command_reply: tid=0 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 client.15336 shutdown 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 -- 172.21.15.159:0/2078101757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 msgr2=0x563fe5996450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe5996450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8031550 tx=0x7ff3c80042f0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 -- 172.21.15.159:0/2078101757 shutdown_connections 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563fe59a7720 0x563fe59a8b90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3baff5640 0 client.15336 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 0x563fe5993ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe59937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2078101757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe5996450 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 -- 172.21.15.159:0/2078101757 >> 172.21.15.159:0/2078101757 conn(0x563fe5987f60 msgr2=0x563fe598dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 -- 172.21.15.159:0/2078101757 shutdown_connections 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 1 -- 172.21.15.159:0/2078101757 wait complete. 2024-09-19T06:47:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.279+0000 7ff3df45e740 20 client.15336 trim_cache size 0 max 16384 2024-09-19T06:47:26.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3df45e740 1 Processor -- start 2024-09-19T06:47:26.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3df45e740 1 -- start start 2024-09-19T06:47:26.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe59a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe5988340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 0x563fe598ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3df45e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563fe59a6ed0 con 0x563fe598b9d0 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3df45e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fe59a75a0 con 0x563fe598c2f0 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3df45e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563fe59a7c70 con 0x563fe5996bb0 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe59a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe59a8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45314/0 (socket says 172.21.15.159:45314) 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/2974766682 learned_addr learned my addr 172.21.15.159:0/2974766682 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.297+0000 7ff3d659c640 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe5988340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3d759e640 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 0x563fe598ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/2974766682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 msgr2=0x563fe598ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 0x563fe598ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/2974766682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 msgr2=0x563fe5988340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe5988340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/2974766682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe5987d90 con 0x563fe598b9d0 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3d659c640 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe5988340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe59a8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff3c804c820 tx=0x7ff3c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b444b19ec2c27b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3bcff9640 1 -- 172.21.15.159:0/2974766682 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8059070 con 0x563fe598b9d0 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3bcff9640 1 -- 172.21.15.159:0/2974766682 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c804ca90 con 0x563fe598b9d0 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.298+0000 7ff3bcff9640 1 -- 172.21.15.159:0/2974766682 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8035030 con 0x563fe598b9d0 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 -- 172.21.15.159:0/2974766682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 msgr2=0x563fe59a8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe59a8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff3c804c820 tx=0x7ff3c8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 -- 172.21.15.159:0/2974766682 shutdown_connections 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe5996bb0 0x563fe598ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe598c2f0 0x563fe5988340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 --2- 172.21.15.159:0/2974766682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598b9d0 0x563fe59a8b90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 -- 172.21.15.159:0/2974766682 >> 172.21.15.159:0/2974766682 conn(0x563fe5987f60 msgr2=0x563fe598e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 -- 172.21.15.159:0/2974766682 shutdown_connections 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 -- 172.21.15.159:0/2974766682 wait complete. 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 -- start start 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 Processor -- start 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe59b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598c2f0 0x563fe59aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe5996bb0 0x563fe59aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563fe59a8a10 con 0x563fe598c2f0 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fe59a8340 con 0x563fe5996bb0 2024-09-19T06:47:26.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563fe59a90e0 con 0x563fe598b9d0 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3df45e740 10 client.0 _ll_register_callbacks cb 0x7ff3c8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.299+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe59b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598c2f0 0x563fe59aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe59b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:47470/0 (socket says 172.21.15.159:47470) 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/349647650 learned_addr learned my addr 172.21.15.159:0/349647650 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d759e640 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe5996bb0 0x563fe59aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/349647650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe5996bb0 msgr2=0x563fe59aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe5996bb0 0x563fe59aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/349647650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598c2f0 msgr2=0x563fe59aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598c2f0 0x563fe59aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d6d9d640 1 -- 172.21.15.159:0/349647650 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe59890f0 con 0x563fe598b9d0 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d659c640 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598c2f0 0x563fe59aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:26.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3d6d9d640 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe59b15f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8057040 tx=0x7ff3c80042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a3a43872567a14a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3baff5640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3baff5640 1 -- 172.21.15.159:0/349647650 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8035050 con 0x563fe598b9d0 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3df45e740 1 -- 172.21.15.159:0/349647650 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c804ca90 con 0x563fe598b9d0 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3baff5640 1 -- 172.21.15.159:0/349647650 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff3c80035f0 con 0x563fe598b9d0 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3baff5640 1 -- 172.21.15.159:0/349647650 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff3c8059040 con 0x563fe598b9d0 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3df45e740 10 client.24955 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.300+0000 7ff3df45e740 1 -- 172.21.15.159:0/349647650 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563fe5a11e30 con 0x563fe598b9d0 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.301+0000 7ff3baff5640 1 -- 172.21.15.159:0/349647650 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c804ca90 con 0x563fe598b9d0 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.301+0000 7ff3baff5640 1 -- 172.21.15.159:0/349647650 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff3c805c070 con 0x563fe598b9d0 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.301+0000 7ff3df45e740 10 client.24955 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.301+0000 7ff3df45e740 10 client.24955 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.301+0000 7ff3df45e740 20 client.24955 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.301+0000 7ff3df45e740 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563fe59a7720 0x563fe5a15120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:26.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.301+0000 7ff3df45e740 4 client.24955 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.301+0000 7ff3df45e740 1 -- 172.21.15.159:0/349647650 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "status"}) -- 0x563fe58f9b10 con 0x563fe59a7720 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.301+0000 7ff3d659c640 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563fe59a7720 0x563fe5a15120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3baff5640 10 client.24955 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3d659c640 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563fe59a7720 0x563fe5a15120 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ca4b4052fbc5021 server_cookie=3cd3b5996b20cc90 in_seq=0 out_seq=0 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3baff5640 1 -- 172.21.15.159:0/349647650 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563fe58f9b10 con 0x563fe59a7720 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3baff5640 10 client.24955 handle_command_reply: tid=0 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 client.24955 shutdown 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 -- 172.21.15.159:0/349647650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 msgr2=0x563fe59b15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe59b15f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8057040 tx=0x7ff3c80042f0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 -- 172.21.15.159:0/349647650 shutdown_connections 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563fe59a7720 0x563fe5a15120 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fe5996bb0 0x563fe59aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563fe598c2f0 0x563fe59aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 --2- 172.21.15.159:0/349647650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563fe598b9d0 0x563fe59b15f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3baff5640 0 client.24955 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:26.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 -- 172.21.15.159:0/349647650 >> 172.21.15.159:0/349647650 conn(0x563fe5987f60 msgr2=0x563fe598edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:26.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 -- 172.21.15.159:0/349647650 shutdown_connections 2024-09-19T06:47:26.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 1 -- 172.21.15.159:0/349647650 wait complete. 2024-09-19T06:47:26.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.302+0000 7ff3df45e740 20 client.24955 trim_cache size 0 max 16384 2024-09-19T06:47:26.312 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:47:26.312 INFO:teuthology.orchestra.run.smithi159.stdout: "cluster_fsid": "82c73dba-7651-11ef-bceb-c7b262605968", 2024-09-19T06:47:26.312 INFO:teuthology.orchestra.run.smithi159.stdout: "whoami": 0, 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 24487, 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout: "want_state": "up:active", 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout: "state": "up:active", 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs", 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout: "rank_uptime": 122.530248648, 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout: "mdsmap_epoch": 20, 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch": 82, 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout: "uptime": 141.88540620000001 2024-09-19T06:47:26.313 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 -- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff3c00a3440 msgr2=0x7ff3c00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff3c00a3440 0x7ff3c00a5900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3d806b7e0 tx=0x7ff3cc009520 comp rx=0 tx=0).stop 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 -- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 msgr2=0x7ff3d819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 0x7ff3d819cdc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000cad0 tx=0x7ff3d000ced0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 -- 172.21.15.159:0/3086798046 shutdown_connections 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff3c00a3440 0x7ff3c00a5900 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d8106a80 0x7ff3d819cdc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3d8101420 0x7ff3d8198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 --2- 172.21.15.159:0/3086798046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d8100a80 0x7ff3d81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:26.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 -- 172.21.15.159:0/3086798046 >> 172.21.15.159:0/3086798046 conn(0x7ff3d80fc7a0 msgr2=0x7ff3d81048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:26.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 -- 172.21.15.159:0/3086798046 shutdown_connections 2024-09-19T06:47:26.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:26.303+0000 7ff3dd085640 1 -- 172.21.15.159:0/3086798046 wait complete. 2024-09-19T06:47:26.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:26 smithi159 ceph-mon[30935]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T06:47:27.031 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T06:47:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:26 smithi203 ceph-mon[35473]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T06:47:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:26 smithi189 ceph-mon[34880]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T06:47:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:28 smithi203 ceph-mon[35473]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-19T06:47:29.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:28 smithi189 ceph-mon[34880]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-19T06:47:29.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:28 smithi159 ceph-mon[30935]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-19T06:47:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:30 smithi203 ceph-mon[35473]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-19T06:47:31.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:30 smithi189 ceph-mon[34880]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-19T06:47:31.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:30 smithi159 ceph-mon[30935]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-19T06:47:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:32 smithi203 ceph-mon[35473]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-19T06:47:33.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:32 smithi189 ceph-mon[34880]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-19T06:47:33.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:32 smithi159 ceph-mon[30935]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-19T06:47:35.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:34 smithi203 ceph-mon[35473]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-19T06:47:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:34 smithi189 ceph-mon[34880]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-19T06:47:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:34 smithi159 ceph-mon[30935]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-19T06:47:37.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:36 smithi203 ceph-mon[35473]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-19T06:47:37.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:36 smithi189 ceph-mon[34880]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-19T06:47:37.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:36 smithi159 ceph-mon[30935]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-19T06:47:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.332+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2626418970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd8102cc0 msgr2=0x7f1dd81030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.332+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2626418970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd8102cc0 0x7f1dd81030a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009900 tx=0x7f1dc802a480 comp rx=0 tx=0).stop 2024-09-19T06:47:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.332+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2626418970 shutdown_connections 2024-09-19T06:47:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.332+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2626418970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd810c0e0 0x7f1dd810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.332+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2626418970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd81035e0 0x7f1dd810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.332+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2626418970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd8102cc0 0x7f1dd81030a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.332+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2626418970 >> 172.21.15.159:0/2626418970 conn(0x7f1dd8077990 msgr2=0x7f1dd80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.332+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2626418970 shutdown_connections 2024-09-19T06:47:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.332+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2626418970 wait complete. 2024-09-19T06:47:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1ddc99a640 1 Processor -- start 2024-09-19T06:47:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1ddc99a640 1 -- start start 2024-09-19T06:47:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1ddc99a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd8102cc0 0x7f1dd8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1ddc99a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd81035e0 0x7f1dd81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1ddc99a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd810c0e0 0x7f1dd819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1ddc99a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8111f00 con 0x7f1dd81035e0 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1ddc99a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8111d80 con 0x7f1dd810c0e0 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1ddc99a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8112080 con 0x7f1dd8102cc0 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd81035e0 0x7f1dd81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd81035e0 0x7f1dd81988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52472/0 (socket says 172.21.15.159:52472) 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.333+0000 7f1dcffff640 1 -- 172.21.15.159:0/2023587575 learned_addr learned my addr 172.21.15.159:0/2023587575 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dd659c640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd8102cc0 0x7f1dd8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dd6d9d640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd810c0e0 0x7f1dd819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dcffff640 1 -- 172.21.15.159:0/2023587575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd8102cc0 msgr2=0x7f1dd8198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dcffff640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd8102cc0 0x7f1dd8198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dcffff640 1 -- 172.21.15.159:0/2023587575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd810c0e0 msgr2=0x7f1dd819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dcffff640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd810c0e0 0x7f1dd819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dcffff640 1 -- 172.21.15.159:0/2023587575 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd819d360 con 0x7f1dd81035e0 2024-09-19T06:47:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dcffff640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd81035e0 0x7f1dd81988b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000e9f0 tx=0x7f1dc000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dcf7fe640 1 -- 172.21.15.159:0/2023587575 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000cd80 con 0x7f1dd81035e0 2024-09-19T06:47:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dcf7fe640 1 -- 172.21.15.159:0/2023587575 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc0010910 con 0x7f1dd81035e0 2024-09-19T06:47:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1dcf7fe640 1 -- 172.21.15.159:0/2023587575 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0018990 con 0x7f1dd81035e0 2024-09-19T06:47:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2023587575 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd819d650 con 0x7f1dd81035e0 2024-09-19T06:47:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.334+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2023587575 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd81a4ee0 con 0x7f1dd81035e0 2024-09-19T06:47:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.336+0000 7f1dcf7fe640 1 -- 172.21.15.159:0/2023587575 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f1dc0010ac0 con 0x7f1dd81035e0 2024-09-19T06:47:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.337+0000 7f1ddf80e740 1 Processor -- start 2024-09-19T06:47:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.337+0000 7f1ddf80e740 1 -- start start 2024-09-19T06:47:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.337+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf410eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.337+0000 7f1dcf7fe640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1dc40a3500 0x7f1dc40a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.337+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4119770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.337+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf411c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.337+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557cf40732f0 con 0x557cf4119cb0 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.337+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557cf401b270 con 0x557cf410f410 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.337+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557cf406f2b0 con 0x557cf410eaf0 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf411c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd659c640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1dc40a3500 0x7f1dc40a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf411c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52474/0 (socket says 172.21.15.159:52474) 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4119770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 -- 172.21.15.159:0/4244808969 learned_addr learned my addr 172.21.15.159:0/4244808969 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 --2- 172.21.15.159:0/4244808969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf410eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dcf7fe640 1 -- 172.21.15.159:0/2023587575 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f1dc00d0140 con 0x7f1dd81035e0 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 -- 172.21.15.159:0/4244808969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 msgr2=0x557cf410eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 --2- 172.21.15.159:0/4244808969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf410eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 -- 172.21.15.159:0/4244808969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 msgr2=0x557cf4119770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 --2- 172.21.15.159:0/4244808969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4119770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 -- 172.21.15.159:0/4244808969 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cf401a340 con 0x557cf4119cb0 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dcffff640 1 --2- 172.21.15.159:0/4244808969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4119770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd6d9d640 1 --2- 172.21.15.159:0/4244808969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf411c0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0005f40 tx=0x7f1dd0005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146dcf4218cd05af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dd659c640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1dc40a3500 0x7f1dc40a59c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8000c00 tx=0x7f1dc8005b50 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dccff9640 1 -- 172.21.15.159:0/4244808969 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0011130 con 0x557cf4119cb0 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dccff9640 1 -- 172.21.15.159:0/4244808969 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd00112d0 con 0x557cf4119cb0 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.338+0000 7f1dccff9640 1 -- 172.21.15.159:0/4244808969 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000fc20 con 0x557cf4119cb0 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.339+0000 7f1ddf80e740 1 -- 172.21.15.159:0/4244808969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 msgr2=0x557cf411c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.339+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/4244808969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf411c0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0005f40 tx=0x7f1dd0005bd0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.339+0000 7f1ddf80e740 1 -- 172.21.15.159:0/4244808969 shutdown_connections 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.339+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/4244808969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf411c0a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.339+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/4244808969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4119770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.339+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/4244808969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf410eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.339+0000 7f1ddf80e740 1 -- 172.21.15.159:0/4244808969 >> 172.21.15.159:0/4244808969 conn(0x557cf410b060 msgr2=0x557cf410b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.339+0000 7f1ddf80e740 1 -- 172.21.15.159:0/4244808969 shutdown_connections 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.339+0000 7f1ddf80e740 1 -- 172.21.15.159:0/4244808969 wait complete. 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1ddf80e740 1 -- start start 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1ddf80e740 1 Processor -- start 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410eaf0 0x557cf4116b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf41170d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf4119cb0 0x557cf4117610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557cf411c880 con 0x557cf410f410 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557cf3ffc290 con 0x557cf410eaf0 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557cf411ca00 con 0x557cf4119cb0 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1ddf80e740 10 client.0 _ll_register_callbacks cb 0x557cf402d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf41170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf41170d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52480/0 (socket says 172.21.15.159:52480) 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dcffff640 1 -- 172.21.15.159:0/834028015 learned_addr learned my addr 172.21.15.159:0/834028015 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dd659c640 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410eaf0 0x557cf4116b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dcffff640 1 -- 172.21.15.159:0/834028015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf4119cb0 msgr2=0x557cf4117610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dcffff640 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf4119cb0 0x557cf4117610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dcffff640 1 -- 172.21.15.159:0/834028015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410eaf0 msgr2=0x557cf4116b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dcffff640 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410eaf0 0x557cf4116b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dcffff640 1 -- 172.21.15.159:0/834028015 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cf3d86210 con 0x557cf410f410 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dd659c640 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410eaf0 0x557cf4116b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dcffff640 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf41170d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1dc009c0d0 tx=0x7f1dc001da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b088b140fa5c9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.340+0000 7f1dbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1dbdffb640 1 -- 172.21.15.159:0/834028015 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00a48f0 con 0x557cf410f410 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1dbdffb640 1 -- 172.21.15.159:0/834028015 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f1dc00a2ec0 con 0x557cf410f410 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1ddf80e740 1 -- 172.21.15.159:0/834028015 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd00112d0 con 0x557cf410f410 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1dbdffb640 1 -- 172.21.15.159:0/834028015 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1dc00a3c90 con 0x557cf410f410 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1ddf80e740 10 client.15354 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1ddf80e740 1 -- 172.21.15.159:0/834028015 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557cf3e52620 con 0x557cf410f410 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1dbdffb640 1 -- 172.21.15.159:0/834028015 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd00112d0 con 0x557cf410f410 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1dbdffb640 1 -- 172.21.15.159:0/834028015 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1dc00a4300 con 0x557cf410f410 2024-09-19T06:47:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1ddf80e740 10 client.15354 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1ddf80e740 10 client.15354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1ddf80e740 20 client.15354 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557cf4129c70 0x557cf412c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1ddf80e740 4 client.15354 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.341+0000 7f1ddf80e740 1 -- 172.21.15.159:0/834028015 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cf4080a20 con 0x557cf4129c70 2024-09-19T06:47:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.342+0000 7f1dd659c640 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557cf4129c70 0x557cf412c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.342+0000 7f1dbdffb640 10 client.15354 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.342+0000 7f1dd659c640 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557cf4129c70 0x557cf412c100 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e08666912d59915b server_cookie=e74e42a7e8befbf6 in_seq=0 out_seq=0 2024-09-19T06:47:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1dbdffb640 1 -- 172.21.15.159:0/834028015 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557cf4080a20 con 0x557cf4129c70 2024-09-19T06:47:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1dbdffb640 10 client.15354 handle_command_reply: tid=0 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 client.15354 shutdown 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 -- 172.21.15.159:0/834028015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 msgr2=0x557cf41170d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf41170d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1dc009c0d0 tx=0x7f1dc001da00 comp rx=0 tx=0).stop 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 -- 172.21.15.159:0/834028015 shutdown_connections 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557cf4129c70 0x557cf412c100 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf4119cb0 0x557cf4117610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf41170d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1dbdffb640 0 client.15354 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/834028015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410eaf0 0x557cf4116b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 -- 172.21.15.159:0/834028015 >> 172.21.15.159:0/834028015 conn(0x557cf410b060 msgr2=0x557cf4110d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 -- 172.21.15.159:0/834028015 shutdown_connections 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 1 -- 172.21.15.159:0/834028015 wait complete. 2024-09-19T06:47:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.343+0000 7f1ddf80e740 20 client.15354 trim_cache size 0 max 16384 2024-09-19T06:47:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.357+0000 7f1ddf80e740 1 Processor -- start 2024-09-19T06:47:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.357+0000 7f1ddf80e740 1 -- start start 2024-09-19T06:47:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.357+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf4117440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.357+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4131a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.357+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf4131f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.357+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81ab820 con 0x557cf4119cb0 2024-09-19T06:47:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.357+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81ae0a0 con 0x557cf410f410 2024-09-19T06:47:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.357+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81abe90 con 0x557cf410eaf0 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf4131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf4131f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52496/0 (socket says 172.21.15.159:52496) 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd6d9d640 1 -- 172.21.15.159:0/3087449671 learned_addr learned my addr 172.21.15.159:0/3087449671 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd659c640 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf4117440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dcffff640 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4131a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd6d9d640 1 -- 172.21.15.159:0/3087449671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 msgr2=0x557cf4117440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd6d9d640 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf4117440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd6d9d640 1 -- 172.21.15.159:0/3087449671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 msgr2=0x557cf4131a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd6d9d640 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4131a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd6d9d640 1 -- 172.21.15.159:0/3087449671 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cf410ae90 con 0x557cf4119cb0 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd659c640 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf4117440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dcffff640 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4131a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dd6d9d640 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf4131f50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00116a0 tx=0x7f1dd0011530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c97cfc79335d735 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dbffff640 1 -- 172.21.15.159:0/3087449671 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0011330 con 0x557cf4119cb0 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dbffff640 1 -- 172.21.15.159:0/3087449671 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd000f850 con 0x557cf4119cb0 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.358+0000 7f1dbffff640 1 -- 172.21.15.159:0/3087449671 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0005450 con 0x557cf4119cb0 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 -- 172.21.15.159:0/3087449671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 msgr2=0x557cf4131f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf4131f50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00116a0 tx=0x7f1dd0011530 comp rx=0 tx=0).stop 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 -- 172.21.15.159:0/3087449671 shutdown_connections 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf4119cb0 0x557cf4131f50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf410f410 0x557cf4131a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/3087449671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf4117440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 -- 172.21.15.159:0/3087449671 >> 172.21.15.159:0/3087449671 conn(0x557cf410b060 msgr2=0x557cf4118c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 -- 172.21.15.159:0/3087449671 shutdown_connections 2024-09-19T06:47:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 -- 172.21.15.159:0/3087449671 wait complete. 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 -- start start 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.359+0000 7f1ddf80e740 1 Processor -- start 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf411d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf411de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf4119cb0 0x557cf411e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81ac560 con 0x557cf410f410 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81ad9d0 con 0x557cf4119cb0 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81acc30 con 0x557cf410eaf0 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 10 client.0 _ll_register_callbacks cb 0x7f1dc000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf411de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf411de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52512/0 (socket says 172.21.15.159:52512) 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dcffff640 1 -- 172.21.15.159:0/2898330851 learned_addr learned my addr 172.21.15.159:0/2898330851 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dd659c640 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf411d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dd6d9d640 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf4119cb0 0x557cf411e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dcffff640 1 -- 172.21.15.159:0/2898330851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 msgr2=0x557cf411d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dcffff640 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf411d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dcffff640 1 -- 172.21.15.159:0/2898330851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf4119cb0 msgr2=0x557cf411e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dcffff640 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf4119cb0 0x557cf411e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dcffff640 1 -- 172.21.15.159:0/2898330851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cf41939e0 con 0x557cf410f410 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dd659c640 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf411d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dcffff640 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf411de80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00a3c10 tx=0x7f1dc009be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981cfdcece44b269 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dbdffb640 1 -- 172.21.15.159:0/2898330851 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00a4700 con 0x557cf410f410 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dbdffb640 1 -- 172.21.15.159:0/2898330851 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f1dc00a2ec0 con 0x557cf410f410 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 1 -- 172.21.15.159:0/2898330851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd000f850 con 0x557cf410f410 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dbdffb640 1 -- 172.21.15.159:0/2898330851 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1dc00cdcf0 con 0x557cf410f410 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 10 client.15360 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1ddf80e740 1 -- 172.21.15.159:0/2898330851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557cf4194b80 con 0x557cf410f410 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.360+0000 7f1dbdffb640 1 -- 172.21.15.159:0/2898330851 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd000f850 con 0x557cf410f410 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1dbdffb640 1 -- 172.21.15.159:0/2898330851 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1dc00b50f0 con 0x557cf410f410 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1ddf80e740 10 client.15360 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1ddf80e740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1ddf80e740 20 client.15360 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557cf4195350 0x557cf4197770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1ddf80e740 4 client.15360 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:47:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1ddf80e740 1 -- 172.21.15.159:0/2898330851 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557cf407ad70 con 0x557cf4195350 2024-09-19T06:47:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1dd659c640 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557cf4195350 0x557cf4197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1dbdffb640 10 client.15360 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.361+0000 7f1dd659c640 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557cf4195350 0x557cf4197770 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e168fda1e2379b6 server_cookie=cef0334b3bb1996f in_seq=0 out_seq=0 2024-09-19T06:47:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1dbdffb640 1 -- 172.21.15.159:0/2898330851 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557cf407ad70 con 0x557cf4195350 2024-09-19T06:47:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1dbdffb640 10 client.15360 handle_command_reply: tid=0 2024-09-19T06:47:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 client.15360 shutdown 2024-09-19T06:47:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 -- 172.21.15.159:0/2898330851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 msgr2=0x557cf411de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf411de80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00a3c10 tx=0x7f1dc009be60 comp rx=0 tx=0).stop 2024-09-19T06:47:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 -- 172.21.15.159:0/2898330851 shutdown_connections 2024-09-19T06:47:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557cf4195350 0x557cf4197770 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cf4119cb0 0x557cf411e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557cf410f410 0x557cf411de80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1dbdffb640 0 client.15360 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 --2- 172.21.15.159:0/2898330851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557cf410eaf0 0x557cf411d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 -- 172.21.15.159:0/2898330851 >> 172.21.15.159:0/2898330851 conn(0x557cf410b060 msgr2=0x557cf41099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 -- 172.21.15.159:0/2898330851 shutdown_connections 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.365+0000 7f1ddf80e740 1 -- 172.21.15.159:0/2898330851 wait complete. 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddf80e740 20 client.15360 trim_cache size 0 max 16384 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:47:37.371 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:47:37.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1dc40a3500 msgr2=0x7f1dc40a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:37.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1dc40a3500 0x7f1dc40a59c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8000c00 tx=0x7f1dc8005b50 comp rx=0 tx=0).stop 2024-09-19T06:47:37.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd81035e0 msgr2=0x7f1dd81988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:37.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd81035e0 0x7f1dd81988b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000e9f0 tx=0x7f1dc000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2023587575 shutdown_connections 2024-09-19T06:47:37.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1dc40a3500 0x7f1dc40a59c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd810c0e0 0x7f1dd819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd81035e0 0x7f1dd81988b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 --2- 172.21.15.159:0/2023587575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd8102cc0 0x7f1dd8198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:37.373 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2023587575 >> 172.21.15.159:0/2023587575 conn(0x7f1dd8077990 msgr2=0x7f1dd80fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:37.373 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2023587575 shutdown_connections 2024-09-19T06:47:37.373 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:37.366+0000 7f1ddc99a640 1 -- 172.21.15.159:0/2023587575 wait complete. 2024-09-19T06:47:39.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:38 smithi203 ceph-mon[35473]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T06:47:39.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:38 smithi189 ceph-mon[34880]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T06:47:39.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:38 smithi159 ceph-mon[30935]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-19T06:47:41.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:40 smithi203 ceph-mon[35473]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:47:41.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:40 smithi189 ceph-mon[34880]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:47:41.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:40 smithi159 ceph-mon[30935]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:47:42.032 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T06:47:42.033 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:42.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:47:42.296 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:42.734 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:42 smithi159 ceph-mon[30935]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 -- 172.21.15.159:0/2368663687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c106f10 msgr2=0x7ff49c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/2368663687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c106f10 0x7ff49c10ea90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff494009ca0 tx=0x7ff49402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 -- 172.21.15.159:0/2368663687 shutdown_connections 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/2368663687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c106f10 0x7ff49c10ea90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/2368663687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff49c102790 0x7ff49c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/2368663687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff49c101de0 0x7ff49c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 -- 172.21.15.159:0/2368663687 >> 172.21.15.159:0/2368663687 conn(0x7ff49c0fd8c0 msgr2=0x7ff49c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 -- 172.21.15.159:0/2368663687 shutdown_connections 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 -- 172.21.15.159:0/2368663687 wait complete. 2024-09-19T06:47:42.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 Processor -- start 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.822+0000 7ff4a1e57640 1 -- start start 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff4a1e57640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff49c101de0 0x7ff49c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff4a1e57640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c102790 0x7ff49c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff4a1e57640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff49c106f10 0x7ff49c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff4a1e57640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c111f90 con 0x7ff49c102790 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff4a1e57640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c111e10 con 0x7ff49c106f10 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff4a1e57640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c112110 con 0x7ff49c101de0 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c102790 0x7ff49c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c102790 0x7ff49c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60812/0 (socket says 172.21.15.159:60812) 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49affd640 1 -- 172.21.15.159:0/1833260423 learned_addr learned my addr 172.21.15.159:0/1833260423 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49bfff640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff49c106f10 0x7ff49c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49b7fe640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff49c101de0 0x7ff49c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49affd640 1 -- 172.21.15.159:0/1833260423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff49c101de0 msgr2=0x7ff49c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49affd640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff49c101de0 0x7ff49c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49affd640 1 -- 172.21.15.159:0/1833260423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff49c106f10 msgr2=0x7ff49c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49affd640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff49c106f10 0x7ff49c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49affd640 1 -- 172.21.15.159:0/1833260423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c1a68f0 con 0x7ff49c102790 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.823+0000 7ff49affd640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c102790 0x7ff49c074a30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff49000d950 tx=0x7ff49000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.824+0000 7ff498ff9640 1 -- 172.21.15.159:0/1833260423 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490017030 con 0x7ff49c102790 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.824+0000 7ff498ff9640 1 -- 172.21.15.159:0/1833260423 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff490004020 con 0x7ff49c102790 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.824+0000 7ff498ff9640 1 -- 172.21.15.159:0/1833260423 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4900047a0 con 0x7ff49c102790 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.824+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49c1a6be0 con 0x7ff49c102790 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.824+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49c1a70d0 con 0x7ff49c102790 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.825+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff49c1021c0 con 0x7ff49c102790 2024-09-19T06:47:42.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.826+0000 7ff498ff9640 1 -- 172.21.15.159:0/1833260423 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7ff4900041d0 con 0x7ff49c102790 2024-09-19T06:47:42.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.827+0000 7ff498ff9640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff4840a3440 0x7ff4840a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.827+0000 7ff49b7fe640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff4840a3440 0x7ff4840a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.827+0000 7ff498ff9640 1 -- 172.21.15.159:0/1833260423 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff4900cf8b0 con 0x7ff49c102790 2024-09-19T06:47:42.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.827+0000 7ff49b7fe640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff4840a3440 0x7ff4840a5900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009890 tx=0x7ff48c008040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:42.831+0000 7ff498ff9640 1 -- 172.21.15.159:0/1833260423 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff49009c0f0 con 0x7ff49c102790 2024-09-19T06:47:42.887 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:42.940 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:42 smithi189 ceph-mon[34880]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:47:43.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.075+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff49c02d7c0 con 0x7ff49c102790 2024-09-19T06:47:43.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.076+0000 7ff498ff9640 1 -- 172.21.15.159:0/1833260423 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7ff49009b9f0 con 0x7ff49c102790 2024-09-19T06:47:43.077 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:43.077 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:47:43.078 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:47:43.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff4840a3440 msgr2=0x7ff4840a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff4840a3440 0x7ff4840a5900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009890 tx=0x7ff48c008040 comp rx=0 tx=0).stop 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c102790 msgr2=0x7ff49c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c102790 0x7ff49c074a30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff49000d950 tx=0x7ff49000de10 comp rx=0 tx=0).stop 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 shutdown_connections 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff4840a3440 0x7ff4840a5900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff49c106f10 0x7ff49c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff49c102790 0x7ff49c074a30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 --2- 172.21.15.159:0/1833260423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff49c101de0 0x7ff49c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 >> 172.21.15.159:0/1833260423 conn(0x7ff49c0fd8c0 msgr2=0x7ff49c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 shutdown_connections 2024-09-19T06:47:43.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.078+0000 7ff4a1e57640 1 -- 172.21.15.159:0/1833260423 wait complete. 2024-09-19T06:47:43.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:42 smithi203 ceph-mon[35473]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:47:43.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.638+0000 7f461049d640 1 -- 172.21.15.159:0/1077175757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4608102d30 msgr2=0x7f4608103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.638+0000 7f461049d640 1 --2- 172.21.15.159:0/1077175757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4608102d30 0x7f4608103110 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4604009930 tx=0x7f460402a420 comp rx=0 tx=0).stop 2024-09-19T06:47:43.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.638+0000 7f461049d640 1 -- 172.21.15.159:0/1077175757 shutdown_connections 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.638+0000 7f461049d640 1 --2- 172.21.15.159:0/1077175757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46081082a0 0x7f460810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.638+0000 7f461049d640 1 --2- 172.21.15.159:0/1077175757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46081036e0 0x7f4608107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.638+0000 7f461049d640 1 --2- 172.21.15.159:0/1077175757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4608102d30 0x7f4608103110 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.639+0000 7f461049d640 1 -- 172.21.15.159:0/1077175757 >> 172.21.15.159:0/1077175757 conn(0x7f46080fc7d0 msgr2=0x7f46080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.639+0000 7f461049d640 1 -- 172.21.15.159:0/1077175757 shutdown_connections 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.639+0000 7f461049d640 1 -- 172.21.15.159:0/1077175757 wait complete. 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.639+0000 7f461049d640 1 Processor -- start 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.639+0000 7f461049d640 1 -- start start 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f461049d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4608102d30 0x7f46081985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f461049d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46081036e0 0x7f4608198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f461049d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46081082a0 0x7f460819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f461049d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f46081120a0 con 0x7f46081082a0 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f461049d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4608111f20 con 0x7f4608102d30 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f461049d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4608112220 con 0x7f46081036e0 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460ea3a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46081082a0 0x7f460819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460ea3a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46081082a0 0x7f460819ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60838/0 (socket says 172.21.15.159:60838) 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460ea3a640 1 -- 172.21.15.159:0/2422825245 learned_addr learned my addr 172.21.15.159:0/2422825245 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460da38640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46081036e0 0x7f4608198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460e239640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4608102d30 0x7f46081985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460ea3a640 1 -- 172.21.15.159:0/2422825245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46081036e0 msgr2=0x7f4608198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460ea3a640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46081036e0 0x7f4608198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460ea3a640 1 -- 172.21.15.159:0/2422825245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4608102d30 msgr2=0x7f46081985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460ea3a640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4608102d30 0x7f46081985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460ea3a640 1 -- 172.21.15.159:0/2422825245 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460819d570 con 0x7f46081082a0 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.640+0000 7f460ea3a640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46081082a0 0x7f460819ce90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4600009fd0 tx=0x7f460000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.641+0000 7f45ff7fe640 1 -- 172.21.15.159:0/2422825245 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600017070 con 0x7f46081082a0 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.641+0000 7f45ff7fe640 1 -- 172.21.15.159:0/2422825245 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4600003e50 con 0x7f46081082a0 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.641+0000 7f461049d640 1 -- 172.21.15.159:0/2422825245 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460819d860 con 0x7f46081082a0 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.641+0000 7f45ff7fe640 1 -- 172.21.15.159:0/2422825245 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46000106c0 con 0x7f46081082a0 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.641+0000 7f461049d640 1 -- 172.21.15.159:0/2422825245 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46081008c0 con 0x7f46081082a0 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.644+0000 7f45ff7fe640 1 -- 172.21.15.159:0/2422825245 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f4600003970 con 0x7f46081082a0 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.644+0000 7f4612876740 1 Processor -- start 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.644+0000 7f4612876740 1 -- start start 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f4612876740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 0x56175ec64880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f4612876740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec64dc0 0x56175ec6f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f4612876740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 0x56175ec71a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f4612876740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56175ebca2e0 con 0x56175ec64dc0 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f4612876740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56175eb71ce0 con 0x56175ec644a0 2024-09-19T06:47:43.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f4612876740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56175ebc62a0 con 0x56175ec6f680 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f460e239640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec64dc0 0x56175ec6f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f460e239640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec64dc0 0x56175ec6f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60852/0 (socket says 172.21.15.159:60852) 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f460e239640 1 -- 172.21.15.159:0/1405918996 learned_addr learned my addr 172.21.15.159:0/1405918996 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f460da38640 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 0x56175ec64880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f460da38640 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 0x56175ec71a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f460e239640 1 -- 172.21.15.159:0/1405918996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 msgr2=0x56175ec71a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f460e239640 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 0x56175ec71a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f460e239640 1 -- 172.21.15.159:0/1405918996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 msgr2=0x56175ec64880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f460e239640 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 0x56175ec64880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.645+0000 7f45ff7fe640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f45f40a34c0 0x7f45f40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.646+0000 7f460e239640 1 -- 172.21.15.159:0/1405918996 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175eb56440 con 0x56175ec64dc0 2024-09-19T06:47:43.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.646+0000 7f460da38640 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 0x56175ec71a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.646+0000 7f460da38640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f45f40a34c0 0x7f45f40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.646+0000 7f460e239640 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec64dc0 0x56175ec6f140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f460402a940 tx=0x7f4604005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ef72d5acfc2e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.646+0000 7f45ff7fe640 1 -- 172.21.15.159:0/2422825245 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f46000cfae0 con 0x7f46081082a0 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.646+0000 7f45fcff9640 1 -- 172.21.15.159:0/1405918996 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604040070 con 0x56175ec64dc0 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.646+0000 7f45fcff9640 1 -- 172.21.15.159:0/1405918996 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46040319f0 con 0x56175ec64dc0 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.646+0000 7f45fcff9640 1 -- 172.21.15.159:0/1405918996 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604035040 con 0x56175ec64dc0 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.646+0000 7f460da38640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f45f40a34c0 0x7f45f40a5980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x56175ec61db0 tx=0x7f45f8014040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.647+0000 7f4612876740 1 -- 172.21.15.159:0/1405918996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec64dc0 msgr2=0x56175ec6f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.647+0000 7f4612876740 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec64dc0 0x56175ec6f140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f460402a940 tx=0x7f4604005c00 comp rx=0 tx=0).stop 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.647+0000 7f4612876740 1 -- 172.21.15.159:0/1405918996 shutdown_connections 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.647+0000 7f4612876740 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 0x56175ec71a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.647+0000 7f4612876740 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec64dc0 0x56175ec6f140 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.647+0000 7f4612876740 1 --2- 172.21.15.159:0/1405918996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 0x56175ec64880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.647+0000 7f4612876740 1 -- 172.21.15.159:0/1405918996 >> 172.21.15.159:0/1405918996 conn(0x56175ec60a30 msgr2=0x56175ec60e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.648+0000 7f4612876740 1 -- 172.21.15.159:0/1405918996 shutdown_connections 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.648+0000 7f4612876740 1 -- 172.21.15.159:0/1405918996 wait complete. 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.648+0000 7f4612876740 1 -- start start 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.648+0000 7f4612876740 1 Processor -- start 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.648+0000 7f4612876740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 0x56175ec6eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f4612876740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ec6c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f4612876740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec6f680 0x56175ec6c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f4612876740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56175ec72250 con 0x56175ec6f680 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f4612876740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56175eb85050 con 0x56175ec644a0 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f4612876740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56175ec723d0 con 0x56175ec64dc0 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f4612876740 10 client.0 _ll_register_callbacks cb 0x56175ebc5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:43.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460da38640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ec6c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460da38640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ec6c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:51318/0 (socket says 172.21.15.159:51318) 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460da38640 1 -- 172.21.15.159:0/851787385 learned_addr learned my addr 172.21.15.159:0/851787385 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460ea3a640 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec6f680 0x56175ec6c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460da38640 1 -- 172.21.15.159:0/851787385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 msgr2=0x56175ec6eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460e239640 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 0x56175ec6eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460da38640 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 0x56175ec6eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460da38640 1 -- 172.21.15.159:0/851787385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec6f680 msgr2=0x56175ec6c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460da38640 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec6f680 0x56175ec6c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460da38640 1 -- 172.21.15.159:0/851787385 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56175e93b3c0 con 0x56175ec64dc0 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.649+0000 7f460ea3a640 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec6f680 0x56175ec6c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f460e239640 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 0x56175ec6eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f460da38640 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ec6c150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f45f8005d00 tx=0x7f45f8005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c7e868a3b6d8b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f45f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:47:43.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f45f1ffb640 1 -- 172.21.15.159:0/851787385 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f802c060 con 0x56175ec64dc0 2024-09-19T06:47:43.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f4612876740 1 -- 172.21.15.159:0/851787385 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46040319f0 con 0x56175ec64dc0 2024-09-19T06:47:43.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f45f1ffb640 1 -- 172.21.15.159:0/851787385 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f45f8019070 con 0x56175ec64dc0 2024-09-19T06:47:43.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f45f1ffb640 1 -- 172.21.15.159:0/851787385 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f45f801d480 con 0x56175ec64dc0 2024-09-19T06:47:43.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f4612876740 10 client.24979 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:43.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f4612876740 1 -- 172.21.15.159:0/851787385 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56175ec7dad0 con 0x56175ec64dc0 2024-09-19T06:47:43.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.650+0000 7f45f1ffb640 1 -- 172.21.15.159:0/851787385 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f801db00 con 0x56175ec64dc0 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.651+0000 7f45f1ffb640 1 -- 172.21.15.159:0/851787385 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f45f8027a80 con 0x56175ec64dc0 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.651+0000 7f4612876740 10 client.24979 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.651+0000 7f4612876740 10 client.24979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.651+0000 7f4612876740 20 client.24979 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.651+0000 7f4612876740 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56175ec7ef90 0x56175ec813e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.651+0000 7f4612876740 4 client.24979 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.651+0000 7f4612876740 1 -- 172.21.15.159:0/851787385 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f46040319f0 con 0x56175ec7ef90 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.651+0000 7f460e239640 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56175ec7ef90 0x56175ec813e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.652+0000 7f460e239640 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56175ec7ef90 0x56175ec813e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89df1e0d86e1f15e server_cookie=416dea3728a1229c in_seq=0 out_seq=0 2024-09-19T06:47:43.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.652+0000 7f45f1ffb640 10 client.24979 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.652+0000 7f45f1ffb640 1 -- 172.21.15.159:0/851787385 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f46040319f0 con 0x56175ec7ef90 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.652+0000 7f45f1ffb640 10 client.24979 handle_command_reply: tid=0 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.652+0000 7f4612876740 1 client.24979 shutdown 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 -- 172.21.15.159:0/851787385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 msgr2=0x56175ec6c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ec6c150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f45f8005d00 tx=0x7f45f8005c90 comp rx=0 tx=0).stop 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 -- 172.21.15.159:0/851787385 shutdown_connections 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56175ec7ef90 0x56175ec813e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec6f680 0x56175ec6c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ec6c150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 --2- 172.21.15.159:0/851787385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec644a0 0x56175ec6eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 -- 172.21.15.159:0/851787385 >> 172.21.15.159:0/851787385 conn(0x56175ec60a30 msgr2=0x56175ec66760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f45f1ffb640 0 client.24979 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:43.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 -- 172.21.15.159:0/851787385 shutdown_connections 2024-09-19T06:47:43.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 1 -- 172.21.15.159:0/851787385 wait complete. 2024-09-19T06:47:43.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.653+0000 7f4612876740 20 client.24979 trim_cache size 0 max 16384 2024-09-19T06:47:43.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f4612876740 1 Processor -- start 2024-09-19T06:47:43.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f4612876740 1 -- start start 2024-09-19T06:47:43.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f4612876740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ec6e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f4612876740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec64dc0 0x56175ec86cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f4612876740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 0x56175ec871f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f4612876740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f46081a9790 con 0x56175ec644a0 2024-09-19T06:47:43.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f4612876740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46081ac010 con 0x56175ec64dc0 2024-09-19T06:47:43.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f4612876740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46081a9e00 con 0x56175ec6f680 2024-09-19T06:47:43.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f460e239640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ec6e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f460e239640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ec6e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60870/0 (socket says 172.21.15.159:60870) 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f460e239640 1 -- 172.21.15.159:0/2943521647 learned_addr learned my addr 172.21.15.159:0/2943521647 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f460da38640 1 --2- 172.21.15.159:0/2943521647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec64dc0 0x56175ec86cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.673+0000 7f460ea3a640 1 --2- 172.21.15.159:0/2943521647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 0x56175ec871f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.674+0000 7f460e239640 1 -- 172.21.15.159:0/2943521647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 msgr2=0x56175ec871f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.674+0000 7f460e239640 1 --2- 172.21.15.159:0/2943521647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 0x56175ec871f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.674+0000 7f460e239640 1 -- 172.21.15.159:0/2943521647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec64dc0 msgr2=0x56175ec86cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.674+0000 7f460e239640 1 --2- 172.21.15.159:0/2943521647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec64dc0 0x56175ec86cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.674+0000 7f460e239640 1 -- 172.21.15.159:0/2943521647 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175ec60860 con 0x56175ec644a0 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.674+0000 7f460e239640 1 --2- 172.21.15.159:0/2943521647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ec6e0c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4604005560 tx=0x7f4604000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648027f5a17fdccc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.674+0000 7f45f3fff640 1 -- 172.21.15.159:0/2943521647 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604040070 con 0x56175ec644a0 2024-09-19T06:47:43.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.674+0000 7f45f3fff640 1 -- 172.21.15.159:0/2943521647 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46040035f0 con 0x56175ec644a0 2024-09-19T06:47:43.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.674+0000 7f45f3fff640 1 -- 172.21.15.159:0/2943521647 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604035050 con 0x56175ec644a0 2024-09-19T06:47:43.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.675+0000 7f4612876740 1 -- 172.21.15.159:0/2943521647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 msgr2=0x56175ec6e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.675+0000 7f4612876740 1 --2- 172.21.15.159:0/2943521647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ec6e0c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4604005560 tx=0x7f4604000bc0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.675+0000 7f4612876740 1 -- 172.21.15.159:0/2943521647 shutdown_connections 2024-09-19T06:47:43.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.675+0000 7f4612876740 1 --2- 172.21.15.159:0/2943521647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec6f680 0x56175ec871f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.675+0000 7f4612876740 1 --2- 172.21.15.159:0/2943521647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec64dc0 0x56175ec86cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.675+0000 7f4612876740 1 --2- 172.21.15.159:0/2943521647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ec6e0c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.675+0000 7f4612876740 1 -- 172.21.15.159:0/2943521647 >> 172.21.15.159:0/2943521647 conn(0x56175ec60a30 msgr2=0x56175ec6d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.675+0000 7f4612876740 1 -- 172.21.15.159:0/2943521647 shutdown_connections 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.675+0000 7f4612876740 1 -- 172.21.15.159:0/2943521647 wait complete. 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f4612876740 1 -- start start 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f4612876740 1 Processor -- start 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f4612876740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ece1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f4612876740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ece2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f4612876740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec6f680 0x56175ec772b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f4612876740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f46081aa4d0 con 0x56175ec644a0 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f4612876740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46081ab940 con 0x56175ec6f680 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f4612876740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46081aaba0 con 0x56175ec64dc0 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f4612876740 10 client.0 _ll_register_callbacks cb 0x7f45f800bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:43.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f460e239640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ece1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f460e239640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ece1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60886/0 (socket says 172.21.15.159:60886) 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f460e239640 1 -- 172.21.15.159:0/4109073894 learned_addr learned my addr 172.21.15.159:0/4109073894 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f460da38640 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ece2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.676+0000 7f460ea3a640 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec6f680 0x56175ec772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f460e239640 1 -- 172.21.15.159:0/4109073894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 msgr2=0x56175ece2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f460e239640 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ece2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f460e239640 1 -- 172.21.15.159:0/4109073894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec6f680 msgr2=0x56175ec772b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f460e239640 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec6f680 0x56175ec772b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f460e239640 1 -- 172.21.15.159:0/4109073894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56175ec779a0 con 0x56175ec644a0 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f460e239640 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ece1e20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f460402a940 tx=0x7f4604005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf9d4434dd7ff7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f45f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:43.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f45f1ffb640 1 -- 172.21.15.159:0/4109073894 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460405b060 con 0x56175ec644a0 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f4612876740 1 -- 172.21.15.159:0/4109073894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46040035f0 con 0x56175ec644a0 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f45f1ffb640 1 -- 172.21.15.159:0/4109073894 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f4604004310 con 0x56175ec644a0 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f45f1ffb640 1 -- 172.21.15.159:0/4109073894 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4604035020 con 0x56175ec644a0 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f4612876740 10 client.15384 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.677+0000 7f4612876740 1 -- 172.21.15.159:0/4109073894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56175ece96e0 con 0x56175ec644a0 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.678+0000 7f45f1ffb640 1 -- 172.21.15.159:0/4109073894 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4604003c80 con 0x56175ec644a0 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.678+0000 7f45f1ffb640 1 -- 172.21.15.159:0/4109073894 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f460404ea70 con 0x56175ec644a0 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.678+0000 7f4612876740 10 client.15384 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.678+0000 7f4612876740 10 client.15384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.678+0000 7f4612876740 20 client.15384 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.678+0000 7f4612876740 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56175ece9900 0x56175ecebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.678+0000 7f4612876740 4 client.15384 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:47:43.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.678+0000 7f4612876740 1 -- 172.21.15.159:0/4109073894 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f46040035f0 con 0x56175ece9900 2024-09-19T06:47:43.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.678+0000 7f460da38640 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56175ece9900 0x56175ecebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f45f1ffb640 10 client.15384 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:43.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f460da38640 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56175ece9900 0x56175ecebcf0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6e93b5bd8ce5778 server_cookie=8fb92976cbc0405e in_seq=0 out_seq=0 2024-09-19T06:47:43.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f45f1ffb640 1 -- 172.21.15.159:0/4109073894 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f46040035f0 con 0x56175ece9900 2024-09-19T06:47:43.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f45f1ffb640 10 client.15384 handle_command_reply: tid=0 2024-09-19T06:47:43.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 client.15384 shutdown 2024-09-19T06:47:43.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 -- 172.21.15.159:0/4109073894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 msgr2=0x56175ece1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ece1e20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f460402a940 tx=0x7f4604005590 comp rx=0 tx=0).stop 2024-09-19T06:47:43.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 -- 172.21.15.159:0/4109073894 shutdown_connections 2024-09-19T06:47:43.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56175ece9900 0x56175ecebcf0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56175ec6f680 0x56175ec772b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56175ec64dc0 0x56175ece2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f45f1ffb640 0 client.15384 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 --2- 172.21.15.159:0/4109073894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56175ec644a0 0x56175ece1e20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 -- 172.21.15.159:0/4109073894 >> 172.21.15.159:0/4109073894 conn(0x56175ec60a30 msgr2=0x56175ec6a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 -- 172.21.15.159:0/4109073894 shutdown_connections 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 1 -- 172.21.15.159:0/4109073894 wait complete. 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.679+0000 7f4612876740 20 client.15384 trim_cache size 0 max 16384 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:47:43.685 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:47:43.686 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:47:43.686 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:47:43.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 -- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f45f40a34c0 msgr2=0x7f45f40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f45f40a34c0 0x7f45f40a5980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x56175ec61db0 tx=0x7f45f8014040 comp rx=0 tx=0).stop 2024-09-19T06:47:43.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 -- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46081082a0 msgr2=0x7f460819ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46081082a0 0x7f460819ce90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4600009fd0 tx=0x7f460000b260 comp rx=0 tx=0).stop 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 -- 172.21.15.159:0/2422825245 shutdown_connections 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f45f40a34c0 0x7f45f40a5980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46081082a0 0x7f460819ce90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46081036e0 0x7f4608198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 --2- 172.21.15.159:0/2422825245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4608102d30 0x7f46081985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 -- 172.21.15.159:0/2422825245 >> 172.21.15.159:0/2422825245 conn(0x7f46080fc7d0 msgr2=0x7f4608105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 -- 172.21.15.159:0/2422825245 shutdown_connections 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:43.680+0000 7f461049d640 1 -- 172.21.15.159:0/2422825245 wait complete. 2024-09-19T06:47:43.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:43 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1833260423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:44.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:43 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1833260423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:44.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:43 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1833260423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:44.161 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T06:47:44.161 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T06:47:44.835 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:44 smithi159 ceph-mon[30935]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:47:44.866 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:47:44.866 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:44.907 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:45.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:44 smithi203 ceph-mon[35473]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:47:45.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:44 smithi189 ceph-mon[34880]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:47:45.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.416+0000 7f39559e5640 1 -- 172.21.15.159:0/3039364418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102570 msgr2=0x7f39501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.416+0000 7f39559e5640 1 --2- 172.21.15.159:0/3039364418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102570 0x7f39501029b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3944009900 tx=0x7f394402a480 comp rx=0 tx=0).stop 2024-09-19T06:47:45.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.416+0000 7f39559e5640 1 -- 172.21.15.159:0/3039364418 shutdown_connections 2024-09-19T06:47:45.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.416+0000 7f39559e5640 1 --2- 172.21.15.159:0/3039364418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950102ef0 0x7f395010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.416+0000 7f39559e5640 1 --2- 172.21.15.159:0/3039364418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102570 0x7f39501029b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.416+0000 7f39559e5640 1 --2- 172.21.15.159:0/3039364418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3950100e20 0x7f3950101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.416+0000 7f39559e5640 1 -- 172.21.15.159:0/3039364418 >> 172.21.15.159:0/3039364418 conn(0x7f39500fc7d0 msgr2=0x7f39500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.416+0000 7f39559e5640 1 -- 172.21.15.159:0/3039364418 shutdown_connections 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.417+0000 7f39559e5640 1 -- 172.21.15.159:0/3039364418 wait complete. 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.417+0000 7f39559e5640 1 Processor -- start 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f39559e5640 1 -- start start 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f39559e5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950100e20 0x7f3950197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f39559e5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3950102570 0x7f3950197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f39559e5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102ef0 0x7f395019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f39559e5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3950110f80 con 0x7f3950102ef0 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f39559e5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3950110e00 con 0x7f3950100e20 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f39559e5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3950111100 con 0x7f3950102570 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102ef0 0x7f395019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102ef0 0x7f395019bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60900/0 (socket says 172.21.15.159:60900) 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394f7fe640 1 -- 172.21.15.159:0/4288374132 learned_addr learned my addr 172.21.15.159:0/4288374132 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:45.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394effd640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950100e20 0x7f3950197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394e7fc640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3950102570 0x7f3950197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394f7fe640 1 -- 172.21.15.159:0/4288374132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3950102570 msgr2=0x7f3950197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394f7fe640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3950102570 0x7f3950197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394f7fe640 1 -- 172.21.15.159:0/4288374132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950100e20 msgr2=0x7f3950197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394f7fe640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950100e20 0x7f3950197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.418+0000 7f394f7fe640 1 -- 172.21.15.159:0/4288374132 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395019c3d0 con 0x7f3950102ef0 2024-09-19T06:47:45.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.419+0000 7f394f7fe640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102ef0 0x7f395019bcf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f394800cce0 tx=0x7f394800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.419+0000 7f39549e3640 1 -- 172.21.15.159:0/4288374132 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394800f450 con 0x7f3950102ef0 2024-09-19T06:47:45.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.419+0000 7f39549e3640 1 -- 172.21.15.159:0/4288374132 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f394800fad0 con 0x7f3950102ef0 2024-09-19T06:47:45.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.419+0000 7f39559e5640 1 -- 172.21.15.159:0/4288374132 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395019c6c0 con 0x7f3950102ef0 2024-09-19T06:47:45.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.419+0000 7f39549e3640 1 -- 172.21.15.159:0/4288374132 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948018c10 con 0x7f3950102ef0 2024-09-19T06:47:45.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.419+0000 7f39559e5640 1 -- 172.21.15.159:0/4288374132 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501a3fa0 con 0x7f3950102ef0 2024-09-19T06:47:45.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.421+0000 7f39549e3640 1 -- 172.21.15.159:0/4288374132 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f394800f5f0 con 0x7f3950102ef0 2024-09-19T06:47:45.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.422+0000 7f3957dbe740 1 Processor -- start 2024-09-19T06:47:45.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.422+0000 7f3957dbe740 1 -- start start 2024-09-19T06:47:45.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a77e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 0x55ba4a77f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a78fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f39549e3640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39380a3440 0x7f39380a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f3957dbe740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ba4a6e42a0 con 0x55ba4a78da00 2024-09-19T06:47:45.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f3957dbe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ba4a68bb10 con 0x55ba4a77fe00 2024-09-19T06:47:45.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f3957dbe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ba4a6e0260 con 0x55ba4a77ebd0 2024-09-19T06:47:45.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394e7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a77e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394e7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a77e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:58718/0 (socket says 172.21.15.159:58718) 2024-09-19T06:47:45.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394e7fc640 1 -- 172.21.15.159:0/4069799300 learned_addr learned my addr 172.21.15.159:0/4069799300 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:45.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f39549e3640 1 -- 172.21.15.159:0/4288374132 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f39480d0650 con 0x7f3950102ef0 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394effd640 1 --2- 172.21.15.159:0/4069799300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 0x55ba4a77f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394f7fe640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39380a3440 0x7f39380a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394e7fc640 1 --2- 172.21.15.159:0/4069799300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a78fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394e7fc640 1 -- 172.21.15.159:0/4069799300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 msgr2=0x55ba4a77f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394e7fc640 1 --2- 172.21.15.159:0/4069799300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 0x55ba4a77f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394e7fc640 1 -- 172.21.15.159:0/4069799300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 msgr2=0x55ba4a78fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394e7fc640 1 --2- 172.21.15.159:0/4069799300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a78fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.423+0000 7f394e7fc640 1 -- 172.21.15.159:0/4069799300 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba4a455b90 con 0x55ba4a77fe00 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.424+0000 7f394e7fc640 1 --2- 172.21.15.159:0/4069799300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a77e600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39440096c0 tx=0x7f39440056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b99dac3956b9490 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.424+0000 7f394f7fe640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39380a3440 0x7f39380a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39480cdcb0 tx=0x7f394800af30 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.424+0000 7f3935ffb640 1 -- 172.21.15.159:0/4069799300 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944035040 con 0x55ba4a77fe00 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.425+0000 7f3935ffb640 1 -- 172.21.15.159:0/4069799300 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3944003ad0 con 0x55ba4a77fe00 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.425+0000 7f3935ffb640 1 -- 172.21.15.159:0/4069799300 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394403d950 con 0x55ba4a77fe00 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 -- 172.21.15.159:0/4069799300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 msgr2=0x55ba4a77e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4069799300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a77e600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39440096c0 tx=0x7f39440056d0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 -- 172.21.15.159:0/4069799300 shutdown_connections 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4069799300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a78fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4069799300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 0x55ba4a77f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4069799300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a77e600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 -- 172.21.15.159:0/4069799300 >> 172.21.15.159:0/4069799300 conn(0x55ba4a77acf0 msgr2=0x55ba4a77b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 -- 172.21.15.159:0/4069799300 shutdown_connections 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 -- 172.21.15.159:0/4069799300 wait complete. 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.426+0000 7f3957dbe740 1 -- start start 2024-09-19T06:47:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f3957dbe740 1 Processor -- start 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a78a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a78af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 0x55ba4a78b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f3957dbe740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ba4a790890 con 0x55ba4a77fe00 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f3957dbe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ba4a66c6e0 con 0x55ba4a77ebd0 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f3957dbe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ba4a790a10 con 0x55ba4a78da00 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f3957dbe740 10 client.0 _ll_register_callbacks cb 0x55ba4a690a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f394effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a78af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f394effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a78af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60926/0 (socket says 172.21.15.159:60926) 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f394e7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a78a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f394effd640 1 -- 172.21.15.159:0/597766735 learned_addr learned my addr 172.21.15.159:0/597766735 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:45.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.427+0000 7f394e7fc640 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 0x55ba4a78b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f394effd640 1 -- 172.21.15.159:0/597766735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 msgr2=0x55ba4a78b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f394effd640 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 0x55ba4a78b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f394effd640 1 -- 172.21.15.159:0/597766735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 msgr2=0x55ba4a78a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f394effd640 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a78a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f394effd640 1 -- 172.21.15.159:0/597766735 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba4a799ea0 con 0x55ba4a77fe00 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f394e7fc640 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a78a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f394effd640 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a78af00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f394000bf00 tx=0x7f3940012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19650bef8c515d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f392effd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f392effd640 1 -- 172.21.15.159:0/597766735 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39400108a0 con 0x55ba4a77fe00 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f3957dbe740 1 -- 172.21.15.159:0/597766735 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3944003ad0 con 0x55ba4a77fe00 2024-09-19T06:47:45.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f392effd640 1 -- 172.21.15.159:0/597766735 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f3940010a40 con 0x55ba4a77fe00 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f392effd640 1 -- 172.21.15.159:0/597766735 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3940010c40 con 0x55ba4a77fe00 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f3957dbe740 10 client.15396 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.428+0000 7f3957dbe740 1 -- 172.21.15.159:0/597766735 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ba4a79c8c0 con 0x55ba4a77fe00 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.429+0000 7f392effd640 1 -- 172.21.15.159:0/597766735 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3944003ad0 con 0x55ba4a77fe00 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.429+0000 7f392effd640 1 -- 172.21.15.159:0/597766735 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3940019070 con 0x55ba4a77fe00 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.429+0000 7f3957dbe740 10 client.15396 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.429+0000 7f3957dbe740 10 client.15396 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.429+0000 7f3957dbe740 20 client.15396 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.429+0000 7f3957dbe740 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ba4a79dcd0 0x55ba4a7a0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.429+0000 7f3957dbe740 4 client.15396 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.429+0000 7f3957dbe740 1 -- 172.21.15.159:0/597766735 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba4a6f19d0 con 0x55ba4a79dcd0 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.429+0000 7f394e7fc640 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ba4a79dcd0 0x55ba4a7a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.430+0000 7f392effd640 10 client.15396 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.430+0000 7f394e7fc640 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ba4a79dcd0 0x55ba4a7a0130 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d289365e927f7b43 server_cookie=fefd12b935c02dd0 in_seq=0 out_seq=0 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f392effd640 1 -- 172.21.15.159:0/597766735 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba4a6f19d0 con 0x55ba4a79dcd0 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f392effd640 10 client.15396 handle_command_reply: tid=0 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 client.15396 shutdown 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 -- 172.21.15.159:0/597766735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 msgr2=0x55ba4a78af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a78af00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f394000bf00 tx=0x7f3940012820 comp rx=0 tx=0).stop 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 -- 172.21.15.159:0/597766735 shutdown_connections 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ba4a79dcd0 0x55ba4a7a0130 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 0x55ba4a78b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a78af00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 --2- 172.21.15.159:0/597766735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a78a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 -- 172.21.15.159:0/597766735 >> 172.21.15.159:0/597766735 conn(0x55ba4a77acf0 msgr2=0x55ba4a780a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f392effd640 0 client.15396 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:45.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 -- 172.21.15.159:0/597766735 shutdown_connections 2024-09-19T06:47:45.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 1 -- 172.21.15.159:0/597766735 wait complete. 2024-09-19T06:47:45.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.431+0000 7f3957dbe740 20 client.15396 trim_cache size 0 max 16384 2024-09-19T06:47:45.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.454+0000 7f3957dbe740 1 Processor -- start 2024-09-19T06:47:45.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.454+0000 7f3957dbe740 1 -- start start 2024-09-19T06:47:45.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 0x55ba4a789290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a78c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a7a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f3957dbe740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f39501a9580 con 0x55ba4a78da00 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f3957dbe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39501abe00 con 0x55ba4a77fe00 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f3957dbe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39501a9bf0 con 0x55ba4a77ebd0 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a7a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a7a5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60938/0 (socket says 172.21.15.159:60938) 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394e7fc640 1 -- 172.21.15.159:0/1329553169 learned_addr learned my addr 172.21.15.159:0/1329553169 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394effd640 1 --2- 172.21.15.159:0/1329553169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a78c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394e7fc640 1 --2- 172.21.15.159:0/1329553169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 0x55ba4a789290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394e7fc640 1 -- 172.21.15.159:0/1329553169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 msgr2=0x55ba4a789290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394e7fc640 1 --2- 172.21.15.159:0/1329553169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 0x55ba4a789290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394e7fc640 1 -- 172.21.15.159:0/1329553169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 msgr2=0x55ba4a78c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394e7fc640 1 --2- 172.21.15.159:0/1329553169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a78c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.455+0000 7f394e7fc640 1 -- 172.21.15.159:0/1329553169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba4a7901f0 con 0x55ba4a78da00 2024-09-19T06:47:45.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.456+0000 7f394e7fc640 1 --2- 172.21.15.159:0/1329553169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a7a5a00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3944005ab0 tx=0x7f3944005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75c2f4b0cdbc58a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.456+0000 7f39357fa640 1 -- 172.21.15.159:0/1329553169 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394405b070 con 0x55ba4a78da00 2024-09-19T06:47:45.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.456+0000 7f39357fa640 1 -- 172.21.15.159:0/1329553169 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f394405c040 con 0x55ba4a78da00 2024-09-19T06:47:45.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.456+0000 7f39357fa640 1 -- 172.21.15.159:0/1329553169 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944035040 con 0x55ba4a78da00 2024-09-19T06:47:45.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.456+0000 7f3957dbe740 1 -- 172.21.15.159:0/1329553169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 msgr2=0x55ba4a7a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.456+0000 7f3957dbe740 1 --2- 172.21.15.159:0/1329553169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a7a5a00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3944005ab0 tx=0x7f3944005bd0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.457+0000 7f3957dbe740 1 -- 172.21.15.159:0/1329553169 shutdown_connections 2024-09-19T06:47:45.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.457+0000 7f3957dbe740 1 --2- 172.21.15.159:0/1329553169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a78da00 0x55ba4a7a5a00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.457+0000 7f3957dbe740 1 --2- 172.21.15.159:0/1329553169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77fe00 0x55ba4a78c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.457+0000 7f3957dbe740 1 --2- 172.21.15.159:0/1329553169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a77ebd0 0x55ba4a789290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.457+0000 7f3957dbe740 1 -- 172.21.15.159:0/1329553169 >> 172.21.15.159:0/1329553169 conn(0x55ba4a77acf0 msgr2=0x55ba4a78c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.457+0000 7f3957dbe740 1 -- 172.21.15.159:0/1329553169 shutdown_connections 2024-09-19T06:47:45.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.457+0000 7f3957dbe740 1 -- 172.21.15.159:0/1329553169 wait complete. 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.457+0000 7f3957dbe740 1 -- start start 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.457+0000 7f3957dbe740 1 Processor -- start 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a795c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a7961b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f3957dbe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 0x55ba4a792c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f3957dbe740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f39501aa2c0 con 0x55ba4a77fe00 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f3957dbe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39501ab730 con 0x55ba4a77ebd0 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f3957dbe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39501aa990 con 0x55ba4a78da00 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f3957dbe740 10 client.0 _ll_register_callbacks cb 0x7f394000bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f394e7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a795c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f394e7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a795c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:58742/0 (socket says 172.21.15.159:58742) 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f394e7fc640 1 -- 172.21.15.159:0/4111896164 learned_addr learned my addr 172.21.15.159:0/4111896164 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:45.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f394effd640 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a7961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.458+0000 7f394e7fc640 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 0x55ba4a792c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f394effd640 1 -- 172.21.15.159:0/4111896164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 msgr2=0x55ba4a792c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f394effd640 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 0x55ba4a792c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f394effd640 1 -- 172.21.15.159:0/4111896164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 msgr2=0x55ba4a795c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f394effd640 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a795c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f394effd640 1 -- 172.21.15.159:0/4111896164 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba4a789970 con 0x55ba4a77fe00 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f394e7fc640 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a795c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f394effd640 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a7961b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f394000bed0 tx=0x7f3940023430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1372c0b557c8ea91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f392effd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f392effd640 1 -- 172.21.15.159:0/4111896164 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940023830 con 0x55ba4a77fe00 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f392effd640 1 -- 172.21.15.159:0/4111896164 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f39400239d0 con 0x55ba4a77fe00 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.459+0000 7f3957dbe740 1 -- 172.21.15.159:0/4111896164 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f394405c040 con 0x55ba4a77fe00 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.460+0000 7f392effd640 1 -- 172.21.15.159:0/4111896164 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3940023bf0 con 0x55ba4a77fe00 2024-09-19T06:47:45.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.460+0000 7f3957dbe740 10 client.15402 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:45.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.460+0000 7f3957dbe740 1 -- 172.21.15.159:0/4111896164 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ba4a80d2d0 con 0x55ba4a77fe00 2024-09-19T06:47:45.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.460+0000 7f392effd640 1 -- 172.21.15.159:0/4111896164 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f394405c040 con 0x55ba4a77fe00 2024-09-19T06:47:45.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f392effd640 1 -- 172.21.15.159:0/4111896164 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3940019050 con 0x55ba4a77fe00 2024-09-19T06:47:45.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f3957dbe740 10 client.15402 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:45.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f3957dbe740 10 client.15402 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:47:45.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f3957dbe740 20 client.15402 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:45.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ba4a80dae0 0x55ba4a80ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f3957dbe740 4 client.15402 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T06:47:45.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f3957dbe740 1 -- 172.21.15.159:0/4111896164 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x55ba4a6ebd20 con 0x55ba4a80dae0 2024-09-19T06:47:45.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f394e7fc640 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ba4a80dae0 0x55ba4a80ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f394e7fc640 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ba4a80dae0 0x55ba4a80ff00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d7cc941611017ed server_cookie=b451ec178b810b72 in_seq=0 out_seq=0 2024-09-19T06:47:45.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.461+0000 7f392effd640 10 client.15402 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:45.468 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:45.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.470+0000 7f392effd640 1 -- 172.21.15.159:0/4111896164 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ba4a6ebd20 con 0x55ba4a80dae0 2024-09-19T06:47:45.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.470+0000 7f392effd640 10 client.15402 handle_command_reply: tid=0 2024-09-19T06:47:45.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.470+0000 7f3957dbe740 1 client.15402 shutdown 2024-09-19T06:47:45.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.470+0000 7f3957dbe740 1 -- 172.21.15.159:0/4111896164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 msgr2=0x55ba4a7961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.470+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a7961b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f394000bed0 tx=0x7f3940023430 comp rx=0 tx=0).stop 2024-09-19T06:47:45.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f3957dbe740 1 -- 172.21.15.159:0/4111896164 shutdown_connections 2024-09-19T06:47:45.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ba4a80dae0 0x55ba4a80ff00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba4a78da00 0x55ba4a792c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba4a77fe00 0x55ba4a7961b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f3957dbe740 1 --2- 172.21.15.159:0/4111896164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba4a77ebd0 0x55ba4a795c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f3957dbe740 1 -- 172.21.15.159:0/4111896164 >> 172.21.15.159:0/4111896164 conn(0x55ba4a77acf0 msgr2=0x55ba4a779650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f392effd640 0 client.15402 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f3957dbe740 1 -- 172.21.15.159:0/4111896164 shutdown_connections 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f3957dbe740 1 -- 172.21.15.159:0/4111896164 wait complete. 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.471+0000 7f3957dbe740 20 client.15402 trim_cache size 0 max 16384 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:47:45.473 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 20, 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 2, 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "9a727710": { 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 2, 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:47:45.474 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 131.2, 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:45.475 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:47:45.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 -- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39380a3440 msgr2=0x7f39380a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39380a3440 0x7f39380a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39480cdcb0 tx=0x7f394800af30 comp rx=0 tx=0).stop 2024-09-19T06:47:45.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 -- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102ef0 msgr2=0x7f395019bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102ef0 0x7f395019bcf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f394800cce0 tx=0x7f394800a620 comp rx=0 tx=0).stop 2024-09-19T06:47:45.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 -- 172.21.15.159:0/4288374132 shutdown_connections 2024-09-19T06:47:45.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39380a3440 0x7f39380a5900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3950102ef0 0x7f395019bcf0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3950102570 0x7f3950197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 --2- 172.21.15.159:0/4288374132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3950100e20 0x7f3950197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 -- 172.21.15.159:0/4288374132 >> 172.21.15.159:0/4288374132 conn(0x7f39500fc7d0 msgr2=0x7f3950105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 -- 172.21.15.159:0/4288374132 shutdown_connections 2024-09-19T06:47:45.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:45.472+0000 7f39559e5640 1 -- 172.21.15.159:0/4288374132 wait complete. 2024-09-19T06:47:46.206 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9a727710', quiesce took 4.2 seconds. Will release after: 6.999999999999999 2024-09-19T06:47:46.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.715+0000 7fc547903640 1 -- 172.21.15.159:0/3884358633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540102d90 msgr2=0x7fc540103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.715+0000 7fc547903640 1 --2- 172.21.15.159:0/3884358633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540102d90 0x7fc540103170 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009930 tx=0x7fc53c02a420 comp rx=0 tx=0).stop 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.715+0000 7fc547903640 1 -- 172.21.15.159:0/3884358633 shutdown_connections 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.715+0000 7fc547903640 1 --2- 172.21.15.159:0/3884358633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc540108290 0x7fc54010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.715+0000 7fc547903640 1 --2- 172.21.15.159:0/3884358633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc540103740 0x7fc540107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.715+0000 7fc547903640 1 --2- 172.21.15.159:0/3884358633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540102d90 0x7fc540103170 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.715+0000 7fc547903640 1 -- 172.21.15.159:0/3884358633 >> 172.21.15.159:0/3884358633 conn(0x7fc5400fc7d0 msgr2=0x7fc5400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.715+0000 7fc547903640 1 -- 172.21.15.159:0/3884358633 shutdown_connections 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.715+0000 7fc547903640 1 -- 172.21.15.159:0/3884358633 wait complete. 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc547903640 1 Processor -- start 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc547903640 1 -- start start 2024-09-19T06:47:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc547903640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc540102d90 0x7fc5401009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc547903640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc540103740 0x7fc540100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc547903640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540108290 0x7fc540101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc547903640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc540112090 con 0x7fc540108290 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc547903640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc540111f10 con 0x7fc540102d90 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc547903640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc540112210 con 0x7fc540103740 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc545ea0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540108290 0x7fc540101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc545ea0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540108290 0x7fc540101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60970/0 (socket says 172.21.15.159:60970) 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc545ea0640 1 -- 172.21.15.159:0/209090364 learned_addr learned my addr 172.21.15.159:0/209090364 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc54569f640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc540102d90 0x7fc5401009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.716+0000 7fc544e9e640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc540103740 0x7fc540100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.717+0000 7fc545ea0640 1 -- 172.21.15.159:0/209090364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc540103740 msgr2=0x7fc540100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.717+0000 7fc545ea0640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc540103740 0x7fc540100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.717+0000 7fc545ea0640 1 -- 172.21.15.159:0/209090364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc540102d90 msgr2=0x7fc5401009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.717+0000 7fc545ea0640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc540102d90 0x7fc5401009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.717+0000 7fc545ea0640 1 -- 172.21.15.159:0/209090364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5401a6ab0 con 0x7fc540108290 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.717+0000 7fc545ea0640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540108290 0x7fc540101470 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc53800cad0 tx=0x7fc53800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.717+0000 7fc5367fc640 1 -- 172.21.15.159:0/209090364 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53800ae20 con 0x7fc540108290 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.717+0000 7fc5367fc640 1 -- 172.21.15.159:0/209090364 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc538005020 con 0x7fc540108290 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.717+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5401a6da0 con 0x7fc540108290 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.718+0000 7fc5367fc640 1 -- 172.21.15.159:0/209090364 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53800f6f0 con 0x7fc540108290 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.718+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5401a72b0 con 0x7fc540108290 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.719+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54006a7f0 con 0x7fc540108290 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.720+0000 7fc5367fc640 1 -- 172.21.15.159:0/209090364 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fc5380051d0 con 0x7fc540108290 2024-09-19T06:47:46.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.721+0000 7fc5367fc640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc52c0a34c0 0x7fc52c0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.721+0000 7fc54569f640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc52c0a34c0 0x7fc52c0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.721+0000 7fc5367fc640 1 -- 172.21.15.159:0/209090364 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc5380cfe00 con 0x7fc540108290 2024-09-19T06:47:46.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.721+0000 7fc54569f640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc52c0a34c0 0x7fc52c0a5980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009900 tx=0x7fc53c0058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:46.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.725+0000 7fc5367fc640 1 -- 172.21.15.159:0/209090364 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc538014030 con 0x7fc540108290 2024-09-19T06:47:46.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:46 smithi159 ceph-mon[30935]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T06:47:46.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.938+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc54010a2a0 con 0x7fc540108290 2024-09-19T06:47:46.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.939+0000 7fc5367fc640 1 -- 172.21.15.159:0/209090364 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7fc53809bf90 con 0x7fc540108290 2024-09-19T06:47:46.940 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:46.941 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:47:46.941 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:47:46.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc52c0a34c0 msgr2=0x7fc52c0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc52c0a34c0 0x7fc52c0a5980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009900 tx=0x7fc53c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540108290 msgr2=0x7fc540101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540108290 0x7fc540101470 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc53800cad0 tx=0x7fc53800cf90 comp rx=0 tx=0).stop 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 shutdown_connections 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc52c0a34c0 0x7fc52c0a5980 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc540108290 0x7fc540101470 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc540103740 0x7fc540100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 --2- 172.21.15.159:0/209090364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc540102d90 0x7fc5401009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 >> 172.21.15.159:0/209090364 conn(0x7fc5400fc7d0 msgr2=0x7fc540105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 shutdown_connections 2024-09-19T06:47:46.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:46.941+0000 7fc547903640 1 -- 172.21.15.159:0/209090364 wait complete. 2024-09-19T06:47:47.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:46 smithi203 ceph-mon[35473]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T06:47:47.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:46 smithi189 ceph-mon[34880]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T06:47:48.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:47 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/209090364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:48.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:47 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/209090364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:48.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:47 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/209090364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:49.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:48 smithi203 ceph-mon[35473]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:47:49.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:48 smithi189 ceph-mon[34880]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:47:49.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:48 smithi159 ceph-mon[30935]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:47:49.777 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:47:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.459+0000 7fa6e569b640 1 -- 172.21.15.159:0/3667047565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 msgr2=0x7fa6e0106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.459+0000 7fa6e569b640 1 --2- 172.21.15.159:0/3667047565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 0x7fa6e0106da0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009930 tx=0x7fa6d002a420 comp rx=0 tx=0).stop 2024-09-19T06:47:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.459+0000 7fa6e569b640 1 -- 172.21.15.159:0/3667047565 shutdown_connections 2024-09-19T06:47:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.459+0000 7fa6e569b640 1 --2- 172.21.15.159:0/3667047565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6e0101350 0x7fa6e010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.459+0000 7fa6e569b640 1 --2- 172.21.15.159:0/3667047565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01009b0 0x7fa6e0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.459+0000 7fa6e569b640 1 --2- 172.21.15.159:0/3667047565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 0x7fa6e0106da0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.459+0000 7fa6e569b640 1 -- 172.21.15.159:0/3667047565 >> 172.21.15.159:0/3667047565 conn(0x7fa6e0077990 msgr2=0x7fa6e00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.459+0000 7fa6e569b640 1 -- 172.21.15.159:0/3667047565 shutdown_connections 2024-09-19T06:47:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.459+0000 7fa6e569b640 1 -- 172.21.15.159:0/3667047565 wait complete. 2024-09-19T06:47:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.460+0000 7fa6e569b640 1 Processor -- start 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.460+0000 7fa6e569b640 1 -- start start 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6e569b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01009b0 0x7fa6e0197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6e569b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6e0101350 0x7fa6e0197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6e569b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 0x7fa6e019bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6e569b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0110e00 con 0x7fa6e01069c0 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6e569b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0110c80 con 0x7fa6e01009b0 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6e569b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0110f80 con 0x7fa6e0101350 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6df7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 0x7fa6e019bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6deffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01009b0 0x7fa6e0197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6deffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01009b0 0x7fa6e0197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:56598/0 (socket says 172.21.15.159:56598) 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6df7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 0x7fa6e019bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49476/0 (socket says 172.21.15.159:49476) 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6d7fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6e0101350 0x7fa6e0197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6deffd640 1 -- 172.21.15.159:0/596705266 learned_addr learned my addr 172.21.15.159:0/596705266 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6df7fe640 1 -- 172.21.15.159:0/596705266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6e0101350 msgr2=0x7fa6e0197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6df7fe640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6e0101350 0x7fa6e0197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6df7fe640 1 -- 172.21.15.159:0/596705266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01009b0 msgr2=0x7fa6e0197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6df7fe640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01009b0 0x7fa6e0197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6df7fe640 1 -- 172.21.15.159:0/596705266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e019c240 con 0x7fa6e01069c0 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6deffd640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01009b0 0x7fa6e0197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6df7fe640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 0x7fa6e019bb10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800da10 tx=0x7fa6d800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.461+0000 7fa6dcff9640 1 -- 172.21.15.159:0/596705266 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800bd70 con 0x7fa6e01069c0 2024-09-19T06:47:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.462+0000 7fa6dcff9640 1 -- 172.21.15.159:0/596705266 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6d8003e50 con 0x7fa6e01069c0 2024-09-19T06:47:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.462+0000 7fa6dcff9640 1 -- 172.21.15.159:0/596705266 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80106a0 con 0x7fa6e01069c0 2024-09-19T06:47:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.462+0000 7fa6e569b640 1 -- 172.21.15.159:0/596705266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e019c530 con 0x7fa6e01069c0 2024-09-19T06:47:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.462+0000 7fa6e569b640 1 -- 172.21.15.159:0/596705266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e01a3dc0 con 0x7fa6e01069c0 2024-09-19T06:47:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.464+0000 7fa6e8435740 1 Processor -- start 2024-09-19T06:47:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.464+0000 7fa6dcff9640 1 -- 172.21.15.159:0/596705266 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fa6d8003970 con 0x7fa6e01069c0 2024-09-19T06:47:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.464+0000 7fa6e8435740 1 -- start start 2024-09-19T06:47:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a32d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a3f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 0x5604c1a422b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6e8435740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5604c19972f0 con 0x5604c1a33290 2024-09-19T06:47:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6e8435740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5604c193f270 con 0x5604c1a32970 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6e8435740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5604c19932b0 con 0x5604c1a3fec0 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6deffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a3f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6deffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a3f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49486/0 (socket says 172.21.15.159:49486) 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6deffd640 1 -- 172.21.15.159:0/1591768456 learned_addr learned my addr 172.21.15.159:0/1591768456 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a32d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 0x5604c1a422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6deffd640 1 -- 172.21.15.159:0/1591768456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 msgr2=0x5604c1a422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6deffd640 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 0x5604c1a422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6deffd640 1 -- 172.21.15.159:0/1591768456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 msgr2=0x5604c1a32d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6deffd640 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a32d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6deffd640 1 -- 172.21.15.159:0/1591768456 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c193e340 con 0x5604c1a33290 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6dcff9640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6cc0a3580 0x7fa6cc0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a32d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.465+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6cc0a3580 0x7fa6cc0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.466+0000 7fa6dcff9640 1 -- 172.21.15.159:0/596705266 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa6d80d0170 con 0x7fa6e01069c0 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.466+0000 7fa6deffd640 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a3f980 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009a50 tx=0x7fa6d0031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2a66cac0dd0e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.466+0000 7fa6d57fa640 1 -- 172.21.15.159:0/1591768456 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0035040 con 0x5604c1a33290 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.466+0000 7fa6d57fa640 1 -- 172.21.15.159:0/1591768456 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6d00319d0 con 0x5604c1a33290 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.466+0000 7fa6d57fa640 1 -- 172.21.15.159:0/1591768456 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0004a70 con 0x5604c1a33290 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 -- 172.21.15.159:0/1591768456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 msgr2=0x5604c1a3f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6cc0a3580 0x7fa6cc0a5a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x5604c1a30150 tx=0x7fa6c8014040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a3f980 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009a50 tx=0x7fa6d0031660 comp rx=0 tx=0).stop 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 -- 172.21.15.159:0/1591768456 shutdown_connections 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 0x5604c1a422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a3f980 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 --2- 172.21.15.159:0/1591768456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a32d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 -- 172.21.15.159:0/1591768456 >> 172.21.15.159:0/1591768456 conn(0x5604c1a2f060 msgr2=0x5604c1a2f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 -- 172.21.15.159:0/1591768456 shutdown_connections 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 -- 172.21.15.159:0/1591768456 wait complete. 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 -- start start 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.467+0000 7fa6e8435740 1 Processor -- start 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 0x5604c1a3cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a33290 0x5604c1a3d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a3fec0 0x5604c1a3d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6e8435740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5604c1a42a90 con 0x5604c1a3fec0 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6e8435740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5604c1920290 con 0x5604c1a33290 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6e8435740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5604c1a42c10 con 0x5604c1a32970 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6e8435740 10 client.0 _ll_register_callbacks cb 0x5604c1951140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6df7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a3fec0 0x5604c1a3d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6df7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a3fec0 0x5604c1a3d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49502/0 (socket says 172.21.15.159:49502) 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6df7fe640 1 -- 172.21.15.159:0/3101423184 learned_addr learned my addr 172.21.15.159:0/3101423184 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6deffd640 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 0x5604c1a3cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a33290 0x5604c1a3d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6df7fe640 1 -- 172.21.15.159:0/3101423184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 msgr2=0x5604c1a3cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6df7fe640 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 0x5604c1a3cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6df7fe640 1 -- 172.21.15.159:0/3101423184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a33290 msgr2=0x5604c1a3d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6df7fe640 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a33290 0x5604c1a3d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6df7fe640 1 -- 172.21.15.159:0/3101423184 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c16aa210 con 0x5604c1a3fec0 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6df7fe640 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a3fec0 0x5604c1a3d840 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80cd860 tx=0x7fa6d809bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b9f3e6cd932492 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6c67fc640 1 -- 172.21.15.159:0/3101423184 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80a4f20 con 0x5604c1a3fec0 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6c67fc640 1 -- 172.21.15.159:0/3101423184 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa6d8098920 con 0x5604c1a3fec0 2024-09-19T06:47:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.468+0000 7fa6e8435740 1 -- 172.21.15.159:0/3101423184 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6d00319d0 con 0x5604c1a3fec0 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6c67fc640 1 -- 172.21.15.159:0/3101423184 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa6d8003c60 con 0x5604c1a3fec0 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6e8435740 10 client.15420 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6e8435740 1 -- 172.21.15.159:0/3101423184 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5604c1776620 con 0x5604c1a3fec0 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6c67fc640 1 -- 172.21.15.159:0/3101423184 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6d00319d0 con 0x5604c1a3fec0 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6c67fc640 1 -- 172.21.15.159:0/3101423184 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa6d8024060 con 0x5604c1a3fec0 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6e8435740 10 client.15420 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6e8435740 10 client.15420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6e8435740 20 client.15420 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6e8435740 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5604c1a4fdf0 0x5604c1a52240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6e8435740 4 client.15420 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6e8435740 1 -- 172.21.15.159:0/3101423184 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604c19a4a20 con 0x5604c1a4fdf0 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.469+0000 7fa6deffd640 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5604c1a4fdf0 0x5604c1a52240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.470+0000 7fa6c67fc640 10 client.15420 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.470+0000 7fa6deffd640 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5604c1a4fdf0 0x5604c1a52240 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f50a52e11d68e586 server_cookie=c0b69dc0a786714f in_seq=0 out_seq=0 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.470+0000 7fa6c67fc640 1 -- 172.21.15.159:0/3101423184 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604c19a4a20 con 0x5604c1a4fdf0 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.470+0000 7fa6c67fc640 10 client.15420 handle_command_reply: tid=0 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.470+0000 7fa6e8435740 1 client.15420 shutdown 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 -- 172.21.15.159:0/3101423184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a3fec0 msgr2=0x5604c1a3d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a3fec0 0x5604c1a3d840 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80cd860 tx=0x7fa6d809bcd0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 -- 172.21.15.159:0/3101423184 shutdown_connections 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5604c1a4fdf0 0x5604c1a52240 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6c67fc640 0 client.15420 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a3fec0 0x5604c1a3d840 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a33290 0x5604c1a3d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 --2- 172.21.15.159:0/3101423184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 0x5604c1a3cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 -- 172.21.15.159:0/3101423184 >> 172.21.15.159:0/3101423184 conn(0x5604c1a2f060 msgr2=0x5604c1a34dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 -- 172.21.15.159:0/3101423184 shutdown_connections 2024-09-19T06:47:50.482 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 1 -- 172.21.15.159:0/3101423184 wait complete. 2024-09-19T06:47:50.482 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.471+0000 7fa6e8435740 20 client.15420 trim_cache size 0 max 16384 2024-09-19T06:47:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6e8435740 1 Processor -- start 2024-09-19T06:47:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6e8435740 1 -- start start 2024-09-19T06:47:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a57b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a58090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 0x5604c1a3a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6e8435740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01a9630 con 0x5604c1a33290 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6e8435740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01abeb0 con 0x5604c1a32970 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6e8435740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01a9ca0 con 0x5604c1a3fec0 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6d7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a58090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6d7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a58090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49510/0 (socket says 172.21.15.159:49510) 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6d7fff640 1 -- 172.21.15.159:0/1499491582 learned_addr learned my addr 172.21.15.159:0/1499491582 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6deffd640 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a57b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6df7fe640 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 0x5604c1a3a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6d7fff640 1 -- 172.21.15.159:0/1499491582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 msgr2=0x5604c1a3a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.487+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 0x5604c1a3a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.488+0000 7fa6d7fff640 1 -- 172.21.15.159:0/1499491582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 msgr2=0x5604c1a57b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.488+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a57b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.488+0000 7fa6d7fff640 1 -- 172.21.15.159:0/1499491582 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c1a2ee90 con 0x5604c1a33290 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.488+0000 7fa6df7fe640 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 0x5604c1a3a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.488+0000 7fa6deffd640 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a57b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.488+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a58090 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6c801e410 tx=0x7fa6c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeef7e1c9ec5ca5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.488+0000 7fa6d4ff9640 1 -- 172.21.15.159:0/1499491582 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c801e190 con 0x5604c1a33290 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.488+0000 7fa6d4ff9640 1 -- 172.21.15.159:0/1499491582 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c80035f0 con 0x5604c1a33290 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.488+0000 7fa6d4ff9640 1 -- 172.21.15.159:0/1499491582 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8028470 con 0x5604c1a33290 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 -- 172.21.15.159:0/1499491582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 msgr2=0x5604c1a58090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a58090 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6c801e410 tx=0x7fa6c8016000 comp rx=0 tx=0).stop 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 -- 172.21.15.159:0/1499491582 shutdown_connections 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a3fec0 0x5604c1a3a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a58090 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 --2- 172.21.15.159:0/1499491582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a32970 0x5604c1a57b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 -- 172.21.15.159:0/1499491582 >> 172.21.15.159:0/1499491582 conn(0x5604c1a2f060 msgr2=0x5604c1a2e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 -- 172.21.15.159:0/1499491582 shutdown_connections 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 -- 172.21.15.159:0/1499491582 wait complete. 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 -- start start 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 Processor -- start 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 0x5604c1a36730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a36c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a3fec0 0x5604c1a371b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01aa370 con 0x5604c1a33290 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01ab7e0 con 0x5604c1a3fec0 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.489+0000 7fa6e8435740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01aaa40 con 0x5604c1a32970 2024-09-19T06:47:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6e8435740 10 client.0 _ll_register_callbacks cb 0x7fa6d80cd660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6d7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a36c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6d7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a36c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49518/0 (socket says 172.21.15.159:49518) 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6d7fff640 1 -- 172.21.15.159:0/837082407 learned_addr learned my addr 172.21.15.159:0/837082407 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6df7fe640 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a3fec0 0x5604c1a371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6deffd640 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 0x5604c1a36730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6d7fff640 1 -- 172.21.15.159:0/837082407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 msgr2=0x5604c1a36730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 0x5604c1a36730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6d7fff640 1 -- 172.21.15.159:0/837082407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a3fec0 msgr2=0x5604c1a371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a3fec0 0x5604c1a371b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6d7fff640 1 -- 172.21.15.159:0/837082407 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c1a2fcf0 con 0x5604c1a33290 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6deffd640 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 0x5604c1a36730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6d7fff640 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a36c70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c010 tx=0x7fa6c8003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c592f830517fa906 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6c67fc640 1 -- 172.21.15.159:0/837082407 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80039b0 con 0x5604c1a33290 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6c67fc640 1 -- 172.21.15.159:0/837082407 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa6c8003b50 con 0x5604c1a33290 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6e8435740 1 -- 172.21.15.159:0/837082407 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c80035f0 con 0x5604c1a33290 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6c67fc640 1 -- 172.21.15.159:0/837082407 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa6c8003fc0 con 0x5604c1a33290 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6e8435740 10 client.15426 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.490+0000 7fa6e8435740 1 -- 172.21.15.159:0/837082407 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5604c1abd040 con 0x5604c1a33290 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.491+0000 7fa6c67fc640 1 -- 172.21.15.159:0/837082407 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c80035f0 con 0x5604c1a33290 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.491+0000 7fa6c67fc640 1 -- 172.21.15.159:0/837082407 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa6c8028b70 con 0x5604c1a33290 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.491+0000 7fa6e8435740 10 client.15426 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.491+0000 7fa6e8435740 10 client.15426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.491+0000 7fa6e8435740 20 client.15426 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.491+0000 7fa6e8435740 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5604c1a4fdf0 0x5604c1abf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.491+0000 7fa6e8435740 4 client.15426 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:47:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.491+0000 7fa6e8435740 1 -- 172.21.15.159:0/837082407 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604c199ed70 con 0x5604c1a4fdf0 2024-09-19T06:47:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.491+0000 7fa6deffd640 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5604c1a4fdf0 0x5604c1abf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.492+0000 7fa6c67fc640 10 client.15426 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.492+0000 7fa6deffd640 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5604c1a4fdf0 0x5604c1abf6a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91600134266055b1 server_cookie=b6986e0ac86238ab in_seq=0 out_seq=0 2024-09-19T06:47:50.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6c67fc640 1 -- 172.21.15.159:0/837082407 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604c199ed70 con 0x5604c1a4fdf0 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6c67fc640 10 client.15426 handle_command_reply: tid=0 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 client.15426 shutdown 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 -- 172.21.15.159:0/837082407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 msgr2=0x5604c1a36c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a36c70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c010 tx=0x7fa6c8003df0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 -- 172.21.15.159:0/837082407 shutdown_connections 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5604c1a4fdf0 0x5604c1abf6a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604c1a3fec0 0x5604c1a371b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6c67fc640 0 client.15426 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5604c1a33290 0x5604c1a36c70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 --2- 172.21.15.159:0/837082407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604c1a32970 0x5604c1a36730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 -- 172.21.15.159:0/837082407 >> 172.21.15.159:0/837082407 conn(0x5604c1a2f060 msgr2=0x5604c1a2e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 -- 172.21.15.159:0/837082407 shutdown_connections 2024-09-19T06:47:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 1 -- 172.21.15.159:0/837082407 wait complete. 2024-09-19T06:47:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e8435740 20 client.15426 trim_cache size 0 max 16384 2024-09-19T06:47:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:47:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:47:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:47:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e569b640 1 -- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6cc0a3580 msgr2=0x7fa6cc0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e569b640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6cc0a3580 0x7fa6cc0a5a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x5604c1a30150 tx=0x7fa6c8014040 comp rx=0 tx=0).stop 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e569b640 1 -- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 msgr2=0x7fa6e019bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.499+0000 7fa6e569b640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 0x7fa6e019bb10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800da10 tx=0x7fa6d800ded0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.500+0000 7fa6e569b640 1 -- 172.21.15.159:0/596705266 shutdown_connections 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.500+0000 7fa6e569b640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6cc0a3580 0x7fa6cc0a5a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.500+0000 7fa6e569b640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e01069c0 0x7fa6e019bb10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.500+0000 7fa6e569b640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6e0101350 0x7fa6e0197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.500+0000 7fa6e569b640 1 --2- 172.21.15.159:0/596705266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01009b0 0x7fa6e0197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.500+0000 7fa6e569b640 1 -- 172.21.15.159:0/596705266 >> 172.21.15.159:0/596705266 conn(0x7fa6e0077990 msgr2=0x7fa6e00ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.500+0000 7fa6e569b640 1 -- 172.21.15.159:0/596705266 shutdown_connections 2024-09-19T06:47:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:47:50.500+0000 7fa6e569b640 1 -- 172.21.15.159:0/596705266 wait complete. 2024-09-19T06:47:50.984 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:50 smithi159 ceph-mon[30935]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:47:51.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:50 smithi203 ceph-mon[35473]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:47:51.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:50 smithi189 ceph-mon[34880]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T06:47:51.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.320+0000 7f9b59566640 1 -- 172.21.15.159:0/4055956863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b541027a0 msgr2=0x7f9b541067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.320+0000 7f9b59566640 1 --2- 172.21.15.159:0/4055956863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b541027a0 0x7f9b541067f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009900 tx=0x7f9b3c02a410 comp rx=0 tx=0).stop 2024-09-19T06:47:51.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.320+0000 7f9b59566640 1 -- 172.21.15.159:0/4055956863 shutdown_connections 2024-09-19T06:47:51.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.320+0000 7f9b59566640 1 --2- 172.21.15.159:0/4055956863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b54106f20 0x7f9b5410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.320+0000 7f9b59566640 1 --2- 172.21.15.159:0/4055956863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b541027a0 0x7f9b541067f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.320+0000 7f9b59566640 1 --2- 172.21.15.159:0/4055956863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b54101df0 0x7f9b541021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.320+0000 7f9b59566640 1 -- 172.21.15.159:0/4055956863 >> 172.21.15.159:0/4055956863 conn(0x7f9b540fd8f0 msgr2=0x7f9b540ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.320+0000 7f9b59566640 1 -- 172.21.15.159:0/4055956863 shutdown_connections 2024-09-19T06:47:51.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.320+0000 7f9b59566640 1 -- 172.21.15.159:0/4055956863 wait complete. 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b59566640 1 Processor -- start 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b59566640 1 -- start start 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b59566640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b54101df0 0x7f9b540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b59566640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b541027a0 0x7f9b54074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b59566640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b54106f20 0x7f9b54074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b59566640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54111f80 con 0x7f9b54106f20 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b59566640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54111e00 con 0x7f9b54101df0 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b59566640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54112100 con 0x7f9b541027a0 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b537fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b54106f20 0x7f9b54074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b537fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b54106f20 0x7f9b54074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49522/0 (socket says 172.21.15.159:49522) 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b537fe640 1 -- 172.21.15.159:0/545138638 learned_addr learned my addr 172.21.15.159:0/545138638 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:51.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b541027a0 0x7f9b54074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.321+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b54101df0 0x7f9b540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b537fe640 1 -- 172.21.15.159:0/545138638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b541027a0 msgr2=0x7f9b54074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b537fe640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b541027a0 0x7f9b54074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b537fe640 1 -- 172.21.15.159:0/545138638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b54101df0 msgr2=0x7f9b540744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b537fe640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b54101df0 0x7f9b540744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b537fe640 1 -- 172.21.15.159:0/545138638 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b541a6920 con 0x7f9b54106f20 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b54101df0 0x7f9b540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b537fe640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b54106f20 0x7f9b54074f70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00eaa0 tx=0x7f9b4c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b50ff9640 1 -- 172.21.15.159:0/545138638 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00cdb0 con 0x7f9b54106f20 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b59566640 1 -- 172.21.15.159:0/545138638 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b541a6c10 con 0x7f9b54106f20 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b50ff9640 1 -- 172.21.15.159:0/545138638 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b4c005020 con 0x7f9b54106f20 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b50ff9640 1 -- 172.21.15.159:0/545138638 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0116b0 con 0x7f9b54106f20 2024-09-19T06:47:51.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.322+0000 7f9b59566640 1 -- 172.21.15.159:0/545138638 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b541a70d0 con 0x7f9b54106f20 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.324+0000 7f9b50ff9640 1 -- 172.21.15.159:0/545138638 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f9b4c005560 con 0x7f9b54106f20 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b5b93f740 1 Processor -- start 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b5b93f740 1 -- start start 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485826090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 0x559485826a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 0x559485833760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55948578c2f0 con 0x559485827b40 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559485733cf0 con 0x5594858265d0 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5594857882b0 con 0x559485831370 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b50ff9640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9b400a3440 0x7f9b400a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b4bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485826090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b4bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485826090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49526/0 (socket says 172.21.15.159:49526) 2024-09-19T06:47:51.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.325+0000 7f9b4bfff640 1 -- 172.21.15.159:0/1904035617 learned_addr learned my addr 172.21.15.159:0/1904035617 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/1904035617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 0x559485826a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b50ff9640 1 -- 172.21.15.159:0/545138638 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f9b4c0d0160 con 0x7f9b54106f20 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b537fe640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9b400a3440 0x7f9b400a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b4bfff640 1 -- 172.21.15.159:0/1904035617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 msgr2=0x559485833760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/1904035617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 0x559485833760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b4bfff640 1 -- 172.21.15.159:0/1904035617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 msgr2=0x559485826a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/1904035617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 0x559485826a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b4bfff640 1 -- 172.21.15.159:0/1904035617 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594857183a0 con 0x559485827b40 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/1904035617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485826090 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c02a930 tx=0x7f9b3c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abfd5d425e04c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b537fe640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9b400a3440 0x7f9b400a5900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0cd7c0 tx=0x7f9b4c0058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b497fa640 1 -- 172.21.15.159:0/1904035617 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c035040 con 0x559485827b40 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b497fa640 1 -- 172.21.15.159:0/1904035617 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b3c031930 con 0x559485827b40 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.326+0000 7f9b497fa640 1 -- 172.21.15.159:0/1904035617 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0047a0 con 0x559485827b40 2024-09-19T06:47:51.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.327+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1904035617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 msgr2=0x559485826090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.327+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/1904035617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485826090 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c02a930 tx=0x7f9b3c005c00 comp rx=0 tx=0).stop 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.327+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1904035617 shutdown_connections 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.327+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/1904035617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 0x559485833760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.327+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/1904035617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 0x559485826a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.327+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/1904035617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485826090 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.327+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1904035617 >> 172.21.15.159:0/1904035617 conn(0x5594857ef310 msgr2=0x559485822c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.327+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1904035617 shutdown_connections 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.327+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1904035617 wait complete. 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b5b93f740 1 -- start start 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b5b93f740 1 Processor -- start 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5594858265d0 0x559485830d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485827b40 0x55948582dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 0x55948582e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559485834010 con 0x5594858265d0 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559485747060 con 0x559485831370 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559485834190 con 0x559485827b40 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b5b93f740 10 client.0 _ll_register_callbacks cb 0x55948549a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b4bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5594858265d0 0x559485830d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b4bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5594858265d0 0x559485830d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49528/0 (socket says 172.21.15.159:49528) 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b4bfff640 1 -- 172.21.15.159:0/3408674851 learned_addr learned my addr 172.21.15.159:0/3408674851 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 0x55948582e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.328+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485827b40 0x55948582dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b4bfff640 1 -- 172.21.15.159:0/3408674851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485827b40 msgr2=0x55948582dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485827b40 0x55948582dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b4bfff640 1 -- 172.21.15.159:0/3408674851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 msgr2=0x55948582e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 0x55948582e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b4bfff640 1 -- 172.21.15.159:0/3408674851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594854fd3c0 con 0x5594858265d0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5594858265d0 0x559485830d20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c006010 tx=0x7f9b3c0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b82ec41f2f9abc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/3408674851 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c004450 con 0x5594858265d0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/3408674851 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f9b3c004750 con 0x5594858265d0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b5b93f740 1 -- 172.21.15.159:0/3408674851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b3c031930 con 0x5594858265d0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/3408674851 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9b3c004950 con 0x5594858265d0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b5b93f740 10 client.15438 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b5b93f740 1 -- 172.21.15.159:0/3408674851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55948583fa90 con 0x5594858265d0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/3408674851 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b3c031930 con 0x5594858265d0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.329+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/3408674851 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9b3c045440 con 0x5594858265d0 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.330+0000 7f9b5b93f740 10 client.15438 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.330+0000 7f9b5b93f740 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:51.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.330+0000 7f9b5b93f740 20 client.15438 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.330+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559485840de0 0x5594858431d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.330+0000 7f9b5b93f740 4 client.15438 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.330+0000 7f9b5b93f740 1 -- 172.21.15.159:0/3408674851 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559485799860 con 0x559485840de0 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.330+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559485840de0 0x5594858431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559485840de0 0x5594858431d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6371c30bf5b333b8 server_cookie=9e3b83333159b53d in_seq=0 out_seq=0 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b3a7fc640 10 client.15438 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/3408674851 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559485799860 con 0x559485840de0 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b3a7fc640 10 client.15438 handle_command_reply: tid=0 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b5b93f740 1 client.15438 shutdown 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b5b93f740 1 -- 172.21.15.159:0/3408674851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5594858265d0 msgr2=0x559485830d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5594858265d0 0x559485830d20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c006010 tx=0x7f9b3c0054a0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b5b93f740 1 -- 172.21.15.159:0/3408674851 shutdown_connections 2024-09-19T06:47:51.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559485840de0 0x5594858431d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b3a7fc640 0 client.15438 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.331+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 0x55948582e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.332+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485827b40 0x55948582dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.332+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/3408674851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5594858265d0 0x559485830d20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.332+0000 7f9b5b93f740 1 -- 172.21.15.159:0/3408674851 >> 172.21.15.159:0/3408674851 conn(0x5594857ef310 msgr2=0x559485828930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.332+0000 7f9b5b93f740 1 -- 172.21.15.159:0/3408674851 shutdown_connections 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.332+0000 7f9b5b93f740 1 -- 172.21.15.159:0/3408674851 wait complete. 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.332+0000 7f9b5b93f740 20 client.15438 trim_cache size 0 max 16384 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.345+0000 7f9b5b93f740 1 Processor -- start 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.345+0000 7f9b5b93f740 1 -- start start 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.345+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594858265d0 0x559485822e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.345+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x55948582d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.345+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 0x55948582ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.345+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541adab0 con 0x559485827b40 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.345+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541b0330 con 0x559485831370 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.345+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541ae120 con 0x5594858265d0 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b52ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x55948582d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b52ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x55948582d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49536/0 (socket says 172.21.15.159:49536) 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b52ffd640 1 -- 172.21.15.159:0/1677498078 learned_addr learned my addr 172.21.15.159:0/1677498078 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/1677498078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594858265d0 0x559485822e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/1677498078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 0x55948582ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b52ffd640 1 -- 172.21.15.159:0/1677498078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594858265d0 msgr2=0x559485822e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/1677498078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594858265d0 0x559485822e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b52ffd640 1 -- 172.21.15.159:0/1677498078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 msgr2=0x55948582ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/1677498078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 0x55948582ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b52ffd640 1 -- 172.21.15.159:0/1677498078 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55948582cf80 con 0x559485827b40 2024-09-19T06:47:51.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/1677498078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x55948582d890 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x559485823ac0 tx=0x7f9b440118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c935eb3540f57b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b48ff9640 1 -- 172.21.15.159:0/1677498078 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44022020 con 0x559485827b40 2024-09-19T06:47:51.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b48ff9640 1 -- 172.21.15.159:0/1677498078 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b4401dc80 con 0x559485827b40 2024-09-19T06:47:51.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.346+0000 7f9b48ff9640 1 -- 172.21.15.159:0/1677498078 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b440103d0 con 0x559485827b40 2024-09-19T06:47:51.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.347+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1677498078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 msgr2=0x55948582d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.347+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/1677498078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x55948582d890 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x559485823ac0 tx=0x7f9b440118d0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.347+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1677498078 shutdown_connections 2024-09-19T06:47:51.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.347+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/1677498078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559485831370 0x55948582ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.347+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/1677498078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x55948582d890 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.347+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/1677498078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594858265d0 0x559485822e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.347+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1677498078 >> 172.21.15.159:0/1677498078 conn(0x5594857ef310 msgr2=0x55948582f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.347+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1677498078 shutdown_connections 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.347+0000 7f9b5b93f740 1 -- 172.21.15.159:0/1677498078 wait complete. 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b5b93f740 1 -- start start 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b5b93f740 1 Processor -- start 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 0x5594858469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485843d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b5b93f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 0x5594858442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541ae7f0 con 0x559485827b40 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541afc60 con 0x5594858265d0 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b5b93f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541aeec0 con 0x559485831370 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b5b93f740 10 client.0 _ll_register_callbacks cb 0x7f9b4400b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b52ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485843d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b52ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485843d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49552/0 (socket says 172.21.15.159:49552) 2024-09-19T06:47:51.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b52ffd640 1 -- 172.21.15.159:0/2523523168 learned_addr learned my addr 172.21.15.159:0/2523523168 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 0x5594858469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 0x5594858442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b52ffd640 1 -- 172.21.15.159:0/2523523168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 msgr2=0x5594858442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 0x5594858442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b52ffd640 1 -- 172.21.15.159:0/2523523168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 msgr2=0x5594858469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 0x5594858469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b52ffd640 1 -- 172.21.15.159:0/2523523168 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559485844b00 con 0x559485827b40 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.348+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 0x5594858442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b52ffd640 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485843d70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9b44014040 tx=0x7f9b4401d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d9bb3347bce468 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/2523523168 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44005250 con 0x559485827b40 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/2523523168 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f9b440053f0 con 0x559485827b40 2024-09-19T06:47:51.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b5b93f740 1 -- 172.21.15.159:0/2523523168 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b4401dc80 con 0x559485827b40 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/2523523168 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9b440055f0 con 0x559485827b40 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b5b93f740 10 client.15444 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b5b93f740 1 -- 172.21.15.159:0/2523523168 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5594858ab7b0 con 0x559485827b40 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/2523523168 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b4401dc80 con 0x559485827b40 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/2523523168 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9b44027860 con 0x559485827b40 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b5b93f740 10 client.15444 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b5b93f740 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b5b93f740 20 client.15444 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.349+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559485840de0 0x5594858adf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.350+0000 7f9b5b93f740 4 client.15444 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.350+0000 7f9b5b93f740 1 -- 172.21.15.159:0/2523523168 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559485793d70 con 0x559485840de0 2024-09-19T06:47:51.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.350+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559485840de0 0x5594858adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.350+0000 7f9b3a7fc640 10 client.15444 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.350+0000 7f9b4bfff640 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559485840de0 0x5594858adf40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8762606d79ca3e91 server_cookie=c07bdec486d0483b in_seq=0 out_seq=0 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.350+0000 7f9b3a7fc640 1 -- 172.21.15.159:0/2523523168 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559485793d70 con 0x559485840de0 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.350+0000 7f9b3a7fc640 10 client.15444 handle_command_reply: tid=0 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 client.15444 shutdown 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 -- 172.21.15.159:0/2523523168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 msgr2=0x559485843d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485843d70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9b44014040 tx=0x7f9b4401d5a0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 -- 172.21.15.159:0/2523523168 shutdown_connections 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559485840de0 0x5594858adf40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b3a7fc640 0 client.15444 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559485831370 0x5594858442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559485827b40 0x559485843d70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 --2- 172.21.15.159:0/2523523168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5594858265d0 0x5594858469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 -- 172.21.15.159:0/2523523168 >> 172.21.15.159:0/2523523168 conn(0x5594857ef310 msgr2=0x55948582f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 -- 172.21.15.159:0/2523523168 shutdown_connections 2024-09-19T06:47:51.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 1 -- 172.21.15.159:0/2523523168 wait complete. 2024-09-19T06:47:51.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.351+0000 7f9b5b93f740 20 client.15444 trim_cache size 0 max 16384 2024-09-19T06:47:51.367 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 -- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9b400a3440 msgr2=0x7f9b400a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9b400a3440 0x7f9b400a5900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0cd7c0 tx=0x7f9b4c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 -- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b54106f20 msgr2=0x7f9b54074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b54106f20 0x7f9b54074f70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00eaa0 tx=0x7f9b4c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 -- 172.21.15.159:0/545138638 shutdown_connections 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9b400a3440 0x7f9b400a5900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b54106f20 0x7f9b54074f70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b541027a0 0x7f9b54074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 --2- 172.21.15.159:0/545138638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b54101df0 0x7f9b540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 -- 172.21.15.159:0/545138638 >> 172.21.15.159:0/545138638 conn(0x7f9b540fd8f0 msgr2=0x7f9b540fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 -- 172.21.15.159:0/545138638 shutdown_connections 2024-09-19T06:47:51.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:51.352+0000 7f9b59566640 1 -- 172.21.15.159:0/545138638 wait complete. 2024-09-19T06:47:53.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:52 smithi203 ceph-mon[35473]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-19T06:47:53.116 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:47:53.116 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:47:53.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:52 smithi189 ceph-mon[34880]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-19T06:47:53.139 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:52 smithi159 ceph-mon[30935]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-19T06:47:53.206 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:53.435 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:53.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 -- 172.21.15.159:0/3797582455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07c102ef0 msgr2=0x7ff07c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:53.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 --2- 172.21.15.159:0/3797582455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07c102ef0 0x7ff07c10da40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff074009c10 tx=0x7ff07402a770 comp rx=0 tx=0).stop 2024-09-19T06:47:53.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 -- 172.21.15.159:0/3797582455 shutdown_connections 2024-09-19T06:47:53.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 --2- 172.21.15.159:0/3797582455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07c102ef0 0x7ff07c10da40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 --2- 172.21.15.159:0/3797582455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c102570 0x7ff07c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 --2- 172.21.15.159:0/3797582455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff07c100e20 0x7ff07c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 -- 172.21.15.159:0/3797582455 >> 172.21.15.159:0/3797582455 conn(0x7ff07c0fc7d0 msgr2=0x7ff07c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:53.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 -- 172.21.15.159:0/3797582455 shutdown_connections 2024-09-19T06:47:53.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 -- 172.21.15.159:0/3797582455 wait complete. 2024-09-19T06:47:53.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.971+0000 7ff081d08640 1 Processor -- start 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff081d08640 1 -- start start 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff081d08640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07c100e20 0x7ff07c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff081d08640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff07c102570 0x7ff07c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff081d08640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c102ef0 0x7ff07c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff081d08640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c110f80 con 0x7ff07c102ef0 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff081d08640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c110e00 con 0x7ff07c100e20 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff081d08640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c111100 con 0x7ff07c102570 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff07bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c102ef0 0x7ff07c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff07b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07c100e20 0x7ff07c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff07bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c102ef0 0x7ff07c19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49570/0 (socket says 172.21.15.159:49570) 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff07bfff640 1 -- 172.21.15.159:0/297212685 learned_addr learned my addr 172.21.15.159:0/297212685 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:53.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.972+0000 7ff07affd640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff07c102570 0x7ff07c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff07affd640 1 -- 172.21.15.159:0/297212685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07c100e20 msgr2=0x7ff07c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff07affd640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07c100e20 0x7ff07c19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff07affd640 1 -- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c102ef0 msgr2=0x7ff07c19ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff07affd640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c102ef0 0x7ff07c19ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff07affd640 1 -- 172.21.15.159:0/297212685 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07c19f670 con 0x7ff07c102570 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff07bfff640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c102ef0 0x7ff07c19ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff07affd640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff07c102570 0x7ff07c19ac00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff070005fd0 tx=0x7ff07000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff078ff9640 1 -- 172.21.15.159:0/297212685 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07000cd00 con 0x7ff07c102570 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff078ff9640 1 -- 172.21.15.159:0/297212685 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0700035f0 con 0x7ff07c102570 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.973+0000 7ff081d08640 1 -- 172.21.15.159:0/297212685 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07c19f960 con 0x7ff07c102570 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.974+0000 7ff081d08640 1 -- 172.21.15.159:0/297212685 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07c1a7240 con 0x7ff07c102570 2024-09-19T06:47:53.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.974+0000 7ff078ff9640 1 -- 172.21.15.159:0/297212685 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070010670 con 0x7ff07c102570 2024-09-19T06:47:53.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.976+0000 7ff078ff9640 1 -- 172.21.15.159:0/297212685 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7ff070004020 con 0x7ff07c102570 2024-09-19T06:47:53.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.977+0000 7ff078ff9640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff0640a34c0 0x7ff0640a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.977+0000 7ff078ff9640 1 -- 172.21.15.159:0/297212685 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff0700d00d0 con 0x7ff07c102570 2024-09-19T06:47:53.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.977+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff0640a34c0 0x7ff0640a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.977+0000 7ff0840e1740 1 Processor -- start 2024-09-19T06:47:53.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.977+0000 7ff0840e1740 1 -- start start 2024-09-19T06:47:53.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.977+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 0x55d3af8d3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.977+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d4480 0x55d3af8de800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 0x55d3af8e1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff0840e1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d3af839280 con 0x55d3af8d4480 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff0840e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d3af7e0b10 con 0x55d3af8d3b60 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff0840e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d3af835240 con 0x55d3af8ded40 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff07affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d4480 0x55d3af8de800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff07affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d4480 0x55d3af8de800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49574/0 (socket says 172.21.15.159:49574) 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff07affd640 1 -- 172.21.15.159:0/1932668796 learned_addr learned my addr 172.21.15.159:0/1932668796 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff07affd640 1 -- 172.21.15.159:0/1932668796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 msgr2=0x55d3af8e1130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff07affd640 1 --2- 172.21.15.159:0/1932668796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 0x55d3af8e1130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff07affd640 1 -- 172.21.15.159:0/1932668796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 msgr2=0x55d3af8d3f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff07affd640 1 --2- 172.21.15.159:0/1932668796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 0x55d3af8d3f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff07affd640 1 -- 172.21.15.159:0/1932668796 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3af7ed1f0 con 0x55d3af8d4480 2024-09-19T06:47:53.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff07affd640 1 --2- 172.21.15.159:0/1932668796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d4480 0x55d3af8de800 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c6a0 tx=0x7ff07009bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6789314fa1e5a1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff061ffb640 1 -- 172.21.15.159:0/1932668796 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07009c8b0 con 0x55d3af8d4480 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.978+0000 7ff061ffb640 1 -- 172.21.15.159:0/1932668796 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff07009c1b0 con 0x55d3af8d4480 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.979+0000 7ff061ffb640 1 -- 172.21.15.159:0/1932668796 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070098820 con 0x55d3af8d4480 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.979+0000 7ff0840e1740 1 -- 172.21.15.159:0/1932668796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d4480 msgr2=0x55d3af8de800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.979+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1932668796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d4480 0x55d3af8de800 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c6a0 tx=0x7ff07009bcf0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.979+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff0640a34c0 0x7ff0640a5980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00bbe0 tx=0x7ff06c00b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.979+0000 7ff0840e1740 1 -- 172.21.15.159:0/1932668796 shutdown_connections 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.979+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1932668796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 0x55d3af8e1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.979+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1932668796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d4480 0x55d3af8de800 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.979+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1932668796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 0x55d3af8d3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.979+0000 7ff0840e1740 1 -- 172.21.15.159:0/1932668796 >> 172.21.15.159:0/1932668796 conn(0x55d3af8d00f0 msgr2=0x55d3af8d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:53.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.980+0000 7ff0840e1740 1 -- 172.21.15.159:0/1932668796 shutdown_connections 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.980+0000 7ff0840e1740 1 -- 172.21.15.159:0/1932668796 wait complete. 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.980+0000 7ff0840e1740 1 -- start start 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.980+0000 7ff0840e1740 1 Processor -- start 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.980+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 0x55d3af8dbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d4480 0x55d3af8dc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8ded40 0x55d3af8dc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff0840e1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d3af8e1910 con 0x55d3af8ded40 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff0840e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d3af7f3f10 con 0x55d3af8d3b60 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff0840e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d3af8e1a90 con 0x55d3af8d4480 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff0840e1740 10 client.0 _ll_register_callbacks cb 0x55d3af7bca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8ded40 0x55d3af8dc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8ded40 0x55d3af8dc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49576/0 (socket says 172.21.15.159:49576) 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07bfff640 1 -- 172.21.15.159:0/612511617 learned_addr learned my addr 172.21.15.159:0/612511617 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07affd640 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d4480 0x55d3af8dc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 0x55d3af8dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07bfff640 1 -- 172.21.15.159:0/612511617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d4480 msgr2=0x55d3af8dc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07bfff640 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d4480 0x55d3af8dc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07bfff640 1 -- 172.21.15.159:0/612511617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 msgr2=0x55d3af8dbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07bfff640 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 0x55d3af8dbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07bfff640 1 -- 172.21.15.159:0/612511617 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3af5aa6a0 con 0x55d3af8ded40 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 0x55d3af8dbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff07bfff640 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8ded40 0x55d3af8dc6f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff074009b30 tx=0x7ff0740303a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53950d0aeec3c283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.981+0000 7ff05affd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:53.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff05affd640 1 -- 172.21.15.159:0/612511617 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074041030 con 0x55d3af8ded40 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff05affd640 1 -- 172.21.15.159:0/612511617 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff074030510 con 0x55d3af8ded40 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff0840e1740 1 -- 172.21.15.159:0/612511617 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff07009c1b0 con 0x55d3af8ded40 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff05affd640 1 -- 172.21.15.159:0/612511617 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff074036040 con 0x55d3af8ded40 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff0840e1740 10 client.15456 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff0840e1740 1 -- 172.21.15.159:0/612511617 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d3af8f5d60 con 0x55d3af8ded40 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff05affd640 1 -- 172.21.15.159:0/612511617 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff074003e50 con 0x55d3af8ded40 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff05affd640 1 -- 172.21.15.159:0/612511617 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff07403d460 con 0x55d3af8ded40 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff0840e1740 10 client.15456 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff0840e1740 10 client.15456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff0840e1740 20 client.15456 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:53.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff0840e1740 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d3af8f7220 0x55d3af8f9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff0840e1740 4 client.15456 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.982+0000 7ff0840e1740 1 -- 172.21.15.159:0/612511617 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff07009c1b0 con 0x55d3af8f7220 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.983+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d3af8f7220 0x55d3af8f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.983+0000 7ff05affd640 10 client.15456 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.983+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d3af8f7220 0x55d3af8f9640 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=325b11912850fddd server_cookie=c62ad6e4b45c674f in_seq=0 out_seq=0 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff05affd640 1 -- 172.21.15.159:0/612511617 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff07009c1b0 con 0x55d3af8f7220 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff05affd640 10 client.15456 handle_command_reply: tid=0 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 client.15456 shutdown 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 -- 172.21.15.159:0/612511617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8ded40 msgr2=0x55d3af8dc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8ded40 0x55d3af8dc6f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff074009b30 tx=0x7ff0740303a0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 -- 172.21.15.159:0/612511617 shutdown_connections 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d3af8f7220 0x55d3af8f9640 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff05affd640 0 client.15456 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:53.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8ded40 0x55d3af8dc6f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d4480 0x55d3af8dc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 --2- 172.21.15.159:0/612511617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d3b60 0x55d3af8dbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 -- 172.21.15.159:0/612511617 >> 172.21.15.159:0/612511617 conn(0x55d3af8d00f0 msgr2=0x55d3af8cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:53.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 -- 172.21.15.159:0/612511617 shutdown_connections 2024-09-19T06:47:53.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 1 -- 172.21.15.159:0/612511617 wait complete. 2024-09-19T06:47:53.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:53.984+0000 7ff0840e1740 20 client.15456 trim_cache size 0 max 16384 2024-09-19T06:47:54.002 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:54.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.013+0000 7ff0840e1740 1 Processor -- start 2024-09-19T06:47:54.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff0840e1740 1 -- start start 2024-09-19T06:47:54.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d00f0 0x55d3af8d6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:54.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d3b60 0x55d3af8fef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:54.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 0x55d3af8ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff07b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d00f0 0x55d3af8d6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff0840e1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1a9750 con 0x55d3af8d00f0 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff0840e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1abfb0 con 0x55d3af8d4480 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff07b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d00f0 0x55d3af8d6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49584/0 (socket says 172.21.15.159:49584) 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff0840e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1a9da0 con 0x55d3af8d3b60 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff07b7fe640 1 -- 172.21.15.159:0/1598325468 learned_addr learned my addr 172.21.15.159:0/1598325468 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.014+0000 7ff07affd640 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d3b60 0x55d3af8fef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff07bfff640 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 0x55d3af8ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff07b7fe640 1 -- 172.21.15.159:0/1598325468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d3b60 msgr2=0x55d3af8fef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d3b60 0x55d3af8fef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff07b7fe640 1 -- 172.21.15.159:0/1598325468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 msgr2=0x55d3af8ff480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:54.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 0x55d3af8ff480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff07b7fe640 1 -- 172.21.15.159:0/1598325468 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3af8ca680 con 0x55d3af8d00f0 2024-09-19T06:47:54.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff07affd640 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d3b60 0x55d3af8fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:54.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d00f0 0x55d3af8d6610 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff06c010860 tx=0x7ff06c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08eac37cb61d69b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:54.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff0617fa640 1 -- 172.21.15.159:0/1598325468 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c005020 con 0x55d3af8d00f0 2024-09-19T06:47:54.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff0617fa640 1 -- 172.21.15.159:0/1598325468 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff06c0047a0 con 0x55d3af8d00f0 2024-09-19T06:47:54.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.015+0000 7ff0617fa640 1 -- 172.21.15.159:0/1598325468 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c01f760 con 0x55d3af8d00f0 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.016+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598325468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d00f0 msgr2=0x55d3af8d6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.016+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d00f0 0x55d3af8d6610 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff06c010860 tx=0x7ff06c013000 comp rx=0 tx=0).stop 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.017+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598325468 shutdown_connections 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.017+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 0x55d3af8ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.017+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8d3b60 0x55d3af8fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.017+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598325468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d00f0 0x55d3af8d6610 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.017+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598325468 >> 172.21.15.159:0/1598325468 conn(0x55d3af8d7660 msgr2=0x55d3af8ddbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.017+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598325468 shutdown_connections 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.017+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598325468 wait complete. 2024-09-19T06:47:54.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.017+0000 7ff0840e1740 1 -- start start 2024-09-19T06:47:54.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff0840e1740 1 Processor -- start 2024-09-19T06:47:54.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d3b60 0x55d3af8eb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:54.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 0x55d3af8eba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:54.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff0840e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 0x55d3af8ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:54.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff0840e1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1aa470 con 0x55d3af8d3b60 2024-09-19T06:47:54.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff0840e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1ab8e0 con 0x55d3af8d4480 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff0840e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1aab40 con 0x55d3af8ded40 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff07b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d3b60 0x55d3af8eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff0840e1740 10 client.0 _ll_register_callbacks cb 0x7ff07402af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff07b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d3b60 0x55d3af8eb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49594/0 (socket says 172.21.15.159:49594) 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff07b7fe640 1 -- 172.21.15.159:0/1598157556 learned_addr learned my addr 172.21.15.159:0/1598157556 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff07affd640 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 0x55d3af8eba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.018+0000 7ff07bfff640 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 0x55d3af8ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff07affd640 1 -- 172.21.15.159:0/1598157556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 msgr2=0x55d3af8ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff07affd640 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 0x55d3af8ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff07affd640 1 -- 172.21.15.159:0/1598157556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d3b60 msgr2=0x55d3af8eb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff07affd640 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d3b60 0x55d3af8eb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff07affd640 1 -- 172.21.15.159:0/1598157556 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3af9611e0 con 0x55d3af8d4480 2024-09-19T06:47:54.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d3b60 0x55d3af8eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:54.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff07bfff640 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 0x55d3af8ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:54.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff07affd640 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 0x55d3af8eba40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff070098b80 tx=0x7ff0700b5210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=857ec48f753c9475 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:54.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff05affd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:47:54.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff05affd640 1 -- 172.21.15.159:0/1598157556 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0700ba020 con 0x55d3af8d4480 2024-09-19T06:47:54.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff05affd640 1 -- 172.21.15.159:0/1598157556 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff0700bc0c0 con 0x55d3af8d4480 2024-09-19T06:47:54.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.019+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598157556 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff06c0047a0 con 0x55d3af8d4480 2024-09-19T06:47:54.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.020+0000 7ff05affd640 1 -- 172.21.15.159:0/1598157556 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff07009c1b0 con 0x55d3af8d4480 2024-09-19T06:47:54.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.020+0000 7ff0840e1740 10 client.25028 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:54.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.020+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598157556 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d3af962520 con 0x55d3af8d4480 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.020+0000 7ff05affd640 1 -- 172.21.15.159:0/1598157556 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff06c0047a0 con 0x55d3af8d4480 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.021+0000 7ff05affd640 1 -- 172.21.15.159:0/1598157556 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff0700cd980 con 0x55d3af8d4480 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.021+0000 7ff0840e1740 10 client.25028 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.021+0000 7ff0840e1740 10 client.25028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.021+0000 7ff0840e1740 20 client.25028 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.021+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d3af8f7220 0x55d3af964810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.021+0000 7ff0840e1740 4 client.25028 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.021+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598157556 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d3af8467f0 con 0x55d3af8f7220 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.022+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d3af8f7220 0x55d3af964810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:54.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.022+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d3af8f7220 0x55d3af964810 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=113ae27e1cec45bf server_cookie=895c0bf24ebaa264 in_seq=0 out_seq=0 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.022+0000 7ff05affd640 10 client.25028 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.023+0000 7ff05affd640 1 -- 172.21.15.159:0/1598157556 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d3af8467f0 con 0x55d3af8f7220 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.023+0000 7ff05affd640 10 client.25028 handle_command_reply: tid=0 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.023+0000 7ff0840e1740 1 client.25028 shutdown 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598157556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 msgr2=0x55d3af8eba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 0x55d3af8eba40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff070098b80 tx=0x7ff0700b5210 comp rx=0 tx=0).stop 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598157556 shutdown_connections 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d3af8f7220 0x55d3af964810 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3af8ded40 0x55d3af8ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3af8d4480 0x55d3af8eba40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 --2- 172.21.15.159:0/1598157556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d3af8d3b60 0x55d3af8eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598157556 >> 172.21.15.159:0/1598157556 conn(0x55d3af8d7660 msgr2=0x55d3af8f23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:54.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff05affd640 0 client.25028 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:54.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598157556 shutdown_connections 2024-09-19T06:47:54.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.024+0000 7ff0840e1740 1 -- 172.21.15.159:0/1598157556 wait complete. 2024-09-19T06:47:54.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.025+0000 7ff0840e1740 20 client.25028 trim_cache size 0 max 16384 2024-09-19T06:47:54.027 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:47:54.028 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:47:54.028 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "6dba7b6b-479a-475d-b9f0-93213cf9cf86", 2024-09-19T06:47:54.028 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:47:54.028 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:47:54.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.025+0000 7ff081d08640 1 -- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff0640a34c0 msgr2=0x7ff0640a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:54.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.025+0000 7ff081d08640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff0640a34c0 0x7ff0640a5980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00bbe0 tx=0x7ff06c00b390 comp rx=0 tx=0).stop 2024-09-19T06:47:54.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.025+0000 7ff081d08640 1 -- 172.21.15.159:0/297212685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff07c102570 msgr2=0x7ff07c19ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:54.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.025+0000 7ff081d08640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff07c102570 0x7ff07c19ac00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff070005fd0 tx=0x7ff07000ee50 comp rx=0 tx=0).stop 2024-09-19T06:47:54.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.026+0000 7ff081d08640 1 -- 172.21.15.159:0/297212685 shutdown_connections 2024-09-19T06:47:54.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.026+0000 7ff081d08640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff0640a34c0 0x7ff0640a5980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.026+0000 7ff081d08640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c102ef0 0x7ff07c19ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.026+0000 7ff081d08640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff07c102570 0x7ff07c19ac00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.026+0000 7ff081d08640 1 --2- 172.21.15.159:0/297212685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff07c100e20 0x7ff07c19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.026+0000 7ff081d08640 1 -- 172.21.15.159:0/297212685 >> 172.21.15.159:0/297212685 conn(0x7ff07c0fc7d0 msgr2=0x7ff07c06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:54.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.026+0000 7ff081d08640 1 -- 172.21.15.159:0/297212685 shutdown_connections 2024-09-19T06:47:54.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:54.026+0000 7ff081d08640 1 -- 172.21.15.159:0/297212685 wait complete. 2024-09-19T06:47:54.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:54 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:47:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:54 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:54 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:47:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:54 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:54 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:47:54.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:54 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:47:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:54 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:54 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:47:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:54 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:54 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:47:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:54 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:47:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:54 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:54 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:47:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:54 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:54 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:47:55.095 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:47:55.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.301+0000 7f7d203dd640 1 -- 172.21.15.159:0/332351507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d18074ee0 msgr2=0x7f7d1810def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:55.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.301+0000 7f7d203dd640 1 --2- 172.21.15.159:0/332351507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d18074ee0 0x7f7d1810def0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009900 tx=0x7f7d0802a480 comp rx=0 tx=0).stop 2024-09-19T06:47:55.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.301+0000 7f7d203dd640 1 -- 172.21.15.159:0/332351507 shutdown_connections 2024-09-19T06:47:55.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.301+0000 7f7d203dd640 1 --2- 172.21.15.159:0/332351507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d1810e430 0x7f7d18110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.301+0000 7f7d203dd640 1 --2- 172.21.15.159:0/332351507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d18074ee0 0x7f7d1810def0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.301+0000 7f7d203dd640 1 --2- 172.21.15.159:0/332351507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d180745c0 0x7f7d180749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.301+0000 7f7d203dd640 1 -- 172.21.15.159:0/332351507 >> 172.21.15.159:0/332351507 conn(0x7f7d180fd8f0 msgr2=0x7f7d180ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:55.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.302+0000 7f7d203dd640 1 -- 172.21.15.159:0/332351507 shutdown_connections 2024-09-19T06:47:55.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.302+0000 7f7d203dd640 1 -- 172.21.15.159:0/332351507 wait complete. 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.302+0000 7f7d203dd640 1 Processor -- start 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d203dd640 1 -- start start 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d203dd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d180745c0 0x7f7d181a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d203dd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18074ee0 0x7f7d181a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d203dd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d1810e430 0x7f7d1819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d203dd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181141e0 con 0x7f7d180745c0 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d203dd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18114060 con 0x7f7d18074ee0 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d203dd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18114360 con 0x7f7d1810e430 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d1e179640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d180745c0 0x7f7d181a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d1e179640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d180745c0 0x7f7d181a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49620/0 (socket says 172.21.15.159:49620) 2024-09-19T06:47:55.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d1e179640 1 -- 172.21.15.159:0/2040679267 learned_addr learned my addr 172.21.15.159:0/2040679267 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d1d978640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18074ee0 0x7f7d181a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.303+0000 7f7d1e97a640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d1810e430 0x7f7d1819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d1e179640 1 -- 172.21.15.159:0/2040679267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d1810e430 msgr2=0x7f7d1819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d1e179640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d1810e430 0x7f7d1819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d1e179640 1 -- 172.21.15.159:0/2040679267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18074ee0 msgr2=0x7f7d181a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d1e179640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18074ee0 0x7f7d181a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d1e179640 1 -- 172.21.15.159:0/2040679267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1819ace0 con 0x7f7d180745c0 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d1e179640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d180745c0 0x7f7d181a03f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400d950 tx=0x7f7d1400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d0f7fe640 1 -- 172.21.15.159:0/2040679267 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14017070 con 0x7f7d180745c0 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d0f7fe640 1 -- 172.21.15.159:0/2040679267 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d14009c30 con 0x7f7d180745c0 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1819afd0 con 0x7f7d180745c0 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d181a72c0 con 0x7f7d180745c0 2024-09-19T06:47:55.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.304+0000 7f7d0f7fe640 1 -- 172.21.15.159:0/2040679267 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400f6b0 con 0x7f7d180745c0 2024-09-19T06:47:55.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.306+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cfc005290 con 0x7f7d180745c0 2024-09-19T06:47:55.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.307+0000 7f7d0f7fe640 1 -- 172.21.15.159:0/2040679267 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f7d1400f850 con 0x7f7d180745c0 2024-09-19T06:47:55.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.308+0000 7f7d0f7fe640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d040a3440 0x7f7d040a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:55.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.308+0000 7f7d0f7fe640 1 -- 172.21.15.159:0/2040679267 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f7d140cfcc0 con 0x7f7d180745c0 2024-09-19T06:47:55.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.308+0000 7f7d1d978640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d040a3440 0x7f7d040a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:55.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.309+0000 7f7d1d978640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d040a3440 0x7f7d040a5900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009230 tx=0x7f7d080058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:55.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.315+0000 7f7d0f7fe640 1 -- 172.21.15.159:0/2040679267 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d14009de0 con 0x7f7d180745c0 2024-09-19T06:47:55.421 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:55.628 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:55 smithi159 ceph-mon[30935]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T06:47:55.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.699+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cfc005850 con 0x7f7d180745c0 2024-09-19T06:47:55.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.700+0000 7f7d0f7fe640 1 -- 172.21.15.159:0/2040679267 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f7d14086020 con 0x7f7d180745c0 2024-09-19T06:47:55.702 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:55.702 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:47:55.702 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:47:55.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d040a3440 msgr2=0x7f7d040a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:55.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d040a3440 0x7f7d040a5900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009230 tx=0x7f7d080058d0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d180745c0 msgr2=0x7f7d181a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:55.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d180745c0 0x7f7d181a03f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400d950 tx=0x7f7d1400de10 comp rx=0 tx=0).stop 2024-09-19T06:47:55.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 shutdown_connections 2024-09-19T06:47:55.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d040a3440 0x7f7d040a5900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d1810e430 0x7f7d1819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d18074ee0 0x7f7d181a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 --2- 172.21.15.159:0/2040679267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d180745c0 0x7f7d181a03f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:55.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 >> 172.21.15.159:0/2040679267 conn(0x7f7d180fd8f0 msgr2=0x7f7d180fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:55.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.703+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 shutdown_connections 2024-09-19T06:47:55.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:55.704+0000 7f7d203dd640 1 -- 172.21.15.159:0/2040679267 wait complete. 2024-09-19T06:47:55.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:55 smithi203 ceph-mon[35473]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T06:47:55.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:55 smithi189 ceph-mon[34880]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.180+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/1440020764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d68100e20 msgr2=0x7f9d68101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.180+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/1440020764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d68100e20 0x7f9d68101200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009900 tx=0x7f9d5802a480 comp rx=0 tx=0).stop 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.180+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/1440020764 shutdown_connections 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.180+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/1440020764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d68102ef0 0x7f9d6810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.180+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/1440020764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d68102570 0x7f9d681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.180+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/1440020764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d68100e20 0x7f9d68101200 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.180+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/1440020764 >> 172.21.15.159:0/1440020764 conn(0x7f9d680fc7d0 msgr2=0x7f9d680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.180+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/1440020764 shutdown_connections 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.180+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/1440020764 wait complete. 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.181+0000 7f9d6d1ed640 1 Processor -- start 2024-09-19T06:47:56.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.181+0000 7f9d6d1ed640 1 -- start start 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.181+0000 7f9d6d1ed640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d68100e20 0x7f9d68197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.181+0000 7f9d6d1ed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d68102570 0x7f9d681978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6d1ed640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d68102ef0 0x7f9d6819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6d1ed640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9d68110f50 con 0x7f9d68102ef0 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6d1ed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d68110dd0 con 0x7f9d68102570 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6d1ed640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681110d0 con 0x7f9d68100e20 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d68102570 0x7f9d681978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d68102ef0 0x7f9d6819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d66d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d68100e20 0x7f9d68197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d68102570 0x7f9d681978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:56772/0 (socket says 172.21.15.159:56772) 2024-09-19T06:47:56.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6659c640 1 -- 172.21.15.159:0/3851951488 learned_addr learned my addr 172.21.15.159:0/3851951488 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6759e640 1 -- 172.21.15.159:0/3851951488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d68100e20 msgr2=0x7f9d68197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6759e640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d68100e20 0x7f9d68197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6759e640 1 -- 172.21.15.159:0/3851951488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d68102570 msgr2=0x7f9d681978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6759e640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d68102570 0x7f9d681978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6759e640 1 -- 172.21.15.159:0/3851951488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6819c340 con 0x7f9d68102ef0 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.182+0000 7f9d6759e640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d68102ef0 0x7f9d6819bc60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9d60007ef0 tx=0x7f9d6000a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.183+0000 7f9d4ffff640 1 -- 172.21.15.159:0/3851951488 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60013d70 con 0x7f9d68102ef0 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.183+0000 7f9d4ffff640 1 -- 172.21.15.159:0/3851951488 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d6000ae40 con 0x7f9d68102ef0 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.183+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/3851951488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6819c630 con 0x7f9d68102ef0 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.183+0000 7f9d4ffff640 1 -- 172.21.15.159:0/3851951488 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6000e3b0 con 0x7f9d68102ef0 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.183+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/3851951488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d68069f70 con 0x7f9d68102ef0 2024-09-19T06:47:56.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.185+0000 7f9d6f5c6740 1 Processor -- start 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d4ffff640 1 -- 172.21.15.159:0/3851951488 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f9d6000a960 con 0x7f9d68102ef0 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d6f5c6740 1 -- start start 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x560919283880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919290a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5609191e92e0 con 0x56091928e680 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560919190ce0 con 0x560919283dc0 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5609191e52a0 con 0x5609192834a0 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d66d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d66d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:56782/0 (socket says 172.21.15.159:56782) 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d66d9d640 1 -- 172.21.15.159:0/4092036784 learned_addr learned my addr 172.21.15.159:0/4092036784 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d6659c640 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919290a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.187+0000 7f9d6659c640 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x560919283880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d66d9d640 1 -- 172.21.15.159:0/4092036784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 msgr2=0x560919283880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x560919283880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d66d9d640 1 -- 172.21.15.159:0/4092036784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 msgr2=0x560919290a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919290a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d66d9d640 1 -- 172.21.15.159:0/4092036784 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560919175440 con 0x560919283dc0 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d4ffff640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9d500a34c0 0x7f9d500a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d6659c640 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x560919283880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d6659c640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9d500a34c0 0x7f9d500a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d4ffff640 1 -- 172.21.15.159:0/3851951488 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f9d600d4550 con 0x7f9d68102ef0 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928e140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009900 tx=0x7f9d58004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e8ceca5f213884 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d6659c640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9d500a34c0 0x7f9d500a5980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x560919280db0 tx=0x7f9d5c00b830 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.188+0000 7f9d4d7fa640 1 -- 172.21.15.159:0/4092036784 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58035030 con 0x560919283dc0 2024-09-19T06:47:56.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d4d7fa640 1 -- 172.21.15.159:0/4092036784 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d58040070 con 0x560919283dc0 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d4d7fa640 1 -- 172.21.15.159:0/4092036784 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58031ad0 con 0x560919283dc0 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/4092036784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 msgr2=0x56091928e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928e140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009900 tx=0x7f9d58004170 comp rx=0 tx=0).stop 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/4092036784 shutdown_connections 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919290a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928e140 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/4092036784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x560919283880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/4092036784 >> 172.21.15.159:0/4092036784 conn(0x56091927fa30 msgr2=0x56091927fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.189+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/4092036784 shutdown_connections 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.190+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/4092036784 wait complete. 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.190+0000 7f9d6f5c6740 1 -- start start 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.190+0000 7f9d6f5c6740 1 Processor -- start 2024-09-19T06:47:56.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.190+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x56091928dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.190+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.190+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x56091928b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.190+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x560919291250 con 0x56091928e680 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.190+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609191a4050 con 0x560919283dc0 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.190+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5609192913d0 con 0x5609192834a0 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6f5c6740 10 client.0 _ll_register_callbacks cb 0x5609191e4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:56794/0 (socket says 172.21.15.159:56794) 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6659c640 1 -- 172.21.15.159:0/1161753697 learned_addr learned my addr 172.21.15.159:0/1161753697 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x56091928dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6759e640 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x56091928b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6659c640 1 -- 172.21.15.159:0/1161753697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 msgr2=0x56091928dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6659c640 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x56091928dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6659c640 1 -- 172.21.15.159:0/1161753697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 msgr2=0x56091928b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6659c640 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x56091928b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6659c640 1 -- 172.21.15.159:0/1161753697 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560918f5a3c0 con 0x560919283dc0 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6759e640 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x56091928b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d6659c640 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928b2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c011990 tx=0x7f9d5c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8163c4367440a9df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.191+0000 7f9d4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.192+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1161753697 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c021d40 con 0x560919283dc0 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.192+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1161753697 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f9d5c004030 con 0x560919283dc0 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.192+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1161753697 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d58040070 con 0x560919283dc0 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.192+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1161753697 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9d5c004230 con 0x560919283dc0 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.192+0000 7f9d6f5c6740 10 client.25043 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:56.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.192+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1161753697 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56091929cc80 con 0x560919283dc0 2024-09-19T06:47:56.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.192+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1161753697 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d58040070 con 0x560919283dc0 2024-09-19T06:47:56.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.193+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1161753697 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9d5c031070 con 0x560919283dc0 2024-09-19T06:47:56.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.193+0000 7f9d6f5c6740 10 client.25043 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:56.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.193+0000 7f9d6f5c6740 10 client.25043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:56.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.193+0000 7f9d6f5c6740 20 client.25043 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:56.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.193+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56091929e140 0x5609192a0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.193+0000 7f9d6f5c6740 4 client.25043 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.193+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1161753697 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609191f6850 con 0x56091929e140 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.193+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56091929e140 0x5609192a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.194+0000 7f9d4aff5640 10 client.25043 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.194+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56091929e140 0x5609192a0550 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd9701c833933f2f server_cookie=4b57b925ab1b0938 in_seq=0 out_seq=0 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.194+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1161753697 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609191f6850 con 0x56091929e140 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.194+0000 7f9d4aff5640 10 client.25043 handle_command_reply: tid=0 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.194+0000 7f9d6f5c6740 1 client.25043 shutdown 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.194+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1161753697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 msgr2=0x56091928b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.194+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928b2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c011990 tx=0x7f9d5c004730 comp rx=0 tx=0).stop 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.194+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1161753697 shutdown_connections 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.194+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56091929e140 0x5609192a0550 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.195+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x56091928b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.195+0000 7f9d4aff5640 0 client.25043 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:56.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.195+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560919283dc0 0x56091928b2a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.195+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1161753697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x56091928dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.195+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1161753697 >> 172.21.15.159:0/1161753697 conn(0x56091927fa30 msgr2=0x560919285710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.195+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1161753697 shutdown_connections 2024-09-19T06:47:56.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.195+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1161753697 wait complete. 2024-09-19T06:47:56.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.195+0000 7f9d6f5c6740 20 client.25043 trim_cache size 0 max 16384 2024-09-19T06:47:56.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.213+0000 7f9d6f5c6740 1 Processor -- start 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.213+0000 7f9d6f5c6740 1 -- start start 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.213+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x56091929a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.213+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560919283dc0 0x5609192a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.213+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56091928e680 0x5609192a6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.213+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681a96b0 con 0x560919283dc0 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.213+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681abf30 con 0x56091928e680 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.213+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681a9d20 con 0x5609192834a0 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560919283dc0 0x5609192a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560919283dc0 0x5609192a5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49670/0 (socket says 172.21.15.159:49670) 2024-09-19T06:47:56.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d6659c640 1 -- 172.21.15.159:0/1371232378 learned_addr learned my addr 172.21.15.159:0/1371232378 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:56.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/1371232378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x56091929a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d6659c640 1 -- 172.21.15.159:0/1371232378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 msgr2=0x56091929a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d6659c640 1 --2- 172.21.15.159:0/1371232378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x56091929a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d6659c640 1 -- 172.21.15.159:0/1371232378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56091928e680 msgr2=0x5609192a6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d6659c640 1 --2- 172.21.15.159:0/1371232378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56091928e680 0x5609192a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d6659c640 1 -- 172.21.15.159:0/1371232378 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56091928bb70 con 0x560919283dc0 2024-09-19T06:47:56.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d6659c640 1 --2- 172.21.15.159:0/1371232378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560919283dc0 0x5609192a5e20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c01f570 tx=0x7f9d5c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab804a9c3966f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d4cff9640 1 -- 172.21.15.159:0/1371232378 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c03f070 con 0x560919283dc0 2024-09-19T06:47:56.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d4cff9640 1 -- 172.21.15.159:0/1371232378 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d5c00be20 con 0x560919283dc0 2024-09-19T06:47:56.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.214+0000 7f9d4cff9640 1 -- 172.21.15.159:0/1371232378 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c037070 con 0x560919283dc0 2024-09-19T06:47:56.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.215+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1371232378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560919283dc0 msgr2=0x5609192a5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.215+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1371232378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560919283dc0 0x5609192a5e20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c01f570 tx=0x7f9d5c00bd50 comp rx=0 tx=0).stop 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.215+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1371232378 shutdown_connections 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.215+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1371232378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56091928e680 0x5609192a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.215+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1371232378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560919283dc0 0x5609192a5e20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.215+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1371232378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609192834a0 0x56091929a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.215+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1371232378 >> 172.21.15.159:0/1371232378 conn(0x56091927fa30 msgr2=0x560919286900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.215+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1371232378 shutdown_connections 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.215+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1371232378 wait complete. 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6f5c6740 1 -- start start 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6f5c6740 1 Processor -- start 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609192834a0 0x5609192926a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560919283dc0 0x560919292be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6f5c6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919307df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681aa3f0 con 0x56091928e680 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681ab860 con 0x5609192834a0 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6f5c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681aaac0 con 0x560919283dc0 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6f5c6740 10 client.0 _ll_register_callbacks cb 0x7f9d5c00baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919307df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919307df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49682/0 (socket says 172.21.15.159:49682) 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6759e640 1 -- 172.21.15.159:0/1180057282 learned_addr learned my addr 172.21.15.159:0/1180057282 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.216+0000 7f9d6659c640 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560919283dc0 0x560919292be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609192834a0 0x5609192926a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d6759e640 1 -- 172.21.15.159:0/1180057282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560919283dc0 msgr2=0x560919292be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d6759e640 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560919283dc0 0x560919292be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d6759e640 1 -- 172.21.15.159:0/1180057282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609192834a0 msgr2=0x5609192926a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d6759e640 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609192834a0 0x5609192926a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d6759e640 1 -- 172.21.15.159:0/1180057282 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560919293470 con 0x56091928e680 2024-09-19T06:47:56.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d6759e640 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919307df0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9d6009d0c0 tx=0x7f9d600a01d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e79c00a1c807ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:56.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1180057282 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600a9300 con 0x56091928e680 2024-09-19T06:47:56.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1180057282 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f9d600a8e70 con 0x56091928e680 2024-09-19T06:47:56.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1180057282 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5609191f0d60 con 0x56091928e680 2024-09-19T06:47:56.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1180057282 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9d6000ac50 con 0x56091928e680 2024-09-19T06:47:56.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d6f5c6740 10 client.15486 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:56.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.217+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1180057282 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560919309470 con 0x56091928e680 2024-09-19T06:47:56.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.218+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1180057282 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d600a9070 con 0x56091928e680 2024-09-19T06:47:56.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.218+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1180057282 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9d6009c490 con 0x56091928e680 2024-09-19T06:47:56.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.218+0000 7f9d6f5c6740 10 client.15486 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:56.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.218+0000 7f9d6f5c6740 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:47:56.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.218+0000 7f9d6f5c6740 20 client.15486 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:56.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.218+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560919309be0 0x56091930bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.218+0000 7f9d6f5c6740 4 client.15486 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.218+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1180057282 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5609191f0d60 con 0x560919309be0 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560919309be0 0x56091930bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d4aff5640 10 client.15486 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d66d9d640 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560919309be0 0x56091930bfd0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff19879c4dca208b server_cookie=71ece47ea768852b in_seq=0 out_seq=0 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d4aff5640 1 -- 172.21.15.159:0/1180057282 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5609191f0d60 con 0x560919309be0 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d4aff5640 10 client.15486 handle_command_reply: tid=0 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d6f5c6740 1 client.15486 shutdown 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1180057282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 msgr2=0x560919307df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919307df0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9d6009d0c0 tx=0x7f9d600a01d0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1180057282 shutdown_connections 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560919309be0 0x56091930bfd0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56091928e680 0x560919307df0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d4aff5640 0 client.15486 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560919283dc0 0x560919292be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d6f5c6740 1 --2- 172.21.15.159:0/1180057282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609192834a0 0x5609192926a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.219+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1180057282 >> 172.21.15.159:0/1180057282 conn(0x56091927fa30 msgr2=0x56091927e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1180057282 shutdown_connections 2024-09-19T06:47:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6f5c6740 1 -- 172.21.15.159:0/1180057282 wait complete. 2024-09-19T06:47:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6f5c6740 20 client.15486 trim_cache size 0 max 16384 2024-09-19T06:47:56.227 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:47:56.227 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:47:56.227 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:47:56.228 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:47:56.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9d500a34c0 msgr2=0x7f9d500a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9d500a34c0 0x7f9d500a5980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x560919280db0 tx=0x7f9d5c00b830 comp rx=0 tx=0).stop 2024-09-19T06:47:56.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d68102ef0 msgr2=0x7f9d6819bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d68102ef0 0x7f9d6819bc60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9d60007ef0 tx=0x7f9d6000a250 comp rx=0 tx=0).stop 2024-09-19T06:47:56.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/3851951488 shutdown_connections 2024-09-19T06:47:56.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9d500a34c0 0x7f9d500a5980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d68102ef0 0x7f9d6819bc60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d68102570 0x7f9d681978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 --2- 172.21.15.159:0/3851951488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d68100e20 0x7f9d68197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.220+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/3851951488 >> 172.21.15.159:0/3851951488 conn(0x7f9d680fc7d0 msgr2=0x7f9d680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.221+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/3851951488 shutdown_connections 2024-09-19T06:47:56.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:56.221+0000 7f9d6d1ed640 1 -- 172.21.15.159:0/3851951488 wait complete. 2024-09-19T06:47:56.684 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id 9a727710 --release --await' 2024-09-19T06:47:56.684 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id 9a727710 --release --await 2024-09-19T06:47:56.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:56 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2040679267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:56.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:56 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2040679267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:56.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:56 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2040679267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:57.346 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:47:57.346 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:57.481 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:57.613 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:57 smithi159 ceph-mon[30935]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-19T06:47:57.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:57 smithi203 ceph-mon[35473]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-19T06:47:57.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:57 smithi189 ceph-mon[34880]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-19T06:47:58.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.050+0000 7fa1acf79640 1 -- 172.21.15.159:0/349195340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a8100860 msgr2=0x7fa1a81045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:58.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.050+0000 7fa1acf79640 1 --2- 172.21.15.159:0/349195340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a8100860 0x7fa1a81045a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009900 tx=0x7fa19c02a410 comp rx=0 tx=0).stop 2024-09-19T06:47:58.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.051+0000 7fa1acf79640 1 -- 172.21.15.159:0/349195340 shutdown_connections 2024-09-19T06:47:58.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.051+0000 7fa1acf79640 1 --2- 172.21.15.159:0/349195340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a8100860 0x7fa1a81045a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.051+0000 7fa1acf79640 1 --2- 172.21.15.159:0/349195340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a8107440 0x7fa1a8100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.051+0000 7fa1acf79640 1 --2- 172.21.15.159:0/349195340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa1a8106a90 0x7fa1a8106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.051+0000 7fa1acf79640 1 -- 172.21.15.159:0/349195340 >> 172.21.15.159:0/349195340 conn(0x7fa1a8077230 msgr2=0x7fa1a80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:58.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.051+0000 7fa1acf79640 1 -- 172.21.15.159:0/349195340 shutdown_connections 2024-09-19T06:47:58.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.051+0000 7fa1acf79640 1 -- 172.21.15.159:0/349195340 wait complete. 2024-09-19T06:47:58.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1acf79640 1 Processor -- start 2024-09-19T06:47:58.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1acf79640 1 -- start start 2024-09-19T06:47:58.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1acf79640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a8100860 0x7fa1a81155e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1acf79640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa1a8106a90 0x7fa1a8115b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1acf79640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a810e780 0x7fa1a810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1acf79640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a81185d0 con 0x7fa1a810e780 2024-09-19T06:47:58.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1acf79640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a8118450 con 0x7fa1a8106a90 2024-09-19T06:47:58.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1acf79640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a8118750 con 0x7fa1a8100860 2024-09-19T06:47:58.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1a6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a810e780 0x7fa1a810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1a6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a810e780 0x7fa1a810ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49690/0 (socket says 172.21.15.159:49690) 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.052+0000 7fa1a6d9d640 1 -- 172.21.15.159:0/3412901868 learned_addr learned my addr 172.21.15.159:0/3412901868 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.053+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a8100860 0x7fa1a81155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.053+0000 7fa1a659c640 1 -- 172.21.15.159:0/3412901868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa1a8106a90 msgr2=0x7fa1a8115b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.053+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa1a8106a90 0x7fa1a8115b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.053+0000 7fa1a659c640 1 -- 172.21.15.159:0/3412901868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a810e780 msgr2=0x7fa1a810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.053+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a810e780 0x7fa1a810ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.053+0000 7fa1a659c640 1 -- 172.21.15.159:0/3412901868 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a8113110 con 0x7fa1a8100860 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.053+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a8100860 0x7fa1a81155e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa19800b3f0 tx=0x7fa19800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.053+0000 7fa1977fe640 1 -- 172.21.15.159:0/3412901868 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa198015020 con 0x7fa1a8100860 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.054+0000 7fa1acf79640 1 -- 172.21.15.159:0/3412901868 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a8113400 con 0x7fa1a8100860 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.054+0000 7fa1acf79640 1 -- 172.21.15.159:0/3412901868 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a8113990 con 0x7fa1a8100860 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.054+0000 7fa1977fe640 1 -- 172.21.15.159:0/3412901868 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa198011d10 con 0x7fa1a8100860 2024-09-19T06:47:58.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.054+0000 7fa1977fe640 1 -- 172.21.15.159:0/3412901868 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19800f2e0 con 0x7fa1a8100860 2024-09-19T06:47:58.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.057+0000 7fa1977fe640 1 -- 172.21.15.159:0/3412901868 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fa198018020 con 0x7fa1a8100860 2024-09-19T06:47:58.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.057+0000 7fa1af352740 1 Processor -- start 2024-09-19T06:47:58.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.058+0000 7fa1af352740 1 -- start start 2024-09-19T06:47:58.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.058+0000 7fa1977fe640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1900a34c0 0x7fa1900a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.058+0000 7fa1af352740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde284c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.058+0000 7fa1af352740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde2856d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.058+0000 7fa1977fe640 1 -- 172.21.15.159:0/3412901868 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa1980cf480 con 0x7fa1a8100860 2024-09-19T06:47:58.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1af352740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde2857240 0x55bde2859630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1af352740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55bde27b1620 con 0x55bde284c060 2024-09-19T06:47:58.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1af352740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bde2758e50 con 0x55bde284c980 2024-09-19T06:47:58.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1af352740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bde27ad5e0 con 0x55bde2857240 2024-09-19T06:47:58.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a6d9d640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1900a34c0 0x7fa1900a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde284c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde284c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49698/0 (socket says 172.21.15.159:49698) 2024-09-19T06:47:58.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a659c640 1 -- 172.21.15.159:0/3587045393 learned_addr learned my addr 172.21.15.159:0/3587045393 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:58.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a5d9b640 1 --2- 172.21.15.159:0/3587045393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde2856d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a659c640 1 -- 172.21.15.159:0/3587045393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde2857240 msgr2=0x55bde2859630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:47:58.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3587045393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde2857240 0x55bde2859630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a659c640 1 -- 172.21.15.159:0/3587045393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 msgr2=0x55bde2856d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:58.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3587045393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde2856d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a659c640 1 -- 172.21.15.159:0/3587045393 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde2749d40 con 0x55bde284c060 2024-09-19T06:47:58.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a6d9d640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1900a34c0 0x7fa1900a5980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0096c0 tx=0x7fa19c005a20 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:58.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.059+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3587045393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde284c440 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa19800bdb0 tx=0x7fa19809b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08af83d0536b118 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:58.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.060+0000 7fa194ff9640 1 -- 172.21.15.159:0/3587045393 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1980b4070 con 0x55bde284c060 2024-09-19T06:47:58.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.060+0000 7fa194ff9640 1 -- 172.21.15.159:0/3587045393 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa19809b6d0 con 0x55bde284c060 2024-09-19T06:47:58.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.061+0000 7fa194ff9640 1 -- 172.21.15.159:0/3587045393 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1980b4070 con 0x55bde284c060 2024-09-19T06:47:58.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.061+0000 7fa1af352740 1 -- 172.21.15.159:0/3587045393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 msgr2=0x55bde284c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:58.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.061+0000 7fa1af352740 1 --2- 172.21.15.159:0/3587045393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde284c440 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa19800bdb0 tx=0x7fa19809b140 comp rx=0 tx=0).stop 2024-09-19T06:47:58.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.061+0000 7fa1af352740 1 -- 172.21.15.159:0/3587045393 shutdown_connections 2024-09-19T06:47:58.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.061+0000 7fa1af352740 1 --2- 172.21.15.159:0/3587045393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde2857240 0x55bde2859630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.061+0000 7fa1af352740 1 --2- 172.21.15.159:0/3587045393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde2856d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.061+0000 7fa1af352740 1 --2- 172.21.15.159:0/3587045393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde284c440 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.061+0000 7fa1af352740 1 -- 172.21.15.159:0/3587045393 >> 172.21.15.159:0/3587045393 conn(0x55bde28485f0 msgr2=0x55bde28489d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:58.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.062+0000 7fa1af352740 1 -- 172.21.15.159:0/3587045393 shutdown_connections 2024-09-19T06:47:58.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.062+0000 7fa1af352740 1 -- 172.21.15.159:0/3587045393 wait complete. 2024-09-19T06:47:58.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.062+0000 7fa1af352740 1 -- start start 2024-09-19T06:47:58.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1af352740 1 Processor -- start 2024-09-19T06:47:58.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1af352740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde28540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1af352740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde2854610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1af352740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde2857240 0x55bde2854b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1af352740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55bde2859e60 con 0x55bde284c060 2024-09-19T06:47:58.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1af352740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bde2739f10 con 0x55bde284c980 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1af352740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bde2859fe0 con 0x55bde2857240 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1a659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde28540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1a659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde28540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49710/0 (socket says 172.21.15.159:49710) 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1a659c640 1 -- 172.21.15.159:0/3471916989 learned_addr learned my addr 172.21.15.159:0/3471916989 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1af352740 10 client.0 _ll_register_callbacks cb 0x55bde275ddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1a659c640 1 -- 172.21.15.159:0/3471916989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde2857240 msgr2=0x55bde2854b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde2857240 0x55bde2854b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1a659c640 1 -- 172.21.15.159:0/3471916989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 msgr2=0x55bde2854610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde2854610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.063+0000 7fa1a659c640 1 -- 172.21.15.159:0/3471916989 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde24c0580 con 0x55bde284c060 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa1a659c640 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde28540d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa1980980a0 tx=0x7fa1980cf410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb40191c8d6373d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa18dffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:58.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa18dffb640 1 -- 172.21.15.159:0/3471916989 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1980b8070 con 0x55bde284c060 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa18dffb640 1 -- 172.21.15.159:0/3471916989 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa19809ab20 con 0x55bde284c060 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa1af352740 1 -- 172.21.15.159:0/3471916989 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa19809b6d0 con 0x55bde284c060 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa18dffb640 1 -- 172.21.15.159:0/3471916989 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa198084050 con 0x55bde284c060 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa1af352740 10 client.15498 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa1af352740 1 -- 172.21.15.159:0/3471916989 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55bde258a960 con 0x55bde284c060 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa18dffb640 1 -- 172.21.15.159:0/3471916989 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa19809b6d0 con 0x55bde284c060 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa18dffb640 1 -- 172.21.15.159:0/3471916989 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa1980ce070 con 0x55bde284c060 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa1af352740 10 client.15498 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa1af352740 10 client.15498 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa1af352740 20 client.15498 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.064+0000 7fa1af352740 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bde2866ef0 0x55bde28693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.065+0000 7fa1af352740 4 client.15498 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:58.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.065+0000 7fa1af352740 1 -- 172.21.15.159:0/3471916989 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bde27beb90 con 0x55bde2866ef0 2024-09-19T06:47:58.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.065+0000 7fa1a5d9b640 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bde2866ef0 0x55bde28693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.066+0000 7fa1a5d9b640 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bde2866ef0 0x55bde28693b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=497b7b71edde56ed server_cookie=49a0833deb8ffc0b in_seq=0 out_seq=0 2024-09-19T06:47:58.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.066+0000 7fa18dffb640 10 client.15498 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa18dffb640 1 -- 172.21.15.159:0/3471916989 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bde27beb90 con 0x55bde2866ef0 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa18dffb640 10 client.15498 handle_command_reply: tid=0 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa1af352740 1 client.15498 shutdown 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa1af352740 1 -- 172.21.15.159:0/3471916989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 msgr2=0x55bde28540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa1af352740 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde28540d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa1980980a0 tx=0x7fa1980cf410 comp rx=0 tx=0).stop 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa1af352740 1 -- 172.21.15.159:0/3471916989 shutdown_connections 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa1af352740 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bde2866ef0 0x55bde28693b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa1af352740 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde2857240 0x55bde2854b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa1af352740 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde2854610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa1af352740 1 --2- 172.21.15.159:0/3471916989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde284c060 0x55bde28540d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa1af352740 1 -- 172.21.15.159:0/3471916989 >> 172.21.15.159:0/3471916989 conn(0x55bde28485f0 msgr2=0x55bde284e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.067+0000 7fa18dffb640 0 client.15498 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:58.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.068+0000 7fa1af352740 1 -- 172.21.15.159:0/3471916989 shutdown_connections 2024-09-19T06:47:58.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.068+0000 7fa1af352740 1 -- 172.21.15.159:0/3471916989 wait complete. 2024-09-19T06:47:58.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.068+0000 7fa1af352740 20 client.15498 trim_cache size 0 max 16384 2024-09-19T06:47:58.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1af352740 1 Processor -- start 2024-09-19T06:47:58.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1af352740 1 -- start start 2024-09-19T06:47:58.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1af352740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c060 0x55bde284eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1af352740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c980 0x55bde284f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1af352740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde2847640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1af352740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa18800c800 con 0x55bde2857240 2024-09-19T06:47:58.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1af352740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa18800f080 con 0x55bde284c060 2024-09-19T06:47:58.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1af352740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa18800ce70 con 0x55bde284c980 2024-09-19T06:47:58.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1a6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde2847640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.095+0000 7fa1a6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde2847640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49722/0 (socket says 172.21.15.159:49722) 2024-09-19T06:47:58.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.096+0000 7fa1a6d9d640 1 -- 172.21.15.159:0/2234436917 learned_addr learned my addr 172.21.15.159:0/2234436917 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:58.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.096+0000 7fa1a659c640 1 --2- 172.21.15.159:0/2234436917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c060 0x55bde284eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.096+0000 7fa1a5d9b640 1 --2- 172.21.15.159:0/2234436917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c980 0x55bde284f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.096+0000 7fa1a6d9d640 1 -- 172.21.15.159:0/2234436917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c980 msgr2=0x55bde284f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:58.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.096+0000 7fa1a6d9d640 1 --2- 172.21.15.159:0/2234436917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c980 0x55bde284f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.096+0000 7fa1a6d9d640 1 -- 172.21.15.159:0/2234436917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c060 msgr2=0x55bde284eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:58.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.096+0000 7fa1a6d9d640 1 --2- 172.21.15.159:0/2234436917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c060 0x55bde284eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.096+0000 7fa1a6d9d640 1 -- 172.21.15.159:0/2234436917 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde2856010 con 0x55bde2857240 2024-09-19T06:47:58.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.096+0000 7fa1a6d9d640 1 --2- 172.21.15.159:0/2234436917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde2847640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa19c006010 tx=0x7fa19c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22d654cdbf8c547 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:58.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.097+0000 7fa18ffff640 1 -- 172.21.15.159:0/2234436917 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c035040 con 0x55bde2857240 2024-09-19T06:47:58.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.097+0000 7fa18ffff640 1 -- 172.21.15.159:0/2234436917 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa19c04e070 con 0x55bde2857240 2024-09-19T06:47:58.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.097+0000 7fa18ffff640 1 -- 172.21.15.159:0/2234436917 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0498a0 con 0x55bde2857240 2024-09-19T06:47:58.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.098+0000 7fa1af352740 1 -- 172.21.15.159:0/2234436917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 msgr2=0x55bde2847640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:58.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.098+0000 7fa1af352740 1 --2- 172.21.15.159:0/2234436917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde2847640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa19c006010 tx=0x7fa19c03d000 comp rx=0 tx=0).stop 2024-09-19T06:47:58.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.098+0000 7fa1af352740 1 -- 172.21.15.159:0/2234436917 shutdown_connections 2024-09-19T06:47:58.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.098+0000 7fa1af352740 1 --2- 172.21.15.159:0/2234436917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde2847640 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.098+0000 7fa1af352740 1 --2- 172.21.15.159:0/2234436917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c980 0x55bde284f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.098+0000 7fa1af352740 1 --2- 172.21.15.159:0/2234436917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c060 0x55bde284eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.098+0000 7fa1af352740 1 -- 172.21.15.159:0/2234436917 >> 172.21.15.159:0/2234436917 conn(0x55bde28485f0 msgr2=0x55bde2846f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:58.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.098+0000 7fa1af352740 1 -- 172.21.15.159:0/2234436917 shutdown_connections 2024-09-19T06:47:58.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.098+0000 7fa1af352740 1 -- 172.21.15.159:0/2234436917 wait complete. 2024-09-19T06:47:58.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.099+0000 7fa1af352740 1 -- start start 2024-09-19T06:47:58.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.099+0000 7fa1af352740 1 Processor -- start 2024-09-19T06:47:58.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.099+0000 7fa1af352740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c060 0x55bde285b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1af352740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde285b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1af352740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde285bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1a659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c060 0x55bde285b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1a659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c060 0x55bde285b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:57124/0 (socket says 172.21.15.159:57124) 2024-09-19T06:47:58.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1a659c640 1 -- 172.21.15.159:0/606885694 learned_addr learned my addr 172.21.15.159:0/606885694 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:58.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1a6d9d640 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde285bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1af352740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa18800d540 con 0x55bde2857240 2024-09-19T06:47:58.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa18800e9b0 con 0x55bde284c980 2024-09-19T06:47:58.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa18800dc10 con 0x55bde284c060 2024-09-19T06:47:58.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1a5d9b640 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde285b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.100+0000 7fa1af352740 10 client.0 _ll_register_callbacks cb 0x7fa198009200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:58.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa1a6d9d640 1 -- 172.21.15.159:0/606885694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c060 msgr2=0x55bde285b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:58.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa1a6d9d640 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c060 0x55bde285b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa1a6d9d640 1 -- 172.21.15.159:0/606885694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 msgr2=0x55bde285b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:58.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa1a6d9d640 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde285b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa1a6d9d640 1 -- 172.21.15.159:0/606885694 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde28d0d90 con 0x55bde2857240 2024-09-19T06:47:58.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa1a5d9b640 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde285b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:58.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa1a6d9d640 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde285bb40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009850 tx=0x7fa19c005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c853d8ca502f665d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:58.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa18dffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa18dffb640 1 -- 172.21.15.159:0/606885694 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c035070 con 0x55bde2857240 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa18dffb640 1 -- 172.21.15.159:0/606885694 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa19c004100 con 0x55bde2857240 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.101+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa19c04e070 con 0x55bde2857240 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa18dffb640 1 -- 172.21.15.159:0/606885694 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa19c004300 con 0x55bde2857240 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa1af352740 10 client.15504 fetch_fsmap learned FSMap version 20 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55bde28d2070 con 0x55bde2857240 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa18dffb640 1 -- 172.21.15.159:0/606885694 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa19c04e070 con 0x55bde2857240 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa18dffb640 1 -- 172.21.15.159:0/606885694 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa19c049a90 con 0x55bde2857240 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa1af352740 10 client.15504 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa1af352740 10 client.15504 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa1af352740 20 client.15504 populate_metadata read hostname 'smithi159' 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa1af352740 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bde28d26e0 0x55bde28d4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:58.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa1af352740 4 client.15504 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9a727710", "release": true, "await": true}] 2024-09-19T06:47:58.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.102+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9a727710", "release": true, "await": true}) -- 0x55bde2843950 con 0x55bde28d26e0 2024-09-19T06:47:58.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.103+0000 7fa1a659c640 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bde28d26e0 0x55bde28d4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:58.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.103+0000 7fa18dffb640 10 client.15504 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:58.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.103+0000 7fa1a659c640 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bde28d26e0 0x55bde28d4ad0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453ac55c95fcafd9 server_cookie=cba04a91e281a590 in_seq=0 out_seq=0 2024-09-19T06:47:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.105+0000 7fa18dffb640 1 -- 172.21.15.159:0/606885694 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55bde2843950 con 0x55bde28d26e0 2024-09-19T06:47:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.105+0000 7fa18dffb640 10 client.15504 handle_command_reply: tid=0 2024-09-19T06:47:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.105+0000 7fa1af352740 1 client.15504 shutdown 2024-09-19T06:47:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.105+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 msgr2=0x55bde285bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde285bb40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009850 tx=0x7fa19c005d70 comp rx=0 tx=0).stop 2024-09-19T06:47:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 shutdown_connections 2024-09-19T06:47:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bde28d26e0 0x55bde28d4ad0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bde2857240 0x55bde285bb40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bde284c980 0x55bde285b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 1 --2- 172.21.15.159:0/606885694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bde284c060 0x55bde285b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 >> 172.21.15.159:0/606885694 conn(0x55bde28485f0 msgr2=0x55bde2847750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa18dffb640 0 client.15504 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 shutdown_connections 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 1 -- 172.21.15.159:0/606885694 wait complete. 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.106+0000 7fa1af352740 20 client.15504 trim_cache size 0 max 16384 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 20, 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 4, 2024-09-19T06:47:58.109 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "9a727710": { 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 4, 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 131.2, 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:47:58.110 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:47:58.111 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:47:58.111 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:58.111 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:58.111 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:58.111 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:58.111 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:47:58.111 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:47:58.111 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 -- 172.21.15.159:0/3412901868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1900a34c0 msgr2=0x7fa1900a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1900a34c0 0x7fa1900a5980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0096c0 tx=0x7fa19c005a20 comp rx=0 tx=0).stop 2024-09-19T06:47:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 -- 172.21.15.159:0/3412901868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a8100860 msgr2=0x7fa1a81155e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a8100860 0x7fa1a81155e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa19800b3f0 tx=0x7fa19800b8b0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 -- 172.21.15.159:0/3412901868 shutdown_connections 2024-09-19T06:47:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa1900a34c0 0x7fa1900a5980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a810e780 0x7fa1a810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa1a8106a90 0x7fa1a8115b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 --2- 172.21.15.159:0/3412901868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a8100860 0x7fa1a81155e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:58.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 -- 172.21.15.159:0/3412901868 >> 172.21.15.159:0/3412901868 conn(0x7fa1a8077230 msgr2=0x7fa1a81026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:58.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 -- 172.21.15.159:0/3412901868 shutdown_connections 2024-09-19T06:47:58.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:58.107+0000 7fa1acf79640 1 -- 172.21.15.159:0/3412901868 wait complete. 2024-09-19T06:47:58.862 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9a727710', total seconds elapsed: 16.8 2024-09-19T06:47:58.963 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:58 smithi159 ceph-mon[30935]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T06:47:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:58 smithi203 ceph-mon[35473]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T06:47:59.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:58 smithi189 ceph-mon[34880]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T06:47:59.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.363+0000 7f5a36be2640 1 -- 172.21.15.159:0/872719361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a301082e0 msgr2=0x7f5a3010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.363+0000 7f5a36be2640 1 --2- 172.21.15.159:0/872719361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a301082e0 0x7f5a3010ec50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009cd0 tx=0x7f5a2802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.363+0000 7f5a36be2640 1 -- 172.21.15.159:0/872719361 shutdown_connections 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.363+0000 7f5a36be2640 1 --2- 172.21.15.159:0/872719361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a301082e0 0x7f5a3010ec50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.363+0000 7f5a36be2640 1 --2- 172.21.15.159:0/872719361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a30103760 0x7f5a30107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.363+0000 7f5a36be2640 1 --2- 172.21.15.159:0/872719361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a30102db0 0x7f5a30103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.363+0000 7f5a36be2640 1 -- 172.21.15.159:0/872719361 >> 172.21.15.159:0/872719361 conn(0x7f5a300fc7d0 msgr2=0x7f5a300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.363+0000 7f5a36be2640 1 -- 172.21.15.159:0/872719361 shutdown_connections 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.363+0000 7f5a36be2640 1 -- 172.21.15.159:0/872719361 wait complete. 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a36be2640 1 Processor -- start 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a36be2640 1 -- start start 2024-09-19T06:47:59.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a36be2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a30102db0 0x7f5a30100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a36be2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a30103760 0x7f5a30100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a36be2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a301082e0 0x7f5a30101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a36be2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5a301120b0 con 0x7f5a30102db0 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a36be2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30111f30 con 0x7f5a30103760 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a36be2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30112230 con 0x7f5a301082e0 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a3497e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a30102db0 0x7f5a30100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a3497e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a30102db0 0x7f5a30100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38742/0 (socket says 172.21.15.159:38742) 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a3497e640 1 -- 172.21.15.159:0/282134961 learned_addr learned my addr 172.21.15.159:0/282134961 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a3517f640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a301082e0 0x7f5a30101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a2ffff640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a30103760 0x7f5a30100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a3497e640 1 -- 172.21.15.159:0/282134961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a301082e0 msgr2=0x7f5a30101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a3497e640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a301082e0 0x7f5a30101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a3497e640 1 -- 172.21.15.159:0/282134961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a30103760 msgr2=0x7f5a30100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a3497e640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a30103760 0x7f5a30100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a3497e640 1 -- 172.21.15.159:0/282134961 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a301a6a70 con 0x7f5a30102db0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.364+0000 7f5a2ffff640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a30103760 0x7f5a30100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.365+0000 7f5a3497e640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a30102db0 0x7f5a30100a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400d950 tx=0x7f5a2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.365+0000 7f5a2dffb640 1 -- 172.21.15.159:0/282134961 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a24017070 con 0x7f5a30102db0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.365+0000 7f5a2dffb640 1 -- 172.21.15.159:0/282134961 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a24009c30 con 0x7f5a30102db0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.365+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a301a6d60 con 0x7f5a30102db0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.365+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a301a71b0 con 0x7f5a30102db0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.365+0000 7f5a2dffb640 1 -- 172.21.15.159:0/282134961 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2400f6b0 con 0x7f5a30102db0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.367+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a30103190 con 0x7f5a30102db0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.368+0000 7f5a2dffb640 1 -- 172.21.15.159:0/282134961 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f5a240109d0 con 0x7f5a30102db0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.369+0000 7f5a2dffb640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a200a34c0 0x7f5a200a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.369+0000 7f5a2ffff640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a200a34c0 0x7f5a200a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.369+0000 7f5a2dffb640 1 -- 172.21.15.159:0/282134961 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f5a240cfb90 con 0x7f5a30102db0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.369+0000 7f5a2ffff640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a200a34c0 0x7f5a200a5980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c005fd0 tx=0x7f5a1c00b5d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:59.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.373+0000 7f5a2dffb640 1 -- 172.21.15.159:0/282134961 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a24009de0 con 0x7f5a30102db0 2024-09-19T06:47:59.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.599+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a3010a2c0 con 0x7f5a30102db0 2024-09-19T06:47:59.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.600+0000 7f5a2dffb640 1 -- 172.21.15.159:0/282134961 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f5a2409c370 con 0x7f5a30102db0 2024-09-19T06:47:59.602 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:47:59.602 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:47:59.602 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:47:59.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a200a34c0 msgr2=0x7f5a200a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:59.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a200a34c0 0x7f5a200a5980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c005fd0 tx=0x7f5a1c00b5d0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a30102db0 msgr2=0x7f5a30100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:59.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a30102db0 0x7f5a30100a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400d950 tx=0x7f5a2400de10 comp rx=0 tx=0).stop 2024-09-19T06:47:59.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 shutdown_connections 2024-09-19T06:47:59.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a200a34c0 0x7f5a200a5980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a301082e0 0x7f5a30101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a30103760 0x7f5a30100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 --2- 172.21.15.159:0/282134961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a30102db0 0x7f5a30100a10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.603+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 >> 172.21.15.159:0/282134961 conn(0x7f5a300fc7d0 msgr2=0x7f5a30105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:59.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.604+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 shutdown_connections 2024-09-19T06:47:59.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:47:59.604+0000 7f5a36be2640 1 -- 172.21.15.159:0/282134961 wait complete. 2024-09-19T06:47:59.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:47:59 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/282134961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:00.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:47:59 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/282134961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:00.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:47:59 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/282134961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:00.261 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:48:00.580 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:00.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:48:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:48:00.300+0000 7f9d08279640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:48:00.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:48:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:48:00.300+0000 7f9d08279640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:48:00.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:48:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:48:00.300+0000 7f9d08279640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:48:00.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:48:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:48:00.300+0000 7f9d08279640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:48:00.648 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:48:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x[31164]: 2024-09-19T06:48:00.300+0000 7f9d08279640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:48:01.033 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:00 smithi159 ceph-mon[30935]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T06:48:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:00 smithi203 ceph-mon[35473]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T06:48:01.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:00 smithi189 ceph-mon[34880]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T06:48:01.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.118+0000 7fa2813db640 1 -- 172.21.15.159:0/4058328090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa27c074e30 msgr2=0x7fa27c10df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:01.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.118+0000 7fa2813db640 1 --2- 172.21.15.159:0/4058328090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa27c074e30 0x7fa27c10df10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa270009900 tx=0x7fa27002a480 comp rx=0 tx=0).stop 2024-09-19T06:48:01.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.118+0000 7fa2813db640 1 -- 172.21.15.159:0/4058328090 shutdown_connections 2024-09-19T06:48:01.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.118+0000 7fa2813db640 1 --2- 172.21.15.159:0/4058328090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa27c10e450 0x7fa27c110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.118+0000 7fa2813db640 1 --2- 172.21.15.159:0/4058328090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa27c074e30 0x7fa27c10df10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.118+0000 7fa2813db640 1 --2- 172.21.15.159:0/4058328090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa27c074510 0x7fa27c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.118+0000 7fa2813db640 1 -- 172.21.15.159:0/4058328090 >> 172.21.15.159:0/4058328090 conn(0x7fa27c0fd8f0 msgr2=0x7fa27c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:01.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.118+0000 7fa2813db640 1 -- 172.21.15.159:0/4058328090 shutdown_connections 2024-09-19T06:48:01.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.118+0000 7fa2813db640 1 -- 172.21.15.159:0/4058328090 wait complete. 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.119+0000 7fa2813db640 1 Processor -- start 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.119+0000 7fa2813db640 1 -- start start 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.119+0000 7fa2813db640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa27c074510 0x7fa27c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa2813db640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa27c074e30 0x7fa27c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa2813db640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa27c10e450 0x7fa27c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa2813db640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c114170 con 0x7fa27c074e30 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa2813db640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c113ff0 con 0x7fa27c074510 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa2813db640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c1142f0 con 0x7fa27c10e450 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27affd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa27c074510 0x7fa27c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa27c074e30 0x7fa27c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27affd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa27c074510 0x7fa27c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:60728/0 (socket says 172.21.15.159:60728) 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27affd640 1 -- 172.21.15.159:0/4140173780 learned_addr learned my addr 172.21.15.159:0/4140173780 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:01.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27b7fe640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa27c10e450 0x7fa27c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27affd640 1 -- 172.21.15.159:0/4140173780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa27c10e450 msgr2=0x7fa27c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27affd640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa27c10e450 0x7fa27c19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27affd640 1 -- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa27c074e30 msgr2=0x7fa27c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27affd640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa27c074e30 0x7fa27c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27affd640 1 -- 172.21.15.159:0/4140173780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c19f6a0 con 0x7fa27c074510 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.120+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa27c074e30 0x7fa27c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.121+0000 7fa27affd640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa27c074510 0x7fa27c19a6f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00d770 tx=0x7fa26c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.121+0000 7fa263fff640 1 -- 172.21.15.159:0/4140173780 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c017070 con 0x7fa27c074510 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.121+0000 7fa263fff640 1 -- 172.21.15.159:0/4140173780 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa26c005500 con 0x7fa27c074510 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.121+0000 7fa2813db640 1 -- 172.21.15.159:0/4140173780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27c19f990 con 0x7fa27c074510 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.122+0000 7fa2813db640 1 -- 172.21.15.159:0/4140173780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27c1a7270 con 0x7fa27c074510 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.122+0000 7fa263fff640 1 -- 172.21.15.159:0/4140173780 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c004e00 con 0x7fa27c074510 2024-09-19T06:48:01.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.124+0000 7fa2837b4740 1 Processor -- start 2024-09-19T06:48:01.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.124+0000 7fa2837b4740 1 -- start start 2024-09-19T06:48:01.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.124+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.124+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b15d0 0x55ccfb8b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.124+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.124+0000 7fa2837b4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ccfb8172f0 con 0x55ccfb8bc370 2024-09-19T06:48:01.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.124+0000 7fa2837b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ccfb7becf0 con 0x55ccfb8b15d0 2024-09-19T06:48:01.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.124+0000 7fa2837b4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ccfb8132b0 con 0x55ccfb8b2b40 2024-09-19T06:48:01.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8be760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38808/0 (socket says 172.21.15.159:38808) 2024-09-19T06:48:01.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27a7fc640 1 -- 172.21.15.159:0/1908391512 learned_addr learned my addr 172.21.15.159:0/1908391512 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:01.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27b7fe640 1 --2- 172.21.15.159:0/1908391512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27b7fe640 1 -- 172.21.15.159:0/1908391512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b15d0 msgr2=0x55ccfb8b1a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:48:01.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27b7fe640 1 --2- 172.21.15.159:0/1908391512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b15d0 0x55ccfb8b1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27b7fe640 1 -- 172.21.15.159:0/1908391512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 msgr2=0x55ccfb8be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:01.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27b7fe640 1 --2- 172.21.15.159:0/1908391512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27b7fe640 1 -- 172.21.15.159:0/1908391512 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccfb7a33a0 con 0x55ccfb8b2b40 2024-09-19T06:48:01.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.125+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/1908391512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:01.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.126+0000 7fa27b7fe640 1 --2- 172.21.15.159:0/1908391512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b1090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0754f0 tx=0x7fa27400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97b32cce89bb0657 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:01.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.126+0000 7fa2617fa640 1 -- 172.21.15.159:0/1908391512 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274004d20 con 0x55ccfb8b2b40 2024-09-19T06:48:01.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.126+0000 7fa2617fa640 1 -- 172.21.15.159:0/1908391512 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa274018920 con 0x55ccfb8b2b40 2024-09-19T06:48:01.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.126+0000 7fa2617fa640 1 -- 172.21.15.159:0/1908391512 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2740054e0 con 0x55ccfb8b2b40 2024-09-19T06:48:01.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.126+0000 7fa263fff640 1 -- 172.21.15.159:0/4140173780 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fa26c004fa0 con 0x7fa27c074510 2024-09-19T06:48:01.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.127+0000 7fa2837b4740 1 -- 172.21.15.159:0/1908391512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b2b40 msgr2=0x55ccfb8b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:01.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.127+0000 7fa2837b4740 1 --2- 172.21.15.159:0/1908391512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b1090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0754f0 tx=0x7fa27400f790 comp rx=0 tx=0).stop 2024-09-19T06:48:01.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.127+0000 7fa2837b4740 1 -- 172.21.15.159:0/1908391512 shutdown_connections 2024-09-19T06:48:01.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.127+0000 7fa2837b4740 1 --2- 172.21.15.159:0/1908391512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.127+0000 7fa2837b4740 1 --2- 172.21.15.159:0/1908391512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b15d0 0x55ccfb8b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.127+0000 7fa2837b4740 1 --2- 172.21.15.159:0/1908391512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b1090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.127+0000 7fa2837b4740 1 -- 172.21.15.159:0/1908391512 >> 172.21.15.159:0/1908391512 conn(0x55ccfb87a310 msgr2=0x55ccfb8adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.127+0000 7fa263fff640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa2640a34d0 0x7fa2640a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.128+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa2640a34d0 0x7fa2640a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.128+0000 7fa263fff640 1 -- 172.21.15.159:0/4140173780 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa26c099b90 con 0x7fa27c074510 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.128+0000 7fa2837b4740 1 -- 172.21.15.159:0/1908391512 shutdown_connections 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.128+0000 7fa2837b4740 1 -- 172.21.15.159:0/1908391512 wait complete. 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.128+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa2640a34d0 0x7fa2640a5990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55ccfb8b2070 tx=0x7fa2700058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.128+0000 7fa2837b4740 1 -- start start 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa2837b4740 1 Processor -- start 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8b8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8b9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa2837b4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ccfb8bf070 con 0x55ccfb8bc370 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa2837b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ccfb7d2060 con 0x55ccfb8b2b40 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa2837b4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ccfb8bf1f0 con 0x55ccfb8b94c0 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa27a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8b8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa2837b4740 10 client.0 _ll_register_callbacks cb 0x55ccfb5258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa27a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8b8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38820/0 (socket says 172.21.15.159:38820) 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa27a7fc640 1 -- 172.21.15.159:0/3791156231 learned_addr learned my addr 172.21.15.159:0/3791156231 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa27affd640 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.129+0000 7fa27b7fe640 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa27a7fc640 1 -- 172.21.15.159:0/3791156231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 msgr2=0x55ccfb8b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8b9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa27a7fc640 1 -- 172.21.15.159:0/3791156231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 msgr2=0x55ccfb8bbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:01.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8bbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa27a7fc640 1 -- 172.21.15.159:0/3791156231 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccfb5883c0 con 0x55ccfb8bc370 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8b8f80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa2700042c0 tx=0x7fa270009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ace7b7068dcaa5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa25eff5640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa25eff5640 1 -- 172.21.15.159:0/3791156231 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27004e070 con 0x55ccfb8bc370 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa2837b4740 1 -- 172.21.15.159:0/3791156231 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa274018920 con 0x55ccfb8bc370 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa25eff5640 1 -- 172.21.15.159:0/3791156231 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa270004950 con 0x55ccfb8bc370 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa25eff5640 1 -- 172.21.15.159:0/3791156231 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa27005a050 con 0x55ccfb8bc370 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa2837b4740 10 client.15528 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.130+0000 7fa2837b4740 1 -- 172.21.15.159:0/3791156231 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ccfb8caeb0 con 0x55ccfb8bc370 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.131+0000 7fa25eff5640 1 -- 172.21.15.159:0/3791156231 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa274018920 con 0x55ccfb8bc370 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.131+0000 7fa25eff5640 1 -- 172.21.15.159:0/3791156231 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa27003d450 con 0x55ccfb8bc370 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.131+0000 7fa2837b4740 10 client.15528 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.131+0000 7fa2837b4740 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:01.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.131+0000 7fa2837b4740 20 client.15528 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.131+0000 7fa2837b4740 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ccfb8cc6b0 0x55ccfb8ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.131+0000 7fa2837b4740 4 client.15528 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.131+0000 7fa2837b4740 1 -- 172.21.15.159:0/3791156231 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccfb824860 con 0x55ccfb8cc6b0 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.131+0000 7fa27affd640 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ccfb8cc6b0 0x55ccfb8ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.132+0000 7fa25eff5640 10 client.15528 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.132+0000 7fa27affd640 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ccfb8cc6b0 0x55ccfb8ceb50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aafaa17c2d17de6a server_cookie=88b8efb0281eb0a9 in_seq=0 out_seq=0 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa25eff5640 1 -- 172.21.15.159:0/3791156231 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ccfb824860 con 0x55ccfb8cc6b0 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa25eff5640 10 client.15528 handle_command_reply: tid=0 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 client.15528 shutdown 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 -- 172.21.15.159:0/3791156231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 msgr2=0x55ccfb8b8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:01.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8b8f80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa2700042c0 tx=0x7fa270009260 comp rx=0 tx=0).stop 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 -- 172.21.15.159:0/3791156231 shutdown_connections 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ccfb8cc6b0 0x55ccfb8ceb50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8b8f80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 --2- 172.21.15.159:0/3791156231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8bbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 -- 172.21.15.159:0/3791156231 >> 172.21.15.159:0/3791156231 conn(0x55ccfb87a310 msgr2=0x55ccfb8b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa25eff5640 0 client.15528 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 -- 172.21.15.159:0/3791156231 shutdown_connections 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 1 -- 172.21.15.159:0/3791156231 wait complete. 2024-09-19T06:48:01.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.133+0000 7fa2837b4740 20 client.15528 trim_cache size 0 max 16384 2024-09-19T06:48:01.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.147+0000 7fa2837b4740 1 Processor -- start 2024-09-19T06:48:01.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.147+0000 7fa2837b4740 1 -- start start 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.147+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.147+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8bc370 0x55ccfb8bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa2837b4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c1adbd0 con 0x55ccfb8b2b40 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa2837b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c1b0450 con 0x55ccfb8b94c0 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa2837b4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c1ae240 con 0x55ccfb8bc370 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38826/0 (socket says 172.21.15.159:38826) 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27affd640 1 -- 172.21.15.159:0/2897382693 learned_addr learned my addr 172.21.15.159:0/2897382693 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27b7fe640 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8bc370 0x55ccfb8bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27affd640 1 -- 172.21.15.159:0/2897382693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8bc370 msgr2=0x55ccfb8bd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27affd640 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8bc370 0x55ccfb8bd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27affd640 1 -- 172.21.15.159:0/2897382693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b94c0 msgr2=0x55ccfb8b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27affd640 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27affd640 1 -- 172.21.15.159:0/2897382693 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccfb8b74d0 con 0x55ccfb8b2b40 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27b7fe640 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8bc370 0x55ccfb8bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.148+0000 7fa27affd640 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b4120 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa26c09ba80 tx=0x7fa26c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc52750b21c4311 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.149+0000 7fa260ff9640 1 -- 172.21.15.159:0/2897382693 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0b9070 con 0x55ccfb8b2b40 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.149+0000 7fa260ff9640 1 -- 172.21.15.159:0/2897382693 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa26c005290 con 0x55ccfb8b2b40 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.149+0000 7fa260ff9640 1 -- 172.21.15.159:0/2897382693 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0b3030 con 0x55ccfb8b2b40 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 -- 172.21.15.159:0/2897382693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8b2b40 msgr2=0x55ccfb8b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:01.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b4120 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa26c09ba80 tx=0x7fa26c086040 comp rx=0 tx=0).stop 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 -- 172.21.15.159:0/2897382693 shutdown_connections 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8bc370 0x55ccfb8bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2897382693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8b4120 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 -- 172.21.15.159:0/2897382693 >> 172.21.15.159:0/2897382693 conn(0x55ccfb87a310 msgr2=0x55ccfb8b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 -- 172.21.15.159:0/2897382693 shutdown_connections 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 -- 172.21.15.159:0/2897382693 wait complete. 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 -- start start 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.150+0000 7fa2837b4740 1 Processor -- start 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8d3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa2837b4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8d4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa2837b4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c1ae910 con 0x55ccfb8bc370 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa2837b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c1afd80 con 0x55ccfb8b2b40 2024-09-19T06:48:01.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa2837b4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c1aefe0 con 0x55ccfb8b94c0 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa27b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8d4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa27b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8d4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38840/0 (socket says 172.21.15.159:38840) 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa27b7fe640 1 -- 172.21.15.159:0/2050674011 learned_addr learned my addr 172.21.15.159:0/2050674011 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8d3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa27affd640 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.151+0000 7fa2837b4740 10 client.0 _ll_register_callbacks cb 0x7fa270031b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa27a7fc640 1 -- 172.21.15.159:0/2050674011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 msgr2=0x55ccfb8c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa27a7fc640 1 -- 172.21.15.159:0/2050674011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 msgr2=0x55ccfb8d4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8d4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa27a7fc640 1 -- 172.21.15.159:0/2050674011 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccfb8c2880 con 0x55ccfb8b94c0 2024-09-19T06:48:01.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa27b7fe640 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8d4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:01.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa2837b4740 1 -- 172.21.15.159:0/2050674011 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa26c005290 con 0x55ccfb8b94c0 2024-09-19T06:48:01.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa27a7fc640 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8d3f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55ccfb8ba530 tx=0x7fa270031800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b114d864dadb0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:01.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa25eff5640 10 client.25102 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:48:01.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa25eff5640 1 -- 172.21.15.159:0/2050674011 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270062070 con 0x55ccfb8b94c0 2024-09-19T06:48:01.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa25eff5640 1 -- 172.21.15.159:0/2050674011 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa2700048c0 con 0x55ccfb8b94c0 2024-09-19T06:48:01.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa25eff5640 1 -- 172.21.15.159:0/2050674011 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa27004e040 con 0x55ccfb8b94c0 2024-09-19T06:48:01.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa2837b4740 10 client.25102 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:01.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.152+0000 7fa2837b4740 1 -- 172.21.15.159:0/2050674011 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55ccfb93fd60 con 0x55ccfb8b94c0 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa25eff5640 1 -- 172.21.15.159:0/2050674011 <== mon.1 v2:172.21.15.203:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa270065030 con 0x55ccfb8b94c0 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa2837b4740 10 client.25102 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa2837b4740 10 client.25102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa2837b4740 20 client.25102 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ccfb9402c0 0x55ccfb9426e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa2837b4740 4 client.25102 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa2837b4740 1 -- 172.21.15.159:0/2050674011 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ccfb81ed70 con 0x55ccfb9402c0 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa27affd640 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ccfb9402c0 0x55ccfb9426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa25eff5640 10 client.25102 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.153+0000 7fa27affd640 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ccfb9402c0 0x55ccfb9426e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e3ffeecbe15945 server_cookie=366f2df4a0a8214f in_seq=0 out_seq=0 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa25eff5640 1 -- 172.21.15.159:0/2050674011 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ccfb81ed70 con 0x55ccfb9402c0 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa25eff5640 10 client.25102 handle_command_reply: tid=0 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 client.25102 shutdown 2024-09-19T06:48:01.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 -- 172.21.15.159:0/2050674011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 msgr2=0x55ccfb8d3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8d3f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55ccfb8ba530 tx=0x7fa270031800 comp rx=0 tx=0).stop 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 -- 172.21.15.159:0/2050674011 shutdown_connections 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ccfb9402c0 0x55ccfb9426e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa25eff5640 0 client.25102 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ccfb8bc370 0x55ccfb8d4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfb8b94c0 0x55ccfb8d3f00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 --2- 172.21.15.159:0/2050674011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ccfb8b2b40 0x55ccfb8c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 -- 172.21.15.159:0/2050674011 >> 172.21.15.159:0/2050674011 conn(0x55ccfb87a310 msgr2=0x55ccfb8ba7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 -- 172.21.15.159:0/2050674011 shutdown_connections 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 1 -- 172.21.15.159:0/2050674011 wait complete. 2024-09-19T06:48:01.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.154+0000 7fa2837b4740 20 client.25102 trim_cache size 0 max 16384 2024-09-19T06:48:01.167 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:48:01.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 -- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa2640a34d0 msgr2=0x7fa2640a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa2640a34d0 0x7fa2640a5990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55ccfb8b2070 tx=0x7fa2700058d0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 -- 172.21.15.159:0/4140173780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa27c074510 msgr2=0x7fa27c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa27c074510 0x7fa27c19a6f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00d770 tx=0x7fa26c00dc30 comp rx=0 tx=0).stop 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 -- 172.21.15.159:0/4140173780 shutdown_connections 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa2640a34d0 0x7fa2640a5990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa27c10e450 0x7fa27c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa27c074e30 0x7fa27c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 --2- 172.21.15.159:0/4140173780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa27c074510 0x7fa27c19a6f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.155+0000 7fa2813db640 1 -- 172.21.15.159:0/4140173780 >> 172.21.15.159:0/4140173780 conn(0x7fa27c0fd8f0 msgr2=0x7fa27c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.156+0000 7fa2813db640 1 -- 172.21.15.159:0/4140173780 shutdown_connections 2024-09-19T06:48:01.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:01.156+0000 7fa2813db640 1 -- 172.21.15.159:0/4140173780 wait complete. 2024-09-19T06:48:02.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:01 smithi203 ceph-mon[35473]: mgrmap e24: x(active, since 60s), standbys: y, z 2024-09-19T06:48:02.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:01 smithi189 ceph-mon[34880]: mgrmap e24: x(active, since 60s), standbys: y, z 2024-09-19T06:48:02.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:01 smithi159 ceph-mon[30935]: mgrmap e24: x(active, since 60s), standbys: y, z 2024-09-19T06:48:02.910 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:48:02.911 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:48:02.935 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:02 smithi159 ceph-mon[30935]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T06:48:03.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:02 smithi203 ceph-mon[35473]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T06:48:03.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:02 smithi189 ceph-mon[34880]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T06:48:03.185 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.589+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2097058314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc0101a30 msgr2=0x7fbfc010d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.589+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2097058314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc0101a30 0x7fbfc010d990 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009ca0 tx=0x7fbfb802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.590+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2097058314 shutdown_connections 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.590+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2097058314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc0101a30 0x7fbfc010d990 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.590+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2097058314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc01010b0 0x7fbfc01014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.590+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2097058314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc01028d0 0x7fbfc0102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.590+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2097058314 >> 172.21.15.159:0/2097058314 conn(0x7fbfc00770f0 msgr2=0x7fbfc00fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.590+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2097058314 shutdown_connections 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.590+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2097058314 wait complete. 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.590+0000 7fbfc87cf640 1 Processor -- start 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.590+0000 7fbfc87cf640 1 -- start start 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc87cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc01010b0 0x7fbfc0199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc87cf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0101a30 0x7fbfc01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc87cf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc01028d0 0x7fbfc01a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc87cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0110f00 con 0x7fbfc01010b0 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc87cf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0110d80 con 0x7fbfc01028d0 2024-09-19T06:48:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc87cf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0111080 con 0x7fbfc0101a30 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc01010b0 0x7fbfc0199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc01010b0 0x7fbfc0199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38866/0 (socket says 172.21.15.159:38866) 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc656b640 1 -- 172.21.15.159:0/2241327830 learned_addr learned my addr 172.21.15.159:0/2241327830 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0101a30 0x7fbfc01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc656b640 1 -- 172.21.15.159:0/2241327830 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0101a30 msgr2=0x7fbfc01996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc656b640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0101a30 0x7fbfc01996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc656b640 1 -- 172.21.15.159:0/2241327830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc01028d0 msgr2=0x7fbfc01a41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc6d6c640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc01028d0 0x7fbfc01a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc656b640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc01028d0 0x7fbfc01a41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc656b640 1 -- 172.21.15.159:0/2241327830 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc01a4730 con 0x7fbfc01010b0 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.591+0000 7fbfc656b640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc01010b0 0x7fbfc0199170 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e9f0 tx=0x7fbfbc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.592+0000 7fbfb77fe640 1 -- 172.21.15.159:0/2241327830 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc00cd80 con 0x7fbfc01010b0 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.592+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2241327830 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc01a4900 con 0x7fbfc01010b0 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.592+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2241327830 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc01a4e20 con 0x7fbfc01010b0 2024-09-19T06:48:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.592+0000 7fbfb77fe640 1 -- 172.21.15.159:0/2241327830 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfbc005500 con 0x7fbfc01010b0 2024-09-19T06:48:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.592+0000 7fbfb77fe640 1 -- 172.21.15.159:0/2241327830 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc010690 con 0x7fbfc01010b0 2024-09-19T06:48:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.595+0000 7fbfb77fe640 1 -- 172.21.15.159:0/2241327830 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fbfbc0046c0 con 0x7fbfc01010b0 2024-09-19T06:48:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.595+0000 7fbfcb644740 1 Processor -- start 2024-09-19T06:48:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.595+0000 7fbfcb644740 1 -- start start 2024-09-19T06:48:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0439ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e043a410 0x5587e0444770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 0x5587e04470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfcb644740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5587e039e2f0 con 0x5587e0439af0 2024-09-19T06:48:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfcb644740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5587e0346270 con 0x5587e043a410 2024-09-19T06:48:03.598 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfcb644740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5587e039a2b0 con 0x5587e0444cb0 2024-09-19T06:48:03.598 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfc6d6c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0439ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.598 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e043a410 0x5587e0444770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.598 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e043a410 0x5587e0444770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:60776/0 (socket says 172.21.15.159:60776) 2024-09-19T06:48:03.598 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfc6d6c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0439ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38868/0 (socket says 172.21.15.159:38868) 2024-09-19T06:48:03.598 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfc656b640 1 -- 172.21.15.159:0/1907722439 learned_addr learned my addr 172.21.15.159:0/1907722439 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.598 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.596+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/1907722439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 0x5587e04470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.599 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfc656b640 1 -- 172.21.15.159:0/1907722439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 msgr2=0x5587e04470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.599 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfc656b640 1 --2- 172.21.15.159:0/1907722439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 0x5587e04470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfc656b640 1 -- 172.21.15.159:0/1907722439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 msgr2=0x5587e0439ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfb77fe640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbfac0a3580 0x7fbfac0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfc656b640 1 --2- 172.21.15.159:0/1907722439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0439ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfc656b640 1 -- 172.21.15.159:0/1907722439 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587e0345340 con 0x5587e043a410 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbfac0a3580 0x7fbfac0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfc6d6c640 1 --2- 172.21.15.159:0/1907722439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0439ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfb77fe640 1 -- 172.21.15.159:0/2241327830 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fbfbc0d0490 con 0x7fbfc01010b0 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfc656b640 1 --2- 172.21.15.159:0/1907722439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e043a410 0x5587e0444770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0cdb40 tx=0x7fbfbc00a440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=732042b74978ede1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.597+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbfac0a3580 0x7fbfac0a5a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5587e04373e0 tx=0x7fbfb0011820 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfb4ff9640 1 -- 172.21.15.159:0/1907722439 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc09c2c0 con 0x5587e043a410 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfb4ff9640 1 -- 172.21.15.159:0/1907722439 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfbc067400 con 0x5587e043a410 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfb4ff9640 1 -- 172.21.15.159:0/1907722439 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc09be50 con 0x5587e043a410 2024-09-19T06:48:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfcb644740 1 -- 172.21.15.159:0/1907722439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e043a410 msgr2=0x5587e0444770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfcb644740 1 --2- 172.21.15.159:0/1907722439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e043a410 0x5587e0444770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0cdb40 tx=0x7fbfbc00a440 comp rx=0 tx=0).stop 2024-09-19T06:48:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfcb644740 1 -- 172.21.15.159:0/1907722439 shutdown_connections 2024-09-19T06:48:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfcb644740 1 --2- 172.21.15.159:0/1907722439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 0x5587e04470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfcb644740 1 --2- 172.21.15.159:0/1907722439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e043a410 0x5587e0444770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfcb644740 1 --2- 172.21.15.159:0/1907722439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0439ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.598+0000 7fbfcb644740 1 -- 172.21.15.159:0/1907722439 >> 172.21.15.159:0/1907722439 conn(0x5587e0436060 msgr2=0x5587e0436440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.599+0000 7fbfcb644740 1 -- 172.21.15.159:0/1907722439 shutdown_connections 2024-09-19T06:48:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.599+0000 7fbfcb644740 1 -- 172.21.15.159:0/1907722439 wait complete. 2024-09-19T06:48:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.599+0000 7fbfcb644740 1 -- start start 2024-09-19T06:48:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.599+0000 7fbfcb644740 1 Processor -- start 2024-09-19T06:48:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.600+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0439af0 0x5587e0441b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.600+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0442090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.600+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0439af0 0x5587e0441b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.600+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0439af0 0x5587e0441b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:60780/0 (socket says 172.21.15.159:60780) 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.600+0000 7fbfc5d6a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0442090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.600+0000 7fbfc5d6a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0442090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38874/0 (socket says 172.21.15.159:38874) 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.600+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 0x5587e04425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.600+0000 7fbfc656b640 1 -- 172.21.15.159:0/250169377 learned_addr learned my addr 172.21.15.159:0/250169377 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5587e0447880 con 0x5587e043a410 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5587e0327290 con 0x5587e0439af0 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5587e0447a00 con 0x5587e0444cb0 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfc6d6c640 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 0x5587e04425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfc656b640 1 -- 172.21.15.159:0/250169377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 msgr2=0x5587e04425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfc656b640 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 0x5587e04425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfc656b640 1 -- 172.21.15.159:0/250169377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 msgr2=0x5587e0442090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfc656b640 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0442090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfc656b640 1 -- 172.21.15.159:0/250169377 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587e00b1210 con 0x5587e0439af0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0442090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfcb644740 10 client.0 _ll_register_callbacks cb 0x5587e0358140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfc656b640 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0439af0 0x5587e0441b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc09c1f0 tx=0x7fbfbc00c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb97be2bc030fede server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfa9ffb640 10 client.25088 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfbc067400 con 0x5587e0439af0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.601+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/250169377 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc09c030 con 0x5587e0439af0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.602+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/250169377 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fbfbc0982c0 con 0x5587e0439af0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.602+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/250169377 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbfbc09be50 con 0x5587e0439af0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.602+0000 7fbfcb644740 10 client.25088 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.602+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=20}) -- 0x5587e017d620 con 0x5587e0439af0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.602+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/250169377 <== mon.2 v2:172.21.15.189:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbfbc0b5290 con 0x5587e0439af0 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.602+0000 7fbfcb644740 10 client.25088 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.602+0000 7fbfcb644740 10 client.25088 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.603+0000 7fbfcb644740 20 client.25088 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.603+0000 7fbfcb644740 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5587e04548e0 0x5587e0456cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.603+0000 7fbfcb644740 4 client.25088 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.603+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587e03aba20 con 0x5587e04548e0 2024-09-19T06:48:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.603+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5587e04548e0 0x5587e0456cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.604+0000 7fbfa9ffb640 10 client.25088 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.604+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5587e04548e0 0x5587e0456cd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8154ec875797c43a server_cookie=bd4d8a29e6203d82 in_seq=0 out_seq=0 2024-09-19T06:48:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.604+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/250169377 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587e03aba20 con 0x5587e04548e0 2024-09-19T06:48:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.604+0000 7fbfa9ffb640 10 client.25088 handle_command_reply: tid=0 2024-09-19T06:48:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.604+0000 7fbfcb644740 1 client.25088 shutdown 2024-09-19T06:48:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.604+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0439af0 msgr2=0x5587e0441b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.604+0000 7fbfcb644740 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0439af0 0x5587e0441b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc09c1f0 tx=0x7fbfbc00c7d0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 shutdown_connections 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfcb644740 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5587e04548e0 0x5587e0456cd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfcb644740 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0444cb0 0x5587e04425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfa9ffb640 0 client.25088 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfcb644740 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0442090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfcb644740 1 --2- 172.21.15.159:0/250169377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0439af0 0x5587e0441b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 >> 172.21.15.159:0/250169377 conn(0x5587e0436060 msgr2=0x5587e043bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 shutdown_connections 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfcb644740 1 -- 172.21.15.159:0/250169377 wait complete. 2024-09-19T06:48:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.605+0000 7fbfcb644740 20 client.25088 trim_cache size 0 max 16384 2024-09-19T06:48:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.636+0000 7fbfcb644740 1 Processor -- start 2024-09-19T06:48:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.636+0000 7fbfcb644740 1 -- start start 2024-09-19T06:48:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0439af0 0x5587e0442400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0459cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0444cb0 0x5587e045a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfcb644740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01a9610 con 0x5587e043a410 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfcb644740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01abe90 con 0x5587e0444cb0 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfcb644740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01a9c80 con 0x5587e0439af0 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc5d6a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0459cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0439af0 0x5587e0442400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc5d6a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0459cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38882/0 (socket says 172.21.15.159:38882) 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0439af0 0x5587e0442400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:39552/0 (socket says 172.21.15.159:39552) 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc5d6a640 1 -- 172.21.15.159:0/1956288535 learned_addr learned my addr 172.21.15.159:0/1956288535 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc656b640 1 -- 172.21.15.159:0/1956288535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0444cb0 msgr2=0x5587e045a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc656b640 1 --2- 172.21.15.159:0/1956288535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0444cb0 0x5587e045a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc656b640 1 -- 172.21.15.159:0/1956288535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 msgr2=0x5587e0459cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc656b640 1 --2- 172.21.15.159:0/1956288535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0459cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.637+0000 7fbfc656b640 1 -- 172.21.15.159:0/1956288535 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587e043a240 con 0x5587e0439af0 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.638+0000 7fbfc656b640 1 --2- 172.21.15.159:0/1956288535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0439af0 0x5587e0442400 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc09a7a0 tx=0x7fbfbc0d1000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3e1fae0a2b7f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.638+0000 7fbfabfff640 1 -- 172.21.15.159:0/1956288535 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc09c2c0 con 0x5587e0439af0 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.638+0000 7fbfabfff640 1 -- 172.21.15.159:0/1956288535 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfbc067400 con 0x5587e0439af0 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.638+0000 7fbfabfff640 1 -- 172.21.15.159:0/1956288535 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc00a250 con 0x5587e0439af0 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 -- 172.21.15.159:0/1956288535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0439af0 msgr2=0x5587e0442400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 --2- 172.21.15.159:0/1956288535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0439af0 0x5587e0442400 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc09a7a0 tx=0x7fbfbc0d1000 comp rx=0 tx=0).stop 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 -- 172.21.15.159:0/1956288535 shutdown_connections 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 --2- 172.21.15.159:0/1956288535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0444cb0 0x5587e045a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 --2- 172.21.15.159:0/1956288535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e043a410 0x5587e0459cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 --2- 172.21.15.159:0/1956288535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e0439af0 0x5587e0442400 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 -- 172.21.15.159:0/1956288535 >> 172.21.15.159:0/1956288535 conn(0x5587e0436060 msgr2=0x5587e0443bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 -- 172.21.15.159:0/1956288535 shutdown_connections 2024-09-19T06:48:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 -- 172.21.15.159:0/1956288535 wait complete. 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 -- start start 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.639+0000 7fbfcb644740 1 Processor -- start 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0459d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e043a410 0x5587e045a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfcb644740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0444cb0 0x5587e0457290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfcb644740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01aa350 con 0x5587e0439af0 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfcb644740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01ab7c0 con 0x5587e0444cb0 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfcb644740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01aaa20 con 0x5587e043a410 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfcb644740 10 client.0 _ll_register_callbacks cb 0x7fbfbc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0459d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc656b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0459d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38884/0 (socket says 172.21.15.159:38884) 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc656b640 1 -- 172.21.15.159:0/561551103 learned_addr learned my addr 172.21.15.159:0/561551103 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e043a410 0x5587e045a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc656b640 1 -- 172.21.15.159:0/561551103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e043a410 msgr2=0x5587e045a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc656b640 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e043a410 0x5587e045a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc656b640 1 -- 172.21.15.159:0/561551103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0444cb0 msgr2=0x5587e0457290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc656b640 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0444cb0 0x5587e0457290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc656b640 1 -- 172.21.15.159:0/561551103 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587e0457980 con 0x5587e0439af0 2024-09-19T06:48:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfc656b640 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0459d30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ce1b0 tx=0x7fbfbc098450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46108a60b798afdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.640+0000 7fbfa9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/561551103 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc09c2c0 con 0x5587e0439af0 2024-09-19T06:48:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/561551103 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fbfbc09c960 con 0x5587e0439af0 2024-09-19T06:48:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfcb644740 1 -- 172.21.15.159:0/561551103 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfbc067400 con 0x5587e0439af0 2024-09-19T06:48:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/561551103 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbfbc09c030 con 0x5587e0439af0 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfcb644740 10 client.15552 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfcb644740 1 -- 172.21.15.159:0/561551103 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5587e0457980 con 0x5587e0439af0 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/561551103 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfbc067400 con 0x5587e0439af0 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/561551103 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbfbc0cdd10 con 0x5587e0439af0 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfcb644740 10 client.15552 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfcb644740 10 client.15552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfcb644740 20 client.15552 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfcb644740 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5587e04548e0 0x5587e04c9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfcb644740 4 client.15552 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.641+0000 7fbfcb644740 1 -- 172.21.15.159:0/561551103 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5587e03a5d70 con 0x5587e04548e0 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.642+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5587e04548e0 0x5587e04c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.642+0000 7fbfc5d6a640 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5587e04548e0 0x5587e04c9850 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85448adc18e10bd6 server_cookie=257cd51d37241b22 in_seq=0 out_seq=0 2024-09-19T06:48:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:03.642+0000 7fbfa9ffb640 10 client.15552 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.749+0000 7f72379c5640 1 -- 172.21.15.159:0/1414054249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7230100e20 msgr2=0x7f7230101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.749+0000 7f72379c5640 1 --2- 172.21.15.159:0/1414054249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7230100e20 0x7f7230101200 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f722c009900 tx=0x7f722c02a480 comp rx=0 tx=0).stop 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.749+0000 7f72379c5640 1 -- 172.21.15.159:0/1414054249 shutdown_connections 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.749+0000 7f72379c5640 1 --2- 172.21.15.159:0/1414054249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7230102ef0 0x7f723010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.749+0000 7f72379c5640 1 --2- 172.21.15.159:0/1414054249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7230102570 0x7f72301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.749+0000 7f72379c5640 1 --2- 172.21.15.159:0/1414054249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7230100e20 0x7f7230101200 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.749+0000 7f72379c5640 1 -- 172.21.15.159:0/1414054249 >> 172.21.15.159:0/1414054249 conn(0x7f72300fc7d0 msgr2=0x7f72300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.749+0000 7f72379c5640 1 -- 172.21.15.159:0/1414054249 shutdown_connections 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.749+0000 7f72379c5640 1 -- 172.21.15.159:0/1414054249 wait complete. 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.750+0000 7f72379c5640 1 Processor -- start 2024-09-19T06:48:03.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.750+0000 7f72379c5640 1 -- start start 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.750+0000 7f72379c5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7230100e20 0x7f72301984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f72379c5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7230102570 0x7f7230198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f72379c5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7230102ef0 0x7f723019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f72379c5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7230112090 con 0x7f7230100e20 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f72379c5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7230111f10 con 0x7f7230102ef0 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f72379c5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7230112210 con 0x7f7230102570 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7235761640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7230100e20 0x7f72301984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7235f62640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7230102ef0 0x7f723019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7235f62640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7230102ef0 0x7f723019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:60830/0 (socket says 172.21.15.159:60830) 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7235f62640 1 -- 172.21.15.159:0/3471306051 learned_addr learned my addr 172.21.15.159:0/3471306051 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7234f60640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7230102570 0x7f7230198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7235f62640 1 -- 172.21.15.159:0/3471306051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7230102570 msgr2=0x7f7230198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7235f62640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7230102570 0x7f7230198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7235f62640 1 -- 172.21.15.159:0/3471306051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7230100e20 msgr2=0x7f72301984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7235f62640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7230100e20 0x7f72301984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.751+0000 7f7235f62640 1 -- 172.21.15.159:0/3471306051 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723019d400 con 0x7f7230102ef0 2024-09-19T06:48:03.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.752+0000 7f7234f60640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7230102570 0x7f7230198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:03.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.752+0000 7f7235f62640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7230102ef0 0x7f723019cd20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f722800cce0 tx=0x7f722800a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.752+0000 7f72267fc640 1 -- 172.21.15.159:0/3471306051 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722800f450 con 0x7f7230102ef0 2024-09-19T06:48:03.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.752+0000 7f72267fc640 1 -- 172.21.15.159:0/3471306051 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722800fad0 con 0x7f7230102ef0 2024-09-19T06:48:03.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.752+0000 7f72267fc640 1 -- 172.21.15.159:0/3471306051 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228018c90 con 0x7f7230102ef0 2024-09-19T06:48:03.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.752+0000 7f72379c5640 1 -- 172.21.15.159:0/3471306051 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723019d6f0 con 0x7f7230102ef0 2024-09-19T06:48:03.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.752+0000 7f72379c5640 1 -- 172.21.15.159:0/3471306051 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72301a4fd0 con 0x7f7230102ef0 2024-09-19T06:48:03.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.755+0000 7f7239d9e740 1 Processor -- start 2024-09-19T06:48:03.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f72267fc640 1 -- 172.21.15.159:0/3471306051 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f722800f5f0 con 0x7f7230102ef0 2024-09-19T06:48:03.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7239d9e740 1 -- start start 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382fc0e0 0x55a2382faa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382faf40 0x55a2382fb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a23830e3e0 0x55a2383107d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7239d9e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a238260280 con 0x55a2382fc0e0 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7239d9e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a238207b10 con 0x55a23830e3e0 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7239d9e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a23825c240 con 0x55a2382faf40 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7234f60640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382fc0e0 0x55a2382faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7234f60640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382fc0e0 0x55a2382faa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38894/0 (socket says 172.21.15.159:38894) 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7234f60640 1 -- 172.21.15.159:0/2010433719 learned_addr learned my addr 172.21.15.159:0/2010433719 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.756+0000 7f7234f60640 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a23830e3e0 0x55a2383107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.757+0000 7f7235761640 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382faf40 0x55a2382fb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.757+0000 7f7234f60640 1 -- 172.21.15.159:0/2010433719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382faf40 msgr2=0x55a2382fb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.757+0000 7f7234f60640 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382faf40 0x55a2382fb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.757+0000 7f7234f60640 1 -- 172.21.15.159:0/2010433719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a23830e3e0 msgr2=0x55a2383107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.757+0000 7f7234f60640 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a23830e3e0 0x55a2383107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.757+0000 7f7234f60640 1 -- 172.21.15.159:0/2010433719 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2382141f0 con 0x55a2382fc0e0 2024-09-19T06:48:03.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.757+0000 7f7235761640 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382faf40 0x55a2382fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:03.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.758+0000 7f72267fc640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f721c0a3510 0x7f721c0a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.758+0000 7f72267fc640 1 -- 172.21.15.159:0/3471306051 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f72280d05d0 con 0x7f7230102ef0 2024-09-19T06:48:03.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.758+0000 7f7234f60640 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382fc0e0 0x55a2382faa00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7220012860 tx=0x7f722000b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0ff6b77be1c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.758+0000 7f7235761640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f721c0a3510 0x7f721c0a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.759+0000 7f721b7fe640 1 -- 172.21.15.159:0/2010433719 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220008a40 con 0x55a2382fc0e0 2024-09-19T06:48:03.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.759+0000 7f721b7fe640 1 -- 172.21.15.159:0/2010433719 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7220008be0 con 0x55a2382fc0e0 2024-09-19T06:48:03.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.759+0000 7f721b7fe640 1 -- 172.21.15.159:0/2010433719 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722000d3d0 con 0x55a2382fc0e0 2024-09-19T06:48:03.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.759+0000 7f7239d9e740 1 -- 172.21.15.159:0/2010433719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382fc0e0 msgr2=0x55a2382faa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.759+0000 7f7235761640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f721c0a3510 0x7f721c0a59d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f722c0314e0 tx=0x7f722c02a980 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.759+0000 7f7239d9e740 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382fc0e0 0x55a2382faa00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7220012860 tx=0x7f722000b3d0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.760+0000 7f7239d9e740 1 -- 172.21.15.159:0/2010433719 shutdown_connections 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.760+0000 7f7239d9e740 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a23830e3e0 0x55a2383107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.760+0000 7f7239d9e740 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382faf40 0x55a2382fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.760+0000 7f7239d9e740 1 --2- 172.21.15.159:0/2010433719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382fc0e0 0x55a2382faa00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.760+0000 7f7239d9e740 1 -- 172.21.15.159:0/2010433719 >> 172.21.15.159:0/2010433719 conn(0x55a2382f70f0 msgr2=0x55a2382f74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.760+0000 7f7239d9e740 1 -- 172.21.15.159:0/2010433719 shutdown_connections 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.760+0000 7f7239d9e740 1 -- 172.21.15.159:0/2010433719 wait complete. 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.760+0000 7f7239d9e740 1 -- start start 2024-09-19T06:48:03.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.760+0000 7f7239d9e740 1 Processor -- start 2024-09-19T06:48:03.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.761+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a2382fe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.761+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 0x55a2382fecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.761+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 0x55a2382ff200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.761+0000 7f7235761640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a2382fe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.761+0000 7f7235761640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a2382fe780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38910/0 (socket says 172.21.15.159:38910) 2024-09-19T06:48:03.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.761+0000 7f7235761640 1 -- 172.21.15.159:0/3570565361 learned_addr learned my addr 172.21.15.159:0/3570565361 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.761+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a2383110b0 con 0x55a2382faf40 2024-09-19T06:48:03.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.761+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a23821af10 con 0x55a2382fc0e0 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.761+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a238311230 con 0x55a23830e3e0 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7235f62640 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 0x55a2382ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7234f60640 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 0x55a2382fecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7235761640 1 -- 172.21.15.159:0/3570565361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 msgr2=0x55a2382ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7235761640 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 0x55a2382ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7235761640 1 -- 172.21.15.159:0/3570565361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 msgr2=0x55a2382fecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7235761640 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 0x55a2382fecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7235761640 1 -- 172.21.15.159:0/3570565361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a237fd16a0 con 0x55a2382faf40 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7234f60640 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 0x55a2382fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7239d9e740 10 client.0 _ll_register_callbacks cb 0x55a2381e3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7235761640 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a2382fe780 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f722c009900 tx=0x7f722c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e9b45f1add72b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7220008be0 con 0x55a2382faf40 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.762+0000 7f7218ff9640 10 client.15564 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:03.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.763+0000 7f7218ff9640 1 -- 172.21.15.159:0/3570565361 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c057050 con 0x55a2382faf40 2024-09-19T06:48:03.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.763+0000 7f7218ff9640 1 -- 172.21.15.159:0/3570565361 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f722c031950 con 0x55a2382faf40 2024-09-19T06:48:03.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.763+0000 7f7218ff9640 1 -- 172.21.15.159:0/3570565361 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f722c04d070 con 0x55a2382faf40 2024-09-19T06:48:03.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.763+0000 7f7239d9e740 10 client.15564 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:03.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.763+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55a23831cb60 con 0x55a2382faf40 2024-09-19T06:48:03.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.763+0000 7f7218ff9640 1 -- 172.21.15.159:0/3570565361 <== mon.0 v2:172.21.15.159:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f722c031bb0 con 0x55a2382faf40 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.763+0000 7f7239d9e740 10 client.15564 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.764+0000 7f7239d9e740 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.764+0000 7f7239d9e740 20 client.15564 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.764+0000 7f7239d9e740 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a23831e4a0 0x55a238320960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.764+0000 7f7239d9e740 4 client.15564 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.764+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a23826d7f0 con 0x55a23831e4a0 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.764+0000 7f7234f60640 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a23831e4a0 0x55a238320960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.765+0000 7f7218ff9640 10 client.15564 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.765+0000 7f7234f60640 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a23831e4a0 0x55a238320960 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=620c8ec8c4b38c46 server_cookie=f11af230fbbcde9d in_seq=0 out_seq=0 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.765+0000 7f7218ff9640 1 -- 172.21.15.159:0/3570565361 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a23826d7f0 con 0x55a23831e4a0 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.765+0000 7f7218ff9640 10 client.15564 handle_command_reply: tid=0 2024-09-19T06:48:03.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 client.15564 shutdown 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 msgr2=0x55a2382fe780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a2382fe780 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f722c009900 tx=0x7f722c009260 comp rx=0 tx=0).stop 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 shutdown_connections 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a23831e4a0 0x55a238320960 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 0x55a2382ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 0x55a2382fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 --2- 172.21.15.159:0/3570565361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a2382fe780 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 >> 172.21.15.159:0/3570565361 conn(0x55a2382f70f0 msgr2=0x55a2382fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7218ff9640 0 client.15564 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.766+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 shutdown_connections 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.767+0000 7f7239d9e740 1 -- 172.21.15.159:0/3570565361 wait complete. 2024-09-19T06:48:03.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.767+0000 7f7239d9e740 20 client.15564 trim_cache size 0 max 16384 2024-09-19T06:48:03.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.800+0000 7f7239d9e740 1 Processor -- start 2024-09-19T06:48:03.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.800+0000 7f7239d9e740 1 -- start start 2024-09-19T06:48:03.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.800+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382faf40 0x55a2382fd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.800+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382fc0e0 0x55a2382ff050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a23830e3e0 0x55a2382f6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7239d9e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f72301a95c0 con 0x55a23830e3e0 2024-09-19T06:48:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7239d9e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72301abe40 con 0x55a2382faf40 2024-09-19T06:48:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7239d9e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72301a9c30 con 0x55a2382fc0e0 2024-09-19T06:48:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7235f62640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a23830e3e0 0x55a2382f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7235f62640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a23830e3e0 0x55a2382f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38916/0 (socket says 172.21.15.159:38916) 2024-09-19T06:48:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7235f62640 1 -- 172.21.15.159:0/2135476730 learned_addr learned my addr 172.21.15.159:0/2135476730 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7234f60640 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382fc0e0 0x55a2382ff050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7235761640 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382faf40 0x55a2382fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7234f60640 1 -- 172.21.15.159:0/2135476730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382faf40 msgr2=0x55a2382fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7234f60640 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382faf40 0x55a2382fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7234f60640 1 -- 172.21.15.159:0/2135476730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a23830e3e0 msgr2=0x55a2382f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7234f60640 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a23830e3e0 0x55a2382f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7234f60640 1 -- 172.21.15.159:0/2135476730 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2382fb950 con 0x55a2382fc0e0 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.801+0000 7f7235f62640 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a23830e3e0 0x55a2382f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.802+0000 7f7234f60640 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382fc0e0 0x55a2382ff050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55a2382ffdc0 tx=0x7f722000b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a1b278c711ee55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.802+0000 7f721affd640 1 -- 172.21.15.159:0/2135476730 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722002c070 con 0x55a2382fc0e0 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.802+0000 7f721affd640 1 -- 172.21.15.159:0/2135476730 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722000e950 con 0x55a2382fc0e0 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.802+0000 7f721affd640 1 -- 172.21.15.159:0/2135476730 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72200278a0 con 0x55a2382fc0e0 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 -- 172.21.15.159:0/2135476730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382fc0e0 msgr2=0x55a2382ff050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382fc0e0 0x55a2382ff050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55a2382ffdc0 tx=0x7f722000b4a0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 -- 172.21.15.159:0/2135476730 shutdown_connections 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a23830e3e0 0x55a2382f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2382fc0e0 0x55a2382ff050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 --2- 172.21.15.159:0/2135476730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382faf40 0x55a2382fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 -- 172.21.15.159:0/2135476730 >> 172.21.15.159:0/2135476730 conn(0x55a2382f70f0 msgr2=0x55a2382f5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 -- 172.21.15.159:0/2135476730 shutdown_connections 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 -- 172.21.15.159:0/2135476730 wait complete. 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 -- start start 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.803+0000 7f7239d9e740 1 Processor -- start 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a23830d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 0x55a2383164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7239d9e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 0x55a238316c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7239d9e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f72301aa300 con 0x55a2382faf40 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7239d9e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72301ab770 con 0x55a2382fc0e0 2024-09-19T06:48:03.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7239d9e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72301aa9d0 con 0x55a23830e3e0 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7239d9e740 10 client.0 _ll_register_callbacks cb 0x7f722c0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235761640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a23830d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235761640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a23830d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38932/0 (socket says 172.21.15.159:38932) 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235761640 1 -- 172.21.15.159:0/644218123 learned_addr learned my addr 172.21.15.159:0/644218123 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235f62640 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 0x55a238316c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7234f60640 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 0x55a2383164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235761640 1 -- 172.21.15.159:0/644218123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 msgr2=0x55a238316c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235761640 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 0x55a238316c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235761640 1 -- 172.21.15.159:0/644218123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 msgr2=0x55a2383164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:03.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235761640 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 0x55a2383164b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235761640 1 -- 172.21.15.159:0/644218123 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a238320cd0 con 0x55a2382faf40 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7235761640 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a23830d080 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f722c02a9f0 tx=0x7f722c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2b269d653f94c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.804+0000 7f7218ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7218ff9640 1 -- 172.21.15.159:0/644218123 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c057040 con 0x55a2382faf40 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7218ff9640 1 -- 172.21.15.159:0/644218123 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f722c049b30 con 0x55a2382faf40 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7239d9e740 1 -- 172.21.15.159:0/644218123 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f722000e950 con 0x55a2382faf40 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7218ff9640 1 -- 172.21.15.159:0/644218123 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f722c06a050 con 0x55a2382faf40 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7239d9e740 10 client.15570 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7239d9e740 1 -- 172.21.15.159:0/644218123 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a2383893c0 con 0x55a2382faf40 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7218ff9640 1 -- 172.21.15.159:0/644218123 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722000e950 con 0x55a2382faf40 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7218ff9640 1 -- 172.21.15.159:0/644218123 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f722c063060 con 0x55a2382faf40 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7239d9e740 10 client.15570 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.805+0000 7f7239d9e740 10 client.15570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:03.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.806+0000 7f7239d9e740 20 client.15570 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:03.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.806+0000 7f7239d9e740 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a238389ae0 0x55a23838bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:03.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.806+0000 7f7239d9e740 4 client.15570 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:48:03.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.806+0000 7f7239d9e740 1 -- 172.21.15.159:0/644218123 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a23830e230 con 0x55a238389ae0 2024-09-19T06:48:03.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.806+0000 7f7234f60640 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a238389ae0 0x55a23838bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:03.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.806+0000 7f7218ff9640 10 client.15570 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:03.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.806+0000 7f7234f60640 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a238389ae0 0x55a23838bf00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2496e389ca389e6 server_cookie=45b79df59ce99793 in_seq=0 out_seq=0 2024-09-19T06:48:03.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.807+0000 7f7218ff9640 1 -- 172.21.15.159:0/644218123 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a23830e230 con 0x55a238389ae0 2024-09-19T06:48:03.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.807+0000 7f7218ff9640 10 client.15570 handle_command_reply: tid=0 2024-09-19T06:48:03.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.807+0000 7f7239d9e740 1 client.15570 shutdown 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.807+0000 7f7239d9e740 1 -- 172.21.15.159:0/644218123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 msgr2=0x55a23830d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.807+0000 7f7239d9e740 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a23830d080 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f722c02a9f0 tx=0x7f722c040000 comp rx=0 tx=0).stop 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7239d9e740 1 -- 172.21.15.159:0/644218123 shutdown_connections 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7239d9e740 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a238389ae0 0x55a23838bf00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7239d9e740 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a23830e3e0 0x55a238316c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7239d9e740 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a2382fc0e0 0x55a2383164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7239d9e740 1 --2- 172.21.15.159:0/644218123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a2382faf40 0x55a23830d080 secure :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f722c02a9f0 tx=0x7f722c040000 comp rx=0 tx=0).stop 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7239d9e740 1 -- 172.21.15.159:0/644218123 >> 172.21.15.159:0/644218123 conn(0x55a2382f70f0 msgr2=0x55a238300610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7218ff9640 0 client.15570 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7239d9e740 1 -- 172.21.15.159:0/644218123 shutdown_connections 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7239d9e740 1 -- 172.21.15.159:0/644218123 wait complete. 2024-09-19T06:48:03.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.808+0000 7f7239d9e740 20 client.15570 trim_cache size 0 max 16384 2024-09-19T06:48:03.815 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:03.815 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:48:03.815 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "f1345b4d-4af4-4284-aaaf-eac9ae5830f5", 2024-09-19T06:48:03.815 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:48:03.815 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:03.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 -- 172.21.15.159:0/3471306051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f721c0a3510 msgr2=0x7f721c0a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f721c0a3510 0x7f721c0a59d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f722c0314e0 tx=0x7f722c02a980 comp rx=0 tx=0).stop 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 -- 172.21.15.159:0/3471306051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7230102ef0 msgr2=0x7f723019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7230102ef0 0x7f723019cd20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f722800cce0 tx=0x7f722800a620 comp rx=0 tx=0).stop 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 -- 172.21.15.159:0/3471306051 shutdown_connections 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f721c0a3510 0x7f721c0a59d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7230102ef0 0x7f723019cd20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7230102570 0x7f7230198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 --2- 172.21.15.159:0/3471306051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7230100e20 0x7f72301984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 -- 172.21.15.159:0/3471306051 >> 172.21.15.159:0/3471306051 conn(0x7f72300fc7d0 msgr2=0x7f7230106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 -- 172.21.15.159:0/3471306051 shutdown_connections 2024-09-19T06:48:03.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:03.809+0000 7f72379c5640 1 -- 172.21.15.159:0/3471306051 wait complete. 2024-09-19T06:48:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfa9ffb640 1 -- 172.21.15.159:0/561551103 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5587e03a5d70 con 0x5587e04548e0 2024-09-19T06:48:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfa9ffb640 10 client.15552 handle_command_reply: tid=0 2024-09-19T06:48:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfcb644740 1 client.15552 shutdown 2024-09-19T06:48:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfcb644740 1 -- 172.21.15.159:0/561551103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 msgr2=0x5587e0459d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfcb644740 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0459d30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ce1b0 tx=0x7fbfbc098450 comp rx=0 tx=0).stop 2024-09-19T06:48:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfcb644740 1 -- 172.21.15.159:0/561551103 shutdown_connections 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfcb644740 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5587e04548e0 0x5587e04c9850 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfcb644740 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e0444cb0 0x5587e0457290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfa9ffb640 0 client.15552 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfcb644740 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587e043a410 0x5587e045a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfcb644740 1 --2- 172.21.15.159:0/561551103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5587e0439af0 0x5587e0459d30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.426+0000 7fbfcb644740 1 -- 172.21.15.159:0/561551103 >> 172.21.15.159:0/561551103 conn(0x5587e0436060 msgr2=0x5587e043b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.427+0000 7fbfcb644740 1 -- 172.21.15.159:0/561551103 shutdown_connections 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.427+0000 7fbfcb644740 1 -- 172.21.15.159:0/561551103 wait complete. 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.427+0000 7fbfcb644740 20 client.15552 trim_cache size 0 max 16384 2024-09-19T06:48:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:48:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:48:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:48:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:48:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.427+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbfac0a3580 msgr2=0x7fbfac0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.427+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbfac0a3580 0x7fbfac0a5a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5587e04373e0 tx=0x7fbfb0011820 comp rx=0 tx=0).stop 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.427+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc01010b0 msgr2=0x7fbfc0199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.427+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc01010b0 0x7fbfc0199170 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e9f0 tx=0x7fbfbc00edf0 comp rx=0 tx=0).stop 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.428+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2241327830 shutdown_connections 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.428+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbfac0a3580 0x7fbfac0a5a40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.428+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc01028d0 0x7fbfc01a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.428+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0101a30 0x7fbfc01996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.428+0000 7fbfc87cf640 1 --2- 172.21.15.159:0/2241327830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfc01010b0 0x7fbfc0199170 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.428+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2241327830 >> 172.21.15.159:0/2241327830 conn(0x7fbfc00770f0 msgr2=0x7fbfc01046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.428+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2241327830 shutdown_connections 2024-09-19T06:48:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:04.428+0000 7fbfc87cf640 1 -- 172.21.15.159:0/2241327830 wait complete. 2024-09-19T06:48:04.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:04 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:48:04.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:04 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:04.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:04 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:48:04.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:04 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:04.601 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:04 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:48:04.632 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:48:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:04 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:48:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:04 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:04 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:48:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:04 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:04.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:04 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:48:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:04 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:48:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:04 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:04 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:48:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:04 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:04 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:48:04.954 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:05.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.518+0000 7ff8f74b1640 1 -- 172.21.15.159:0/979597027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8f01027a0 msgr2=0x7ff8f01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:05.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.518+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/979597027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8f01027a0 0x7ff8f01067f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009900 tx=0x7ff8e002a410 comp rx=0 tx=0).stop 2024-09-19T06:48:05.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.518+0000 7ff8f74b1640 1 -- 172.21.15.159:0/979597027 shutdown_connections 2024-09-19T06:48:05.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.518+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/979597027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0106f20 0x7ff8f010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.518+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/979597027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8f01027a0 0x7ff8f01067f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.518+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/979597027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8f0101df0 0x7ff8f01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.518+0000 7ff8f74b1640 1 -- 172.21.15.159:0/979597027 >> 172.21.15.159:0/979597027 conn(0x7ff8f00fd8f0 msgr2=0x7ff8f00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:05.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.519+0000 7ff8f74b1640 1 -- 172.21.15.159:0/979597027 shutdown_connections 2024-09-19T06:48:05.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.519+0000 7ff8f74b1640 1 -- 172.21.15.159:0/979597027 wait complete. 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.520+0000 7ff8f74b1640 1 Processor -- start 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.520+0000 7ff8f74b1640 1 -- start start 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f74b1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0101df0 0x7ff8f0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f74b1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8f01027a0 0x7ff8f0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f74b1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8f0106f20 0x7ff8f019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f524d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0101df0 0x7ff8f0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f74b1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0111fd0 con 0x7ff8f0106f20 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f74b1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0111e50 con 0x7ff8f01027a0 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f74b1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0112150 con 0x7ff8f0101df0 2024-09-19T06:48:05.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f524d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0101df0 0x7ff8f0198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:39646/0 (socket says 172.21.15.159:39646) 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f524d640 1 -- 172.21.15.159:0/1495552751 learned_addr learned my addr 172.21.15.159:0/1495552751 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f5a4e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8f0106f20 0x7ff8f019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.521+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8f01027a0 0x7ff8f0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.522+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/1495552751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0101df0 msgr2=0x7ff8f0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.522+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0101df0 0x7ff8f0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.522+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/1495552751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8f0106f20 msgr2=0x7ff8f019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.522+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8f0106f20 0x7ff8f019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.522+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/1495552751 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f019d3e0 con 0x7ff8f01027a0 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.522+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8f01027a0 0x7ff8f0198970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8e002a930 tx=0x7ff8e0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.523+0000 7ff8e67fc640 1 -- 172.21.15.159:0/1495552751 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e003f070 con 0x7ff8f01027a0 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.523+0000 7ff8f74b1640 1 -- 172.21.15.159:0/1495552751 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f019d670 con 0x7ff8f01027a0 2024-09-19T06:48:05.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.523+0000 7ff8f74b1640 1 -- 172.21.15.159:0/1495552751 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f0074420 con 0x7ff8f01027a0 2024-09-19T06:48:05.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.524+0000 7ff8e67fc640 1 -- 172.21.15.159:0/1495552751 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8e0031c90 con 0x7ff8f01027a0 2024-09-19T06:48:05.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.524+0000 7ff8e67fc640 1 -- 172.21.15.159:0/1495552751 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0035030 con 0x7ff8f01027a0 2024-09-19T06:48:05.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.526+0000 7ff8e67fc640 1 -- 172.21.15.159:0/1495552751 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7ff8e0042070 con 0x7ff8f01027a0 2024-09-19T06:48:05.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8f988a740 1 Processor -- start 2024-09-19T06:48:05.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8f988a740 1 -- start start 2024-09-19T06:48:05.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 0x5578a901a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901adc0 0x5578a9025140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a9025680 0x5578a9027a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8f988a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5578a8f802e0 con 0x5578a9025680 2024-09-19T06:48:05.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8f988a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5578a8f27ce0 con 0x5578a901a4a0 2024-09-19T06:48:05.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8f988a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5578a8f7c2a0 con 0x5578a901adc0 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8e67fc640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff8dc0a3550 0x7ff8dc0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.527+0000 7ff8f4a4c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a9025680 0x5578a9027a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8f4a4c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a9025680 0x5578a9027a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38970/0 (socket says 172.21.15.159:38970) 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/2726512114 learned_addr learned my addr 172.21.15.159:0/2726512114 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8e67fc640 1 -- 172.21.15.159:0/1495552751 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff8e00f0110 con 0x7ff8f01027a0 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8f5a4e640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff8dc0a3550 0x7ff8dc0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/2726512114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901adc0 msgr2=0x5578a9025140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/2726512114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901adc0 0x5578a9025140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/2726512114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 msgr2=0x5578a901a880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/2726512114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 0x5578a901a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/2726512114 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a8f0c440 con 0x5578a9025680 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.528+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/2726512114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a9025680 0x5578a9027a70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00bc280 tx=0x7ff8e008f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae69da1495344785 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:05.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.529+0000 7ff8db7fe640 1 -- 172.21.15.159:0/2726512114 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0049070 con 0x5578a9025680 2024-09-19T06:48:05.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.529+0000 7ff8db7fe640 1 -- 172.21.15.159:0/2726512114 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8e00c05f0 con 0x5578a9025680 2024-09-19T06:48:05.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.529+0000 7ff8db7fe640 1 -- 172.21.15.159:0/2726512114 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00b6e60 con 0x5578a9025680 2024-09-19T06:48:05.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 -- 172.21.15.159:0/2726512114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a9025680 msgr2=0x5578a9027a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 --2- 172.21.15.159:0/2726512114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a9025680 0x5578a9027a70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00bc280 tx=0x7ff8e008f1b0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f5a4e640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff8dc0a3550 0x7ff8dc0a5a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8005fd0 tx=0x7ff8e8009600 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 -- 172.21.15.159:0/2726512114 shutdown_connections 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 --2- 172.21.15.159:0/2726512114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a9025680 0x5578a9027a70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 --2- 172.21.15.159:0/2726512114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901adc0 0x5578a9025140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 --2- 172.21.15.159:0/2726512114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 0x5578a901a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 -- 172.21.15.159:0/2726512114 >> 172.21.15.159:0/2726512114 conn(0x5578a9016a30 msgr2=0x5578a9016e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 -- 172.21.15.159:0/2726512114 shutdown_connections 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 -- 172.21.15.159:0/2726512114 wait complete. 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 -- start start 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.530+0000 7ff8f988a740 1 Processor -- start 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.531+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901a4a0 0x5578a9024f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.531+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a90221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f524d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901a4a0 0x5578a9024f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a9025680 0x5578a9022700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f524d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901a4a0 0x5578a9024f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:39656/0 (socket says 172.21.15.159:39656) 2024-09-19T06:48:05.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f4a4c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a90221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f988a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5578a9028010 con 0x5578a901adc0 2024-09-19T06:48:05.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f524d640 1 -- 172.21.15.159:0/72050949 learned_addr learned my addr 172.21.15.159:0/72050949 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:05.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5578a8f3b050 con 0x5578a9025680 2024-09-19T06:48:05.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5578a9028190 con 0x5578a901a4a0 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f988a740 10 client.0 _ll_register_callbacks cb 0x5578a8f7b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f5a4e640 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a9025680 0x5578a9022700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/72050949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901a4a0 msgr2=0x5578a9024f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901a4a0 0x5578a9024f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/72050949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a9025680 msgr2=0x5578a9022700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a9025680 0x5578a9022700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/72050949 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a8cf13c0 con 0x5578a901adc0 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a90221c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x5578a901b360 tx=0x7ff8e00bc470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972ebee81f364dae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/72050949 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0049070 con 0x5578a901adc0 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/72050949 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff8e00c01f0 con 0x5578a901adc0 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.532+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8e00c05f0 con 0x5578a901adc0 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/72050949 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff8e00b6e60 con 0x5578a901adc0 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8f988a740 10 client.15582 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5578a9028010 con 0x5578a901adc0 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/72050949 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8e00c4eb0 con 0x5578a901adc0 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/72050949 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff8e004c060 con 0x5578a901adc0 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8f988a740 10 client.15582 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8f988a740 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8f988a740 20 client.15582 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8f988a740 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5578a9034b50 0x5578a9036f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8f988a740 4 client.15582 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.533+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff8e00c05f0 con 0x5578a9034b50 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.534+0000 7ff8f524d640 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5578a9034b50 0x5578a9036f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.534+0000 7ff8d8ff9640 10 client.15582 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.534+0000 7ff8f524d640 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5578a9034b50 0x5578a9036f70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe51bbb756d665 server_cookie=9ac63957aca705be in_seq=0 out_seq=0 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/72050949 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff8e00c05f0 con 0x5578a9034b50 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8d8ff9640 10 client.15582 handle_command_reply: tid=0 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 client.15582 shutdown 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 msgr2=0x5578a90221c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a90221c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x5578a901b360 tx=0x7ff8e00bc470 comp rx=0 tx=0).stop 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 shutdown_connections 2024-09-19T06:48:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5578a9034b50 0x5578a9036f70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a9025680 0x5578a9022700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a90221c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 --2- 172.21.15.159:0/72050949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901a4a0 0x5578a9024f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 >> 172.21.15.159:0/72050949 conn(0x5578a9016a30 msgr2=0x5578a901c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8d8ff9640 0 client.15582 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 shutdown_connections 2024-09-19T06:48:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.535+0000 7ff8f988a740 1 -- 172.21.15.159:0/72050949 wait complete. 2024-09-19T06:48:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.536+0000 7ff8f988a740 20 client.15582 trim_cache size 0 max 16384 2024-09-19T06:48:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.553+0000 7ff8f988a740 1 Processor -- start 2024-09-19T06:48:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.553+0000 7ff8f988a740 1 -- start start 2024-09-19T06:48:05.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901a4a0 0x5578a903c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901adc0 0x5578a903cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a9025680 0x5578a901f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f988a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d400c7b0 con 0x5578a901a4a0 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f988a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d400f030 con 0x5578a9025680 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f988a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d400ce20 con 0x5578a901adc0 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f524d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901a4a0 0x5578a903c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f524d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901a4a0 0x5578a903c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38994/0 (socket says 172.21.15.159:38994) 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f524d640 1 -- 172.21.15.159:0/3673772699 learned_addr learned my addr 172.21.15.159:0/3673772699 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/3673772699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901adc0 0x5578a903cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f524d640 1 -- 172.21.15.159:0/3673772699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901adc0 msgr2=0x5578a903cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f524d640 1 --2- 172.21.15.159:0/3673772699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901adc0 0x5578a903cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f524d640 1 -- 172.21.15.159:0/3673772699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a9025680 msgr2=0x5578a901f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.554+0000 7ff8f524d640 1 --2- 172.21.15.159:0/3673772699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a9025680 0x5578a901f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.555+0000 7ff8f524d640 1 -- 172.21.15.159:0/3673772699 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a901abf0 con 0x5578a901a4a0 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.555+0000 7ff8f524d640 1 --2- 172.21.15.159:0/3673772699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901a4a0 0x5578a903c820 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0058c0 tx=0x7ff8ec00bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b21b01014d7c0f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.555+0000 7ff8daffd640 1 -- 172.21.15.159:0/3673772699 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec003d50 con 0x5578a901a4a0 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.555+0000 7ff8daffd640 1 -- 172.21.15.159:0/3673772699 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ec00be80 con 0x5578a901a4a0 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.555+0000 7ff8daffd640 1 -- 172.21.15.159:0/3673772699 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec011830 con 0x5578a901a4a0 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.556+0000 7ff8f988a740 1 -- 172.21.15.159:0/3673772699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901a4a0 msgr2=0x5578a903c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.556+0000 7ff8f988a740 1 --2- 172.21.15.159:0/3673772699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901a4a0 0x5578a903c820 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0058c0 tx=0x7ff8ec00bc90 comp rx=0 tx=0).stop 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.556+0000 7ff8f988a740 1 -- 172.21.15.159:0/3673772699 shutdown_connections 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.556+0000 7ff8f988a740 1 --2- 172.21.15.159:0/3673772699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a9025680 0x5578a901f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.556+0000 7ff8f988a740 1 --2- 172.21.15.159:0/3673772699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a901adc0 0x5578a903cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.556+0000 7ff8f988a740 1 --2- 172.21.15.159:0/3673772699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901a4a0 0x5578a903c820 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.556+0000 7ff8f988a740 1 -- 172.21.15.159:0/3673772699 >> 172.21.15.159:0/3673772699 conn(0x5578a9016a30 msgr2=0x5578a9024240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.556+0000 7ff8f988a740 1 -- 172.21.15.159:0/3673772699 shutdown_connections 2024-09-19T06:48:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.557+0000 7ff8f988a740 1 -- 172.21.15.159:0/3673772699 wait complete. 2024-09-19T06:48:05.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.557+0000 7ff8f988a740 1 -- start start 2024-09-19T06:48:05.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.557+0000 7ff8f988a740 1 Processor -- start 2024-09-19T06:48:05.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.557+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 0x5578a902db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.557+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a9028ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f988a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a9025680 0x5578a90293e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f988a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d400d4f0 con 0x5578a901adc0 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f988a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d400e960 con 0x5578a901a4a0 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f988a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d400dbc0 con 0x5578a9025680 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f988a740 10 client.0 _ll_register_callbacks cb 0x7ff8e00095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f4a4c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a9028ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f4a4c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a9028ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39004/0 (socket says 172.21.15.159:39004) 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/688778136 learned_addr learned my addr 172.21.15.159:0/688778136 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f5a4e640 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a9025680 0x5578a90293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/688778136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a9025680 msgr2=0x5578a90293e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a9025680 0x5578a90293e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/688778136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 msgr2=0x5578a902db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:05.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f524d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 0x5578a902db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 0x5578a902db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.558+0000 7ff8f4a4c640 1 -- 172.21.15.159:0/688778136 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a9029be0 con 0x5578a901adc0 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8f5a4e640 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a9025680 0x5578a90293e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8f524d640 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 0x5578a902db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8f4a4c640 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a9028ea0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00b8750 tx=0x7ff8e0031490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38656f3035736c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/688778136 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0049070 con 0x5578a901adc0 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/688778136 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff8e003b460 con 0x5578a901adc0 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8f988a740 1 -- 172.21.15.159:0/688778136 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578a8f8d850 con 0x5578a901adc0 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/688778136 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff8e00d5240 con 0x5578a901adc0 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8f988a740 10 client.15588 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.559+0000 7ff8f988a740 1 -- 172.21.15.159:0/688778136 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5578a9029be0 con 0x5578a901adc0 2024-09-19T06:48:05.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.560+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/688778136 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8e00c7020 con 0x5578a901adc0 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.560+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/688778136 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff8e00ed990 con 0x5578a901adc0 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.560+0000 7ff8f988a740 10 client.15588 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.560+0000 7ff8f988a740 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.560+0000 7ff8f988a740 20 client.15588 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.560+0000 7ff8f988a740 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5578a909fb30 0x5578a90a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.560+0000 7ff8f988a740 4 client.15588 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.560+0000 7ff8f988a740 1 -- 172.21.15.159:0/688778136 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5578a8f87d60 con 0x5578a909fb30 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.560+0000 7ff8f524d640 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5578a909fb30 0x5578a90a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f524d640 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5578a909fb30 0x5578a90a1f50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f55f90a254a6c44d server_cookie=a5eb5bf6e61a7022 in_seq=0 out_seq=0 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8d8ff9640 10 client.15588 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8d8ff9640 1 -- 172.21.15.159:0/688778136 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5578a8f87d60 con 0x5578a909fb30 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8d8ff9640 10 client.15588 handle_command_reply: tid=0 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f988a740 1 client.15588 shutdown 2024-09-19T06:48:05.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f988a740 1 -- 172.21.15.159:0/688778136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 msgr2=0x5578a9028ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f988a740 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a9028ea0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00b8750 tx=0x7ff8e0031490 comp rx=0 tx=0).stop 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f988a740 1 -- 172.21.15.159:0/688778136 shutdown_connections 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f988a740 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5578a909fb30 0x5578a90a1f50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f988a740 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578a9025680 0x5578a90293e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f988a740 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5578a901adc0 0x5578a9028ea0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f988a740 1 --2- 172.21.15.159:0/688778136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5578a901a4a0 0x5578a902db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.561+0000 7ff8f988a740 1 -- 172.21.15.159:0/688778136 >> 172.21.15.159:0/688778136 conn(0x5578a9016a30 msgr2=0x5578a9015370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.562+0000 7ff8d8ff9640 0 client.15588 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.562+0000 7ff8f988a740 1 -- 172.21.15.159:0/688778136 shutdown_connections 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.562+0000 7ff8f988a740 1 -- 172.21.15.159:0/688778136 wait complete. 2024-09-19T06:48:05.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.562+0000 7ff8f988a740 20 client.15588 trim_cache size 0 max 16384 2024-09-19T06:48:05.569 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:05.569 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:48:05.569 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:48:05.569 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.562+0000 7ff8f74b1640 1 -- 172.21.15.159:0/1495552751 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff8dc0a3550 msgr2=0x7ff8dc0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.562+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff8dc0a3550 0x7ff8dc0a5a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8005fd0 tx=0x7ff8e8009600 comp rx=0 tx=0).stop 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.562+0000 7ff8f74b1640 1 -- 172.21.15.159:0/1495552751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8f01027a0 msgr2=0x7ff8f0198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.563+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8f01027a0 0x7ff8f0198970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8e002a930 tx=0x7ff8e0003b90 comp rx=0 tx=0).stop 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.563+0000 7ff8f74b1640 1 -- 172.21.15.159:0/1495552751 shutdown_connections 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.563+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff8dc0a3550 0x7ff8dc0a5a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.563+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8f0106f20 0x7ff8f019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.563+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8f01027a0 0x7ff8f0198970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.563+0000 7ff8f74b1640 1 --2- 172.21.15.159:0/1495552751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0101df0 0x7ff8f0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.563+0000 7ff8f74b1640 1 -- 172.21.15.159:0/1495552751 >> 172.21.15.159:0/1495552751 conn(0x7ff8f00fd8f0 msgr2=0x7ff8f00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.563+0000 7ff8f74b1640 1 -- 172.21.15.159:0/1495552751 shutdown_connections 2024-09-19T06:48:05.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:05.563+0000 7ff8f74b1640 1 -- 172.21.15.159:0/1495552751 wait complete. 2024-09-19T06:48:05.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:05 smithi159 ceph-mon[30935]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T06:48:05.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:05 smithi203 ceph-mon[35473]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T06:48:05.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:05 smithi189 ceph-mon[34880]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T06:48:06.385 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:48:06.385 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:48:06.672 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:06.970 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:06 smithi159 ceph-mon[30935]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T06:48:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:06 smithi203 ceph-mon[35473]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T06:48:07.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:06 smithi189 ceph-mon[34880]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.255+0000 7fd75f888640 1 -- 172.21.15.159:0/1811174795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758106a70 msgr2=0x7fd758106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.255+0000 7fd75f888640 1 --2- 172.21.15.159:0/1811174795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758106a70 0x7fd758106e50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd7540099b0 tx=0x7fd75402c650 comp rx=0 tx=0).stop 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.255+0000 7fd75f888640 1 -- 172.21.15.159:0/1811174795 shutdown_connections 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.255+0000 7fd75f888640 1 --2- 172.21.15.159:0/1811174795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd758101410 0x7fd75810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.255+0000 7fd75f888640 1 --2- 172.21.15.159:0/1811174795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd758100a70 0x7fd758100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.255+0000 7fd75f888640 1 --2- 172.21.15.159:0/1811174795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758106a70 0x7fd758106e50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.255+0000 7fd75f888640 1 -- 172.21.15.159:0/1811174795 >> 172.21.15.159:0/1811174795 conn(0x7fd7580fc790 msgr2=0x7fd7580febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.255+0000 7fd75f888640 1 -- 172.21.15.159:0/1811174795 shutdown_connections 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.255+0000 7fd75f888640 1 -- 172.21.15.159:0/1811174795 wait complete. 2024-09-19T06:48:07.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.256+0000 7fd75f888640 1 Processor -- start 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.256+0000 7fd75f888640 1 -- start start 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75f888640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758100a70 0x7fd75819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75f888640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd758101410 0x7fd75819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75d624640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758100a70 0x7fd75819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75d624640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758100a70 0x7fd75819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39034/0 (socket says 172.21.15.159:39034) 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75d624640 1 -- 172.21.15.159:0/4281795328 learned_addr learned my addr 172.21.15.159:0/4281795328 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75f888640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd758106a70 0x7fd75819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd75810fd60 con 0x7fd758100a70 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd75810fbe0 con 0x7fd758101410 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75ce23640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd758101410 0x7fd75819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd75810fee0 con 0x7fd758106a70 2024-09-19T06:48:07.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.257+0000 7fd75de25640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd758106a70 0x7fd75819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd75d624640 1 -- 172.21.15.159:0/4281795328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd758106a70 msgr2=0x7fd75819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd75d624640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd758106a70 0x7fd75819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd75d624640 1 -- 172.21.15.159:0/4281795328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd758101410 msgr2=0x7fd75819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd75d624640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd758101410 0x7fd75819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd75d624640 1 -- 172.21.15.159:0/4281795328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75819f570 con 0x7fd758100a70 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd75de25640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd758106a70 0x7fd75819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd75d624640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758100a70 0x7fd75819a5c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd754009230 tx=0x7fd754004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd75ce23640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd758101410 0x7fd75819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd74e7fc640 1 -- 172.21.15.159:0/4281795328 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754041070 con 0x7fd758100a70 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75819f800 con 0x7fd758100a70 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd74e7fc640 1 -- 172.21.15.159:0/4281795328 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd754003cd0 con 0x7fd758100a70 2024-09-19T06:48:07.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.258+0000 7fd74e7fc640 1 -- 172.21.15.159:0/4281795328 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754037050 con 0x7fd758100a70 2024-09-19T06:48:07.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.259+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7581a7140 con 0x7fd758100a70 2024-09-19T06:48:07.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.260+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7581021b0 con 0x7fd758100a70 2024-09-19T06:48:07.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.261+0000 7fd74e7fc640 1 -- 172.21.15.159:0/4281795328 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fd754044070 con 0x7fd758100a70 2024-09-19T06:48:07.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.262+0000 7fd74e7fc640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7440a3550 0x7fd7440a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:07.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.262+0000 7fd74e7fc640 1 -- 172.21.15.159:0/4281795328 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fd7540f04d0 con 0x7fd758100a70 2024-09-19T06:48:07.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.262+0000 7fd75ce23640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7440a3550 0x7fd7440a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:07.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.263+0000 7fd75ce23640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7440a3550 0x7fd7440a5a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7580fec40 tx=0x7fd74800a2d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:07.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.266+0000 7fd74e7fc640 1 -- 172.21.15.159:0/4281795328 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7540bcd00 con 0x7fd758100a70 2024-09-19T06:48:07.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.688+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7581a7310 con 0x7fd758100a70 2024-09-19T06:48:07.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.689+0000 7fd74e7fc640 1 -- 172.21.15.159:0/4281795328 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7fd7540bc600 con 0x7fd758100a70 2024-09-19T06:48:07.691 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:48:07.691 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:48:07.691 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:48:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.692+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7440a3550 msgr2=0x7fd7440a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:07.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.692+0000 7fd75f888640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7440a3550 0x7fd7440a5a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7580fec40 tx=0x7fd74800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.692+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758100a70 msgr2=0x7fd75819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:07.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.692+0000 7fd75f888640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758100a70 0x7fd75819a5c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd754009230 tx=0x7fd754004270 comp rx=0 tx=0).stop 2024-09-19T06:48:07.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.693+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 shutdown_connections 2024-09-19T06:48:07.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.693+0000 7fd75f888640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7440a3550 0x7fd7440a5a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.693+0000 7fd75f888640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd758106a70 0x7fd75819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.693+0000 7fd75f888640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd758101410 0x7fd75819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.693+0000 7fd75f888640 1 --2- 172.21.15.159:0/4281795328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd758100a70 0x7fd75819a5c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:07.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.693+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 >> 172.21.15.159:0/4281795328 conn(0x7fd7580fc790 msgr2=0x7fd75810bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:07.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.693+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 shutdown_connections 2024-09-19T06:48:07.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:07.693+0000 7fd75f888640 1 -- 172.21.15.159:0/4281795328 wait complete. 2024-09-19T06:48:08.028 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:07 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/4281795328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:08.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:07 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/4281795328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:08.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:07 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/4281795328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:08.401 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:48:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:09.016 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:08 smithi159 ceph-mon[30935]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-19T06:48:09.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:08 smithi203 ceph-mon[35473]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-19T06:48:09.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:08 smithi189 ceph-mon[34880]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-19T06:48:09.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.225+0000 7fc44dcae640 1 -- 172.21.15.159:0/3739954857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4481036e0 msgr2=0x7fc448107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:09.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.225+0000 7fc44dcae640 1 --2- 172.21.15.159:0/3739954857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4481036e0 0x7fc448107b90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc430009930 tx=0x7fc43002a420 comp rx=0 tx=0).stop 2024-09-19T06:48:09.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.226+0000 7fc44dcae640 1 -- 172.21.15.159:0/3739954857 shutdown_connections 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.226+0000 7fc44dcae640 1 --2- 172.21.15.159:0/3739954857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4481082a0 0x7fc44810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.226+0000 7fc44dcae640 1 --2- 172.21.15.159:0/3739954857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4481036e0 0x7fc448107b90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.226+0000 7fc44dcae640 1 --2- 172.21.15.159:0/3739954857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc448102d30 0x7fc448103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.226+0000 7fc44dcae640 1 -- 172.21.15.159:0/3739954857 >> 172.21.15.159:0/3739954857 conn(0x7fc4480fc7d0 msgr2=0x7fc4480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.226+0000 7fc44dcae640 1 -- 172.21.15.159:0/3739954857 shutdown_connections 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.226+0000 7fc44dcae640 1 -- 172.21.15.159:0/3739954857 wait complete. 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.226+0000 7fc44dcae640 1 Processor -- start 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.226+0000 7fc44dcae640 1 -- start start 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc44dcae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448102d30 0x7fc4481985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc44dcae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4481036e0 0x7fc448198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc44dcae640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4481082a0 0x7fc44819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448102d30 0x7fc4481985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448102d30 0x7fc4481985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44474/0 (socket says 172.21.15.159:44474) 2024-09-19T06:48:09.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc4477fe640 1 -- 172.21.15.159:0/2616936090 learned_addr learned my addr 172.21.15.159:0/2616936090 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc448112040 con 0x7fc448102d30 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc448111ec0 con 0x7fc4481036e0 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481121c0 con 0x7fc4481082a0 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc447fff640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4481082a0 0x7fc44819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc43ffff640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4481036e0 0x7fc448198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.227+0000 7fc4477fe640 1 -- 172.21.15.159:0/2616936090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4481082a0 msgr2=0x7fc44819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.228+0000 7fc4477fe640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4481082a0 0x7fc44819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.228+0000 7fc4477fe640 1 -- 172.21.15.159:0/2616936090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4481036e0 msgr2=0x7fc448198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.228+0000 7fc4477fe640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4481036e0 0x7fc448198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.228+0000 7fc4477fe640 1 -- 172.21.15.159:0/2616936090 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44819d550 con 0x7fc448102d30 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.228+0000 7fc4477fe640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448102d30 0x7fc4481985a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc43800d950 tx=0x7fc43800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.228+0000 7fc4457fa640 1 -- 172.21.15.159:0/2616936090 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438017070 con 0x7fc448102d30 2024-09-19T06:48:09.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.228+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44819d840 con 0x7fc448102d30 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.228+0000 7fc4457fa640 1 -- 172.21.15.159:0/2616936090 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc438009c30 con 0x7fc448102d30 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.229+0000 7fc4457fa640 1 -- 172.21.15.159:0/2616936090 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43800f6b0 con 0x7fc448102d30 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.229+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4481a5120 con 0x7fc448102d30 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.231+0000 7fc4457fa640 1 -- 172.21.15.159:0/2616936090 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fc4380109d0 con 0x7fc448102d30 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.231+0000 7fc4457fa640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4340a3550 0x7fc4340a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.231+0000 7fc450087740 1 Processor -- start 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.231+0000 7fc43ffff640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4340a3550 0x7fc4340a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.231+0000 7fc450087740 1 -- start start 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.231+0000 7fc4457fa640 1 -- 172.21.15.159:0/2616936090 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc4380d00b0 con 0x7fc448102d30 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc450087740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc450087740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 0x55c16c1c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc450087740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1def60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc450087740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c16c12f2f0 con 0x55c16c1c9120 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc450087740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c16c0d6cf0 con 0x55c16c1ca840 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc450087740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c16c12b2b0 con 0x55c16c1c9b80 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc447fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1def60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:35402/0 (socket says 172.21.15.159:35402) 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc4477fe640 1 -- 172.21.15.159:0/408715284 learned_addr learned my addr 172.21.15.159:0/408715284 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc43ffff640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4340a3550 0x7fc4340a5a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc430009900 tx=0x7fc430005e50 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.232+0000 7fc43ffff640 1 --2- 172.21.15.159:0/408715284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 0x55c16c1c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.233+0000 7fc4477fe640 1 -- 172.21.15.159:0/408715284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 msgr2=0x55c16c1def60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:09.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.233+0000 7fc4477fe640 1 --2- 172.21.15.159:0/408715284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1def60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.233+0000 7fc4477fe640 1 -- 172.21.15.159:0/408715284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 msgr2=0x55c16c1c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.233+0000 7fc4477fe640 1 --2- 172.21.15.159:0/408715284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 0x55c16c1c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.233+0000 7fc4477fe640 1 -- 172.21.15.159:0/408715284 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c16c0bb3a0 con 0x55c16c1ca840 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.233+0000 7fc4477fe640 1 --2- 172.21.15.159:0/408715284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1cac20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc438010fd0 tx=0x7fc438009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17f50e43d32345e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.233+0000 7fc43dffb640 1 -- 172.21.15.159:0/408715284 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438020040 con 0x55c16c1ca840 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.233+0000 7fc43dffb640 1 -- 172.21.15.159:0/408715284 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4380a4d20 con 0x55c16c1ca840 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.233+0000 7fc43dffb640 1 -- 172.21.15.159:0/408715284 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4380a4890 con 0x55c16c1ca840 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 -- 172.21.15.159:0/408715284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 msgr2=0x55c16c1cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 --2- 172.21.15.159:0/408715284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1cac20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc438010fd0 tx=0x7fc438009f20 comp rx=0 tx=0).stop 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 -- 172.21.15.159:0/408715284 shutdown_connections 2024-09-19T06:48:09.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 --2- 172.21.15.159:0/408715284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1def60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 --2- 172.21.15.159:0/408715284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 0x55c16c1c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 --2- 172.21.15.159:0/408715284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1cac20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 -- 172.21.15.159:0/408715284 >> 172.21.15.159:0/408715284 conn(0x55c16c192310 msgr2=0x55c16c1c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 -- 172.21.15.159:0/408715284 shutdown_connections 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 -- 172.21.15.159:0/408715284 wait complete. 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 -- start start 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.234+0000 7fc450087740 1 Processor -- start 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc450087740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1dee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc450087740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 0x55c16c1dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc450087740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1dc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc450087740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c16c1df930 con 0x55c16c1ca840 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc450087740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c16c0ea060 con 0x55c16c1c9b80 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc450087740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c16c1dfab0 con 0x55c16c1c9120 2024-09-19T06:48:09.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc450087740 10 client.0 _ll_register_callbacks cb 0x55c16be3d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc447fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1dc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc447fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1dc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44492/0 (socket says 172.21.15.159:44492) 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc447fff640 1 -- 172.21.15.159:0/4046654970 learned_addr learned my addr 172.21.15.159:0/4046654970 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc4477fe640 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1dee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc43ffff640 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 0x55c16c1dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc447fff640 1 -- 172.21.15.159:0/4046654970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 msgr2=0x55c16c1dee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc447fff640 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1dee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc447fff640 1 -- 172.21.15.159:0/4046654970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 msgr2=0x55c16c1dc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc447fff640 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 0x55c16c1dc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc447fff640 1 -- 172.21.15.159:0/4046654970 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c16bea03c0 con 0x55c16c1ca840 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc43ffff640 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 0x55c16c1dc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:09.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc447fff640 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1dc620 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc440012880 tx=0x7fc440012d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6ac1c01602998f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.235+0000 7fc426ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.236+0000 7fc426ffd640 1 -- 172.21.15.159:0/4046654970 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44000cd20 con 0x55c16c1ca840 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.236+0000 7fc450087740 1 -- 172.21.15.159:0/4046654970 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4380a4d20 con 0x55c16c1ca840 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.236+0000 7fc426ffd640 1 -- 172.21.15.159:0/4046654970 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc44001a3e0 con 0x55c16c1ca840 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.236+0000 7fc426ffd640 1 -- 172.21.15.159:0/4046654970 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc44001a5e0 con 0x55c16c1ca840 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.236+0000 7fc450087740 10 client.15606 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.236+0000 7fc450087740 1 -- 172.21.15.159:0/4046654970 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c16c1eb3f0 con 0x55c16c1ca840 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.236+0000 7fc426ffd640 1 -- 172.21.15.159:0/4046654970 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4380a4d20 con 0x55c16c1ca840 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.236+0000 7fc426ffd640 1 -- 172.21.15.159:0/4046654970 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc440019070 con 0x55c16c1ca840 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.237+0000 7fc450087740 10 client.15606 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.237+0000 7fc450087740 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:09.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.237+0000 7fc450087740 20 client.15606 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.237+0000 7fc450087740 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c16c1ecce0 0x55c16c1ef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.237+0000 7fc450087740 4 client.15606 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.237+0000 7fc450087740 1 -- 172.21.15.159:0/4046654970 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c16c13c860 con 0x55c16c1ecce0 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.237+0000 7fc4477fe640 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c16c1ecce0 0x55c16c1ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.237+0000 7fc4477fe640 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c16c1ecce0 0x55c16c1ef140 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e735e0e967ca74a server_cookie=f3bd60d6dd4fcf4d in_seq=0 out_seq=0 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.237+0000 7fc426ffd640 10 client.15606 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.238+0000 7fc426ffd640 1 -- 172.21.15.159:0/4046654970 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c16c13c860 con 0x55c16c1ecce0 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.238+0000 7fc426ffd640 10 client.15606 handle_command_reply: tid=0 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.238+0000 7fc450087740 1 client.15606 shutdown 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.238+0000 7fc450087740 1 -- 172.21.15.159:0/4046654970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 msgr2=0x55c16c1dc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.238+0000 7fc450087740 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1dc620 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc440012880 tx=0x7fc440012d40 comp rx=0 tx=0).stop 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.238+0000 7fc450087740 1 -- 172.21.15.159:0/4046654970 shutdown_connections 2024-09-19T06:48:09.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.238+0000 7fc450087740 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c16c1ecce0 0x55c16c1ef140 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.239+0000 7fc450087740 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1dc620 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.239+0000 7fc426ffd640 0 client.15606 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.239+0000 7fc450087740 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 0x55c16c1dc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.239+0000 7fc450087740 1 --2- 172.21.15.159:0/4046654970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1dee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.239+0000 7fc450087740 1 -- 172.21.15.159:0/4046654970 >> 172.21.15.159:0/4046654970 conn(0x55c16c192310 msgr2=0x55c16c1c4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.239+0000 7fc450087740 1 -- 172.21.15.159:0/4046654970 shutdown_connections 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.239+0000 7fc450087740 1 -- 172.21.15.159:0/4046654970 wait complete. 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.239+0000 7fc450087740 20 client.15606 trim_cache size 0 max 16384 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc450087740 1 Processor -- start 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc450087740 1 -- start start 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc450087740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 0x55c16c1e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc450087740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc450087740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1de030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc450087740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481a97a0 con 0x55c16c1c9120 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc450087740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481ac020 con 0x55c16c1ca840 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc450087740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481a9e10 con 0x55c16c1c9b80 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:36236/0 (socket says 172.21.15.159:36236) 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc43ffff640 1 -- 172.21.15.159:0/2438716704 learned_addr learned my addr 172.21.15.159:0/2438716704 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.252+0000 7fc447fff640 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1de030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.253+0000 7fc4477fe640 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 0x55c16c1e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.253+0000 7fc43ffff640 1 -- 172.21.15.159:0/2438716704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 msgr2=0x55c16c1de030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.253+0000 7fc43ffff640 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1de030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.253+0000 7fc43ffff640 1 -- 172.21.15.159:0/2438716704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 msgr2=0x55c16c1e8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.253+0000 7fc43ffff640 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 0x55c16c1e8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.253+0000 7fc43ffff640 1 -- 172.21.15.159:0/2438716704 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c16c1c6960 con 0x55c16c1c9b80 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.253+0000 7fc4477fe640 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 0x55c16c1e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.253+0000 7fc43ffff640 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1cbc30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc430031550 tx=0x7fc43003c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74632d1864c2e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc43d7fa640 1 -- 172.21.15.159:0/2438716704 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430035050 con 0x55c16c1c9b80 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc43d7fa640 1 -- 172.21.15.159:0/2438716704 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc430032e50 con 0x55c16c1c9b80 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc43d7fa640 1 -- 172.21.15.159:0/2438716704 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430004cd0 con 0x55c16c1c9b80 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc450087740 1 -- 172.21.15.159:0/2438716704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 msgr2=0x55c16c1cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc450087740 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1cbc30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc430031550 tx=0x7fc43003c000 comp rx=0 tx=0).stop 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc450087740 1 -- 172.21.15.159:0/2438716704 shutdown_connections 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc450087740 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1ca840 0x55c16c1de030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc450087740 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9b80 0x55c16c1cbc30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc450087740 1 --2- 172.21.15.159:0/2438716704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1c9120 0x55c16c1e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.254+0000 7fc450087740 1 -- 172.21.15.159:0/2438716704 >> 172.21.15.159:0/2438716704 conn(0x55c16c192310 msgr2=0x55c16c1dd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:09.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 -- 172.21.15.159:0/2438716704 shutdown_connections 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 -- 172.21.15.159:0/2438716704 wait complete. 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 -- start start 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 Processor -- start 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 0x55c16c1f4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481aa4e0 con 0x55c16c1ca840 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481ab950 con 0x55c16c1c9b80 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481aabb0 con 0x55c16c1c9120 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.255+0000 7fc450087740 10 client.0 _ll_register_callbacks cb 0x7fc440009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc447fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc447fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44524/0 (socket says 172.21.15.159:44524) 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc447fff640 1 -- 172.21.15.159:0/2769942450 learned_addr learned my addr 172.21.15.159:0/2769942450 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1f3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:36238/0 (socket says 172.21.15.159:36238) 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc43ffff640 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 0x55c16c1f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc447fff640 1 -- 172.21.15.159:0/2769942450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 msgr2=0x55c16c1f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc447fff640 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc447fff640 1 -- 172.21.15.159:0/2769942450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 msgr2=0x55c16c1f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc447fff640 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 0x55c16c1f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc447fff640 1 -- 172.21.15.159:0/2769942450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c16c1e4380 con 0x55c16c1ca840 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc4477fe640 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:09.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc447fff640 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1e3d40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc44001bb70 tx=0x7fc44000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9beff20edce616 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc426ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc426ffd640 1 -- 172.21.15.159:0/2769942450 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440012270 con 0x55c16c1ca840 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc426ffd640 1 -- 172.21.15.159:0/2769942450 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc4400049e0 con 0x55c16c1ca840 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.256+0000 7fc450087740 1 -- 172.21.15.159:0/2769942450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc430032e50 con 0x55c16c1ca840 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc426ffd640 1 -- 172.21.15.159:0/2769942450 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc440012410 con 0x55c16c1ca840 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc450087740 10 client.15609 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc450087740 1 -- 172.21.15.159:0/2769942450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c16c1e55d0 con 0x55c16c1ca840 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc426ffd640 1 -- 172.21.15.159:0/2769942450 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc440004be0 con 0x55c16c1ca840 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc426ffd640 1 -- 172.21.15.159:0/2769942450 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc44002a070 con 0x55c16c1ca840 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc450087740 10 client.15609 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:09.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc450087740 10 client.15609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc450087740 20 client.15609 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc450087740 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c16c1ecce0 0x55c16c259c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc450087740 4 client.15609 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.257+0000 7fc450087740 1 -- 172.21.15.159:0/2769942450 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc430032e50 con 0x55c16c1ecce0 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc4477fe640 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c16c1ecce0 0x55c16c259c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc4477fe640 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c16c1ecce0 0x55c16c259c70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3212dac79f680ad4 server_cookie=e49fefcfedf7c71 in_seq=0 out_seq=0 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc426ffd640 10 client.15609 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc426ffd640 1 -- 172.21.15.159:0/2769942450 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc430032e50 con 0x55c16c1ecce0 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc426ffd640 10 client.15609 handle_command_reply: tid=0 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc450087740 1 client.15609 shutdown 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc450087740 1 -- 172.21.15.159:0/2769942450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 msgr2=0x55c16c1e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:09.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc450087740 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1e3d40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc44001bb70 tx=0x7fc44000cba0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc450087740 1 -- 172.21.15.159:0/2769942450 shutdown_connections 2024-09-19T06:48:09.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc450087740 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c16c1ecce0 0x55c16c259c70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc450087740 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c16c1ca840 0x55c16c1e3d40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc450087740 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c16c1c9b80 0x55c16c1f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc426ffd640 0 client.15609 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:09.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc450087740 1 --2- 172.21.15.159:0/2769942450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c16c1c9120 0x55c16c1f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.258+0000 7fc450087740 1 -- 172.21.15.159:0/2769942450 >> 172.21.15.159:0/2769942450 conn(0x55c16c192310 msgr2=0x55c16c1de140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:09.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.259+0000 7fc450087740 1 -- 172.21.15.159:0/2769942450 shutdown_connections 2024-09-19T06:48:09.286 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:48:09.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.259+0000 7fc450087740 1 -- 172.21.15.159:0/2769942450 wait complete. 2024-09-19T06:48:09.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.259+0000 7fc450087740 20 client.15609 trim_cache size 0 max 16384 2024-09-19T06:48:09.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.259+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4340a3550 msgr2=0x7fc4340a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:09.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.259+0000 7fc44dcae640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4340a3550 0x7fc4340a5a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc430009900 tx=0x7fc430005e50 comp rx=0 tx=0).stop 2024-09-19T06:48:09.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.259+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448102d30 msgr2=0x7fc4481985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:09.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.259+0000 7fc44dcae640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448102d30 0x7fc4481985a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc43800d950 tx=0x7fc43800de10 comp rx=0 tx=0).stop 2024-09-19T06:48:09.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.260+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 shutdown_connections 2024-09-19T06:48:09.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.260+0000 7fc44dcae640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4340a3550 0x7fc4340a5a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.260+0000 7fc44dcae640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4481082a0 0x7fc44819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.260+0000 7fc44dcae640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4481036e0 0x7fc448198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.260+0000 7fc44dcae640 1 --2- 172.21.15.159:0/2616936090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448102d30 0x7fc4481985a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:09.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.260+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 >> 172.21.15.159:0/2616936090 conn(0x7fc4480fc7d0 msgr2=0x7fc448105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:09.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.260+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 shutdown_connections 2024-09-19T06:48:09.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:09.260+0000 7fc44dcae640 1 -- 172.21.15.159:0/2616936090 wait complete. 2024-09-19T06:48:10.041 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:09 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:10.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:09 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:10.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:09 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:11.079 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:48:11.080 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:48:11.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:10 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:11.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:10 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:11.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:10 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:48:11.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:10 smithi203 ceph-mon[35473]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-19T06:48:11.112 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:10 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:11.112 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:10 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:11.112 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:10 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:48:11.112 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:10 smithi159 ceph-mon[30935]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-19T06:48:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:10 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:10 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:10 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:48:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:10 smithi189 ceph-mon[34880]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-19T06:48:11.367 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:11.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 -- 172.21.15.159:0/919813740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec100a60 msgr2=0x7fe8ec100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:11.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 --2- 172.21.15.159:0/919813740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec100a60 0x7fe8ec100ec0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009930 tx=0x7fe8e002a420 comp rx=0 tx=0).stop 2024-09-19T06:48:11.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 -- 172.21.15.159:0/919813740 shutdown_connections 2024-09-19T06:48:11.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 --2- 172.21.15.159:0/919813740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8ec101400 0x7fe8ec10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 --2- 172.21.15.159:0/919813740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec100a60 0x7fe8ec100ec0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 --2- 172.21.15.159:0/919813740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec106a60 0x7fe8ec106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 -- 172.21.15.159:0/919813740 >> 172.21.15.159:0/919813740 conn(0x7fe8ec0fc780 msgr2=0x7fe8ec0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:11.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 -- 172.21.15.159:0/919813740 shutdown_connections 2024-09-19T06:48:11.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 -- 172.21.15.159:0/919813740 wait complete. 2024-09-19T06:48:11.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.929+0000 7fe8f237b640 1 Processor -- start 2024-09-19T06:48:11.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.930+0000 7fe8f237b640 1 -- start start 2024-09-19T06:48:11.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.930+0000 7fe8f237b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8ec100a60 0x7fe8ec197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.930+0000 7fe8f237b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec101400 0x7fe8ec197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.930+0000 7fe8f237b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec106a60 0x7fe8ec19bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.930+0000 7fe8f237b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec110eb0 con 0x7fe8ec106a60 2024-09-19T06:48:11.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.930+0000 7fe8f0918640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec106a60 0x7fe8ec19bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.930+0000 7fe8f0918640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec106a60 0x7fe8ec19bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44542/0 (socket says 172.21.15.159:44542) 2024-09-19T06:48:11.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.930+0000 7fe8f0918640 1 -- 172.21.15.159:0/3144312565 learned_addr learned my addr 172.21.15.159:0/3144312565 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:11.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.930+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec110d30 con 0x7fe8ec101400 2024-09-19T06:48:11.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8eb7fe640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec101400 0x7fe8ec197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec111030 con 0x7fe8ec100a60 2024-09-19T06:48:11.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8ec100a60 0x7fe8ec197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8eb7fe640 1 -- 172.21.15.159:0/3144312565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8ec100a60 msgr2=0x7fe8ec197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:11.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8eb7fe640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8ec100a60 0x7fe8ec197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8eb7fe640 1 -- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec106a60 msgr2=0x7fe8ec19bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:11.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8eb7fe640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec106a60 0x7fe8ec19bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8eb7fe640 1 -- 172.21.15.159:0/3144312565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec19c300 con 0x7fe8ec101400 2024-09-19T06:48:11.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8ec100a60 0x7fe8ec197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:11.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8f0918640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec106a60 0x7fe8ec19bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:11.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.931+0000 7fe8eb7fe640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec101400 0x7fe8ec197890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8e002a940 tx=0x7fe8e0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:11.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.932+0000 7fe8e97fa640 1 -- 172.21.15.159:0/3144312565 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0035030 con 0x7fe8ec101400 2024-09-19T06:48:11.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.932+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ec19c590 con 0x7fe8ec101400 2024-09-19T06:48:11.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.932+0000 7fe8e97fa640 1 -- 172.21.15.159:0/3144312565 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e003f070 con 0x7fe8ec101400 2024-09-19T06:48:11.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.932+0000 7fe8e97fa640 1 -- 172.21.15.159:0/3144312565 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e003bd10 con 0x7fe8ec101400 2024-09-19T06:48:11.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.932+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ec06a790 con 0x7fe8ec101400 2024-09-19T06:48:11.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.935+0000 7fe8e97fa640 1 -- 172.21.15.159:0/3144312565 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fe8e00317b0 con 0x7fe8ec101400 2024-09-19T06:48:11.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.935+0000 7fe8f4754740 1 Processor -- start 2024-09-19T06:48:11.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.935+0000 7fe8f4754740 1 -- start start 2024-09-19T06:48:11.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.935+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb3bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.935+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 0x562b6bb46820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.935+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb46d60 0x562b6bb49150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.935+0000 7fe8f4754740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562b6baa1280 con 0x562b6bb3bb80 2024-09-19T06:48:11.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.935+0000 7fe8f4754740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562b6ba48b10 con 0x562b6bb46d60 2024-09-19T06:48:11.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f4754740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562b6ba9d240 con 0x562b6bb3c4a0 2024-09-19T06:48:11.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f0918640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb3bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f0918640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb3bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44544/0 (socket says 172.21.15.159:44544) 2024-09-19T06:48:11.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f0918640 1 -- 172.21.15.159:0/1096313455 learned_addr learned my addr 172.21.15.159:0/1096313455 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:11.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/1096313455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 0x562b6bb46820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f0918640 1 -- 172.21.15.159:0/1096313455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 msgr2=0x562b6bb46820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:11.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f0918640 1 --2- 172.21.15.159:0/1096313455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 0x562b6bb46820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f0918640 1 -- 172.21.15.159:0/1096313455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb46d60 msgr2=0x562b6bb49150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:48:11.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f0918640 1 --2- 172.21.15.159:0/1096313455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb46d60 0x562b6bb49150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f0918640 1 -- 172.21.15.159:0/1096313455 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b6ba551f0 con 0x562b6bb3bb80 2024-09-19T06:48:11.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/1096313455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 0x562b6bb46820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:11.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.936+0000 7fe8f0918640 1 --2- 172.21.15.159:0/1096313455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb3bf60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40117e0 tx=0x7fe8e4011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e8af38d4efe632 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:11.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.937+0000 7fe8d27fc640 1 -- 172.21.15.159:0/1096313455 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400fb40 con 0x562b6bb3bb80 2024-09-19T06:48:11.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.937+0000 7fe8d27fc640 1 -- 172.21.15.159:0/1096313455 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e400fce0 con 0x562b6bb3bb80 2024-09-19T06:48:11.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.937+0000 7fe8e97fa640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8d40a35d0 0x7fe8d40a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8e97fa640 1 -- 172.21.15.159:0/3144312565 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fe8e00f2670 con 0x7fe8ec101400 2024-09-19T06:48:11.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8d40a35d0 0x7fe8d40a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8f4754740 1 -- 172.21.15.159:0/1096313455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 msgr2=0x562b6bb3bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:11.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8f4754740 1 --2- 172.21.15.159:0/1096313455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb3bf60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40117e0 tx=0x7fe8e4011ca0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8f4754740 1 -- 172.21.15.159:0/1096313455 shutdown_connections 2024-09-19T06:48:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8f4754740 1 --2- 172.21.15.159:0/1096313455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb46d60 0x562b6bb49150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8f4754740 1 --2- 172.21.15.159:0/1096313455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 0x562b6bb46820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8f4754740 1 --2- 172.21.15.159:0/1096313455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb3bf60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8f4754740 1 -- 172.21.15.159:0/1096313455 >> 172.21.15.159:0/1096313455 conn(0x562b6bb38110 msgr2=0x562b6bb384f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8d40a35d0 0x7fe8d40a5a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x562b6bb38f70 tx=0x7fe8dc00b2c0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:11.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8f4754740 1 -- 172.21.15.159:0/1096313455 shutdown_connections 2024-09-19T06:48:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.938+0000 7fe8f4754740 1 -- 172.21.15.159:0/1096313455 wait complete. 2024-09-19T06:48:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.939+0000 7fe8f4754740 1 -- start start 2024-09-19T06:48:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.939+0000 7fe8f4754740 1 Processor -- start 2024-09-19T06:48:11.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.939+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb43c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 0x562b6bb44180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb46d60 0x562b6bb446c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8ebfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb43c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8f0918640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb46d60 0x562b6bb446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8f0918640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb46d60 0x562b6bb446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44548/0 (socket says 172.21.15.159:44548) 2024-09-19T06:48:11.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8ebfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb43c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:35454/0 (socket says 172.21.15.159:35454) 2024-09-19T06:48:11.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8f0918640 1 -- 172.21.15.159:0/268884485 learned_addr learned my addr 172.21.15.159:0/268884485 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:11.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562b6bb49980 con 0x562b6bb46d60 2024-09-19T06:48:11.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562b6ba5bf10 con 0x562b6bb3bb80 2024-09-19T06:48:11.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562b6bb49b00 con 0x562b6bb3c4a0 2024-09-19T06:48:11.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8f4754740 10 client.0 _ll_register_callbacks cb 0x562b6ba24a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:11.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8ebfff640 1 -- 172.21.15.159:0/268884485 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 msgr2=0x562b6bb44180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:48:11.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 0x562b6bb44180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8ebfff640 1 -- 172.21.15.159:0/268884485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb46d60 msgr2=0x562b6bb446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:11.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb46d60 0x562b6bb446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.940+0000 7fe8ebfff640 1 -- 172.21.15.159:0/268884485 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b6b8126a0 con 0x562b6bb3bb80 2024-09-19T06:48:11.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.941+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb43c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc005fd0 tx=0x7fe8dc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a7b0cfdbf3e504 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:11.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.941+0000 7fe8cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:48:11.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.941+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/268884485 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc023020 con 0x562b6bb3bb80 2024-09-19T06:48:11.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.941+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e400fce0 con 0x562b6bb3bb80 2024-09-19T06:48:11.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.941+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/268884485 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fe8dc004440 con 0x562b6bb3bb80 2024-09-19T06:48:11.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.941+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/268884485 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe8dc02e050 con 0x562b6bb3bb80 2024-09-19T06:48:11.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.941+0000 7fe8f4754740 10 client.25133 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:11.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.941+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562b6bb555b0 con 0x562b6bb3bb80 2024-09-19T06:48:11.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.941+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/268884485 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e400fce0 con 0x562b6bb3bb80 2024-09-19T06:48:11.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.942+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/268884485 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe8dc00f040 con 0x562b6bb3bb80 2024-09-19T06:48:11.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.942+0000 7fe8f4754740 10 client.25133 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:11.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.942+0000 7fe8f4754740 10 client.25133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:11.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.942+0000 7fe8f4754740 20 client.25133 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:11.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.942+0000 7fe8f4754740 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562b6bb56df0 0x562b6bb59290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.942+0000 7fe8f4754740 4 client.25133 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:11.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.942+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b6baae7f0 con 0x562b6bb56df0 2024-09-19T06:48:11.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.942+0000 7fe8eb7fe640 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562b6bb56df0 0x562b6bb59290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.943+0000 7fe8cb7fe640 10 client.25133 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:11.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.943+0000 7fe8eb7fe640 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562b6bb56df0 0x562b6bb59290 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8480ecca46aff12 server_cookie=52fd0f7efc15d36f in_seq=0 out_seq=0 2024-09-19T06:48:11.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.943+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/268884485 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b6baae7f0 con 0x562b6bb56df0 2024-09-19T06:48:11.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.943+0000 7fe8cb7fe640 10 client.25133 handle_command_reply: tid=0 2024-09-19T06:48:11.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 client.25133 shutdown 2024-09-19T06:48:11.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 msgr2=0x562b6bb43c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:11.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb43c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc005fd0 tx=0x7fe8dc004730 comp rx=0 tx=0).stop 2024-09-19T06:48:11.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 shutdown_connections 2024-09-19T06:48:11.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562b6bb56df0 0x562b6bb59290 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb46d60 0x562b6bb446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb3c4a0 0x562b6bb44180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 --2- 172.21.15.159:0/268884485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb43c40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8cb7fe640 0 client.25133 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:11.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 >> 172.21.15.159:0/268884485 conn(0x562b6bb38110 msgr2=0x562b6bb3ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:11.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 shutdown_connections 2024-09-19T06:48:11.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 1 -- 172.21.15.159:0/268884485 wait complete. 2024-09-19T06:48:11.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.944+0000 7fe8f4754740 20 client.25133 trim_cache size 0 max 16384 2024-09-19T06:48:11.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.978+0000 7fe8f4754740 1 Processor -- start 2024-09-19T06:48:11.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.978+0000 7fe8f4754740 1 -- start start 2024-09-19T06:48:11.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.978+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 0x562b6bb44510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.978+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb5eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.978+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3c4a0 0x562b6bb5f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.978+0000 7fe8f4754740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec1a96b0 con 0x562b6bb3bb80 2024-09-19T06:48:11.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.978+0000 7fe8f4754740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec1abf30 con 0x562b6bb3c4a0 2024-09-19T06:48:11.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.978+0000 7fe8f4754740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec1a9d20 con 0x562b6bb38110 2024-09-19T06:48:11.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.978+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb5eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb5eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44556/0 (socket says 172.21.15.159:44556) 2024-09-19T06:48:11.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8eb7fe640 1 -- 172.21.15.159:0/2557458419 learned_addr learned my addr 172.21.15.159:0/2557458419 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:11.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/2557458419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 0x562b6bb44510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8f0918640 1 --2- 172.21.15.159:0/2557458419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3c4a0 0x562b6bb5f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8eb7fe640 1 -- 172.21.15.159:0/2557458419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 msgr2=0x562b6bb44510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:11.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8eb7fe640 1 --2- 172.21.15.159:0/2557458419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 0x562b6bb44510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8eb7fe640 1 -- 172.21.15.159:0/2557458419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3c4a0 msgr2=0x562b6bb5f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:11.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8eb7fe640 1 --2- 172.21.15.159:0/2557458419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3c4a0 0x562b6bb5f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8eb7fe640 1 -- 172.21.15.159:0/2557458419 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b6bb39280 con 0x562b6bb3bb80 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8eb7fe640 1 --2- 172.21.15.159:0/2557458419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb5eba0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00be7e0 tx=0x7fe8e002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce52e1be0d7cdf0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.979+0000 7fe8d1ffb640 1 -- 172.21.15.159:0/2557458419 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00bef50 con 0x562b6bb3bb80 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.980+0000 7fe8d1ffb640 1 -- 172.21.15.159:0/2557458419 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e00be850 con 0x562b6bb3bb80 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.980+0000 7fe8d1ffb640 1 -- 172.21.15.159:0/2557458419 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00beab0 con 0x562b6bb3bb80 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.980+0000 7fe8f4754740 1 -- 172.21.15.159:0/2557458419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 msgr2=0x562b6bb5eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.980+0000 7fe8f4754740 1 --2- 172.21.15.159:0/2557458419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb5eba0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00be7e0 tx=0x7fe8e002a420 comp rx=0 tx=0).stop 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.981+0000 7fe8f4754740 1 -- 172.21.15.159:0/2557458419 shutdown_connections 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.981+0000 7fe8f4754740 1 --2- 172.21.15.159:0/2557458419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3c4a0 0x562b6bb5f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.981+0000 7fe8f4754740 1 --2- 172.21.15.159:0/2557458419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3bb80 0x562b6bb5eba0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.981+0000 7fe8f4754740 1 --2- 172.21.15.159:0/2557458419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 0x562b6bb44510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.981+0000 7fe8f4754740 1 -- 172.21.15.159:0/2557458419 >> 172.21.15.159:0/2557458419 conn(0x562b6bb38b90 msgr2=0x562b6bb45bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:11.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.981+0000 7fe8f4754740 1 -- 172.21.15.159:0/2557458419 shutdown_connections 2024-09-19T06:48:11.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.981+0000 7fe8f4754740 1 -- 172.21.15.159:0/2557458419 wait complete. 2024-09-19T06:48:11.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.981+0000 7fe8f4754740 1 -- start start 2024-09-19T06:48:11.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.981+0000 7fe8f4754740 1 Processor -- start 2024-09-19T06:48:11.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 0x562b6bb40e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb41390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8f4754740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3c4a0 0x562b6bb418d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8f4754740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec1aa3f0 con 0x562b6bb3c4a0 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8f4754740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec1ab860 con 0x562b6bb3bb80 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8f4754740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec1aaac0 con 0x562b6bb38110 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8f4754740 10 client.0 _ll_register_callbacks cb 0x7fe8dc016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb41390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8ebfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 0x562b6bb40e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8f0918640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3c4a0 0x562b6bb418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb41390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:35480/0 (socket says 172.21.15.159:35480) 2024-09-19T06:48:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.982+0000 7fe8eb7fe640 1 -- 172.21.15.159:0/906408445 learned_addr learned my addr 172.21.15.159:0/906408445 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.983+0000 7fe8f0918640 1 -- 172.21.15.159:0/906408445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 msgr2=0x562b6bb40e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.983+0000 7fe8f0918640 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 0x562b6bb40e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.983+0000 7fe8f0918640 1 -- 172.21.15.159:0/906408445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 msgr2=0x562b6bb41390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.983+0000 7fe8f0918640 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb41390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.983+0000 7fe8f0918640 1 -- 172.21.15.159:0/906408445 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b6bbc0d70 con 0x562b6bb3c4a0 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.984+0000 7fe8f0918640 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3c4a0 0x562b6bb418d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4010de0 tx=0x7fe8e400fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7751d01b5b25fd16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.984+0000 7fe8cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.984+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/906408445 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4036060 con 0x562b6bb3c4a0 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.984+0000 7fe8f4754740 1 -- 172.21.15.159:0/906408445 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e00be850 con 0x562b6bb3c4a0 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.984+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/906408445 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fe8e40105d0 con 0x562b6bb3c4a0 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.984+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/906408445 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe8e40107d0 con 0x562b6bb3c4a0 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.984+0000 7fe8f4754740 10 client.15627 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:11.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.984+0000 7fe8f4754740 1 -- 172.21.15.159:0/906408445 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562b6bbc2090 con 0x562b6bb3c4a0 2024-09-19T06:48:11.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.985+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/906408445 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e00be850 con 0x562b6bb3c4a0 2024-09-19T06:48:11.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/906408445 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe8e400c070 con 0x562b6bb3c4a0 2024-09-19T06:48:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8f4754740 10 client.15627 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8f4754740 10 client.15627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8f4754740 20 client.15627 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8f4754740 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562b6bb46d60 0x562b6bbc4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8f4754740 4 client.15627 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:48:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8f4754740 1 -- 172.21.15.159:0/906408445 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562b6baa8d00 con 0x562b6bb46d60 2024-09-19T06:48:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562b6bb46d60 0x562b6bbc4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8cb7fe640 10 client.15627 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.986+0000 7fe8ebfff640 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562b6bb46d60 0x562b6bbc4440 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f76c951f95b60989 server_cookie=12d8b1d655a4807d in_seq=0 out_seq=0 2024-09-19T06:48:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.987+0000 7fe8cb7fe640 1 -- 172.21.15.159:0/906408445 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562b6baa8d00 con 0x562b6bb46d60 2024-09-19T06:48:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.987+0000 7fe8cb7fe640 10 client.15627 handle_command_reply: tid=0 2024-09-19T06:48:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.987+0000 7fe8f4754740 1 client.15627 shutdown 2024-09-19T06:48:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 -- 172.21.15.159:0/906408445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3c4a0 msgr2=0x562b6bb418d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3c4a0 0x562b6bb418d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4010de0 tx=0x7fe8e400fb70 comp rx=0 tx=0).stop 2024-09-19T06:48:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 -- 172.21.15.159:0/906408445 shutdown_connections 2024-09-19T06:48:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562b6bb46d60 0x562b6bbc4440 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.991 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:11.991 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:48:11.991 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "0dd5c944-2572-4cf8-b7ff-f424e512c0d4", 2024-09-19T06:48:11.991 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:48:11.991 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:11.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8cb7fe640 0 client.15627 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:11.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562b6bb3c4a0 0x562b6bb418d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b6bb3bb80 0x562b6bb41390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 --2- 172.21.15.159:0/906408445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b6bb38110 0x562b6bb40e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 -- 172.21.15.159:0/906408445 >> 172.21.15.159:0/906408445 conn(0x562b6bb38b90 msgr2=0x562b6bb3d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:11.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 -- 172.21.15.159:0/906408445 shutdown_connections 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 1 -- 172.21.15.159:0/906408445 wait complete. 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.988+0000 7fe8f4754740 20 client.15627 trim_cache size 0 max 16384 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8d40a35d0 msgr2=0x7fe8d40a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8d40a35d0 0x7fe8d40a5a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x562b6bb38f70 tx=0x7fe8dc00b2c0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec101400 msgr2=0x7fe8ec197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec101400 0x7fe8ec197890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8e002a940 tx=0x7fe8e0003b90 comp rx=0 tx=0).stop 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 shutdown_connections 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8d40a35d0 0x7fe8d40a5a90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8ec106a60 0x7fe8ec19bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8ec101400 0x7fe8ec197890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 --2- 172.21.15.159:0/3144312565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8ec100a60 0x7fe8ec197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 >> 172.21.15.159:0/3144312565 conn(0x7fe8ec0fc780 msgr2=0x7fe8ec0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:11.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 shutdown_connections 2024-09-19T06:48:11.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:11.989+0000 7fe8f237b640 1 -- 172.21.15.159:0/3144312565 wait complete. 2024-09-19T06:48:12.733 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:48:12.806 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:12 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:48:12.806 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:12 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:12.806 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:12 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:48:12.806 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:12 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:12.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:12 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:48:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:12 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:12 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:48:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:12 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:12 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:48:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:12 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:12 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:48:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:12 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:13.093 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:13.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.676+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2416040620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102570 msgr2=0x7fd8ec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.676+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2416040620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102570 0x7fd8ec1029b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009900 tx=0x7fd8d802a480 comp rx=0 tx=0).stop 2024-09-19T06:48:13.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.677+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2416040620 shutdown_connections 2024-09-19T06:48:13.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.677+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2416040620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ec102ef0 0x7fd8ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.677+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2416040620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102570 0x7fd8ec1029b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.677+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2416040620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8ec100e20 0x7fd8ec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.677+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2416040620 >> 172.21.15.159:0/2416040620 conn(0x7fd8ec0fc7d0 msgr2=0x7fd8ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.677+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2416040620 shutdown_connections 2024-09-19T06:48:13.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.677+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2416040620 wait complete. 2024-09-19T06:48:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.678+0000 7fd8f2dee640 1 Processor -- start 2024-09-19T06:48:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.678+0000 7fd8f2dee640 1 -- start start 2024-09-19T06:48:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.678+0000 7fd8f2dee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ec100e20 0x7fd8ec198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8f2dee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102ef0 0x7fd8ec198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8f2dee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8ec19cfe0 0x7fd8ec19d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8f2dee640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1120d0 con 0x7fd8ec102ef0 2024-09-19T06:48:13.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8f2dee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec111f50 con 0x7fd8ec100e20 2024-09-19T06:48:13.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8ebfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102ef0 0x7fd8ec198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8f0b8a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ec100e20 0x7fd8ec198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8f0b8a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ec100e20 0x7fd8ec198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:35490/0 (socket says 172.21.15.159:35490) 2024-09-19T06:48:13.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/2290388510 learned_addr learned my addr 172.21.15.159:0/2290388510 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:13.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8ebfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102ef0 0x7fd8ec198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44598/0 (socket says 172.21.15.159:44598) 2024-09-19T06:48:13.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8f138b640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8ec19cfe0 0x7fd8ec19d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.679+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2290388510 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec112250 con 0x7fd8ec19cfe0 2024-09-19T06:48:13.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8ebfff640 1 -- 172.21.15.159:0/2290388510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8ec19cfe0 msgr2=0x7fd8ec19d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8ec19cfe0 0x7fd8ec19d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8ebfff640 1 -- 172.21.15.159:0/2290388510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ec100e20 msgr2=0x7fd8ec198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ec100e20 0x7fd8ec198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8ebfff640 1 -- 172.21.15.159:0/2290388510 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec19daa0 con 0x7fd8ec102ef0 2024-09-19T06:48:13.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8f138b640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8ec19cfe0 0x7fd8ec19d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:13.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ec100e20 0x7fd8ec198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:13.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102ef0 0x7fd8ec198c50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8008000 tx=0x7fd8d8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8e9ffb640 1 -- 172.21.15.159:0/2290388510 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d803f020 con 0x7fd8ec102ef0 2024-09-19T06:48:13.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8e9ffb640 1 -- 172.21.15.159:0/2290388510 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8d8031c30 con 0x7fd8ec102ef0 2024-09-19T06:48:13.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.680+0000 7fd8e9ffb640 1 -- 172.21.15.159:0/2290388510 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8035070 con 0x7fd8ec102ef0 2024-09-19T06:48:13.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.681+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2290388510 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ec19dd30 con 0x7fd8ec102ef0 2024-09-19T06:48:13.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.682+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2290388510 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ec1a5460 con 0x7fd8ec102ef0 2024-09-19T06:48:13.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.685+0000 7fd8e9ffb640 1 -- 172.21.15.159:0/2290388510 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fd8d8042020 con 0x7fd8ec102ef0 2024-09-19T06:48:13.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.685+0000 7fd8f51c7740 1 Processor -- start 2024-09-19T06:48:13.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.685+0000 7fd8f51c7740 1 -- start start 2024-09-19T06:48:13.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.685+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cebba10 0x55dc6ceba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.685+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6ceba860 0x55dc6cebacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cecdd20 0x55dc6ced0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f51c7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55dc6ce202e0 con 0x55dc6cebba10 2024-09-19T06:48:13.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f51c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dc6cdc7ce0 con 0x55dc6ceba860 2024-09-19T06:48:13.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f51c7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dc6ce1c2a0 con 0x55dc6cecdd20 2024-09-19T06:48:13.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f138b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cebba10 0x55dc6ceba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f138b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cebba10 0x55dc6ceba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44608/0 (socket says 172.21.15.159:44608) 2024-09-19T06:48:13.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f138b640 1 -- 172.21.15.159:0/1003045004 learned_addr learned my addr 172.21.15.159:0/1003045004 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:13.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/1003045004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cecdd20 0x55dc6ced0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/1003045004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6ceba860 0x55dc6cebacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8e9ffb640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd8dc0a35d0 0x7fd8dc0a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f138b640 1 -- 172.21.15.159:0/1003045004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cecdd20 msgr2=0x55dc6ced0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f138b640 1 --2- 172.21.15.159:0/1003045004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cecdd20 0x55dc6ced0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f138b640 1 -- 172.21.15.159:0/1003045004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6ceba860 msgr2=0x55dc6cebacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f138b640 1 --2- 172.21.15.159:0/1003045004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6ceba860 0x55dc6cebacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8f138b640 1 -- 172.21.15.159:0/1003045004 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc6cdac440 con 0x55dc6cebba10 2024-09-19T06:48:13.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.686+0000 7fd8e9ffb640 1 -- 172.21.15.159:0/2290388510 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fd8d80f0670 con 0x7fd8ec102ef0 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.687+0000 7fd8f138b640 1 --2- 172.21.15.159:0/1003045004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cebba10 0x55dc6ceba320 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400f9f0 tx=0x7fd8e400feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90c8f17cadd1de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.687+0000 7fd8f138b640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd8dc0a35d0 0x7fd8dc0a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.687+0000 7fd8f138b640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd8dc0a35d0 0x7fd8dc0a5a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400d710 tx=0x7fd8e4014000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.688+0000 7fd8d6ffd640 1 -- 172.21.15.159:0/1003045004 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400db20 con 0x55dc6cebba10 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.688+0000 7fd8d6ffd640 1 -- 172.21.15.159:0/1003045004 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8e4025480 con 0x55dc6cebba10 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.688+0000 7fd8d6ffd640 1 -- 172.21.15.159:0/1003045004 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4010e60 con 0x55dc6cebba10 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1003045004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cebba10 msgr2=0x55dc6ceba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1003045004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cebba10 0x55dc6ceba320 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400f9f0 tx=0x7fd8e400feb0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1003045004 shutdown_connections 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1003045004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cecdd20 0x55dc6ced0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1003045004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6ceba860 0x55dc6cebacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1003045004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cebba10 0x55dc6ceba320 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1003045004 >> 172.21.15.159:0/1003045004 conn(0x55dc6ceb6a30 msgr2=0x55dc6ceb6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1003045004 shutdown_connections 2024-09-19T06:48:13.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1003045004 wait complete. 2024-09-19T06:48:13.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 -- start start 2024-09-19T06:48:13.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.689+0000 7fd8f51c7740 1 Processor -- start 2024-09-19T06:48:13.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cec0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 0x55dc6cebde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cebe620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f51c7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55dc6ced0a80 con 0x55dc6cecdd20 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f51c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dc6cddb050 con 0x55dc6cebba10 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f51c7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dc6ced0c00 con 0x55dc6ceba860 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f138b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cebe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f138b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cebe620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44618/0 (socket says 172.21.15.159:44618) 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f138b640 1 -- 172.21.15.159:0/1814760876 learned_addr learned my addr 172.21.15.159:0/1814760876 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cec0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 0x55dc6cebde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.690+0000 7fd8f51c7740 10 client.0 _ll_register_callbacks cb 0x55dc6ce1b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:13.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/1814760876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 msgr2=0x55dc6cebde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 0x55dc6cebde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/1814760876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 msgr2=0x55dc6cebe620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cebe620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/1814760876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc6cb913c0 con 0x55dc6ceba860 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cec0be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00106d0 tx=0x7fd8e0010b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=476a989e30ea4786 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8cbfff640 1 -- 172.21.15.159:0/1814760876 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0017070 con 0x55dc6ceba860 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1814760876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e4025480 con 0x55dc6ceba860 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8cbfff640 1 -- 172.21.15.159:0/1814760876 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fd8e000eb30 con 0x55dc6ceba860 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8cbfff640 1 -- 172.21.15.159:0/1814760876 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd8e000ed30 con 0x55dc6ceba860 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8f51c7740 10 client.25189 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1814760876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dc6cec3b90 con 0x55dc6ceba860 2024-09-19T06:48:13.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.691+0000 7fd8cbfff640 1 -- 172.21.15.159:0/1814760876 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8e4025480 con 0x55dc6ceba860 2024-09-19T06:48:13.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.692+0000 7fd8cbfff640 1 -- 172.21.15.159:0/1814760876 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd8e0011440 con 0x55dc6ceba860 2024-09-19T06:48:13.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.693+0000 7fd8f51c7740 10 client.25189 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:13.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.693+0000 7fd8f51c7740 10 client.25189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:13.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.693+0000 7fd8f51c7740 20 client.25189 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:13.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.693+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dc6cec53d0 0x55dc6cec7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.693+0000 7fd8f51c7740 4 client.25189 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:13.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.693+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1814760876 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc6ce2d850 con 0x55dc6cec53d0 2024-09-19T06:48:13.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.693+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dc6cec53d0 0x55dc6cec7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.693+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dc6cec53d0 0x55dc6cec7840 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1970a92d012349c1 server_cookie=e019c3daf6af24aa in_seq=0 out_seq=0 2024-09-19T06:48:13.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.693+0000 7fd8cbfff640 10 client.25189 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:13.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8cbfff640 1 -- 172.21.15.159:0/1814760876 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc6ce2d850 con 0x55dc6cec53d0 2024-09-19T06:48:13.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8cbfff640 10 client.25189 handle_command_reply: tid=0 2024-09-19T06:48:13.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 client.25189 shutdown 2024-09-19T06:48:13.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1814760876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 msgr2=0x55dc6cec0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cec0be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00106d0 tx=0x7fd8e0010b90 comp rx=0 tx=0).stop 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1814760876 shutdown_connections 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dc6cec53d0 0x55dc6cec7840 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cebe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 0x55dc6cebde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8cbfff640 0 client.25189 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1814760876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cec0be0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1814760876 >> 172.21.15.159:0/1814760876 conn(0x55dc6ceb6a30 msgr2=0x55dc6cebc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1814760876 shutdown_connections 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.694+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1814760876 wait complete. 2024-09-19T06:48:13.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.695+0000 7fd8f51c7740 20 client.25189 trim_cache size 0 max 16384 2024-09-19T06:48:13.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.717+0000 7fd8f51c7740 1 Processor -- start 2024-09-19T06:48:13.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f51c7740 1 -- start start 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6ceba860 0x55dc6cecbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cebba10 0x55dc6cecc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cecdd20 0x55dc6ceefdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f51c7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec0701c0 con 0x55dc6ceba860 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f51c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec072a40 con 0x55dc6cecdd20 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f51c7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec070830 con 0x55dc6cebba10 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f0b8a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6ceba860 0x55dc6cecbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f0b8a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6ceba860 0x55dc6cecbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44622/0 (socket says 172.21.15.159:44622) 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/1848698937 learned_addr learned my addr 172.21.15.159:0/1848698937 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f138b640 1 --2- 172.21.15.159:0/1848698937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cecdd20 0x55dc6ceefdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/1848698937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cebba10 0x55dc6cecc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/1848698937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cebba10 msgr2=0x55dc6cecc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/1848698937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cebba10 0x55dc6cecc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/1848698937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cecdd20 msgr2=0x55dc6ceefdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/1848698937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cecdd20 0x55dc6ceefdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.718+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/1848698937 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc6cec1830 con 0x55dc6ceba860 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.719+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/1848698937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6ceba860 0x55dc6cecbd50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000efb0 tx=0x7fd8e0010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a2a16fefa0ba42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.719+0000 7fd8d67fc640 1 -- 172.21.15.159:0/1848698937 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0017040 con 0x55dc6ceba860 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.719+0000 7fd8d67fc640 1 -- 172.21.15.159:0/1848698937 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8e0030070 con 0x55dc6ceba860 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.719+0000 7fd8d67fc640 1 -- 172.21.15.159:0/1848698937 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0005450 con 0x55dc6ceba860 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.720+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1848698937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6ceba860 msgr2=0x55dc6cecbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.720+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1848698937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6ceba860 0x55dc6cecbd50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000efb0 tx=0x7fd8e0010ed0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.720+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1848698937 shutdown_connections 2024-09-19T06:48:13.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.720+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1848698937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cecdd20 0x55dc6ceefdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.720+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1848698937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6cebba10 0x55dc6cecc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.720+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/1848698937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6ceba860 0x55dc6cecbd50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.720+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1848698937 >> 172.21.15.159:0/1848698937 conn(0x55dc6ceb6a30 msgr2=0x55dc6cec0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.720+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1848698937 shutdown_connections 2024-09-19T06:48:13.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.720+0000 7fd8f51c7740 1 -- 172.21.15.159:0/1848698937 wait complete. 2024-09-19T06:48:13.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.721+0000 7fd8f51c7740 1 -- start start 2024-09-19T06:48:13.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.721+0000 7fd8f51c7740 1 Processor -- start 2024-09-19T06:48:13.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.721+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cee4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.721+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 0x55dc6cee5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.721+0000 7fd8f51c7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cee57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f0b8a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cee4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f0b8a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cee4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:36378/0 (socket says 172.21.15.159:36378) 2024-09-19T06:48:13.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8ebfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 0x55dc6cee5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8ebfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 0x55dc6cee5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:35518/0 (socket says 172.21.15.159:35518) 2024-09-19T06:48:13.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f138b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cee57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f138b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cee57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44630/0 (socket says 172.21.15.159:44630) 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec070f00 con 0x55dc6cecdd20 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/3179983716 learned_addr learned my addr 172.21.15.159:0/3179983716 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec072370 con 0x55dc6cebba10 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec0715d0 con 0x55dc6ceba860 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/3179983716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 msgr2=0x55dc6cee5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 0x55dc6cee5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/3179983716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 msgr2=0x55dc6cee57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cee57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f0b8a640 1 -- 172.21.15.159:0/3179983716 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc6cf4fff0 con 0x55dc6ceba860 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f138b640 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cee57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.722+0000 7fd8f51c7740 10 client.0 _ll_register_callbacks cb 0x7fd8e000b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:13.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.723+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e0030070 con 0x55dc6ceba860 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.723+0000 7fd8f0b8a640 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cee4d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0011850 tx=0x7fd8e00105e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c274bfe1f40463 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.723+0000 7fd8cbfff640 10 client.25195 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.723+0000 7fd8cbfff640 1 -- 172.21.15.159:0/3179983716 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0017040 con 0x55dc6ceba860 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.723+0000 7fd8cbfff640 1 -- 172.21.15.159:0/3179983716 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fd8e00052d0 con 0x55dc6ceba860 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.723+0000 7fd8cbfff640 1 -- 172.21.15.159:0/3179983716 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd8e0005550 con 0x55dc6ceba860 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.723+0000 7fd8f51c7740 10 client.25195 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.723+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55dc6cf51090 con 0x55dc6ceba860 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.723+0000 7fd8cbfff640 1 -- 172.21.15.159:0/3179983716 <== mon.1 v2:172.21.15.203:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd8e0004680 con 0x55dc6ceba860 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8f51c7740 10 client.25195 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8f51c7740 10 client.25195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8f51c7740 20 client.25195 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dc6cf516a0 0x55dc6cf53b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8f51c7740 4 client.25195 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dc6ce27d60 con 0x55dc6cf516a0 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dc6cf516a0 0x55dc6cf53b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8cbfff640 10 client.25195 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8ebfff640 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dc6cf516a0 0x55dc6cf53b40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b32bd7813ba14e server_cookie=f3e66f366b88d592 in_seq=0 out_seq=0 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8cbfff640 1 -- 172.21.15.159:0/3179983716 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55dc6ce27d60 con 0x55dc6cf516a0 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8cbfff640 10 client.25195 handle_command_reply: tid=0 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.724+0000 7fd8f51c7740 1 client.25195 shutdown 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 msgr2=0x55dc6cee4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cee4d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0011850 tx=0x7fd8e00105e0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 shutdown_connections 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dc6cf516a0 0x55dc6cf53b40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dc6cecdd20 0x55dc6cee57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dc6cebba10 0x55dc6cee5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8cbfff640 0 client.25195 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:13.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 --2- 172.21.15.159:0/3179983716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc6ceba860 0x55dc6cee4d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 >> 172.21.15.159:0/3179983716 conn(0x55dc6ceb6a30 msgr2=0x55dc6ceefdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 shutdown_connections 2024-09-19T06:48:13.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 1 -- 172.21.15.159:0/3179983716 wait complete. 2024-09-19T06:48:13.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.725+0000 7fd8f51c7740 20 client.25195 trim_cache size 0 max 16384 2024-09-19T06:48:13.731 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:13.731 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:48:13.731 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:48:13.732 INFO:teuthology.orchestra.run.smithi159.stdout: "0dd5c944-2572-4cf8-b7ff-f424e512c0d4": { 2024-09-19T06:48:13.732 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:48:13.732 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "0dd5c944-2572-4cf8-b7ff-f424e512c0d4", 2024-09-19T06:48:13.732 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:48:13.732 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:13.732 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:13.732 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:13.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.726+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd8dc0a35d0 msgr2=0x7fd8dc0a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.726+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd8dc0a35d0 0x7fd8dc0a5a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400d710 tx=0x7fd8e4014000 comp rx=0 tx=0).stop 2024-09-19T06:48:13.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.726+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102ef0 msgr2=0x7fd8ec198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.726+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102ef0 0x7fd8ec198c50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8008000 tx=0x7fd8d8003c10 comp rx=0 tx=0).stop 2024-09-19T06:48:13.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.726+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2290388510 shutdown_connections 2024-09-19T06:48:13.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.726+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd8dc0a35d0 0x7fd8dc0a5a90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.726+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8ec19cfe0 0x7fd8ec19d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.726+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8ec102ef0 0x7fd8ec198c50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.726+0000 7fd8f2dee640 1 --2- 172.21.15.159:0/2290388510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ec100e20 0x7fd8ec198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.727+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2290388510 >> 172.21.15.159:0/2290388510 conn(0x7fd8ec0fc7d0 msgr2=0x7fd8ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.727+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2290388510 shutdown_connections 2024-09-19T06:48:13.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:13.727+0000 7fd8f2dee640 1 -- 172.21.15.159:0/2290388510 wait complete. 2024-09-19T06:48:13.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:13 smithi203 ceph-mon[35473]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T06:48:13.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:13 smithi189 ceph-mon[34880]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T06:48:13.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:13 smithi159 ceph-mon[30935]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T06:48:14.572 INFO:tasks.cephfs.filesystem:scrub status for tag:0dd5c944-2572-4cf8-b7ff-f424e512c0d4 - {'path': '/', 'tag': '0dd5c944-2572-4cf8-b7ff-f424e512c0d4', 'options': 'recursive,force'} 2024-09-19T06:48:14.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:14 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:48:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:14 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:48:14.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:14 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:48:15.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:15 smithi203 ceph-mon[35473]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-19T06:48:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:15 smithi189 ceph-mon[34880]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-19T06:48:15.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:15 smithi159 ceph-mon[30935]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-19T06:48:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:16 smithi203 ceph-mon[35473]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T06:48:17.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:16 smithi189 ceph-mon[34880]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T06:48:17.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:16 smithi159 ceph-mon[30935]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T06:48:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.567+0000 7f84e956d640 1 -- 172.21.15.159:0/3282276851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e41009b0 msgr2=0x7f84e4100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.567+0000 7f84e956d640 1 --2- 172.21.15.159:0/3282276851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e41009b0 0x7f84e4100e10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009900 tx=0x7f84d802a410 comp rx=0 tx=0).stop 2024-09-19T06:48:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.567+0000 7f84e956d640 1 -- 172.21.15.159:0/3282276851 shutdown_connections 2024-09-19T06:48:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.567+0000 7f84e956d640 1 --2- 172.21.15.159:0/3282276851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84e4101350 0x7f84e410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.567+0000 7f84e956d640 1 --2- 172.21.15.159:0/3282276851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e41009b0 0x7f84e4100e10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.567+0000 7f84e956d640 1 --2- 172.21.15.159:0/3282276851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84e41069c0 0x7f84e4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.567+0000 7f84e956d640 1 -- 172.21.15.159:0/3282276851 >> 172.21.15.159:0/3282276851 conn(0x7f84e4077990 msgr2=0x7f84e40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.567+0000 7f84e956d640 1 -- 172.21.15.159:0/3282276851 shutdown_connections 2024-09-19T06:48:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.567+0000 7f84e956d640 1 -- 172.21.15.159:0/3282276851 wait complete. 2024-09-19T06:48:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.568+0000 7f84e956d640 1 Processor -- start 2024-09-19T06:48:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.568+0000 7f84e956d640 1 -- start start 2024-09-19T06:48:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e956d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84e41009b0 0x7f84e410e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e956d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e4101350 0x7f84e410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e956d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84e41069c0 0x7f84e410ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e956d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4111f00 con 0x7f84e4101350 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e4101350 0x7f84e410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e4101350 0x7f84e410e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44648/0 (socket says 172.21.15.159:44648) 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e27fc640 1 -- 172.21.15.159:0/3147975249 learned_addr learned my addr 172.21.15.159:0/3147975249 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4111d80 con 0x7f84e41069c0 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84e41009b0 0x7f84e410e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4112080 con 0x7f84e41009b0 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.569+0000 7f84e37fe640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84e41069c0 0x7f84e410ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84e27fc640 1 -- 172.21.15.159:0/3147975249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84e41009b0 msgr2=0x7f84e410e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84e27fc640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84e41009b0 0x7f84e410e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84e27fc640 1 -- 172.21.15.159:0/3147975249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84e41069c0 msgr2=0x7f84e410ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84e27fc640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84e41069c0 0x7f84e410ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84e27fc640 1 -- 172.21.15.159:0/3147975249 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41a6750 con 0x7f84e4101350 2024-09-19T06:48:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84e37fe640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84e41069c0 0x7f84e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84e27fc640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e4101350 0x7f84e410e550 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009230 tx=0x7f84d8003880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84cbfff640 1 -- 172.21.15.159:0/3147975249 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d803f030 con 0x7f84e4101350 2024-09-19T06:48:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84cbfff640 1 -- 172.21.15.159:0/3147975249 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d8003c80 con 0x7f84e4101350 2024-09-19T06:48:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.570+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e41a69e0 con 0x7f84e4101350 2024-09-19T06:48:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.571+0000 7f84cbfff640 1 -- 172.21.15.159:0/3147975249 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8035070 con 0x7f84e4101350 2024-09-19T06:48:17.574 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.571+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41a6e60 con 0x7f84e4101350 2024-09-19T06:48:17.574 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.574+0000 7f84cbfff640 1 -- 172.21.15.159:0/3147975249 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f84d8042030 con 0x7f84e4101350 2024-09-19T06:48:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.575+0000 7f84cbfff640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f84cc0a3530 0x7f84cc0a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.575+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f84cc0a3530 0x7f84cc0a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.575+0000 7f84cbfff640 1 -- 172.21.15.159:0/3147975249 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f84d80eff20 con 0x7f84e4101350 2024-09-19T06:48:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.575+0000 7f84ec3e4740 1 Processor -- start 2024-09-19T06:48:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.575+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f84cc0a3530 0x7f84cc0a59f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84d400ab60 tx=0x7f84d400a2d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84ec3e4740 1 -- start start 2024-09-19T06:48:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca2fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca3a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 0x5602fca3d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5602fc9942f0 con 0x5602fca30410 2024-09-19T06:48:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5602fc93c270 con 0x5602fca2faf0 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5602fc9902b0 con 0x5602fca3acb0 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca3a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca3a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44652/0 (socket says 172.21.15.159:44652) 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e27fc640 1 -- 172.21.15.159:0/2710247172 learned_addr learned my addr 172.21.15.159:0/2710247172 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca2fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e37fe640 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 0x5602fca3d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e27fc640 1 -- 172.21.15.159:0/2710247172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 msgr2=0x5602fca3d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e27fc640 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 0x5602fca3d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e27fc640 1 -- 172.21.15.159:0/2710247172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 msgr2=0x5602fca2fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e27fc640 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca2fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e27fc640 1 -- 172.21.15.159:0/2710247172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602fc93b340 con 0x5602fca30410 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e37fe640 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 0x5602fca3d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.576+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca2fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.577+0000 7f84e27fc640 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca3a770 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f84d80edc40 tx=0x7f84d80b8420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786d673ecb76d8fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.577+0000 7f84c97fa640 1 -- 172.21.15.159:0/2710247172 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8049040 con 0x5602fca30410 2024-09-19T06:48:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.577+0000 7f84c97fa640 1 -- 172.21.15.159:0/2710247172 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d80bc750 con 0x5602fca30410 2024-09-19T06:48:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.577+0000 7f84c97fa640 1 -- 172.21.15.159:0/2710247172 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d80dc150 con 0x5602fca30410 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 -- 172.21.15.159:0/2710247172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 msgr2=0x5602fca3a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca3a770 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f84d80edc40 tx=0x7f84d80b8420 comp rx=0 tx=0).stop 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 -- 172.21.15.159:0/2710247172 shutdown_connections 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 0x5602fca3d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca3a770 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/2710247172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca2fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 -- 172.21.15.159:0/2710247172 >> 172.21.15.159:0/2710247172 conn(0x5602fca2c060 msgr2=0x5602fca2c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 -- 172.21.15.159:0/2710247172 shutdown_connections 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 -- 172.21.15.159:0/2710247172 wait complete. 2024-09-19T06:48:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.578+0000 7f84ec3e4740 1 -- start start 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84ec3e4740 1 Processor -- start 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca37c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca38180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 0x5602fca386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5602fca3d640 con 0x5602fca30410 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca38180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5602fc91d290 con 0x5602fca2faf0 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca38180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44660/0 (socket says 172.21.15.159:44660) 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84e27fc640 1 -- 172.21.15.159:0/3398167522 learned_addr learned my addr 172.21.15.159:0/3398167522 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca37c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84ec3e4740 1 -- 172.21.15.159:0/3398167522 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5602fca3d7c0 con 0x5602fca3acb0 2024-09-19T06:48:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84e37fe640 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 0x5602fca386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84ec3e4740 10 client.0 _ll_register_callbacks cb 0x5602fc94e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84e27fc640 1 -- 172.21.15.159:0/3398167522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 msgr2=0x5602fca386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84e27fc640 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 0x5602fca386c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.579+0000 7f84e27fc640 1 -- 172.21.15.159:0/3398167522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 msgr2=0x5602fca37c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84e27fc640 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca37c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84e27fc640 1 -- 172.21.15.159:0/3398167522 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602fc6a7210 con 0x5602fca30410 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca37c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84ec3e4740 1 -- 172.21.15.159:0/3398167522 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d80bc750 con 0x5602fca30410 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84e27fc640 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca38180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f84d80f0240 tx=0x7f84d8005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4dd3b87fd750a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84c6ff5640 10 client.15657 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84c6ff5640 1 -- 172.21.15.159:0/3398167522 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8049070 con 0x5602fca30410 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84c6ff5640 1 -- 172.21.15.159:0/3398167522 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f84d80b86c0 con 0x5602fca30410 2024-09-19T06:48:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84c6ff5640 1 -- 172.21.15.159:0/3398167522 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f84d80bc050 con 0x5602fca30410 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84ec3e4740 10 client.15657 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.580+0000 7f84ec3e4740 1 -- 172.21.15.159:0/3398167522 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({fsmap=20}) -- 0x5602fc773620 con 0x5602fca30410 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84c6ff5640 1 -- 172.21.15.159:0/3398167522 <== mon.0 v2:172.21.15.159:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f84d80d7070 con 0x5602fca30410 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84ec3e4740 10 client.15657 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84ec3e4740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84ec3e4740 20 client.15657 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5602fca4a740 0x5602fca4cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84ec3e4740 4 client.15657 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84ec3e4740 1 -- 172.21.15.159:0/3398167522 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602fc9a1a20 con 0x5602fca4a740 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5602fca4a740 0x5602fca4cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84c6ff5640 10 client.15657 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.581+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5602fca4a740 0x5602fca4cb30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e0ac9bf145c64dc server_cookie=cd3f6a12479f4239 in_seq=0 out_seq=0 2024-09-19T06:48:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.582+0000 7f84c6ff5640 1 -- 172.21.15.159:0/3398167522 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602fc9a1a20 con 0x5602fca4a740 2024-09-19T06:48:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.582+0000 7f84c6ff5640 10 client.15657 handle_command_reply: tid=0 2024-09-19T06:48:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.582+0000 7f84ec3e4740 1 client.15657 shutdown 2024-09-19T06:48:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.582+0000 7f84ec3e4740 1 -- 172.21.15.159:0/3398167522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 msgr2=0x5602fca38180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.582+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca38180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f84d80f0240 tx=0x7f84d8005e00 comp rx=0 tx=0).stop 2024-09-19T06:48:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.582+0000 7f84ec3e4740 1 -- 172.21.15.159:0/3398167522 shutdown_connections 2024-09-19T06:48:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.582+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5602fca4a740 0x5602fca4cb30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.583+0000 7f84c6ff5640 0 client.15657 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.583+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca3acb0 0x5602fca386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.583+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca38180 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.583+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/3398167522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca2faf0 0x5602fca37c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.583+0000 7f84ec3e4740 1 -- 172.21.15.159:0/3398167522 >> 172.21.15.159:0/3398167522 conn(0x5602fca2c060 msgr2=0x5602fca31dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.583+0000 7f84ec3e4740 1 -- 172.21.15.159:0/3398167522 shutdown_connections 2024-09-19T06:48:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.583+0000 7f84ec3e4740 1 -- 172.21.15.159:0/3398167522 wait complete. 2024-09-19T06:48:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.583+0000 7f84ec3e4740 20 client.15657 trim_cache size 0 max 16384 2024-09-19T06:48:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.611+0000 7f84ec3e4740 1 Processor -- start 2024-09-19T06:48:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.611+0000 7f84ec3e4740 1 -- start start 2024-09-19T06:48:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.611+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca384f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.611+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca30410 0x5602fca39bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca3acb0 0x5602fca52220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41ad640 con 0x5602fca3acb0 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41afec0 con 0x5602fca30410 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41adcb0 con 0x5602fca2faf0 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca384f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:36430/0 (socket says 172.21.15.159:36430) 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e2ffd640 1 -- 172.21.15.159:0/1669570699 learned_addr learned my addr 172.21.15.159:0/1669570699 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e27fc640 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca30410 0x5602fca39bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e37fe640 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca3acb0 0x5602fca52220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e2ffd640 1 -- 172.21.15.159:0/1669570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca30410 msgr2=0x5602fca39bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca30410 0x5602fca39bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e2ffd640 1 -- 172.21.15.159:0/1669570699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca3acb0 msgr2=0x5602fca52220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca3acb0 0x5602fca52220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e2ffd640 1 -- 172.21.15.159:0/1669570699 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602fca468a0 con 0x5602fca2faf0 2024-09-19T06:48:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e27fc640 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca30410 0x5602fca39bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.612+0000 7f84e37fe640 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca3acb0 0x5602fca52220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.613+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca384f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f84d401d200 tx=0x7f84d4012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd882cb5f86506b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.613+0000 7f84c8ff9640 1 -- 172.21.15.159:0/1669570699 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4016070 con 0x5602fca2faf0 2024-09-19T06:48:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.613+0000 7f84c8ff9640 1 -- 172.21.15.159:0/1669570699 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d401d3b0 con 0x5602fca2faf0 2024-09-19T06:48:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.613+0000 7f84c8ff9640 1 -- 172.21.15.159:0/1669570699 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d40319b0 con 0x5602fca2faf0 2024-09-19T06:48:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.614+0000 7f84ec3e4740 1 -- 172.21.15.159:0/1669570699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 msgr2=0x5602fca384f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.614+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca384f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f84d401d200 tx=0x7f84d4012000 comp rx=0 tx=0).stop 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.614+0000 7f84ec3e4740 1 -- 172.21.15.159:0/1669570699 shutdown_connections 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.614+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca3acb0 0x5602fca52220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.614+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca30410 0x5602fca39bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.614+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/1669570699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca384f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.614+0000 7f84ec3e4740 1 -- 172.21.15.159:0/1669570699 >> 172.21.15.159:0/1669570699 conn(0x5602fca2c060 msgr2=0x5602fca394a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.614+0000 7f84ec3e4740 1 -- 172.21.15.159:0/1669570699 shutdown_connections 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.614+0000 7f84ec3e4740 1 -- 172.21.15.159:0/1669570699 wait complete. 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84ec3e4740 1 -- start start 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84ec3e4740 1 Processor -- start 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca42c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca43140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84ec3e4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca3acb0 0x5602fca34450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41ae380 con 0x5602fca30410 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41af7f0 con 0x5602fca3acb0 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84ec3e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41aea50 con 0x5602fca2faf0 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84e2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca42c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca43140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84e2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca42c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:36438/0 (socket says 172.21.15.159:36438) 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca43140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44678/0 (socket says 172.21.15.159:44678) 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84e2ffd640 1 -- 172.21.15.159:0/932160796 learned_addr learned my addr 172.21.15.159:0/932160796 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.615+0000 7f84ec3e4740 10 client.0 _ll_register_callbacks cb 0x7f84d80d3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84e2ffd640 1 -- 172.21.15.159:0/932160796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca3acb0 msgr2=0x5602fca34450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca3acb0 0x5602fca34450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84e2ffd640 1 -- 172.21.15.159:0/932160796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 msgr2=0x5602fca43140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca43140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84e2ffd640 1 -- 172.21.15.159:0/932160796 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602fca34af0 con 0x5602fca2faf0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84e27fc640 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca43140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84e2ffd640 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca42c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84d4028e50 tx=0x7f84d401fee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94e38854788b0a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84c6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84c6ff5640 1 -- 172.21.15.159:0/932160796 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4005450 con 0x5602fca2faf0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84c6ff5640 1 -- 172.21.15.159:0/932160796 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f84d4031730 con 0x5602fca2faf0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84ec3e4740 1 -- 172.21.15.159:0/932160796 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5602fc99bd70 con 0x5602fca2faf0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.616+0000 7f84c6ff5640 1 -- 172.21.15.159:0/932160796 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f84d40055f0 con 0x5602fca2faf0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84ec3e4740 10 client.25207 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84ec3e4740 1 -- 172.21.15.159:0/932160796 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5602fcab4b80 con 0x5602fca2faf0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84c6ff5640 1 -- 172.21.15.159:0/932160796 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5602fc99bd70 con 0x5602fca2faf0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84c6ff5640 1 -- 172.21.15.159:0/932160796 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f84d40289f0 con 0x5602fca2faf0 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84ec3e4740 10 client.25207 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84ec3e4740 10 client.25207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84ec3e4740 20 client.25207 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5602fca4a740 0x5602fcab7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84ec3e4740 4 client.25207 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.617+0000 7f84ec3e4740 1 -- 172.21.15.159:0/932160796 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602fc918900 con 0x5602fca4a740 2024-09-19T06:48:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.618+0000 7f84e27fc640 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5602fca4a740 0x5602fcab7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.618+0000 7f84c6ff5640 10 client.25207 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.618+0000 7f84e27fc640 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5602fca4a740 0x5602fcab7210 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45cdeeba8eb1bf9c server_cookie=678f76e1594f3282 in_seq=0 out_seq=0 2024-09-19T06:48:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.622+0000 7f84c6ff5640 1 -- 172.21.15.159:0/932160796 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602fc918900 con 0x5602fca4a740 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.622+0000 7f84c6ff5640 10 client.25207 handle_command_reply: tid=0 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.622+0000 7f84ec3e4740 1 client.25207 shutdown 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.622+0000 7f84ec3e4740 1 -- 172.21.15.159:0/932160796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 msgr2=0x5602fca42c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.622+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca42c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84d4028e50 tx=0x7f84d401fee0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.622+0000 7f84ec3e4740 1 -- 172.21.15.159:0/932160796 shutdown_connections 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.622+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5602fca4a740 0x5602fcab7210 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602fca3acb0 0x5602fca34450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5602fca30410 0x5602fca43140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84ec3e4740 1 --2- 172.21.15.159:0/932160796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5602fca2faf0 0x5602fca42c00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84ec3e4740 1 -- 172.21.15.159:0/932160796 >> 172.21.15.159:0/932160796 conn(0x5602fca2c060 msgr2=0x5602fca460b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84c6ff5640 0 client.25207 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84ec3e4740 1 -- 172.21.15.159:0/932160796 shutdown_connections 2024-09-19T06:48:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84ec3e4740 1 -- 172.21.15.159:0/932160796 wait complete. 2024-09-19T06:48:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84ec3e4740 20 client.25207 trim_cache size 0 max 16384 2024-09-19T06:48:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:48:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:48:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:48:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:48:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f84cc0a3530 msgr2=0x7f84cc0a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84e956d640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f84cc0a3530 0x7f84cc0a59f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84d400ab60 tx=0x7f84d400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e4101350 msgr2=0x7f84e410e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.623+0000 7f84e956d640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e4101350 0x7f84e410e550 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009230 tx=0x7f84d8003880 comp rx=0 tx=0).stop 2024-09-19T06:48:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.624+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 shutdown_connections 2024-09-19T06:48:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.624+0000 7f84e956d640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f84cc0a3530 0x7f84cc0a59f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.624+0000 7f84e956d640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84e41069c0 0x7f84e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.624+0000 7f84e956d640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84e4101350 0x7f84e410e550 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.624+0000 7f84e956d640 1 --2- 172.21.15.159:0/3147975249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84e41009b0 0x7f84e410e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.624+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 >> 172.21.15.159:0/3147975249 conn(0x7f84e4077990 msgr2=0x7f84e4103560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.624+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 shutdown_connections 2024-09-19T06:48:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:17.624+0000 7f84e956d640 1 -- 172.21.15.159:0/3147975249 wait complete. 2024-09-19T06:48:19.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:18 smithi203 ceph-mon[35473]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-19T06:48:19.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:18 smithi189 ceph-mon[34880]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-19T06:48:19.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:18 smithi159 ceph-mon[30935]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-19T06:48:19.663 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T06:48:19.663 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T06:48:19.663 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:48:19.953 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:20.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.481+0000 7fe91bfff640 1 -- 172.21.15.159:0/3146295138 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920031940 con 0x7fe924100e20 2024-09-19T06:48:20.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.481+0000 7fe92b684640 1 -- 172.21.15.159:0/3146295138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924100e20 msgr2=0x7fe924101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.481+0000 7fe92b684640 1 --2- 172.21.15.159:0/3146295138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924100e20 0x7fe924101200 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe920009900 tx=0x7fe92002a480 comp rx=0 tx=0).stop 2024-09-19T06:48:20.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.481+0000 7fe92b684640 1 -- 172.21.15.159:0/3146295138 shutdown_connections 2024-09-19T06:48:20.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.481+0000 7fe92b684640 1 --2- 172.21.15.159:0/3146295138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe924102ef0 0x7fe92410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.481+0000 7fe92b684640 1 --2- 172.21.15.159:0/3146295138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe924102570 0x7fe9241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.481+0000 7fe92b684640 1 --2- 172.21.15.159:0/3146295138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924100e20 0x7fe924101200 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.481+0000 7fe92b684640 1 -- 172.21.15.159:0/3146295138 >> 172.21.15.159:0/3146295138 conn(0x7fe9240fc7d0 msgr2=0x7fe9240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.482+0000 7fe92b684640 1 -- 172.21.15.159:0/3146295138 shutdown_connections 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.482+0000 7fe92b684640 1 -- 172.21.15.159:0/3146295138 wait complete. 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.482+0000 7fe92b684640 1 Processor -- start 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.482+0000 7fe92b684640 1 -- start start 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe92b684640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe924100e20 0x7fe9240fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe92b684640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe924102570 0x7fe9240fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe92b684640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924102ef0 0x7fe9240fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe92b684640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe924110f50 con 0x7fe924102ef0 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe92b684640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe924110dd0 con 0x7fe924102570 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe92b684640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241110d0 con 0x7fe924100e20 2024-09-19T06:48:20.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe929c21640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924102ef0 0x7fe9240fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe929c21640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924102ef0 0x7fe9240fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60348/0 (socket says 172.21.15.159:60348) 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe928c1f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe924102570 0x7fe9240fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe929c21640 1 -- 172.21.15.159:0/1912725085 learned_addr learned my addr 172.21.15.159:0/1912725085 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe929420640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe924100e20 0x7fe9240fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe929c21640 1 -- 172.21.15.159:0/1912725085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe924100e20 msgr2=0x7fe9240fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe929c21640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe924100e20 0x7fe9240fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe929c21640 1 -- 172.21.15.159:0/1912725085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe924102570 msgr2=0x7fe9240fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe929c21640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe924102570 0x7fe9240fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe929c21640 1 -- 172.21.15.159:0/1912725085 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9241aaed0 con 0x7fe924102ef0 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.483+0000 7fe928c1f640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe924102570 0x7fe9240fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.484+0000 7fe929420640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe924100e20 0x7fe9240fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.484+0000 7fe929c21640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924102ef0 0x7fe9240fd700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00eaa0 tx=0x7fe91c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:20.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.484+0000 7fe91a7fc640 1 -- 172.21.15.159:0/1912725085 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00cdb0 con 0x7fe924102ef0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.484+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9241ab100 con 0x7fe924102ef0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.484+0000 7fe91a7fc640 1 -- 172.21.15.159:0/1912725085 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe91c005020 con 0x7fe924102ef0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.484+0000 7fe91a7fc640 1 -- 172.21.15.159:0/1912725085 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0116d0 con 0x7fe924102ef0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.484+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9241ab640 con 0x7fe924102ef0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.486+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9241021b0 con 0x7fe924102ef0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.488+0000 7fe91a7fc640 1 -- 172.21.15.159:0/1912725085 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fe91c005540 con 0x7fe924102ef0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.489+0000 7fe91a7fc640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9100a3550 0x7fe9100a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.489+0000 7fe929420640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9100a3550 0x7fe9100a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.489+0000 7fe91a7fc640 1 -- 172.21.15.159:0/1912725085 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fe91c0d0200 con 0x7fe924102ef0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.490+0000 7fe929420640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9100a3550 0x7fe9100a5a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe920000c00 tx=0x7fe920004100 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:20.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.494+0000 7fe91a7fc640 1 -- 172.21.15.159:0/1912725085 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe91c016030 con 0x7fe924102ef0 2024-09-19T06:48:20.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.708+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe92410a0a0 con 0x7fe924102ef0 2024-09-19T06:48:20.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.708+0000 7fe91a7fc640 1 -- 172.21.15.159:0/1912725085 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7fe91c09c960 con 0x7fe924102ef0 2024-09-19T06:48:20.710 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:48:20.710 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:48:20.711 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:48:20.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9100a3550 msgr2=0x7fe9100a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9100a3550 0x7fe9100a5a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe920000c00 tx=0x7fe920004100 comp rx=0 tx=0).stop 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924102ef0 msgr2=0x7fe9240fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924102ef0 0x7fe9240fd700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00eaa0 tx=0x7fe91c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 shutdown_connections 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9100a3550 0x7fe9100a5a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924102ef0 0x7fe9240fd700 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe924102570 0x7fe9240fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 --2- 172.21.15.159:0/1912725085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe924100e20 0x7fe9240fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 >> 172.21.15.159:0/1912725085 conn(0x7fe9240fc7d0 msgr2=0x7fe92406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:20.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 shutdown_connections 2024-09-19T06:48:20.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:20.711+0000 7fe92b684640 1 -- 172.21.15.159:0/1912725085 wait complete. 2024-09-19T06:48:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:20 smithi203 ceph-mon[35473]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-19T06:48:21.117 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:20 smithi159 ceph-mon[30935]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-19T06:48:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:20 smithi189 ceph-mon[34880]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-19T06:48:21.510 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T06:48:21.510 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T06:48:21.767 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:21.888 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:21 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1912725085' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:22.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:21 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1912725085' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:22.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:21 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1912725085' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:23.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:22 smithi203 ceph-mon[35473]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T06:48:23.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:22 smithi189 ceph-mon[34880]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T06:48:23.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:22 smithi159 ceph-mon[30935]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T06:48:23.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.473+0000 7f5efce6e640 1 -- 172.21.15.159:0/3944276770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8100e20 msgr2=0x7f5ef8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:23.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.473+0000 7f5efce6e640 1 --2- 172.21.15.159:0/3944276770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8100e20 0x7f5ef8101200 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009900 tx=0x7f5ee802a480 comp rx=0 tx=0).stop 2024-09-19T06:48:23.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.473+0000 7f5efce6e640 1 -- 172.21.15.159:0/3944276770 shutdown_connections 2024-09-19T06:48:23.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.473+0000 7f5efce6e640 1 --2- 172.21.15.159:0/3944276770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8102ef0 0x7f5ef810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.473+0000 7f5efce6e640 1 --2- 172.21.15.159:0/3944276770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef8102570 0x7f5ef81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.473+0000 7f5efce6e640 1 --2- 172.21.15.159:0/3944276770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8100e20 0x7f5ef8101200 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.473+0000 7f5efce6e640 1 -- 172.21.15.159:0/3944276770 >> 172.21.15.159:0/3944276770 conn(0x7f5ef80fc7d0 msgr2=0x7f5ef80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:23.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.474+0000 7f5efce6e640 1 -- 172.21.15.159:0/3944276770 shutdown_connections 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.474+0000 7f5efce6e640 1 -- 172.21.15.159:0/3944276770 wait complete. 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.474+0000 7f5efce6e640 1 Processor -- start 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5efce6e640 1 -- start start 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5efce6e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8100e20 0x7f5ef81973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5efce6e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8102570 0x7f5ef8197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5efce6e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef8102ef0 0x7f5ef819bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5efce6e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef8110f80 con 0x7f5ef8102570 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5efce6e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef8110e00 con 0x7f5ef8100e20 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5efce6e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef8111100 con 0x7f5ef8102ef0 2024-09-19T06:48:23.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8102570 0x7f5ef8197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8102570 0x7f5ef8197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60364/0 (socket says 172.21.15.159:60364) 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/2862590799 learned_addr learned my addr 172.21.15.159:0/2862590799 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef659c640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8100e20 0x7f5ef81973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef6d9d640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef8102ef0 0x7f5ef819bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/2862590799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef8102ef0 msgr2=0x7f5ef819bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef8102ef0 0x7f5ef819bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/2862590799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8100e20 msgr2=0x7f5ef81973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8100e20 0x7f5ef81973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/2862590799 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef819c3a0 con 0x7f5ef8102570 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef6d9d640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef8102ef0 0x7f5ef819bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.475+0000 7f5ef659c640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8100e20 0x7f5ef81973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.476+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8102570 0x7f5ef8197930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c890 tx=0x7f5eec00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:23.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.476+0000 7f5ee77fe640 1 -- 172.21.15.159:0/2862590799 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec004220 con 0x7f5ef8102570 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.476+0000 7f5ee77fe640 1 -- 172.21.15.159:0/2862590799 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eec0043c0 con 0x7f5ef8102570 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.476+0000 7f5ee77fe640 1 -- 172.21.15.159:0/2862590799 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0049e0 con 0x7f5ef8102570 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.476+0000 7f5efce6e640 1 -- 172.21.15.159:0/2862590799 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef819c690 con 0x7f5ef8102570 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.476+0000 7f5efce6e640 1 -- 172.21.15.159:0/2862590799 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef81a3f70 con 0x7f5ef8102570 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.478+0000 7f5ee77fe640 1 -- 172.21.15.159:0/2862590799 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f5eec0079b0 con 0x7f5ef8102570 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.478+0000 7f5eff247740 1 Processor -- start 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5eff247740 1 -- start start 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5eff247740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 0x557838fe1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5eff247740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fec700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5eff247740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 0x557838fef030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5eff247740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557838f44160 con 0x557838fe2380 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5eff247740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557838eeb720 con 0x557838fe1a60 2024-09-19T06:48:23.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5eff247740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557838f40120 con 0x557838fecc40 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5ef659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5ef659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fec700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60366/0 (socket says 172.21.15.159:60366) 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5ef659c640 1 -- 172.21.15.159:0/1277366740 learned_addr learned my addr 172.21.15.159:0/1277366740 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5ef6d9d640 1 --2- 172.21.15.159:0/1277366740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 0x557838fe1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/1277366740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 0x557838fef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.479+0000 7f5ef659c640 1 -- 172.21.15.159:0/1277366740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 msgr2=0x557838fef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ef659c640 1 --2- 172.21.15.159:0/1277366740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 0x557838fef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ef659c640 1 -- 172.21.15.159:0/1277366740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 msgr2=0x557838fe1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ef659c640 1 --2- 172.21.15.159:0/1277366740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 0x557838fe1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ef659c640 1 -- 172.21.15.159:0/1277366740 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557838cb5ba0 con 0x557838fe2380 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ee77fe640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ee00a34d0 0x7f5ee00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ef6d9d640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ee00a34d0 0x7f5ee00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ee77fe640 1 -- 172.21.15.159:0/2862590799 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f5eec0d0170 con 0x7f5ef8102570 2024-09-19T06:48:23.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ef659c640 1 --2- 172.21.15.159:0/1277366740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fec700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8004170 tx=0x7f5ee8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4167facf1f4534 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:23.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ee4ff9640 1 -- 172.21.15.159:0/1277366740 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee803f070 con 0x557838fe2380 2024-09-19T06:48:23.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ee4ff9640 1 -- 172.21.15.159:0/1277366740 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee8005520 con 0x557838fe2380 2024-09-19T06:48:23.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.480+0000 7f5ee4ff9640 1 -- 172.21.15.159:0/1277366740 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8035030 con 0x557838fe2380 2024-09-19T06:48:23.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 -- 172.21.15.159:0/1277366740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 msgr2=0x557838fec700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:23.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5ef6d9d640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ee00a34d0 0x7f5ee00a5990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0005fd0 tx=0x7f5ef0009700 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:23.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 --2- 172.21.15.159:0/1277366740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fec700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8004170 tx=0x7f5ee8009680 comp rx=0 tx=0).stop 2024-09-19T06:48:23.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 -- 172.21.15.159:0/1277366740 shutdown_connections 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 --2- 172.21.15.159:0/1277366740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 0x557838fef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 --2- 172.21.15.159:0/1277366740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fec700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 --2- 172.21.15.159:0/1277366740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 0x557838fe1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 -- 172.21.15.159:0/1277366740 >> 172.21.15.159:0/1277366740 conn(0x557838fddff0 msgr2=0x557838fde3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 -- 172.21.15.159:0/1277366740 shutdown_connections 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 -- 172.21.15.159:0/1277366740 wait complete. 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.481+0000 7f5eff247740 1 -- start start 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5eff247740 1 Processor -- start 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5eff247740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 0x557838fe9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5eff247740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fe9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5eff247740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 0x557838fea520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5eff247740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557838fef810 con 0x557838fe2380 2024-09-19T06:48:23.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5eff247740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557838ecc900 con 0x557838fecc40 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5eff247740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557838fef990 con 0x557838fe1a60 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5eff247740 10 client.0 _ll_register_callbacks cb 0x557838eca780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fe9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 0x557838fe9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fe9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60374/0 (socket says 172.21.15.159:60374) 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/657161246 learned_addr learned my addr 172.21.15.159:0/657161246 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef6d9d640 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 0x557838fea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/657161246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 msgr2=0x557838fe9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 0x557838fe9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/657161246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 msgr2=0x557838fea520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:23.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 0x557838fea520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.482+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/657161246 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557838f0cc50 con 0x557838fe2380 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fe9fe0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5eec007590 tx=0x7f5eec0984d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e6bffa4af47934 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eddffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eddffb640 1 -- 172.21.15.159:0/657161246 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec01d030 con 0x557838fe2380 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eff247740 1 -- 172.21.15.159:0/657161246 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ee8005520 con 0x557838fe2380 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eddffb640 1 -- 172.21.15.159:0/657161246 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f5eec0a01f0 con 0x557838fe2380 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eddffb640 1 -- 172.21.15.159:0/657161246 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5eec0bc270 con 0x557838fe2380 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eff247740 10 client.15681 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eff247740 1 -- 172.21.15.159:0/657161246 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557838ffb490 con 0x557838fe2380 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eddffb640 1 -- 172.21.15.159:0/657161246 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee8005520 con 0x557838fe2380 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eddffb640 1 -- 172.21.15.159:0/657161246 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5eec096ce0 con 0x557838fe2380 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eff247740 10 client.15681 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eff247740 10 client.15681 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:48:23.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eff247740 20 client.15681 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eff247740 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557838ffcdd0 0x557838fff210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eff247740 4 client.15681 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.483+0000 7f5eff247740 1 -- 172.21.15.159:0/657161246 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557838f51890 con 0x557838ffcdd0 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.484+0000 7f5ef659c640 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557838ffcdd0 0x557838fff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.484+0000 7f5eddffb640 10 client.15681 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.484+0000 7f5ef659c640 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557838ffcdd0 0x557838fff210 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db4f4b6c7887c44f server_cookie=c75d54f06374fc02 in_seq=0 out_seq=0 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eddffb640 1 -- 172.21.15.159:0/657161246 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557838f51890 con 0x557838ffcdd0 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eddffb640 10 client.15681 handle_command_reply: tid=0 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 client.15681 shutdown 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 -- 172.21.15.159:0/657161246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 msgr2=0x557838fe9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:23.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fe9fe0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5eec007590 tx=0x7f5eec0984d0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 -- 172.21.15.159:0/657161246 shutdown_connections 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557838ffcdd0 0x557838fff210 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 0x557838fea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fe9fe0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 --2- 172.21.15.159:0/657161246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 0x557838fe9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 -- 172.21.15.159:0/657161246 >> 172.21.15.159:0/657161246 conn(0x557838fddff0 msgr2=0x557838fe3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eddffb640 0 client.15681 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 -- 172.21.15.159:0/657161246 shutdown_connections 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 1 -- 172.21.15.159:0/657161246 wait complete. 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.485+0000 7f5eff247740 20 client.15681 trim_cache size 0 max 16384 2024-09-19T06:48:23.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5eff247740 1 Processor -- start 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5eff247740 1 -- start start 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5eff247740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 0x557838feba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5eff247740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557839004b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5eff247740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 0x557839005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5eff247740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef81a9680 con 0x557838fe2380 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5eff247740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef81abf00 con 0x557838fe1a60 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5eff247740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef81a9cf0 con 0x557838fecc40 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5ef5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557839004b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5ef659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 0x557838feba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5ef5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557839004b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60382/0 (socket says 172.21.15.159:60382) 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/3139333909 learned_addr learned my addr 172.21.15.159:0/3139333909 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:23.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.502+0000 7f5ef6d9d640 1 --2- 172.21.15.159:0/3139333909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 0x557839005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/3139333909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 msgr2=0x557839005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/3139333909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 0x557839005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/3139333909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 msgr2=0x557838feba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/3139333909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 0x557838feba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/3139333909 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557838fe21b0 con 0x557838fe2380 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5ef6d9d640 1 --2- 172.21.15.159:0/3139333909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 0x557839005060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/3139333909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557839004b20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5eec09be70 tx=0x7f5eec098540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f57bfa9568ca3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5edffff640 1 -- 172.21.15.159:0/3139333909 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec01d070 con 0x557838fe2380 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5edffff640 1 -- 172.21.15.159:0/3139333909 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eec0cd5f0 con 0x557838fe2380 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.503+0000 7f5edffff640 1 -- 172.21.15.159:0/3139333909 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec09c170 con 0x557838fe2380 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 -- 172.21.15.159:0/3139333909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 msgr2=0x557839004b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:23.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 --2- 172.21.15.159:0/3139333909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557839004b20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5eec09be70 tx=0x7f5eec098540 comp rx=0 tx=0).stop 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 -- 172.21.15.159:0/3139333909 shutdown_connections 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 --2- 172.21.15.159:0/3139333909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fecc40 0x557839005060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 --2- 172.21.15.159:0/3139333909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557839004b20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 --2- 172.21.15.159:0/3139333909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fe1a60 0x557838feba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 -- 172.21.15.159:0/3139333909 >> 172.21.15.159:0/3139333909 conn(0x557838fddff0 msgr2=0x557838feb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 -- 172.21.15.159:0/3139333909 shutdown_connections 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 -- 172.21.15.159:0/3139333909 wait complete. 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 -- start start 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.504+0000 7f5eff247740 1 Processor -- start 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5eff247740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 0x557838ff5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5eff247740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fdc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5eff247740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 0x557838fdc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5eff247740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef81aa3c0 con 0x557838fe2380 2024-09-19T06:48:23.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5eff247740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef81ab830 con 0x557838fecc40 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5eff247740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef81aaa90 con 0x557838fe1a60 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5eff247740 10 client.0 _ll_register_callbacks cb 0x7f5eec004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fdc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef5d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fdc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60398/0 (socket says 172.21.15.159:60398) 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/3266155467 learned_addr learned my addr 172.21.15.159:0/3266155467 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef659c640 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 0x557838ff5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef6d9d640 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 0x557838fdc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/3266155467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 msgr2=0x557838ff5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 0x557838ff5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/3266155467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 msgr2=0x557838fdc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:23.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 0x557838fdc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef5d9b640 1 -- 172.21.15.159:0/3266155467 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557838fdccc0 con 0x557838fe2380 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef659c640 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 0x557838ff5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5ef5d9b640 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fdc210 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5eec007590 tx=0x7f5eec0a0520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c87d04cbef779c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.505+0000 7f5eddffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eddffb640 1 -- 172.21.15.159:0/3266155467 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec01d070 con 0x557838fe2380 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eddffb640 1 -- 172.21.15.159:0/3266155467 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f5eec0cd990 con 0x557838fe2380 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eff247740 1 -- 172.21.15.159:0/3266155467 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eec0cd5f0 con 0x557838fe2380 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eddffb640 1 -- 172.21.15.159:0/3266155467 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5eec09c870 con 0x557838fe2380 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eff247740 10 client.15687 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eff247740 1 -- 172.21.15.159:0/3266155467 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557838ff3960 con 0x557838fe2380 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eddffb640 1 -- 172.21.15.159:0/3266155467 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eec0cd5f0 con 0x557838fe2380 2024-09-19T06:48:23.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eddffb640 1 -- 172.21.15.159:0/3266155467 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5eec0d3cc0 con 0x557838fe2380 2024-09-19T06:48:23.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eff247740 10 client.15687 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:23.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eff247740 10 client.15687 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:48:23.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eff247740 20 client.15687 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:23.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eff247740 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557839065da0 0x5578390681c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:23.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eff247740 4 client.15687 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T06:48:23.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5eff247740 1 -- 172.21.15.159:0/3266155467 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x557838f4bbe0 con 0x557839065da0 2024-09-19T06:48:23.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.506+0000 7f5ef659c640 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557839065da0 0x5578390681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:23.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.507+0000 7f5ef659c640 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557839065da0 0x5578390681c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7adfaebafb13f956 server_cookie=15548a78ed4c4982 in_seq=0 out_seq=0 2024-09-19T06:48:23.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.507+0000 7f5eddffb640 10 client.15687 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:23.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eddffb640 1 -- 172.21.15.159:0/3266155467 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557838f4bbe0 con 0x557839065da0 2024-09-19T06:48:23.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eddffb640 10 client.15687 handle_command_reply: tid=0 2024-09-19T06:48:23.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eff247740 1 client.15687 shutdown 2024-09-19T06:48:23.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eff247740 1 -- 172.21.15.159:0/3266155467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 msgr2=0x557838fdc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eff247740 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fdc210 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5eec007590 tx=0x7f5eec0a0520 comp rx=0 tx=0).stop 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eff247740 1 -- 172.21.15.159:0/3266155467 shutdown_connections 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eff247740 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557839065da0 0x5578390681c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eff247740 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557838fecc40 0x557838fdc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eff247740 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557838fe2380 0x557838fdc210 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eff247740 1 --2- 172.21.15.159:0/3266155467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557838fe1a60 0x557838ff5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.511+0000 7f5eff247740 1 -- 172.21.15.159:0/3266155467 >> 172.21.15.159:0/3266155467 conn(0x557838fddff0 msgr2=0x557838fda6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.512+0000 7f5eddffb640 0 client.15687 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.512+0000 7f5eff247740 1 -- 172.21.15.159:0/3266155467 shutdown_connections 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.512+0000 7f5eff247740 1 -- 172.21.15.159:0/3266155467 wait complete. 2024-09-19T06:48:23.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.512+0000 7f5eff247740 20 client.15687 trim_cache size 0 max 16384 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 20, 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 6, 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "d85b1ac4": { 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 6, 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:48:23.529 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 140.3, 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:23.530 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:23.531 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:23.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.512+0000 7f5efce6e640 1 -- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ee00a34d0 msgr2=0x7f5ee00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:23.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.512+0000 7f5efce6e640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ee00a34d0 0x7f5ee00a5990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0005fd0 tx=0x7f5ef0009700 comp rx=0 tx=0).stop 2024-09-19T06:48:23.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.512+0000 7f5efce6e640 1 -- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8102570 msgr2=0x7f5ef8197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:23.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.512+0000 7f5efce6e640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8102570 0x7f5ef8197930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c890 tx=0x7f5eec00cd50 comp rx=0 tx=0).stop 2024-09-19T06:48:23.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.513+0000 7f5efce6e640 1 -- 172.21.15.159:0/2862590799 shutdown_connections 2024-09-19T06:48:23.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.513+0000 7f5efce6e640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ee00a34d0 0x7f5ee00a5990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.513+0000 7f5efce6e640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef8102ef0 0x7f5ef819bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.513+0000 7f5efce6e640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ef8102570 0x7f5ef8197930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.513+0000 7f5efce6e640 1 --2- 172.21.15.159:0/2862590799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8100e20 0x7f5ef81973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:23.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.513+0000 7f5efce6e640 1 -- 172.21.15.159:0/2862590799 >> 172.21.15.159:0/2862590799 conn(0x7f5ef80fc7d0 msgr2=0x7f5ef80fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:23.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.513+0000 7f5efce6e640 1 -- 172.21.15.159:0/2862590799 shutdown_connections 2024-09-19T06:48:23.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:23.513+0000 7f5efce6e640 1 -- 172.21.15.159:0/2862590799 wait complete. 2024-09-19T06:48:24.254 INFO:tasks.workunit.client.0.smithi159.stderr:Updating files: 96% (12387/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T06:48:24.339 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd85b1ac4', quiesce took 4.7 seconds. Will release after: 15.650000000000002 2024-09-19T06:48:24.839 INFO:tasks.workunit.client.0.smithi159.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T06:48:24.839 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:48:24.839 INFO:tasks.workunit.client.0.smithi159.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:48:24.839 INFO:tasks.workunit.client.0.smithi159.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:48:24.839 INFO:tasks.workunit.client.0.smithi159.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:48:24.839 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:48:24.839 INFO:tasks.workunit.client.0.smithi159.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr: git switch -c 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr:Or undo this operation with: 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr: git switch - 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:48:24.840 INFO:tasks.workunit.client.0.smithi159.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T06:48:24.844 DEBUG:teuthology.orchestra.run.smithi159:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T06:48:24.868 INFO:tasks.workunit.client.0.smithi159.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T06:48:24.870 INFO:tasks.workunit.client.0.smithi159.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:48:24.871 INFO:tasks.workunit.client.0.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T06:48:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:24 smithi203 ceph-mon[35473]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T06:48:25.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:24 smithi189 ceph-mon[34880]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T06:48:25.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:24 smithi159 ceph-mon[30935]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T06:48:25.634 INFO:tasks.workunit.client.0.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T06:48:25.721 INFO:tasks.workunit.client.0.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T06:48:25.761 INFO:tasks.workunit.client.0.smithi159.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:48:25.763 INFO:tasks.workunit.client.0.smithi159.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:48:25.763 INFO:tasks.workunit.client.0.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T06:48:25.802 INFO:tasks.workunit.client.0.smithi159.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:48:25.806 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:48:25.806 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T06:48:25.862 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-09-19T06:48:25.863 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-09-19T06:48:25.863 DEBUG:teuthology.orchestra.run.smithi159:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-09-19T06:48:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:26 smithi203 ceph-mon[35473]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T06:48:27.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:26 smithi189 ceph-mon[34880]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T06:48:27.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:26 smithi159 ceph-mon[30935]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T06:48:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:28 smithi203 ceph-mon[35473]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:48:29.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:28 smithi189 ceph-mon[34880]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:48:29.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:28 smithi159 ceph-mon[30935]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:48:30.729 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 -- 172.21.15.159:0/2450262043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 msgr2=0x7f9fa410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 --2- 172.21.15.159:0/2450262043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 0x7f9fa410d8a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009cd0 tx=0x7f9f9c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 -- 172.21.15.159:0/2450262043 shutdown_connections 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 --2- 172.21.15.159:0/2450262043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 0x7f9fa410d8a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 --2- 172.21.15.159:0/2450262043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41009d0 0x7f9fa4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 --2- 172.21.15.159:0/2450262043 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fa41069e0 0x7f9fa4106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 -- 172.21.15.159:0/2450262043 >> 172.21.15.159:0/2450262043 conn(0x7f9fa40fc6f0 msgr2=0x7f9fa40feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 -- 172.21.15.159:0/2450262043 shutdown_connections 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 -- 172.21.15.159:0/2450262043 wait complete. 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.726+0000 7f9fac35f640 1 Processor -- start 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fac35f640 1 -- start start 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fac35f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41009d0 0x7f9fa4199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fac35f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 0x7f9fa4199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fac35f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fa41069e0 0x7f9fa41a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fac35f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4110e20 con 0x7f9fa4101370 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fac35f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4110ca0 con 0x7f9fa41009d0 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fac35f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4110fa0 con 0x7f9fa41069e0 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fa98fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 0x7f9fa4199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fa98fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 0x7f9fa4199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49084/0 (socket says 172.21.15.159:49084) 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fa98fa640 1 -- 172.21.15.159:0/4143877715 learned_addr learned my addr 172.21.15.159:0/4143877715 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41009d0 0x7f9fa4199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fa98fa640 1 -- 172.21.15.159:0/4143877715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fa41069e0 msgr2=0x7f9fa41a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fa41069e0 0x7f9fa41a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fa41069e0 0x7f9fa41a41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fa98fa640 1 -- 172.21.15.159:0/4143877715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41009d0 msgr2=0x7f9fa4199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41009d0 0x7f9fa4199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fa98fa640 1 -- 172.21.15.159:0/4143877715 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa41a4710 con 0x7f9fa4101370 2024-09-19T06:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41009d0 0x7f9fa4199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.727+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 0x7f9fa4199690 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400d950 tx=0x7f9f9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.728+0000 7f9f9b7fe640 1 -- 172.21.15.159:0/4143877715 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94017070 con 0x7f9fa4101370 2024-09-19T06:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.728+0000 7f9f9b7fe640 1 -- 172.21.15.159:0/4143877715 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f94009c30 con 0x7f9fa4101370 2024-09-19T06:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.728+0000 7f9fac35f640 1 -- 172.21.15.159:0/4143877715 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa41a48e0 con 0x7f9fa4101370 2024-09-19T06:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.728+0000 7f9f9b7fe640 1 -- 172.21.15.159:0/4143877715 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9400f6b0 con 0x7f9fa4101370 2024-09-19T06:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.728+0000 7f9fac35f640 1 -- 172.21.15.159:0/4143877715 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa41a4e00 con 0x7f9fa4101370 2024-09-19T06:48:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.730+0000 7f9f9b7fe640 1 -- 172.21.15.159:0/4143877715 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f9f940109d0 con 0x7f9fa4101370 2024-09-19T06:48:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.730+0000 7f9faf1d8740 1 Processor -- start 2024-09-19T06:48:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faf1d8740 1 -- start start 2024-09-19T06:48:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 0x562c27d64ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d6fcb0 0x562c27d720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562c27cc92f0 con 0x562c27d65410 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562c27c71270 con 0x562c27d6fcb0 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562c27cc52b0 con 0x562c27d64af0 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9f9b7fe640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f900a3580 0x7f9f900a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faa0fb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f900a3580 0x7f9f900a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faa0fb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49090/0 (socket says 172.21.15.159:49090) 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faa0fb640 1 -- 172.21.15.159:0/3193148150 learned_addr learned my addr 172.21.15.159:0/3193148150 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9f9b7fe640 1 -- 172.21.15.159:0/4143877715 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f9f940cfd00 con 0x7f9fa4101370 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 0x562c27d64ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.731+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d6fcb0 0x562c27d720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9faa0fb640 1 -- 172.21.15.159:0/3193148150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 msgr2=0x562c27d64ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 0x562c27d64ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9faa0fb640 1 -- 172.21.15.159:0/3193148150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d6fcb0 msgr2=0x562c27d720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d6fcb0 0x562c27d720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9faa0fb640 1 -- 172.21.15.159:0/3193148150 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c27c70340 con 0x562c27d65410 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d6fcb0 0x562c27d720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6f770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009bc0 tx=0x7f9fa000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d1d5f205266acd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f900a3580 0x7f9f900a5a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c005cc0 tx=0x7f9f9c005c50 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9f98bfe640 1 -- 172.21.15.159:0/3193148150 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0016070 con 0x562c27d65410 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9f98bfe640 1 -- 172.21.15.159:0/3193148150 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fa0005500 con 0x562c27d65410 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.732+0000 7f9f98bfe640 1 -- 172.21.15.159:0/3193148150 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00116d0 con 0x562c27d65410 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3193148150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 msgr2=0x562c27d6f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6f770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009bc0 tx=0x7f9fa000e6c0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3193148150 shutdown_connections 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d6fcb0 0x562c27d720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6f770 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3193148150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 0x562c27d64ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3193148150 >> 172.21.15.159:0/3193148150 conn(0x562c27d61060 msgr2=0x562c27d61440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3193148150 shutdown_connections 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3193148150 wait complete. 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 -- start start 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.733+0000 7f9faf1d8740 1 Processor -- start 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d64af0 0x562c27d6cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 0x562c27d6d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562c27d72880 con 0x562c27d65410 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562c27c52290 con 0x562c27d64af0 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562c27d72a00 con 0x562c27d6fcb0 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 10 client.0 _ll_register_callbacks cb 0x562c27c83140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9fa98fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9fa98fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49096/0 (socket says 172.21.15.159:49096) 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9fa98fa640 1 -- 172.21.15.159:0/3071778483 learned_addr learned my addr 172.21.15.159:0/3071778483 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 0x562c27d6d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d64af0 0x562c27d6cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9fa98fa640 1 -- 172.21.15.159:0/3071778483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 msgr2=0x562c27d6d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 0x562c27d6d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9fa98fa640 1 -- 172.21.15.159:0/3071778483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d64af0 msgr2=0x562c27d6cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d64af0 0x562c27d6cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9fa98fa640 1 -- 172.21.15.159:0/3071778483 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c279dc210 con 0x562c27d65410 2024-09-19T06:48:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d64af0 0x562c27d6cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6d130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9f9409ba60 tx=0x7f9f9409c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d536f692c576af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3071778483 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94020040 con 0x562c27d65410 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3071778483 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f9f940cd580 con 0x562c27d65410 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3071778483 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fa0005500 con 0x562c27d65410 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3071778483 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9f940a0110 con 0x562c27d65410 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 10 client.15699 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.734+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3071778483 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562c27aa8620 con 0x562c27d65410 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.735+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3071778483 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fa0005500 con 0x562c27d65410 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.735+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3071778483 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9f9409b1b0 con 0x562c27d65410 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.735+0000 7f9faf1d8740 10 client.15699 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.735+0000 7f9faf1d8740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.735+0000 7f9faf1d8740 20 client.15699 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.735+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562c27d7fb70 0x562c27d81fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.735+0000 7f9faf1d8740 4 client.15699 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.735+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3071778483 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c27cd6a20 con 0x562c27d7fb70 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.735+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562c27d7fb70 0x562c27d81fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.736+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562c27d7fb70 0x562c27d81fa0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e272e23d3efe570c server_cookie=7eab8680e36aae77 in_seq=0 out_seq=0 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.736+0000 7f9f8dffb640 10 client.15699 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.736+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3071778483 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c27cd6a20 con 0x562c27d7fb70 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.736+0000 7f9f8dffb640 10 client.15699 handle_command_reply: tid=0 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.736+0000 7f9faf1d8740 1 client.15699 shutdown 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3071778483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 msgr2=0x562c27d6d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6d130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9f9409ba60 tx=0x7f9f9409c520 comp rx=0 tx=0).stop 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3071778483 shutdown_connections 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562c27d7fb70 0x562c27d81fa0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.744 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 0x562c27d6d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9f8dffb640 0 client.15699 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d65410 0x562c27d6d130 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3071778483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d64af0 0x562c27d6cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3071778483 >> 172.21.15.159:0/3071778483 conn(0x562c27d61060 msgr2=0x562c27d601c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3071778483 shutdown_connections 2024-09-19T06:48:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3071778483 wait complete. 2024-09-19T06:48:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.737+0000 7f9faf1d8740 20 client.15699 trim_cache size 0 max 16384 2024-09-19T06:48:30.757 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.751+0000 7f9faf1d8740 1 Processor -- start 2024-09-19T06:48:30.757 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.751+0000 7f9faf1d8740 1 -- start start 2024-09-19T06:48:30.757 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.751+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 0x562c27d6d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.757 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.751+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.757 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.751+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d6fcb0 0x562c27d87df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.751+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41ab8a0 con 0x562c27d6fcb0 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.751+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41ae120 con 0x562c27d65410 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.751+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41abf10 con 0x562c27d64af0 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa8fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d6fcb0 0x562c27d87df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa8fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d6fcb0 0x562c27d87df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49098/0 (socket says 172.21.15.159:49098) 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa8fc640 1 -- 172.21.15.159:0/197932345 learned_addr learned my addr 172.21.15.159:0/197932345 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 0x562c27d6d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa8fc640 1 -- 172.21.15.159:0/197932345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 msgr2=0x562c27d6d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 0x562c27d6d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa8fc640 1 -- 172.21.15.159:0/197932345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 msgr2=0x562c27d878b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d878b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa8fc640 1 -- 172.21.15.159:0/197932345 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c27d64870 con 0x562c27d6fcb0 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d878b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d6fcb0 0x562c27d87df0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0315c0 tx=0x7f9f9c043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6222b5b6218a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9f8ffff640 1 -- 172.21.15.159:0/197932345 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c003cf0 con 0x562c27d6fcb0 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9f8ffff640 1 -- 172.21.15.159:0/197932345 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f9c036040 con 0x562c27d6fcb0 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.752+0000 7f9f8ffff640 1 -- 172.21.15.159:0/197932345 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c030a60 con 0x562c27d6fcb0 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 -- 172.21.15.159:0/197932345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d6fcb0 msgr2=0x562c27d87df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d6fcb0 0x562c27d87df0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0315c0 tx=0x7f9f9c043000 comp rx=0 tx=0).stop 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 -- 172.21.15.159:0/197932345 shutdown_connections 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d6fcb0 0x562c27d87df0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d878b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/197932345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d64af0 0x562c27d6d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 -- 172.21.15.159:0/197932345 >> 172.21.15.159:0/197932345 conn(0x562c27d61060 msgr2=0x562c27d6ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 -- 172.21.15.159:0/197932345 shutdown_connections 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 -- 172.21.15.159:0/197932345 wait complete. 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 -- start start 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 Processor -- start 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d64af0 0x562c27d78470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d73790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.753+0000 7f9faf1d8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 0x562c27d73cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41ac5e0 con 0x562c27d64af0 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41ada50 con 0x562c27d65410 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faf1d8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41accb0 con 0x562c27d6fcb0 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faf1d8740 10 client.0 _ll_register_callbacks cb 0x7f9f9400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa0fb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d64af0 0x562c27d78470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa0fb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d64af0 0x562c27d78470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49110/0 (socket says 172.21.15.159:49110) 2024-09-19T06:48:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa0fb640 1 -- 172.21.15.159:0/3352089159 learned_addr learned my addr 172.21.15.159:0/3352089159 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d73790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 0x562c27d73cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa0fb640 1 -- 172.21.15.159:0/3352089159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 msgr2=0x562c27d73cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 0x562c27d73cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa0fb640 1 -- 172.21.15.159:0/3352089159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 msgr2=0x562c27d73790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d73790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa0fb640 1 -- 172.21.15.159:0/3352089159 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c27d74520 con 0x562c27d64af0 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa8fc640 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 0x562c27d73cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d73790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faa0fb640 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d64af0 0x562c27d78470 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009bc0 tx=0x7f9fa0009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4391a6e090806a4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3352089159 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0016040 con 0x562c27d64af0 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3352089159 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f9fa0004a90 con 0x562c27d64af0 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3352089159 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f9c036040 con 0x562c27d64af0 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3352089159 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9fa0035050 con 0x562c27d64af0 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faf1d8740 10 client.15705 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.754+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3352089159 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562c27dea8f0 con 0x562c27d64af0 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.755+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3352089159 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f9c036040 con 0x562c27d64af0 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.755+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3352089159 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9fa0025070 con 0x562c27d64af0 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.755+0000 7f9faf1d8740 10 client.15705 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.755+0000 7f9faf1d8740 10 client.15705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.755+0000 7f9faf1d8740 20 client.15705 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.755+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562c27dead90 0x562c27ded1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.755+0000 7f9faf1d8740 4 client.15705 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.755+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3352089159 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c27cd0d70 con 0x562c27dead90 2024-09-19T06:48:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.755+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562c27dead90 0x562c27ded1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.756+0000 7f9f8dffb640 10 client.15705 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.756+0000 7f9fa98fa640 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562c27dead90 0x562c27ded1b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e90d9362d05bc329 server_cookie=757c489f0f181bb7 in_seq=0 out_seq=0 2024-09-19T06:48:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.761+0000 7f9f8dffb640 1 -- 172.21.15.159:0/3352089159 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562c27cd0d70 con 0x562c27dead90 2024-09-19T06:48:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.761+0000 7f9f8dffb640 10 client.15705 handle_command_reply: tid=0 2024-09-19T06:48:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 client.15705 shutdown 2024-09-19T06:48:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3352089159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d64af0 msgr2=0x562c27d78470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d64af0 0x562c27d78470 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009bc0 tx=0x7f9fa0009ee0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3352089159 shutdown_connections 2024-09-19T06:48:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562c27dead90 0x562c27ded1b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562c27d6fcb0 0x562c27d73cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9f8dffb640 0 client.15705 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c27d65410 0x562c27d73790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 --2- 172.21.15.159:0/3352089159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562c27d64af0 0x562c27d78470 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3352089159 >> 172.21.15.159:0/3352089159 conn(0x562c27d61060 msgr2=0x562c27d66d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3352089159 shutdown_connections 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 1 -- 172.21.15.159:0/3352089159 wait complete. 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9faf1d8740 20 client.15705 trim_cache size 0 max 16384 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:48:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:48:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 -- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f900a3580 msgr2=0x7f9f900a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f900a3580 0x7f9f900a5a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c005cc0 tx=0x7f9f9c005c50 comp rx=0 tx=0).stop 2024-09-19T06:48:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 -- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 msgr2=0x7f9fa4199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 0x7f9fa4199690 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400d950 tx=0x7f9f9400de10 comp rx=0 tx=0).stop 2024-09-19T06:48:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 -- 172.21.15.159:0/4143877715 shutdown_connections 2024-09-19T06:48:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f900a3580 0x7f9f900a5a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fa41069e0 0x7f9fa41a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa4101370 0x7f9fa4199690 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 --2- 172.21.15.159:0/4143877715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41009d0 0x7f9fa4199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.762+0000 7f9fac35f640 1 -- 172.21.15.159:0/4143877715 >> 172.21.15.159:0/4143877715 conn(0x7f9fa40fc6f0 msgr2=0x7f9fa40fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.763+0000 7f9fac35f640 1 -- 172.21.15.159:0/4143877715 shutdown_connections 2024-09-19T06:48:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:30.763+0000 7f9fac35f640 1 -- 172.21.15.159:0/4143877715 wait complete. 2024-09-19T06:48:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:30 smithi203 ceph-mon[35473]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:48:31.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:30 smithi189 ceph-mon[34880]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:48:31.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:30 smithi159 ceph-mon[30935]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:48:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:32 smithi203 ceph-mon[35473]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T06:48:33.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:32 smithi203 ceph-mon[35473]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T06:48:33.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:32 smithi189 ceph-mon[34880]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T06:48:33.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:32 smithi189 ceph-mon[34880]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T06:48:33.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:32 smithi159 ceph-mon[30935]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T06:48:33.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:32 smithi159 ceph-mon[30935]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T06:48:35.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:34 smithi203 ceph-mon[35473]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-19T06:48:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:34 smithi189 ceph-mon[34880]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-19T06:48:35.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:34 smithi159 ceph-mon[30935]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-19T06:48:37.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:36 smithi203 ceph-mon[35473]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:48:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:36 smithi189 ceph-mon[34880]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:48:37.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:36 smithi159 ceph-mon[30935]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:48:39.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:38 smithi203 ceph-mon[35473]: pgmap v52: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T06:48:39.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:38 smithi189 ceph-mon[34880]: pgmap v52: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T06:48:39.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:38 smithi159 ceph-mon[30935]: pgmap v52: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T06:48:39.989 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:48:40.252 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:40.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.722+0000 7fee1c8c3640 1 -- 172.21.15.159:0/2274301254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 msgr2=0x7fee1810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:40.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.722+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/2274301254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 0x7fee1810ea90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fee10009900 tx=0x7fee1002a410 comp rx=0 tx=0).stop 2024-09-19T06:48:40.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.722+0000 7fee1c8c3640 1 -- 172.21.15.159:0/2274301254 shutdown_connections 2024-09-19T06:48:40.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.722+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/2274301254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 0x7fee1810ea90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.722+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/2274301254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee18102790 0x7fee181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.722+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/2274301254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee18101de0 0x7fee181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.722+0000 7fee1c8c3640 1 -- 172.21.15.159:0/2274301254 >> 172.21.15.159:0/2274301254 conn(0x7fee180fd8c0 msgr2=0x7fee180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.722+0000 7fee1c8c3640 1 -- 172.21.15.159:0/2274301254 shutdown_connections 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.722+0000 7fee1c8c3640 1 -- 172.21.15.159:0/2274301254 wait complete. 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee1c8c3640 1 Processor -- start 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee1c8c3640 1 -- start start 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee1c8c3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee18101de0 0x7fee18198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee1c8c3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee18102790 0x7fee181989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee1c8c3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 0x7fee1819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee1c8c3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee18111f90 con 0x7fee18106f10 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee1c8c3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee18111e10 con 0x7fee18101de0 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee1c8c3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee18112110 con 0x7fee18102790 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee16d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 0x7fee1819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:40.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee16d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 0x7fee1819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57140/0 (socket says 172.21.15.159:57140) 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee16d9d640 1 -- 172.21.15.159:0/3190257820 learned_addr learned my addr 172.21.15.159:0/3190257820 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee1659c640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee18101de0 0x7fee18198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee15d9b640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee18102790 0x7fee181989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.723+0000 7fee16d9d640 1 -- 172.21.15.159:0/3190257820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee18102790 msgr2=0x7fee181989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee16d9d640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee18102790 0x7fee181989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee16d9d640 1 -- 172.21.15.159:0/3190257820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee18101de0 msgr2=0x7fee18198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee16d9d640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee18101de0 0x7fee18198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee16d9d640 1 -- 172.21.15.159:0/3190257820 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1819d420 con 0x7fee18106f10 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee1659c640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee18101de0 0x7fee18198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee16d9d640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 0x7fee1819cd40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee10009230 tx=0x7fee100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee077fe640 1 -- 172.21.15.159:0/3190257820 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1003f030 con 0x7fee18106f10 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1819d6b0 con 0x7fee18106f10 2024-09-19T06:48:40.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee077fe640 1 -- 172.21.15.159:0/3190257820 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee10003ce0 con 0x7fee18106f10 2024-09-19T06:48:40.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee077fe640 1 -- 172.21.15.159:0/3190257820 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10035070 con 0x7fee18106f10 2024-09-19T06:48:40.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.724+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee181a4ff0 con 0x7fee18106f10 2024-09-19T06:48:40.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.725+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee181021c0 con 0x7fee18106f10 2024-09-19T06:48:40.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.726+0000 7fee077fe640 1 -- 172.21.15.159:0/3190257820 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fee10042030 con 0x7fee18106f10 2024-09-19T06:48:40.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.727+0000 7fee077fe640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fee000a3430 0x7fee000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:40.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.727+0000 7fee1659c640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fee000a3430 0x7fee000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:40.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.727+0000 7fee077fe640 1 -- 172.21.15.159:0/3190257820 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fee100f0640 con 0x7fee18106f10 2024-09-19T06:48:40.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.727+0000 7fee1659c640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fee000a3430 0x7fee000a58f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee0c005c40 tx=0x7fee0c0082f0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:40.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.731+0000 7fee077fe640 1 -- 172.21.15.159:0/3190257820 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee100bcff0 con 0x7fee18106f10 2024-09-19T06:48:40.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:40 smithi159 ceph-mon[30935]: pgmap v53: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T06:48:40.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.936+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee1810a0f0 con 0x7fee18106f10 2024-09-19T06:48:40.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.936+0000 7fee077fe640 1 -- 172.21.15.159:0/3190257820 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7fee100bc8f0 con 0x7fee18106f10 2024-09-19T06:48:40.938 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:48:40.938 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:48:40.938 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.938+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fee000a3430 msgr2=0x7fee000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.938+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fee000a3430 0x7fee000a58f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee0c005c40 tx=0x7fee0c0082f0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.938+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 msgr2=0x7fee1819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.938+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 0x7fee1819cd40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee10009230 tx=0x7fee100042f0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.939+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 shutdown_connections 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.939+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fee000a3430 0x7fee000a58f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.939+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee18106f10 0x7fee1819cd40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.939+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee18102790 0x7fee181989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.939+0000 7fee1c8c3640 1 --2- 172.21.15.159:0/3190257820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee18101de0 0x7fee18198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:40.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.939+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 >> 172.21.15.159:0/3190257820 conn(0x7fee180fd8c0 msgr2=0x7fee180fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:40.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.939+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 shutdown_connections 2024-09-19T06:48:40.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:40.939+0000 7fee1c8c3640 1 -- 172.21.15.159:0/3190257820 wait complete. 2024-09-19T06:48:41.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:40 smithi203 ceph-mon[35473]: pgmap v53: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T06:48:41.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:40 smithi189 ceph-mon[34880]: pgmap v53: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T06:48:41.763 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id d85b1ac4 --release --await' 2024-09-19T06:48:41.763 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id d85b1ac4 --release --await 2024-09-19T06:48:42.013 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:42.039 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:41 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3190257820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:42.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:41 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3190257820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:42.134 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:41 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3190257820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:42.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 -- 172.21.15.159:0/2787635811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 msgr2=0x7f893c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:42.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 --2- 172.21.15.159:0/2787635811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 0x7f893c1067e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f892c009900 tx=0x7f892c02a410 comp rx=0 tx=0).stop 2024-09-19T06:48:42.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 -- 172.21.15.159:0/2787635811 shutdown_connections 2024-09-19T06:48:42.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 --2- 172.21.15.159:0/2787635811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893c106f10 0x7f893c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 --2- 172.21.15.159:0/2787635811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 0x7f893c1067e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 --2- 172.21.15.159:0/2787635811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101de0 0x7f893c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 -- 172.21.15.159:0/2787635811 >> 172.21.15.159:0/2787635811 conn(0x7f893c0fd8c0 msgr2=0x7f893c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:42.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 -- 172.21.15.159:0/2787635811 shutdown_connections 2024-09-19T06:48:42.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 -- 172.21.15.159:0/2787635811 wait complete. 2024-09-19T06:48:42.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.497+0000 7f894192f640 1 Processor -- start 2024-09-19T06:48:42.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f894192f640 1 -- start start 2024-09-19T06:48:42.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f894192f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101de0 0x7f893c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f894192f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 0x7f893c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f894192f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893c106f10 0x7f893c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f894192f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f893c111fb0 con 0x7f893c102790 2024-09-19T06:48:42.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f894192f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f893c111e30 con 0x7f893c101de0 2024-09-19T06:48:42.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f894192f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f893c112130 con 0x7f893c106f10 2024-09-19T06:48:42.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 0x7f893c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 0x7f893c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57148/0 (socket says 172.21.15.159:57148) 2024-09-19T06:48:42.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893a7fc640 1 -- 172.21.15.159:0/3386612919 learned_addr learned my addr 172.21.15.159:0/3386612919 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:42.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893affd640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101de0 0x7f893c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893b7fe640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893c106f10 0x7f893c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893a7fc640 1 -- 172.21.15.159:0/3386612919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893c106f10 msgr2=0x7f893c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:42.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893a7fc640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893c106f10 0x7f893c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893a7fc640 1 -- 172.21.15.159:0/3386612919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101de0 msgr2=0x7f893c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:42.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893a7fc640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101de0 0x7f893c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893a7fc640 1 -- 172.21.15.159:0/3386612919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c19d420 con 0x7f893c102790 2024-09-19T06:48:42.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893b7fe640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893c106f10 0x7f893c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:42.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.498+0000 7f893a7fc640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 0x7f893c1989b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f892c006010 tx=0x7f892c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:42.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.499+0000 7f894092d640 1 -- 172.21.15.159:0/3386612919 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c03f030 con 0x7f893c102790 2024-09-19T06:48:42.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.499+0000 7f894092d640 1 -- 172.21.15.159:0/3386612919 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f892c003ce0 con 0x7f893c102790 2024-09-19T06:48:42.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.499+0000 7f894092d640 1 -- 172.21.15.159:0/3386612919 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c035070 con 0x7f893c102790 2024-09-19T06:48:42.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.499+0000 7f894192f640 1 -- 172.21.15.159:0/3386612919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893c19d6b0 con 0x7f893c102790 2024-09-19T06:48:42.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.499+0000 7f894192f640 1 -- 172.21.15.159:0/3386612919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f893c1a4ff0 con 0x7f893c102790 2024-09-19T06:48:42.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.501+0000 7f894092d640 1 -- 172.21.15.159:0/3386612919 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f892c042030 con 0x7f893c102790 2024-09-19T06:48:42.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.501+0000 7f8943d08740 1 Processor -- start 2024-09-19T06:48:42.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.501+0000 7f8943d08740 1 -- start start 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.501+0000 7f8943d08740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4479440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.501+0000 7f8943d08740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 0x563ca4483d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.501+0000 7f8943d08740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca4486630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.501+0000 7f8943d08740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563ca43de620 con 0x563ca4479060 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.501+0000 7f8943d08740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563ca4385e50 con 0x563ca4479980 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.501+0000 7f8943d08740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563ca43da5e0 con 0x563ca4484240 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4479440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4479440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57152/0 (socket says 172.21.15.159:57152) 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 -- 172.21.15.159:0/301866074 learned_addr learned my addr 172.21.15.159:0/301866074 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893affd640 1 --2- 172.21.15.159:0/301866074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 0x563ca4483d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893a7fc640 1 --2- 172.21.15.159:0/301866074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca4486630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 -- 172.21.15.159:0/301866074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 msgr2=0x563ca4486630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 --2- 172.21.15.159:0/301866074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca4486630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 -- 172.21.15.159:0/301866074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 msgr2=0x563ca4483d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 --2- 172.21.15.159:0/301866074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 0x563ca4483d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f894092d640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f89240a33b0 0x7f89240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 -- 172.21.15.159:0/301866074 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca4376d40 con 0x563ca4479060 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f89240a33b0 0x7f89240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f894092d640 1 -- 172.21.15.159:0/3386612919 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f892c0f0170 con 0x7f893c102790 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f893b7fe640 1 --2- 172.21.15.159:0/301866074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4479440 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8934009fb0 tx=0x7f8934010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f464f0b84c86c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f8921ffb640 1 -- 172.21.15.159:0/301866074 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934022070 con 0x563ca4479060 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f8921ffb640 1 -- 172.21.15.159:0/301866074 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89340113e0 con 0x563ca4479060 2024-09-19T06:48:42.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.502+0000 7f8921ffb640 1 -- 172.21.15.159:0/301866074 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934016070 con 0x563ca4479060 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f8943d08740 1 -- 172.21.15.159:0/301866074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 msgr2=0x563ca4479440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f893b7fe640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f89240a33b0 0x7f89240a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f893401f000 tx=0x7f8934022000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f8943d08740 1 --2- 172.21.15.159:0/301866074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4479440 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8934009fb0 tx=0x7f8934010800 comp rx=0 tx=0).stop 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f8943d08740 1 -- 172.21.15.159:0/301866074 shutdown_connections 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f8943d08740 1 --2- 172.21.15.159:0/301866074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca4486630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f8943d08740 1 --2- 172.21.15.159:0/301866074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 0x563ca4483d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f8943d08740 1 --2- 172.21.15.159:0/301866074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4479440 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f8943d08740 1 -- 172.21.15.159:0/301866074 >> 172.21.15.159:0/301866074 conn(0x563ca44755f0 msgr2=0x563ca44759d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f8943d08740 1 -- 172.21.15.159:0/301866074 shutdown_connections 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.503+0000 7f8943d08740 1 -- 172.21.15.159:0/301866074 wait complete. 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f8943d08740 1 -- start start 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f8943d08740 1 Processor -- start 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f8943d08740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4481150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f8943d08740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 0x563ca4481690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f8943d08740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca4481bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f8943d08740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563ca4486e10 con 0x563ca4479060 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f8943d08740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563ca4366f10 con 0x563ca4479980 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f8943d08740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563ca4486f90 con 0x563ca4484240 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f8943d08740 10 client.0 _ll_register_callbacks cb 0x563ca438adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f893affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4481150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f893affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4481150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57164/0 (socket says 172.21.15.159:57164) 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f893affd640 1 -- 172.21.15.159:0/2896771670 learned_addr learned my addr 172.21.15.159:0/2896771670 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f893b7fe640 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca4481bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.504+0000 7f893a7fc640 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 0x563ca4481690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f893affd640 1 -- 172.21.15.159:0/2896771670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 msgr2=0x563ca4481bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f893affd640 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca4481bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f893affd640 1 -- 172.21.15.159:0/2896771670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 msgr2=0x563ca4481690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f893affd640 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 0x563ca4481690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f893affd640 1 -- 172.21.15.159:0/2896771670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca40ed580 con 0x563ca4479060 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f893affd640 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4481150 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8930009f60 tx=0x7f8930009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4468c2c561f468b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f891affd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f891affd640 1 -- 172.21.15.159:0/2896771670 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930019070 con 0x563ca4479060 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f891affd640 1 -- 172.21.15.159:0/2896771670 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f8930015870 con 0x563ca4479060 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f8943d08740 1 -- 172.21.15.159:0/2896771670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89340113e0 con 0x563ca4479060 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f891affd640 1 -- 172.21.15.159:0/2896771670 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8930025050 con 0x563ca4479060 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f8943d08740 10 client.15723 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f8943d08740 1 -- 172.21.15.159:0/2896771670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563ca41b7960 con 0x563ca4479060 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f891affd640 1 -- 172.21.15.159:0/2896771670 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89340113e0 con 0x563ca4479060 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.505+0000 7f891affd640 1 -- 172.21.15.159:0/2896771670 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8930014b10 con 0x563ca4479060 2024-09-19T06:48:42.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.506+0000 7f8943d08740 10 client.15723 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:42.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.506+0000 7f8943d08740 10 client.15723 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:48:42.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.506+0000 7f8943d08740 20 client.15723 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:42.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.506+0000 7f8943d08740 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563ca4493de0 0x563ca44962a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.506+0000 7f8943d08740 4 client.15723 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:42.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.506+0000 7f8943d08740 1 -- 172.21.15.159:0/2896771670 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ca43ebb90 con 0x563ca4493de0 2024-09-19T06:48:42.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.506+0000 7f893a7fc640 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563ca4493de0 0x563ca44962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.506+0000 7f891affd640 10 client.15723 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:42.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.506+0000 7f893a7fc640 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563ca4493de0 0x563ca44962a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2de634f291a417fa server_cookie=ab5e5fafd44175d9 in_seq=0 out_seq=0 2024-09-19T06:48:42.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f891affd640 1 -- 172.21.15.159:0/2896771670 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ca43ebb90 con 0x563ca4493de0 2024-09-19T06:48:42.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f891affd640 10 client.15723 handle_command_reply: tid=0 2024-09-19T06:48:42.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 client.15723 shutdown 2024-09-19T06:48:42.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 -- 172.21.15.159:0/2896771670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 msgr2=0x563ca4481150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:42.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4481150 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8930009f60 tx=0x7f8930009f90 comp rx=0 tx=0).stop 2024-09-19T06:48:42.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 -- 172.21.15.159:0/2896771670 shutdown_connections 2024-09-19T06:48:42.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563ca4493de0 0x563ca44962a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca4481bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479980 0x563ca4481690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 --2- 172.21.15.159:0/2896771670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4481150 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f891affd640 0 client.15723 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:42.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 -- 172.21.15.159:0/2896771670 >> 172.21.15.159:0/2896771670 conn(0x563ca44755f0 msgr2=0x563ca4474750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:42.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 -- 172.21.15.159:0/2896771670 shutdown_connections 2024-09-19T06:48:42.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 1 -- 172.21.15.159:0/2896771670 wait complete. 2024-09-19T06:48:42.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.507+0000 7f8943d08740 20 client.15723 trim_cache size 0 max 16384 2024-09-19T06:48:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f8943d08740 1 Processor -- start 2024-09-19T06:48:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f8943d08740 1 -- start start 2024-09-19T06:48:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f8943d08740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479060 0x563ca449bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f8943d08740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479980 0x563ca449c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f8943d08740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca447e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f8943d08740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f893c1ab930 con 0x563ca4479980 2024-09-19T06:48:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f8943d08740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f893c1ae1b0 con 0x563ca4479060 2024-09-19T06:48:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f8943d08740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f893c1abfa0 con 0x563ca4484240 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f893a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479980 0x563ca449c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f893a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479980 0x563ca449c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57166/0 (socket says 172.21.15.159:57166) 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f893a7fc640 1 -- 172.21.15.159:0/3702553715 learned_addr learned my addr 172.21.15.159:0/3702553715 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f893a7fc640 1 -- 172.21.15.159:0/3702553715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 msgr2=0x563ca447e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f893a7fc640 1 --2- 172.21.15.159:0/3702553715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca447e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f893a7fc640 1 -- 172.21.15.159:0/3702553715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479060 msgr2=0x563ca449bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f893a7fc640 1 --2- 172.21.15.159:0/3702553715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479060 0x563ca449bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.524+0000 7f893a7fc640 1 -- 172.21.15.159:0/3702553715 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca447cd30 con 0x563ca4479980 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f893a7fc640 1 --2- 172.21.15.159:0/3702553715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479980 0x563ca449c100 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f892c000c00 tx=0x7f892c0b6f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb28a0f1c41e610 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f89217fa640 1 -- 172.21.15.159:0/3702553715 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c049040 con 0x563ca4479980 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f89217fa640 1 -- 172.21.15.159:0/3702553715 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f892c03b510 con 0x563ca4479980 2024-09-19T06:48:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f89217fa640 1 -- 172.21.15.159:0/3702553715 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c0c5090 con 0x563ca4479980 2024-09-19T06:48:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f8943d08740 1 -- 172.21.15.159:0/3702553715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479980 msgr2=0x563ca449c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f8943d08740 1 --2- 172.21.15.159:0/3702553715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479980 0x563ca449c100 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f892c000c00 tx=0x7f892c0b6f90 comp rx=0 tx=0).stop 2024-09-19T06:48:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f8943d08740 1 -- 172.21.15.159:0/3702553715 shutdown_connections 2024-09-19T06:48:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f8943d08740 1 --2- 172.21.15.159:0/3702553715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4484240 0x563ca447e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f8943d08740 1 --2- 172.21.15.159:0/3702553715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479980 0x563ca449c100 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f8943d08740 1 --2- 172.21.15.159:0/3702553715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4479060 0x563ca449bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f8943d08740 1 -- 172.21.15.159:0/3702553715 >> 172.21.15.159:0/3702553715 conn(0x563ca44755f0 msgr2=0x563ca447fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f8943d08740 1 -- 172.21.15.159:0/3702553715 shutdown_connections 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.525+0000 7f8943d08740 1 -- 172.21.15.159:0/3702553715 wait complete. 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f8943d08740 1 -- start start 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f8943d08740 1 Processor -- start 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f8943d08740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4488b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f8943d08740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4479980 0x563ca44890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f8943d08740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4484240 0x563ca44f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f8943d08740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f893c1ac670 con 0x563ca4479060 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f8943d08740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f893c1adae0 con 0x563ca4484240 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f8943d08740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f893c1acd40 con 0x563ca4479980 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f8943d08740 10 client.0 _ll_register_callbacks cb 0x7f8930009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f893affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4488b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f893affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4488b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57172/0 (socket says 172.21.15.159:57172) 2024-09-19T06:48:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.526+0000 7f893affd640 1 -- 172.21.15.159:0/929672302 learned_addr learned my addr 172.21.15.159:0/929672302 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f893b7fe640 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4484240 0x563ca44f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f893a7fc640 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4479980 0x563ca44890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f893affd640 1 -- 172.21.15.159:0/929672302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4479980 msgr2=0x563ca44890a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f893affd640 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4479980 0x563ca44890a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f893affd640 1 -- 172.21.15.159:0/929672302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4484240 msgr2=0x563ca44f6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f893affd640 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4484240 0x563ca44f6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f893affd640 1 -- 172.21.15.159:0/929672302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca44f7380 con 0x563ca4479060 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f893a7fc640 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4479980 0x563ca44890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f893affd640 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4488b60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8930009cb0 tx=0x7f893001d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5a35e371aa5f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f891affd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f891affd640 1 -- 172.21.15.159:0/929672302 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930019040 con 0x563ca4479060 2024-09-19T06:48:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f891affd640 1 -- 172.21.15.159:0/929672302 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f8930005dd0 con 0x563ca4479060 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f8943d08740 1 -- 172.21.15.159:0/929672302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ca43e60a0 con 0x563ca4479060 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f891affd640 1 -- 172.21.15.159:0/929672302 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8930037050 con 0x563ca4479060 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f8943d08740 10 client.15729 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f8943d08740 1 -- 172.21.15.159:0/929672302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563ca44ff6d0 con 0x563ca4479060 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f891affd640 1 -- 172.21.15.159:0/929672302 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563ca43e60a0 con 0x563ca4479060 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.527+0000 7f891affd640 1 -- 172.21.15.159:0/929672302 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8930015790 con 0x563ca4479060 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.528+0000 7f8943d08740 10 client.15729 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.528+0000 7f8943d08740 10 client.15729 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.528+0000 7f8943d08740 20 client.15729 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.528+0000 7f8943d08740 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563ca44ffe40 0x563ca4502260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.528+0000 7f8943d08740 4 client.15729 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d85b1ac4", "release": true, "await": true}] 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.528+0000 7f8943d08740 1 -- 172.21.15.159:0/929672302 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d85b1ac4", "release": true, "await": true}) -- 0x563ca43625a0 con 0x563ca44ffe40 2024-09-19T06:48:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.528+0000 7f893a7fc640 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563ca44ffe40 0x563ca4502260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:42.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.528+0000 7f893a7fc640 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563ca44ffe40 0x563ca4502260 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f648efc203c962d7 server_cookie=1674bfb13bd7967f in_seq=0 out_seq=0 2024-09-19T06:48:42.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.528+0000 7f891affd640 10 client.15729 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f891affd640 1 -- 172.21.15.159:0/929672302 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563ca43625a0 con 0x563ca44ffe40 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f891affd640 10 client.15729 handle_command_reply: tid=0 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 client.15729 shutdown 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 -- 172.21.15.159:0/929672302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 msgr2=0x563ca4488b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4488b60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8930009cb0 tx=0x7f893001d7d0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 -- 172.21.15.159:0/929672302 shutdown_connections 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563ca44ffe40 0x563ca4502260 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f891affd640 0 client.15729 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563ca4484240 0x563ca44f6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563ca4479980 0x563ca44890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 --2- 172.21.15.159:0/929672302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ca4479060 0x563ca4488b60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 -- 172.21.15.159:0/929672302 >> 172.21.15.159:0/929672302 conn(0x563ca44755f0 msgr2=0x563ca4473f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 -- 172.21.15.159:0/929672302 shutdown_connections 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 1 -- 172.21.15.159:0/929672302 wait complete. 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.531+0000 7f8943d08740 20 client.15729 trim_cache size 0 max 16384 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 20, 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 8, 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stdout: "d85b1ac4": { 2024-09-19T06:48:42.536 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 8, 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 140.3, 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:48:42.537 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:48:42.538 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:42.538 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:42.538 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:42.538 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:42.538 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:42.538 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 -- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f89240a33b0 msgr2=0x7f89240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f89240a33b0 0x7f89240a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f893401f000 tx=0x7f8934022000 comp rx=0 tx=0).stop 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 -- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 msgr2=0x7f893c1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 0x7f893c1989b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f892c006010 tx=0x7f892c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 -- 172.21.15.159:0/3386612919 shutdown_connections 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f89240a33b0 0x7f89240a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893c106f10 0x7f893c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f893c102790 0x7f893c1989b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 --2- 172.21.15.159:0/3386612919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101de0 0x7f893c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 -- 172.21.15.159:0/3386612919 >> 172.21.15.159:0/3386612919 conn(0x7f893c0fd8c0 msgr2=0x7f893c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 -- 172.21.15.159:0/3386612919 shutdown_connections 2024-09-19T06:48:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:42.532+0000 7f894192f640 1 -- 172.21.15.159:0/3386612919 wait complete. 2024-09-19T06:48:42.540 INFO:tasks.workunit.client.0.smithi159.stderr:+ set -e 2024-09-19T06:48:42.540 INFO:tasks.workunit.client.0.smithi159.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-09-19T06:48:42.540 INFO:tasks.workunit.client.0.smithi159.stderr:Cloning into 'xfstests-dev'... 2024-09-19T06:48:42.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:42 smithi203 ceph-mon[35473]: pgmap v54: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:48:43.007 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:42 smithi159 ceph-mon[30935]: pgmap v54: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:48:43.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:42 smithi189 ceph-mon[34880]: pgmap v54: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:48:43.353 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd85b1ac4', total seconds elapsed: 23.7 2024-09-19T06:48:43.353 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T06:48:43.353 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:48:43.601 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 -- 172.21.15.159:0/1266588301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5960102d20 msgr2=0x7f5960103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 --2- 172.21.15.159:0/1266588301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5960102d20 0x7f5960103100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f595c009860 tx=0x7f595c02a3d0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 -- 172.21.15.159:0/1266588301 shutdown_connections 2024-09-19T06:48:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 --2- 172.21.15.159:0/1266588301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f596010c0b0 0x7f596010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 --2- 172.21.15.159:0/1266588301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5960103640 0x7f596010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 --2- 172.21.15.159:0/1266588301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5960102d20 0x7f5960103100 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 -- 172.21.15.159:0/1266588301 >> 172.21.15.159:0/1266588301 conn(0x7f59600fc6f0 msgr2=0x7f59600feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 -- 172.21.15.159:0/1266588301 shutdown_connections 2024-09-19T06:48:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 -- 172.21.15.159:0/1266588301 wait complete. 2024-09-19T06:48:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.855+0000 7f59676e6640 1 Processor -- start 2024-09-19T06:48:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f59676e6640 1 -- start start 2024-09-19T06:48:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f59676e6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5960102d20 0x7f5960198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f59676e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5960103640 0x7f5960198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f59676e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f596010c0b0 0x7f596019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f59676e6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5960111ed0 con 0x7f596010c0b0 2024-09-19T06:48:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f59676e6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5960111d50 con 0x7f5960102d20 2024-09-19T06:48:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f59676e6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5960112050 con 0x7f5960103640 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965c83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f596010c0b0 0x7f596019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965c83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f596010c0b0 0x7f596019cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57192/0 (socket says 172.21.15.159:57192) 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965c83640 1 -- 172.21.15.159:0/3622998655 learned_addr learned my addr 172.21.15.159:0/3622998655 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5964c81640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5960103640 0x7f5960198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965482640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5960102d20 0x7f5960198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965c83640 1 -- 172.21.15.159:0/3622998655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5960103640 msgr2=0x7f5960198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965c83640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5960103640 0x7f5960198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965c83640 1 -- 172.21.15.159:0/3622998655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5960102d20 msgr2=0x7f5960198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965c83640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5960102d20 0x7f5960198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965c83640 1 -- 172.21.15.159:0/3622998655 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596019d330 con 0x7f596010c0b0 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965482640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5960102d20 0x7f5960198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.856+0000 7f5965c83640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f596010c0b0 0x7f596019cc00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5958009fd0 tx=0x7f595800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.857+0000 7f59567fc640 1 -- 172.21.15.159:0/3622998655 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958004b20 con 0x7f596010c0b0 2024-09-19T06:48:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.857+0000 7f59567fc640 1 -- 172.21.15.159:0/3622998655 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5958003e50 con 0x7f596010c0b0 2024-09-19T06:48:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.857+0000 7f59676e6640 1 -- 172.21.15.159:0/3622998655 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596019d620 con 0x7f596010c0b0 2024-09-19T06:48:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.857+0000 7f59567fc640 1 -- 172.21.15.159:0/3622998655 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595800b630 con 0x7f596010c0b0 2024-09-19T06:48:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.857+0000 7f59676e6640 1 -- 172.21.15.159:0/3622998655 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59601a4eb0 con 0x7f596010c0b0 2024-09-19T06:48:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.859+0000 7f59567fc640 1 -- 172.21.15.159:0/3622998655 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f595801d020 con 0x7f596010c0b0 2024-09-19T06:48:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f59567fc640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f594c0a3460 0x7f594c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f596a480740 1 Processor -- start 2024-09-19T06:48:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f596a480740 1 -- start start 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965482640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f594c0a3460 0x7f594c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f59567fc640 1 -- 172.21.15.159:0/3622998655 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f59580cfd50 con 0x7f596010c0b0 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f596a480740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a04cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f596a480740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a05bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f596a480740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a05e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f596a480740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561019fb12f0 con 0x56101a05c0c0 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f596a480740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561019f59270 con 0x56101a04d2d0 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f596a480740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561019fad2b0 con 0x56101a04c9b0 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965c83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a05e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965c83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a05e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57200/0 (socket says 172.21.15.159:57200) 2024-09-19T06:48:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965c83640 1 -- 172.21.15.159:0/1787069763 learned_addr learned my addr 172.21.15.159:0/1787069763 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965482640 1 --2- 172.21.15.159:0/1787069763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a04cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5964c81640 1 --2- 172.21.15.159:0/1787069763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a05bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965c83640 1 -- 172.21.15.159:0/1787069763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 msgr2=0x56101a04cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965c83640 1 --2- 172.21.15.159:0/1787069763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a04cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965482640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f594c0a3460 0x7f594c0a5920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f595c005940 tx=0x7f595c030ab0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965c83640 1 -- 172.21.15.159:0/1787069763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 msgr2=0x56101a05bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965c83640 1 --2- 172.21.15.159:0/1787069763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a05bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.860+0000 7f5965c83640 1 -- 172.21.15.159:0/1787069763 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561019f58340 con 0x56101a05c0c0 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.861+0000 7f5965c83640 1 --2- 172.21.15.159:0/1787069763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a05e4b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5958098460 tx=0x7f595809be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3571cc12ae87c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.861+0000 7f594b7fe640 1 -- 172.21.15.159:0/1787069763 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595801a040 con 0x56101a05c0c0 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.861+0000 7f594b7fe640 1 -- 172.21.15.159:0/1787069763 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59580bc0c0 con 0x56101a05c0c0 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.861+0000 7f594b7fe640 1 -- 172.21.15.159:0/1787069763 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59580b7ed0 con 0x56101a05c0c0 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.861+0000 7f596a480740 1 -- 172.21.15.159:0/1787069763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 msgr2=0x56101a05e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.861+0000 7f596a480740 1 --2- 172.21.15.159:0/1787069763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a05e4b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5958098460 tx=0x7f595809be90 comp rx=0 tx=0).stop 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.862+0000 7f596a480740 1 -- 172.21.15.159:0/1787069763 shutdown_connections 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.862+0000 7f596a480740 1 --2- 172.21.15.159:0/1787069763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a05e4b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.862+0000 7f596a480740 1 --2- 172.21.15.159:0/1787069763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a05bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.862+0000 7f596a480740 1 --2- 172.21.15.159:0/1787069763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a04cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.862+0000 7f596a480740 1 -- 172.21.15.159:0/1787069763 >> 172.21.15.159:0/1787069763 conn(0x56101a049060 msgr2=0x56101a049440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.862+0000 7f596a480740 1 -- 172.21.15.159:0/1787069763 shutdown_connections 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.862+0000 7f596a480740 1 -- 172.21.15.159:0/1787069763 wait complete. 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.862+0000 7f596a480740 1 -- start start 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.862+0000 7f596a480740 1 Processor -- start 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f596a480740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a059060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f596a480740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a0595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f596a480740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a059ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f596a480740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56101a05ec90 con 0x56101a05c0c0 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f596a480740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561019f3a290 con 0x56101a04d2d0 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f596a480740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56101a05ee10 con 0x56101a04c9b0 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f596a480740 10 client.0 _ll_register_callbacks cb 0x561019f6b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965c83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a059ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965482640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a059060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965482640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a059060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:46120/0 (socket says 172.21.15.159:46120) 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965c83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a059ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57214/0 (socket says 172.21.15.159:57214) 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965482640 1 -- 172.21.15.159:0/1513592479 learned_addr learned my addr 172.21.15.159:0/1513592479 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5964c81640 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a0595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965482640 1 -- 172.21.15.159:0/1513592479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 msgr2=0x56101a0595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965482640 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a0595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965482640 1 -- 172.21.15.159:0/1513592479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 msgr2=0x56101a059ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965482640 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a059ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965482640 1 -- 172.21.15.159:0/1513592479 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561019cc4210 con 0x56101a04c9b0 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965c83640 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a059ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5965482640 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a059060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f595c0309e0 tx=0x7f595c02a3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c52f80b4ce9aec6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.863+0000 7f5948ff9640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f5948ff9640 1 -- 172.21.15.159:0/1513592479 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c0048c0 con 0x56101a04c9b0 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f5948ff9640 1 -- 172.21.15.159:0/1513592479 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f595c004a60 con 0x56101a04c9b0 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f596a480740 1 -- 172.21.15.159:0/1513592479 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59580bc0c0 con 0x56101a04c9b0 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f5948ff9640 1 -- 172.21.15.159:0/1513592479 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f595c004c60 con 0x56101a04c9b0 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f596a480740 10 client.25255 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f596a480740 1 -- 172.21.15.159:0/1513592479 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561019d90620 con 0x56101a04c9b0 2024-09-19T06:48:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f5948ff9640 1 -- 172.21.15.159:0/1513592479 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59580bc0c0 con 0x56101a04c9b0 2024-09-19T06:48:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f5948ff9640 1 -- 172.21.15.159:0/1513592479 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f595c05b070 con 0x56101a04c9b0 2024-09-19T06:48:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f596a480740 10 client.25255 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f596a480740 10 client.25255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f596a480740 20 client.25255 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f596a480740 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56101a06c4e0 0x56101a06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f596a480740 4 client.25255 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.864+0000 7f596a480740 1 -- 172.21.15.159:0/1513592479 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561019fbea20 con 0x56101a06c4e0 2024-09-19T06:48:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.865+0000 7f5964c81640 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56101a06c4e0 0x56101a06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.865+0000 7f5964c81640 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56101a06c4e0 0x56101a06e940 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eecd783e2bf04302 server_cookie=615a551addaad543 in_seq=0 out_seq=0 2024-09-19T06:48:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.865+0000 7f5948ff9640 10 client.25255 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f5948ff9640 1 -- 172.21.15.159:0/1513592479 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561019fbea20 con 0x56101a06c4e0 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f5948ff9640 10 client.25255 handle_command_reply: tid=0 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f596a480740 1 client.25255 shutdown 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f596a480740 1 -- 172.21.15.159:0/1513592479 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 msgr2=0x56101a059060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f596a480740 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a059060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f595c0309e0 tx=0x7f595c02a3d0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f596a480740 1 -- 172.21.15.159:0/1513592479 shutdown_connections 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f596a480740 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56101a06c4e0 0x56101a06e940 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f596a480740 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a05c0c0 0x56101a059ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f5948ff9640 0 client.25255 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f596a480740 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a0595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f596a480740 1 --2- 172.21.15.159:0/1513592479 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a04c9b0 0x56101a059060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.867+0000 7f596a480740 1 -- 172.21.15.159:0/1513592479 >> 172.21.15.159:0/1513592479 conn(0x56101a049060 msgr2=0x56101a04edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.868+0000 7f596a480740 1 -- 172.21.15.159:0/1513592479 shutdown_connections 2024-09-19T06:48:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.868+0000 7f596a480740 1 -- 172.21.15.159:0/1513592479 wait complete. 2024-09-19T06:48:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.868+0000 7f596a480740 20 client.25255 trim_cache size 0 max 16384 2024-09-19T06:48:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f596a480740 1 Processor -- start 2024-09-19T06:48:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f596a480740 1 -- start start 2024-09-19T06:48:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f596a480740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04c9b0 0x56101a059730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f596a480740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a074250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f596a480740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 0x56101a074790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f596a480740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f59601a96f0 con 0x56101a04c9b0 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f596a480740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59601abf70 con 0x56101a04d2d0 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f596a480740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f59601a9d60 con 0x56101a05c0c0 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f5965482640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04c9b0 0x56101a059730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f5965482640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04c9b0 0x56101a059730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57224/0 (socket says 172.21.15.159:57224) 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f5965482640 1 -- 172.21.15.159:0/13668831 learned_addr learned my addr 172.21.15.159:0/13668831 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f5965482640 1 -- 172.21.15.159:0/13668831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 msgr2=0x56101a074790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f5965482640 1 --2- 172.21.15.159:0/13668831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 0x56101a074790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f5965482640 1 -- 172.21.15.159:0/13668831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 msgr2=0x56101a074250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.884+0000 7f5965482640 1 --2- 172.21.15.159:0/13668831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a074250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.885+0000 7f5965482640 1 -- 172.21.15.159:0/13668831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56101a05bbb0 con 0x56101a04c9b0 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.885+0000 7f5965482640 1 --2- 172.21.15.159:0/13668831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04c9b0 0x56101a059730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f595c0309b0 tx=0x7f595c030a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa407b5055c1a99a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.885+0000 7f594affd640 1 -- 172.21.15.159:0/13668831 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c0046c0 con 0x56101a04c9b0 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.885+0000 7f594affd640 1 -- 172.21.15.159:0/13668831 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c062070 con 0x56101a04c9b0 2024-09-19T06:48:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.885+0000 7f594affd640 1 -- 172.21.15.159:0/13668831 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c05d740 con 0x56101a04c9b0 2024-09-19T06:48:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 -- 172.21.15.159:0/13668831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04c9b0 msgr2=0x56101a059730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 --2- 172.21.15.159:0/13668831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04c9b0 0x56101a059730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f595c0309b0 tx=0x7f595c030a10 comp rx=0 tx=0).stop 2024-09-19T06:48:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 -- 172.21.15.159:0/13668831 shutdown_connections 2024-09-19T06:48:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 --2- 172.21.15.159:0/13668831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 0x56101a074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 --2- 172.21.15.159:0/13668831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04d2d0 0x56101a074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 --2- 172.21.15.159:0/13668831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04c9b0 0x56101a059730 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 -- 172.21.15.159:0/13668831 >> 172.21.15.159:0/13668831 conn(0x56101a049060 msgr2=0x56101a059020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 -- 172.21.15.159:0/13668831 shutdown_connections 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 -- 172.21.15.159:0/13668831 wait complete. 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 -- start start 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.886+0000 7f596a480740 1 Processor -- start 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f596a480740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04c9b0 0x56101a064610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f596a480740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04d2d0 0x56101a055bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f596a480740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 0x56101a056110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f596a480740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f59601aa430 con 0x56101a04d2d0 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f596a480740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59601ab8a0 con 0x56101a04c9b0 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f596a480740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f59601aab00 con 0x56101a05c0c0 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f596a480740 10 client.0 _ll_register_callbacks cb 0x7f5958009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5964c81640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04d2d0 0x56101a055bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5964c81640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04d2d0 0x56101a055bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57228/0 (socket says 172.21.15.159:57228) 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5964c81640 1 -- 172.21.15.159:0/3594367609 learned_addr learned my addr 172.21.15.159:0/3594367609 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5965c83640 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 0x56101a056110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5964c81640 1 -- 172.21.15.159:0/3594367609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 msgr2=0x56101a056110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5964c81640 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 0x56101a056110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5964c81640 1 -- 172.21.15.159:0/3594367609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04c9b0 msgr2=0x56101a064610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5964c81640 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04c9b0 0x56101a064610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5964c81640 1 -- 172.21.15.159:0/3594367609 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56101a056750 con 0x56101a04d2d0 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5965c83640 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 0x56101a056110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5964c81640 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04d2d0 0x56101a055bd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x56101a05a6a0 tx=0x7f5950004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc968d7eadf00469 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.887+0000 7f5948ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f5948ff9640 1 -- 172.21.15.159:0/3594367609 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950027430 con 0x56101a04d2d0 2024-09-19T06:48:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f5948ff9640 1 -- 172.21.15.159:0/3594367609 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f59500275d0 con 0x56101a04d2d0 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f596a480740 1 -- 172.21.15.159:0/3594367609 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595c062070 con 0x56101a04d2d0 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f5948ff9640 1 -- 172.21.15.159:0/3594367609 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59500277d0 con 0x56101a04d2d0 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f596a480740 10 client.15747 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f596a480740 1 -- 172.21.15.159:0/3594367609 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56101a0d7130 con 0x56101a04d2d0 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f5948ff9640 1 -- 172.21.15.159:0/3594367609 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c062070 con 0x56101a04d2d0 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f5948ff9640 1 -- 172.21.15.159:0/3594367609 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f595002e070 con 0x56101a04d2d0 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f596a480740 10 client.15747 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f596a480740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f596a480740 20 client.15747 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f596a480740 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56101a06c4e0 0x56101a0d9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f596a480740 4 client.15747 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.888+0000 7f596a480740 1 -- 172.21.15.159:0/3594367609 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561019fb8d70 con 0x56101a06c4e0 2024-09-19T06:48:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.911+0000 7f5965482640 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56101a06c4e0 0x56101a0d9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.912+0000 7f5948ff9640 10 client.15747 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.912+0000 7f5965482640 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56101a06c4e0 0x56101a0d9900 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b17ca848183bbd6 server_cookie=b80c1401e1bd988e in_seq=0 out_seq=0 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f5948ff9640 1 -- 172.21.15.159:0/3594367609 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561019fb8d70 con 0x56101a06c4e0 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f5948ff9640 10 client.15747 handle_command_reply: tid=0 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 client.15747 shutdown 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 -- 172.21.15.159:0/3594367609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04d2d0 msgr2=0x56101a055bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04d2d0 0x56101a055bd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x56101a05a6a0 tx=0x7f5950004410 comp rx=0 tx=0).stop 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 -- 172.21.15.159:0/3594367609 shutdown_connections 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56101a06c4e0 0x56101a0d9900 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56101a05c0c0 0x56101a056110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56101a04d2d0 0x56101a055bd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f5948ff9640 0 client.15747 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 --2- 172.21.15.159:0/3594367609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56101a04c9b0 0x56101a064610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 -- 172.21.15.159:0/3594367609 >> 172.21.15.159:0/3594367609 conn(0x56101a049060 msgr2=0x56101a059840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 -- 172.21.15.159:0/3594367609 shutdown_connections 2024-09-19T06:48:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.936+0000 7f596a480740 1 -- 172.21.15.159:0/3594367609 wait complete. 2024-09-19T06:48:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f596a480740 20 client.15747 trim_cache size 0 max 16384 2024-09-19T06:48:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:48:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:48:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:48:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:48:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 -- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f594c0a3460 msgr2=0x7f594c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f594c0a3460 0x7f594c0a5920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f595c005940 tx=0x7f595c030ab0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 -- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f596010c0b0 msgr2=0x7f596019cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f596010c0b0 0x7f596019cc00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5958009fd0 tx=0x7f595800c800 comp rx=0 tx=0).stop 2024-09-19T06:48:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 -- 172.21.15.159:0/3622998655 shutdown_connections 2024-09-19T06:48:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f594c0a3460 0x7f594c0a5920 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f596010c0b0 0x7f596019cc00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5960103640 0x7f5960198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 --2- 172.21.15.159:0/3622998655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5960102d20 0x7f5960198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 -- 172.21.15.159:0/3622998655 >> 172.21.15.159:0/3622998655 conn(0x7f59600fc6f0 msgr2=0x7f59600fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 -- 172.21.15.159:0/3622998655 shutdown_connections 2024-09-19T06:48:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:43.937+0000 7f59676e6640 1 -- 172.21.15.159:0/3622998655 wait complete. 2024-09-19T06:48:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.088+0000 7ff80038e640 1 -- 172.21.15.159:0/2777142806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f810c150 msgr2=0x7ff7f810e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.088+0000 7ff80038e640 1 --2- 172.21.15.159:0/2777142806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f810c150 0x7ff7f810e5f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009ca0 tx=0x7ff7f002a950 comp rx=0 tx=0).stop 2024-09-19T06:48:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.088+0000 7ff80038e640 1 -- 172.21.15.159:0/2777142806 shutdown_connections 2024-09-19T06:48:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.088+0000 7ff80038e640 1 --2- 172.21.15.159:0/2777142806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f810c150 0x7ff7f810e5f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.088+0000 7ff80038e640 1 --2- 172.21.15.159:0/2777142806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8103640 0x7ff7f810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.088+0000 7ff80038e640 1 --2- 172.21.15.159:0/2777142806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7f8102d20 0x7ff7f8103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.088+0000 7ff80038e640 1 -- 172.21.15.159:0/2777142806 >> 172.21.15.159:0/2777142806 conn(0x7ff7f80fc780 msgr2=0x7ff7f80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.088+0000 7ff80038e640 1 -- 172.21.15.159:0/2777142806 shutdown_connections 2024-09-19T06:48:44.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.088+0000 7ff80038e640 1 -- 172.21.15.159:0/2777142806 wait complete. 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.089+0000 7ff80038e640 1 Processor -- start 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.089+0000 7ff80038e640 1 -- start start 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff80038e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f8102d20 0x7ff7f81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff80038e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8103640 0x7ff7f81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff80038e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7f810c150 0x7ff7f819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff80038e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f8111fb0 con 0x7ff7f8102d20 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff80038e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f8111e30 con 0x7ff7f8103640 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff80038e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f8112130 con 0x7ff7f810c150 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe12a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f8102d20 0x7ff7f81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe12a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f8102d20 0x7ff7f81984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57254/0 (socket says 172.21.15.159:57254) 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe12a640 1 -- 172.21.15.159:0/695843625 learned_addr learned my addr 172.21.15.159:0/695843625 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe92b640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7f810c150 0x7ff7f819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:44.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fd929640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8103640 0x7ff7f81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe12a640 1 -- 172.21.15.159:0/695843625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7f810c150 msgr2=0x7ff7f819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe12a640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7f810c150 0x7ff7f819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe12a640 1 -- 172.21.15.159:0/695843625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8103640 msgr2=0x7ff7f81989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe12a640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8103640 0x7ff7f81989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe12a640 1 -- 172.21.15.159:0/695843625 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f819d460 con 0x7ff7f8102d20 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7fe12a640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f8102d20 0x7ff7f81984b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400d770 tx=0x7ff7f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7ef7fe640 1 -- 172.21.15.159:0/695843625 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4017070 con 0x7ff7f8102d20 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7ef7fe640 1 -- 172.21.15.159:0/695843625 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7f4005500 con 0x7ff7f8102d20 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff7ef7fe640 1 -- 172.21.15.159:0/695843625 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4004e00 con 0x7ff7f8102d20 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f819d750 con 0x7ff7f8102d20 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.090+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f81008b0 con 0x7ff7f8102d20 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.092+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f806b070 con 0x7ff7f8102d20 2024-09-19T06:48:44.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.093+0000 7ff7ef7fe640 1 -- 172.21.15.159:0/695843625 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ff7f4004fa0 con 0x7ff7f8102d20 2024-09-19T06:48:44.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.093+0000 7ff7ef7fe640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff7e40a33b0 0x7ff7e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:44.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.094+0000 7ff7fd929640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff7e40a33b0 0x7ff7e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:44.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.094+0000 7ff7ef7fe640 1 -- 172.21.15.159:0/695843625 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7ff7f40cfc00 con 0x7ff7f8102d20 2024-09-19T06:48:44.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.094+0000 7ff7fd929640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff7e40a33b0 0x7ff7e40a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80fed80 tx=0x7ff7e8008040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:44.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.097+0000 7ff7ef7fe640 1 -- 172.21.15.159:0/695843625 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7f409c5b0 con 0x7ff7f8102d20 2024-09-19T06:48:44.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.336+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7f81071f0 con 0x7ff7f8102d20 2024-09-19T06:48:44.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.337+0000 7ff7ef7fe640 1 -- 172.21.15.159:0/695843625 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7ff7f409beb0 con 0x7ff7f8102d20 2024-09-19T06:48:44.338 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:48:44.338 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:48:44.339 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:48:44.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.339+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff7e40a33b0 msgr2=0x7ff7e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:44.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.339+0000 7ff80038e640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff7e40a33b0 0x7ff7e40a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80fed80 tx=0x7ff7e8008040 comp rx=0 tx=0).stop 2024-09-19T06:48:44.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.339+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f8102d20 msgr2=0x7ff7f81984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:44.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.339+0000 7ff80038e640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f8102d20 0x7ff7f81984b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400d770 tx=0x7ff7f400dc30 comp rx=0 tx=0).stop 2024-09-19T06:48:44.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.339+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 shutdown_connections 2024-09-19T06:48:44.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.339+0000 7ff80038e640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff7e40a33b0 0x7ff7e40a5870 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80fed80 tx=0x7ff7e8008040 comp rx=0 tx=0).stop 2024-09-19T06:48:44.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.339+0000 7ff80038e640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7f810c150 0x7ff7f819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:44.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.339+0000 7ff80038e640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7f8103640 0x7ff7f81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:44.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.340+0000 7ff80038e640 1 --2- 172.21.15.159:0/695843625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7f8102d20 0x7ff7f81984b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:44.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.340+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 >> 172.21.15.159:0/695843625 conn(0x7ff7f80fc780 msgr2=0x7ff7f80fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:44.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.340+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 shutdown_connections 2024-09-19T06:48:44.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:44.340+0000 7ff80038e640 1 -- 172.21.15.159:0/695843625 wait complete. 2024-09-19T06:48:44.573 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:48:44.596 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:44 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/695843625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:44.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:44 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/695843625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:44.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:44 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/695843625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:45.026 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T06:48:45.026 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T06:48:45.088 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:45.550 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:45 smithi159 ceph-mon[30935]: pgmap v55: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:48:45.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.630+0000 7f8c074c9640 1 -- 172.21.15.159:0/558855642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 msgr2=0x7f8c001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.630+0000 7f8c074c9640 1 --2- 172.21.15.159:0/558855642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 0x7f8c001067e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009900 tx=0x7f8bf002a410 comp rx=0 tx=0).stop 2024-09-19T06:48:45.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.630+0000 7f8c074c9640 1 -- 172.21.15.159:0/558855642 shutdown_connections 2024-09-19T06:48:45.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.630+0000 7f8c074c9640 1 --2- 172.21.15.159:0/558855642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c00106f10 0x7f8c0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.630+0000 7f8c074c9640 1 --2- 172.21.15.159:0/558855642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 0x7f8c001067e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.630+0000 7f8c074c9640 1 --2- 172.21.15.159:0/558855642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c00101de0 0x7f8c001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.630+0000 7f8c074c9640 1 -- 172.21.15.159:0/558855642 >> 172.21.15.159:0/558855642 conn(0x7f8c000fd8c0 msgr2=0x7f8c000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.630+0000 7f8c074c9640 1 -- 172.21.15.159:0/558855642 shutdown_connections 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.630+0000 7f8c074c9640 1 -- 172.21.15.159:0/558855642 wait complete. 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.631+0000 7f8c074c9640 1 Processor -- start 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.631+0000 7f8c074c9640 1 -- start start 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c074c9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c00101de0 0x7f8c00198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c074c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 0x7f8c00198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c074c9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c00106f10 0x7f8c0019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c074c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00111fb0 con 0x7f8c00102790 2024-09-19T06:48:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c074c9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00111e30 con 0x7f8c00106f10 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c074c9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00112130 con 0x7f8c00101de0 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c04a64640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 0x7f8c00198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c04a64640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 0x7f8c00198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57264/0 (socket says 172.21.15.159:57264) 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c04a64640 1 -- 172.21.15.159:0/2469918963 learned_addr learned my addr 172.21.15.159:0/2469918963 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c05a66640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c00106f10 0x7f8c0019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c05265640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c00101de0 0x7f8c00198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c04a64640 1 -- 172.21.15.159:0/2469918963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c00101de0 msgr2=0x7f8c00198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c04a64640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c00101de0 0x7f8c00198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c04a64640 1 -- 172.21.15.159:0/2469918963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c00106f10 msgr2=0x7f8c0019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c04a64640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c00106f10 0x7f8c0019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c04a64640 1 -- 172.21.15.159:0/2469918963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0019d500 con 0x7f8c00102790 2024-09-19T06:48:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c05265640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c00101de0 0x7f8c00198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c04a64640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 0x7f8c00198a90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0005ab0 tx=0x7f8bf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8bf67fc640 1 -- 172.21.15.159:0/2469918963 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf003f030 con 0x7f8c00102790 2024-09-19T06:48:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8bf67fc640 1 -- 172.21.15.159:0/2469918963 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf0003ce0 con 0x7f8c00102790 2024-09-19T06:48:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8c074c9640 1 -- 172.21.15.159:0/2469918963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0019d790 con 0x7f8c00102790 2024-09-19T06:48:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.632+0000 7f8bf67fc640 1 -- 172.21.15.159:0/2469918963 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0035070 con 0x7f8c00102790 2024-09-19T06:48:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.633+0000 7f8c074c9640 1 -- 172.21.15.159:0/2469918963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c001a50d0 con 0x7f8c00102790 2024-09-19T06:48:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.635+0000 7f8bf67fc640 1 -- 172.21.15.159:0/2469918963 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f8bf0042030 con 0x7f8c00102790 2024-09-19T06:48:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.635+0000 7f8c098a2740 1 Processor -- start 2024-09-19T06:48:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.635+0000 7f8c098a2740 1 -- start start 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a305880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 0x55c97a310140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 0x55c97a312a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c098a2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c97a26b2e0 con 0x55c97a3054a0 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c098a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c97a212ce0 con 0x55c97a305dc0 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c098a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c97a2672a0 con 0x55c97a310680 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a305880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8bf67fc640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8bec0a33b0 0x7f8bec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a305880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57276/0 (socket says 172.21.15.159:57276) 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 -- 172.21.15.159:0/3284364546 learned_addr learned my addr 172.21.15.159:0/3284364546 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c04a64640 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 0x55c97a312a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8bec0a33b0 0x7f8bec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05265640 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 0x55c97a310140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 -- 172.21.15.159:0/3284364546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 msgr2=0x55c97a312a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8bf67fc640 1 -- 172.21.15.159:0/2469918963 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f8bf00f0750 con 0x7f8c00102790 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 0x55c97a312a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 -- 172.21.15.159:0/3284364546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 msgr2=0x55c97a310140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 0x55c97a310140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 -- 172.21.15.159:0/3284364546 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97a1f7440 con 0x55c97a3054a0 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05265640 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 0x55c97a310140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8c05a66640 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a305880 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8012890 tx=0x7f8bf8012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31ec649865fb2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.636+0000 7f8beb7fe640 1 -- 172.21.15.159:0/3284364546 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8003d40 con 0x55c97a3054a0 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8beb7fe640 1 -- 172.21.15.159:0/3284364546 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf8004b60 con 0x55c97a3054a0 2024-09-19T06:48:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8beb7fe640 1 -- 172.21.15.159:0/3284364546 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80052b0 con 0x55c97a3054a0 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c05a66640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8bec0a33b0 0x7f8bec0a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8bf801f000 tx=0x7f8bf801e000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c098a2740 1 -- 172.21.15.159:0/3284364546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 msgr2=0x55c97a305880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a305880 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8012890 tx=0x7f8bf8012d50 comp rx=0 tx=0).stop 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c098a2740 1 -- 172.21.15.159:0/3284364546 shutdown_connections 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 0x55c97a312a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 0x55c97a310140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3284364546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a305880 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c098a2740 1 -- 172.21.15.159:0/3284364546 >> 172.21.15.159:0/3284364546 conn(0x55c97a301a30 msgr2=0x55c97a301e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c098a2740 1 -- 172.21.15.159:0/3284364546 shutdown_connections 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.637+0000 7f8c098a2740 1 -- 172.21.15.159:0/3284364546 wait complete. 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c098a2740 1 -- start start 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c098a2740 1 Processor -- start 2024-09-19T06:48:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 0x55c97a30ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a305dc0 0x55c97a30d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 0x55c97a30d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c098a2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c97a313250 con 0x55c97a305dc0 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c098a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c97a226050 con 0x55c97a3054a0 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c098a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c97a3133d0 con 0x55c97a310680 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c098a2740 10 client.0 _ll_register_callbacks cb 0x55c97a266160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c04a64640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a305dc0 0x55c97a30d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c04a64640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a305dc0 0x55c97a30d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57284/0 (socket says 172.21.15.159:57284) 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c04a64640 1 -- 172.21.15.159:0/3167674502 learned_addr learned my addr 172.21.15.159:0/3167674502 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.638+0000 7f8c05a66640 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 0x55c97a30d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c05265640 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 0x55c97a30ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c04a64640 1 -- 172.21.15.159:0/3167674502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 msgr2=0x55c97a30d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c04a64640 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 0x55c97a30d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c04a64640 1 -- 172.21.15.159:0/3167674502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 msgr2=0x55c97a30ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c04a64640 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 0x55c97a30ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c04a64640 1 -- 172.21.15.159:0/3167674502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c979fdc3c0 con 0x55c97a305dc0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c04a64640 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a305dc0 0x55c97a30d270 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00bc6a0 tx=0x7f8bf002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b7150562b04727 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8be8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8be8ff9640 1 -- 172.21.15.159:0/3167674502 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0049040 con 0x55c97a305dc0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8be8ff9640 1 -- 172.21.15.159:0/3167674502 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f8bf00b9010 con 0x55c97a305dc0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c098a2740 1 -- 172.21.15.159:0/3167674502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bf8004b60 con 0x55c97a305dc0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8be8ff9640 1 -- 172.21.15.159:0/3167674502 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8bf00c0d50 con 0x55c97a305dc0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c098a2740 10 client.15765 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8c098a2740 1 -- 172.21.15.159:0/3167674502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c97a31eb70 con 0x55c97a305dc0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8be8ff9640 1 -- 172.21.15.159:0/3167674502 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf8004b60 con 0x55c97a305dc0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.639+0000 7f8be8ff9640 1 -- 172.21.15.159:0/3167674502 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8bf00bcc00 con 0x55c97a305dc0 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.640+0000 7f8c098a2740 10 client.15765 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.640+0000 7f8c098a2740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:45.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.640+0000 7f8c098a2740 20 client.15765 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.640+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c97a320020 0x55c97a322470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.640+0000 7f8c098a2740 4 client.15765 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.640+0000 7f8c098a2740 1 -- 172.21.15.159:0/3167674502 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c97a278850 con 0x55c97a320020 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.640+0000 7f8c05265640 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c97a320020 0x55c97a322470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.640+0000 7f8be8ff9640 10 client.15765 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.640+0000 7f8c05265640 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c97a320020 0x55c97a322470 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88481d544bdccd9d server_cookie=a7a65c2697410fc9 in_seq=0 out_seq=0 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8be8ff9640 1 -- 172.21.15.159:0/3167674502 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c97a278850 con 0x55c97a320020 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8be8ff9640 10 client.15765 handle_command_reply: tid=0 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 client.15765 shutdown 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 -- 172.21.15.159:0/3167674502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a305dc0 msgr2=0x55c97a30d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a305dc0 0x55c97a30d270 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00bc6a0 tx=0x7f8bf002a410 comp rx=0 tx=0).stop 2024-09-19T06:48:45.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 -- 172.21.15.159:0/3167674502 shutdown_connections 2024-09-19T06:48:45.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c97a320020 0x55c97a322470 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a310680 0x55c97a30d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a305dc0 0x55c97a30d270 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8be8ff9640 0 client.15765 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:45.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 --2- 172.21.15.159:0/3167674502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 0x55c97a30ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 -- 172.21.15.159:0/3167674502 >> 172.21.15.159:0/3167674502 conn(0x55c97a301a30 msgr2=0x55c97a300b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:45.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 -- 172.21.15.159:0/3167674502 shutdown_connections 2024-09-19T06:48:45.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 1 -- 172.21.15.159:0/3167674502 wait complete. 2024-09-19T06:48:45.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.641+0000 7f8c098a2740 20 client.15765 trim_cache size 0 max 16384 2024-09-19T06:48:45.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.659+0000 7f8c098a2740 1 Processor -- start 2024-09-19T06:48:45.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.659+0000 7f8c098a2740 1 -- start start 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.659+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a301a30 0x55c97a30f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 0x55c97a327d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a305dc0 0x55c97a328250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c098a2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001ab920 con 0x55c97a301a30 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c098a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001ae1a0 con 0x55c97a3054a0 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c098a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001abf90 con 0x55c97a305dc0 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05265640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a301a30 0x55c97a30f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05265640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a301a30 0x55c97a30f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57290/0 (socket says 172.21.15.159:57290) 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05265640 1 -- 172.21.15.159:0/341599133 learned_addr learned my addr 172.21.15.159:0/341599133 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c04a64640 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 0x55c97a327d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05a66640 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a305dc0 0x55c97a328250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05265640 1 -- 172.21.15.159:0/341599133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a305dc0 msgr2=0x55c97a328250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05265640 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a305dc0 0x55c97a328250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05265640 1 -- 172.21.15.159:0/341599133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 msgr2=0x55c97a327d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:45.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05265640 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 0x55c97a327d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05265640 1 -- 172.21.15.159:0/341599133 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97a305bf0 con 0x55c97a301a30 2024-09-19T06:48:45.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c04a64640 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 0x55c97a327d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:45.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8c05265640 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a301a30 0x55c97a30f1e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00ba00 tx=0x7f8bfc0147e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815effac024d3bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:45.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8beaffd640 1 -- 172.21.15.159:0/341599133 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc020070 con 0x55c97a301a30 2024-09-19T06:48:45.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8beaffd640 1 -- 172.21.15.159:0/341599133 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bfc023840 con 0x55c97a301a30 2024-09-19T06:48:45.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.660+0000 7f8beaffd640 1 -- 172.21.15.159:0/341599133 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0196b0 con 0x55c97a301a30 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.661+0000 7f8c098a2740 1 -- 172.21.15.159:0/341599133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a301a30 msgr2=0x55c97a30f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.661+0000 7f8c098a2740 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a301a30 0x55c97a30f1e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00ba00 tx=0x7f8bfc0147e0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.661+0000 7f8c098a2740 1 -- 172.21.15.159:0/341599133 shutdown_connections 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.661+0000 7f8c098a2740 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a305dc0 0x55c97a328250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.661+0000 7f8c098a2740 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a3054a0 0x55c97a327d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.661+0000 7f8c098a2740 1 --2- 172.21.15.159:0/341599133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a301a30 0x55c97a30f1e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.661+0000 7f8c098a2740 1 -- 172.21.15.159:0/341599133 >> 172.21.15.159:0/341599133 conn(0x55c97a30d910 msgr2=0x55c97a30ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.661+0000 7f8c098a2740 1 -- 172.21.15.159:0/341599133 shutdown_connections 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.661+0000 7f8c098a2740 1 -- 172.21.15.159:0/341599133 wait complete. 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c098a2740 1 -- start start 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c098a2740 1 Processor -- start 2024-09-19T06:48:45.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a301a30 0x55c97a318e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a3161d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c098a2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 0x55c97a316770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c098a2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001ac660 con 0x55c97a3054a0 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c098a2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001adad0 con 0x55c97a305dc0 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c098a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001acd30 con 0x55c97a301a30 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c098a2740 10 client.0 _ll_register_callbacks cb 0x7f8bf00b8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c04a64640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a3161d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c04a64640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a3161d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57294/0 (socket says 172.21.15.159:57294) 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c04a64640 1 -- 172.21.15.159:0/421773704 learned_addr learned my addr 172.21.15.159:0/421773704 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c05265640 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a301a30 0x55c97a318e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c05a66640 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 0x55c97a316770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c04a64640 1 -- 172.21.15.159:0/421773704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a301a30 msgr2=0x55c97a318e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.662+0000 7f8c04a64640 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a301a30 0x55c97a318e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c04a64640 1 -- 172.21.15.159:0/421773704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 msgr2=0x55c97a316770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c04a64640 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 0x55c97a316770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c04a64640 1 -- 172.21.15.159:0/421773704 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c97a316fa0 con 0x55c97a3054a0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c04a64640 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a3161d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00bc930 tx=0x7f8bf00f09d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9800eac86893e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8be8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8be8ff9640 1 -- 172.21.15.159:0/421773704 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0049070 con 0x55c97a3054a0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8be8ff9640 1 -- 172.21.15.159:0/421773704 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f8bf003bd70 con 0x55c97a3054a0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c098a2740 1 -- 172.21.15.159:0/421773704 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bfc023840 con 0x55c97a3054a0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8be8ff9640 1 -- 172.21.15.159:0/421773704 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8bf00bc770 con 0x55c97a3054a0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c098a2740 10 client.15771 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c098a2740 1 -- 172.21.15.159:0/421773704 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c97a38f150 con 0x55c97a3054a0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8be8ff9640 1 -- 172.21.15.159:0/421773704 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bfc023840 con 0x55c97a3054a0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8be8ff9640 1 -- 172.21.15.159:0/421773704 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8bf003b460 con 0x55c97a3054a0 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c098a2740 10 client.15771 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:45.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c098a2740 10 client.15771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c098a2740 20 client.15771 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c098a2740 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c97a310680 0x55c97a391690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c098a2740 4 client.15771 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.663+0000 7f8c098a2740 1 -- 172.21.15.159:0/421773704 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c97a272d60 con 0x55c97a310680 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c05265640 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c97a310680 0x55c97a391690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8be8ff9640 10 client.15771 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c05265640 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c97a310680 0x55c97a391690 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c463e998656da7df server_cookie=72ff855f7f1e2a4f in_seq=0 out_seq=0 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8be8ff9640 1 -- 172.21.15.159:0/421773704 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c97a272d60 con 0x55c97a310680 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8be8ff9640 10 client.15771 handle_command_reply: tid=0 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 client.15771 shutdown 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 -- 172.21.15.159:0/421773704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 msgr2=0x55c97a3161d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a3161d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00bc930 tx=0x7f8bf00f09d0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 -- 172.21.15.159:0/421773704 shutdown_connections 2024-09-19T06:48:45.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c97a310680 0x55c97a391690 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c97a305dc0 0x55c97a316770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c97a3054a0 0x55c97a3161d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 --2- 172.21.15.159:0/421773704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c97a301a30 0x55c97a318e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 -- 172.21.15.159:0/421773704 >> 172.21.15.159:0/421773704 conn(0x55c97a30d910 msgr2=0x55c97a30f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8be8ff9640 0 client.15771 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.664+0000 7f8c098a2740 1 -- 172.21.15.159:0/421773704 shutdown_connections 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c098a2740 1 -- 172.21.15.159:0/421773704 wait complete. 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c098a2740 20 client.15771 trim_cache size 0 max 16384 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:45.671 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:48:45.672 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:48:45.672 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:45.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 -- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8bec0a33b0 msgr2=0x7f8bec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8bec0a33b0 0x7f8bec0a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8bf801f000 tx=0x7f8bf801e000 comp rx=0 tx=0).stop 2024-09-19T06:48:45.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 -- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 msgr2=0x7f8c00198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 0x7f8c00198a90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0005ab0 tx=0x7f8bf00042f0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 -- 172.21.15.159:0/2469918963 shutdown_connections 2024-09-19T06:48:45.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8bec0a33b0 0x7f8bec0a5870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c00106f10 0x7f8c0019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c00102790 0x7f8c00198a90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 --2- 172.21.15.159:0/2469918963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c00101de0 0x7f8c00198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 -- 172.21.15.159:0/2469918963 >> 172.21.15.159:0/2469918963 conn(0x7f8c000fd8c0 msgr2=0x7f8c000fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:45.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 -- 172.21.15.159:0/2469918963 shutdown_connections 2024-09-19T06:48:45.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:45.665+0000 7f8c074c9640 1 -- 172.21.15.159:0/2469918963 wait complete. 2024-09-19T06:48:45.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:45 smithi203 ceph-mon[35473]: pgmap v55: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:48:45.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:45 smithi189 ceph-mon[34880]: pgmap v55: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:48:46.375 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:48:46.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:48:46.433 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:46.984 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:46 smithi159 ceph-mon[30935]: pgmap v56: 97 pgs: 97 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 1.2 MiB/s wr, 18 op/s 2024-09-19T06:48:46.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 -- 172.21.15.159:0/3353432529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c100a80 msgr2=0x7fc71c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 --2- 172.21.15.159:0/3353432529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c100a80 0x7fc71c100ee0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009930 tx=0x7fc70c02a420 comp rx=0 tx=0).stop 2024-09-19T06:48:46.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 -- 172.21.15.159:0/3353432529 shutdown_connections 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 --2- 172.21.15.159:0/3353432529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc71c101420 0x7fc71c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 --2- 172.21.15.159:0/3353432529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c100a80 0x7fc71c100ee0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 --2- 172.21.15.159:0/3353432529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc71c106a80 0x7fc71c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 -- 172.21.15.159:0/3353432529 >> 172.21.15.159:0/3353432529 conn(0x7fc71c0fc7a0 msgr2=0x7fc71c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 -- 172.21.15.159:0/3353432529 shutdown_connections 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 -- 172.21.15.159:0/3353432529 wait complete. 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.983+0000 7fc7237f3640 1 Processor -- start 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc7237f3640 1 -- start start 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc7237f3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc71c100a80 0x7fc71c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc7237f3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc71c101420 0x7fc71c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc7237f3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c106a80 0x7fc71c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc7237f3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c110e80 con 0x7fc71c106a80 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc7237f3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c110d00 con 0x7fc71c100a80 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc7237f3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c111000 con 0x7fc71c101420 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc721d90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c106a80 0x7fc71c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc721d90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c106a80 0x7fc71c19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57320/0 (socket says 172.21.15.159:57320) 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc721d90640 1 -- 172.21.15.159:0/1051209420 learned_addr learned my addr 172.21.15.159:0/1051209420 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc720d8e640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc71c101420 0x7fc71c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc72158f640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc71c100a80 0x7fc71c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc721d90640 1 -- 172.21.15.159:0/1051209420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc71c101420 msgr2=0x7fc71c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc721d90640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc71c101420 0x7fc71c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc721d90640 1 -- 172.21.15.159:0/1051209420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc71c100a80 msgr2=0x7fc71c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc721d90640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc71c100a80 0x7fc71c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.984+0000 7fc721d90640 1 -- 172.21.15.159:0/1051209420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c19d460 con 0x7fc71c106a80 2024-09-19T06:48:46.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.985+0000 7fc721d90640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c106a80 0x7fc71c19cd80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc714009fd0 tx=0x7fc71400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.985+0000 7fc7127fc640 1 -- 172.21.15.159:0/1051209420 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714017070 con 0x7fc71c106a80 2024-09-19T06:48:46.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.985+0000 7fc7127fc640 1 -- 172.21.15.159:0/1051209420 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc714003e50 con 0x7fc71c106a80 2024-09-19T06:48:46.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.985+0000 7fc7237f3640 1 -- 172.21.15.159:0/1051209420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c19d750 con 0x7fc71c106a80 2024-09-19T06:48:46.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.985+0000 7fc7127fc640 1 -- 172.21.15.159:0/1051209420 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7140106c0 con 0x7fc71c106a80 2024-09-19T06:48:46.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.985+0000 7fc7237f3640 1 -- 172.21.15.159:0/1051209420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c1a5030 con 0x7fc71c106a80 2024-09-19T06:48:46.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.987+0000 7fc7127fc640 1 -- 172.21.15.159:0/1051209420 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc714003970 con 0x7fc71c106a80 2024-09-19T06:48:46.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.988+0000 7fc7127fc640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7080a3430 0x7fc7080a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.988+0000 7fc7127fc640 1 -- 172.21.15.159:0/1051209420 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc7140cfa80 con 0x7fc71c106a80 2024-09-19T06:48:46.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.988+0000 7fc72158f640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7080a3430 0x7fc7080a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc725bcc740 1 Processor -- start 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc72158f640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7080a3430 0x7fc7080a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc718005fd0 tx=0x7fc718005850 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc725bcc740 1 -- start start 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 0x560f75f9ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75fa9a30 0x560f75fabe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc725bcc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x560f75f03160 con 0x560f75f9f170 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc725bcc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f75eaa720 con 0x560f75f9e850 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc725bcc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560f75eff120 con 0x560f75fa9a30 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc720d8e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc720d8e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57336/0 (socket says 172.21.15.159:57336) 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc720d8e640 1 -- 172.21.15.159:0/3118179832 learned_addr learned my addr 172.21.15.159:0/3118179832 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc72158f640 1 --2- 172.21.15.159:0/3118179832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 0x560f75f9ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.989+0000 7fc721d90640 1 --2- 172.21.15.159:0/3118179832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75fa9a30 0x560f75fabe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.990+0000 7fc720d8e640 1 -- 172.21.15.159:0/3118179832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75fa9a30 msgr2=0x560f75fabe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.990+0000 7fc720d8e640 1 --2- 172.21.15.159:0/3118179832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75fa9a30 0x560f75fabe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.990+0000 7fc720d8e640 1 -- 172.21.15.159:0/3118179832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 msgr2=0x560f75f9ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.990+0000 7fc720d8e640 1 --2- 172.21.15.159:0/3118179832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 0x560f75f9ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.990+0000 7fc720d8e640 1 -- 172.21.15.159:0/3118179832 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f75c74ba0 con 0x560f75f9f170 2024-09-19T06:48:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.990+0000 7fc720d8e640 1 --2- 172.21.15.159:0/3118179832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa94f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc70c02a940 tx=0x7fc70c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b74d6f5f9f8854 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.990+0000 7fc7077fe640 1 -- 172.21.15.159:0/3118179832 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c040070 con 0x560f75f9f170 2024-09-19T06:48:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.990+0000 7fc7077fe640 1 -- 172.21.15.159:0/3118179832 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc70c0319f0 con 0x560f75f9f170 2024-09-19T06:48:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.990+0000 7fc7077fe640 1 -- 172.21.15.159:0/3118179832 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c035040 con 0x560f75f9f170 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 -- 172.21.15.159:0/3118179832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 msgr2=0x560f75fa94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 --2- 172.21.15.159:0/3118179832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa94f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc70c02a940 tx=0x7fc70c005c00 comp rx=0 tx=0).stop 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 -- 172.21.15.159:0/3118179832 shutdown_connections 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 --2- 172.21.15.159:0/3118179832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75fa9a30 0x560f75fabe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 --2- 172.21.15.159:0/3118179832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa94f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 --2- 172.21.15.159:0/3118179832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 0x560f75f9ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 -- 172.21.15.159:0/3118179832 >> 172.21.15.159:0/3118179832 conn(0x560f75f9ade0 msgr2=0x560f75f9b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 -- 172.21.15.159:0/3118179832 shutdown_connections 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 -- 172.21.15.159:0/3118179832 wait complete. 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 -- start start 2024-09-19T06:48:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.991+0000 7fc725bcc740 1 Processor -- start 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fa67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75fa9a30 0x560f75fa7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc725bcc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x560f75fac600 con 0x560f75f9f170 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc725bcc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f75e8b900 con 0x560f75fa9a30 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc725bcc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560f75fac780 con 0x560f75f9e850 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc725bcc740 10 client.0 _ll_register_callbacks cb 0x560f75e89780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc720d8e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc720d8e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57352/0 (socket says 172.21.15.159:57352) 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc720d8e640 1 -- 172.21.15.159:0/186364328 learned_addr learned my addr 172.21.15.159:0/186364328 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc72158f640 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fa67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc721d90640 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75fa9a30 0x560f75fa7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc720d8e640 1 -- 172.21.15.159:0/186364328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 msgr2=0x560f75fa67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc720d8e640 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fa67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc720d8e640 1 -- 172.21.15.159:0/186364328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75fa9a30 msgr2=0x560f75fa7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc720d8e640 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75fa9a30 0x560f75fa7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc720d8e640 1 -- 172.21.15.159:0/186364328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f75ecbc50 con 0x560f75f9f170 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc72158f640 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fa67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc721d90640 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75fa9a30 0x560f75fa7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc720d8e640 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa6d10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc70c005940 tx=0x7fc70c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67394a57a79bf5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.992+0000 7fc704ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc704ff9640 1 -- 172.21.15.159:0/186364328 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c040030 con 0x560f75f9f170 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc704ff9640 1 -- 172.21.15.159:0/186364328 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc70c004260 con 0x560f75f9f170 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc725bcc740 1 -- 172.21.15.159:0/186364328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc70c0319f0 con 0x560f75f9f170 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc704ff9640 1 -- 172.21.15.159:0/186364328 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc70c056050 con 0x560f75f9f170 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc725bcc740 10 client.15783 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc725bcc740 1 -- 172.21.15.159:0/186364328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560f75fb8170 con 0x560f75f9f170 2024-09-19T06:48:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc704ff9640 1 -- 172.21.15.159:0/186364328 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc70c0319f0 con 0x560f75f9f170 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc704ff9640 1 -- 172.21.15.159:0/186364328 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc70c003660 con 0x560f75f9f170 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc725bcc740 10 client.15783 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc725bcc740 10 client.15783 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc725bcc740 20 client.15783 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc725bcc740 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560f75fb94c0 0x560f75fbb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc725bcc740 4 client.15783 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.993+0000 7fc725bcc740 1 -- 172.21.15.159:0/186364328 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f75f10890 con 0x560f75fb94c0 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.994+0000 7fc72158f640 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560f75fb94c0 0x560f75fbb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.994+0000 7fc704ff9640 10 client.15783 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.994+0000 7fc72158f640 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560f75fb94c0 0x560f75fbb8b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12c0b81d89eca5ea server_cookie=582890b43dc792b4 in_seq=0 out_seq=0 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc704ff9640 1 -- 172.21.15.159:0/186364328 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f75f10890 con 0x560f75fb94c0 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc704ff9640 10 client.15783 handle_command_reply: tid=0 2024-09-19T06:48:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 client.15783 shutdown 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 -- 172.21.15.159:0/186364328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 msgr2=0x560f75fa6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa6d10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc70c005940 tx=0x7fc70c02a420 comp rx=0 tx=0).stop 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 -- 172.21.15.159:0/186364328 shutdown_connections 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560f75fb94c0 0x560f75fbb8b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75fa9a30 0x560f75fa7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc704ff9640 0 client.15783 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75f9f170 0x560f75fa6d10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 --2- 172.21.15.159:0/186364328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fa67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 -- 172.21.15.159:0/186364328 >> 172.21.15.159:0/186364328 conn(0x560f75f9ade0 msgr2=0x560f75fa0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 -- 172.21.15.159:0/186364328 shutdown_connections 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 1 -- 172.21.15.159:0/186364328 wait complete. 2024-09-19T06:48:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:46.995+0000 7fc725bcc740 20 client.15783 trim_cache size 0 max 16384 2024-09-19T06:48:47.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc725bcc740 1 Processor -- start 2024-09-19T06:48:47.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc725bcc740 1 -- start start 2024-09-19T06:48:47.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fc0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9f170 0x560f75fc13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fa3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc725bcc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c1ab900 con 0x560f75fa9a30 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc725bcc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c1ae180 con 0x560f75f9f170 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc725bcc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c1abf70 con 0x560f75f9e850 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc721d90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fa3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc721d90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fa3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57358/0 (socket says 172.21.15.159:57358) 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc721d90640 1 -- 172.21.15.159:0/3496545735 learned_addr learned my addr 172.21.15.159:0/3496545735 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc720d8e640 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9f170 0x560f75fc13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.024+0000 7fc72158f640 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fc0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc721d90640 1 -- 172.21.15.159:0/3496545735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 msgr2=0x560f75fc0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc721d90640 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fc0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc721d90640 1 -- 172.21.15.159:0/3496545735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9f170 msgr2=0x560f75fc13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc721d90640 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9f170 0x560f75fc13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc721d90640 1 -- 172.21.15.159:0/3496545735 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f75f9efa0 con 0x560f75fa9a30 2024-09-19T06:48:47.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc72158f640 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fc0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:47.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc721d90640 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fa3a70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc7140cd200 tx=0x7fc71409c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98383d18c787dbe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc706ffd640 1 -- 172.21.15.159:0/3496545735 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714020040 con 0x560f75fa9a30 2024-09-19T06:48:47.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc706ffd640 1 -- 172.21.15.159:0/3496545735 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7140a00e0 con 0x560f75fa9a30 2024-09-19T06:48:47.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.025+0000 7fc706ffd640 1 -- 172.21.15.159:0/3496545735 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7140cd5b0 con 0x560f75fa9a30 2024-09-19T06:48:47.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.026+0000 7fc725bcc740 1 -- 172.21.15.159:0/3496545735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 msgr2=0x560f75fa3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.026+0000 7fc725bcc740 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fa3a70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc7140cd200 tx=0x7fc71409c430 comp rx=0 tx=0).stop 2024-09-19T06:48:47.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.026+0000 7fc725bcc740 1 -- 172.21.15.159:0/3496545735 shutdown_connections 2024-09-19T06:48:47.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.026+0000 7fc725bcc740 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fa3a70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.026+0000 7fc725bcc740 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9f170 0x560f75fc13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.026+0000 7fc725bcc740 1 --2- 172.21.15.159:0/3496545735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9e850 0x560f75fc0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.026+0000 7fc725bcc740 1 -- 172.21.15.159:0/3496545735 >> 172.21.15.159:0/3496545735 conn(0x560f75f9ade0 msgr2=0x560f75fa8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.026+0000 7fc725bcc740 1 -- 172.21.15.159:0/3496545735 shutdown_connections 2024-09-19T06:48:47.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.026+0000 7fc725bcc740 1 -- 172.21.15.159:0/3496545735 wait complete. 2024-09-19T06:48:47.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.027+0000 7fc725bcc740 1 -- start start 2024-09-19T06:48:47.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.027+0000 7fc725bcc740 1 Processor -- start 2024-09-19T06:48:47.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.027+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 0x560f75fb1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.027+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9f170 0x560f75fb2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.027+0000 7fc725bcc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fac990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.027+0000 7fc725bcc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c1ac640 con 0x560f75fa9a30 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc721d90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc721d90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57368/0 (socket says 172.21.15.159:57368) 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c1adab0 con 0x560f75f9e850 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc721d90640 1 -- 172.21.15.159:0/1848582095 learned_addr learned my addr 172.21.15.159:0/1848582095 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c1acd10 con 0x560f75f9f170 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc720d8e640 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9f170 0x560f75fb2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc725bcc740 10 client.0 _ll_register_callbacks cb 0x7fc70c005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc72158f640 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 0x560f75fb1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc721d90640 1 -- 172.21.15.159:0/1848582095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9f170 msgr2=0x560f75fb2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:47.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc721d90640 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9f170 0x560f75fb2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc721d90640 1 -- 172.21.15.159:0/1848582095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 msgr2=0x560f75fb1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc721d90640 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 0x560f75fb1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc721d90640 1 -- 172.21.15.159:0/1848582095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f75fad190 con 0x560f75fa9a30 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc720d8e640 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9f170 0x560f75fb2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc721d90640 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fac990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc714098190 tx=0x7fc7140097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c74c5531ac3aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc704ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc704ff9640 1 -- 172.21.15.159:0/1848582095 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7140b8020 con 0x560f75fa9a30 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc704ff9640 1 -- 172.21.15.159:0/1848582095 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc71409b180 con 0x560f75fa9a30 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7140a00e0 con 0x560f75fa9a30 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.028+0000 7fc704ff9640 1 -- 172.21.15.159:0/1848582095 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc714020070 con 0x560f75fa9a30 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc725bcc740 10 client.15789 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560f76024840 con 0x560f75fa9a30 2024-09-19T06:48:47.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc704ff9640 1 -- 172.21.15.159:0/1848582095 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7140a00e0 con 0x560f75fa9a30 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc704ff9640 1 -- 172.21.15.159:0/1848582095 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc7140b2020 con 0x560f75fa9a30 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc725bcc740 10 client.15789 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc725bcc740 10 client.15789 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc725bcc740 20 client.15789 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc725bcc740 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560f75fb94c0 0x560f76026f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc725bcc740 4 client.15789 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x560f75f0abe0 con 0x560f75fb94c0 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.029+0000 7fc72158f640 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560f75fb94c0 0x560f76026f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.030+0000 7fc704ff9640 10 client.15789 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.030+0000 7fc72158f640 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560f75fb94c0 0x560f76026f70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20288ccb8bc5799c server_cookie=a0afb641dd10e572 in_seq=0 out_seq=0 2024-09-19T06:48:47.036 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:47.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:46 smithi203 ceph-mon[35473]: pgmap v56: 97 pgs: 97 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 1.2 MiB/s wr, 18 op/s 2024-09-19T06:48:47.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:46 smithi189 ceph-mon[34880]: pgmap v56: 97 pgs: 97 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 1.2 MiB/s wr, 18 op/s 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.502+0000 7fa9d5a18640 1 -- 172.21.15.159:0/599486282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0100a80 msgr2=0x7fa9d0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.502+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/599486282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0100a80 0x7fa9d0100ee0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009930 tx=0x7fa9b802a420 comp rx=0 tx=0).stop 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.502+0000 7fa9d5a18640 1 -- 172.21.15.159:0/599486282 shutdown_connections 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.502+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/599486282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d0101420 0x7fa9d010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.502+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/599486282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0100a80 0x7fa9d0100ee0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.502+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/599486282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9d0106a80 0x7fa9d0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.502+0000 7fa9d5a18640 1 -- 172.21.15.159:0/599486282 >> 172.21.15.159:0/599486282 conn(0x7fa9d00fc7a0 msgr2=0x7fa9d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.502+0000 7fa9d5a18640 1 -- 172.21.15.159:0/599486282 shutdown_connections 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.502+0000 7fa9d5a18640 1 -- 172.21.15.159:0/599486282 wait complete. 2024-09-19T06:48:47.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9d5a18640 1 Processor -- start 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9d5a18640 1 -- start start 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9d5a18640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9d0100a80 0x7fa9d0102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9d5a18640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0101420 0x7fa9d0102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9d5a18640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d0106a80 0x7fa9d01030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9d5a18640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d0110ea0 con 0x7fa9d0101420 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9d5a18640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d0110d20 con 0x7fa9d0106a80 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9d5a18640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d0111020 con 0x7fa9d0100a80 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9c7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0101420 0x7fa9d0102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9c7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0101420 0x7fa9d0102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57386/0 (socket says 172.21.15.159:57386) 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9c7fff640 1 -- 172.21.15.159:0/281383081 learned_addr learned my addr 172.21.15.159:0/281383081 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9ceffd640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9d0100a80 0x7fa9d0102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.503+0000 7fa9cf7fe640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d0106a80 0x7fa9d01030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9c7fff640 1 -- 172.21.15.159:0/281383081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9d0100a80 msgr2=0x7fa9d0102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9c7fff640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9d0100a80 0x7fa9d0102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9c7fff640 1 -- 172.21.15.159:0/281383081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d0106a80 msgr2=0x7fa9d01030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9c7fff640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d0106a80 0x7fa9d01030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9c7fff640 1 -- 172.21.15.159:0/281383081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d01a69a0 con 0x7fa9d0101420 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9c7fff640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0101420 0x7fa9d0102b90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009a50 tx=0x7fa9b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9d4a16640 1 -- 172.21.15.159:0/281383081 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b803f030 con 0x7fa9d0101420 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9d4a16640 1 -- 172.21.15.159:0/281383081 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9b8003ad0 con 0x7fa9d0101420 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9d4a16640 1 -- 172.21.15.159:0/281383081 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8035070 con 0x7fa9d0101420 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d01a6c30 con 0x7fa9d0101420 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.504+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d01a7110 con 0x7fa9d0101420 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.505+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d0100ee0 con 0x7fa9d0101420 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.507+0000 7fa9d4a16640 1 -- 172.21.15.159:0/281383081 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fa9b8042030 con 0x7fa9d0101420 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.508+0000 7fa9d4a16640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa9bc0a33b0 0x7fa9bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.508+0000 7fa9ceffd640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa9bc0a33b0 0x7fa9bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.508+0000 7fa9d4a16640 1 -- 172.21.15.159:0/281383081 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fa9b80f08c0 con 0x7fa9d0101420 2024-09-19T06:48:47.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.508+0000 7fa9ceffd640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa9bc0a33b0 0x7fa9bc0a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009990 tx=0x7fa9c0009110 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.511+0000 7fa9d4a16640 1 -- 172.21.15.159:0/281383081 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa9b80bd270 con 0x7fa9d0101420 2024-09-19T06:48:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.715+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9d01a73a0 con 0x7fa9d0101420 2024-09-19T06:48:47.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.715+0000 7fa9d4a16640 1 -- 172.21.15.159:0/281383081 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7fa9b80bcb70 con 0x7fa9d0101420 2024-09-19T06:48:47.717 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:48:47.717 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:48:47.717 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa9bc0a33b0 msgr2=0x7fa9bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa9bc0a33b0 0x7fa9bc0a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009990 tx=0x7fa9c0009110 comp rx=0 tx=0).stop 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0101420 msgr2=0x7fa9d0102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0101420 0x7fa9d0102b90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009a50 tx=0x7fa9b8004270 comp rx=0 tx=0).stop 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 shutdown_connections 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa9bc0a33b0 0x7fa9bc0a5870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9d0106a80 0x7fa9d01030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9d0101420 0x7fa9d0102b90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 --2- 172.21.15.159:0/281383081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9d0100a80 0x7fa9d0102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.717+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 >> 172.21.15.159:0/281383081 conn(0x7fa9d00fc7a0 msgr2=0x7fa9d01048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.718+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 shutdown_connections 2024-09-19T06:48:47.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:47.718+0000 7fa9d5a18640 1 -- 172.21.15.159:0/281383081 wait complete. 2024-09-19T06:48:48.078 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:47 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/281383081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:48.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:47 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/281383081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:48.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:47 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/281383081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:48.409 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:48:48.697 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:49.084 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:48 smithi159 ceph-mon[30935]: pgmap v57: 97 pgs: 97 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-19T06:48:49.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:48 smithi203 ceph-mon[35473]: pgmap v57: 97 pgs: 97 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-19T06:48:49.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:48 smithi189 ceph-mon[34880]: pgmap v57: 97 pgs: 97 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.164+0000 7fceb3f8b640 1 -- 172.21.15.159:0/3608253118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac100a80 msgr2=0x7fceac100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.164+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/3608253118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac100a80 0x7fceac100ee0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009930 tx=0x7fcea002a420 comp rx=0 tx=0).stop 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.164+0000 7fceb3f8b640 1 -- 172.21.15.159:0/3608253118 shutdown_connections 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.164+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/3608253118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fceac101420 0x7fceac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.164+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/3608253118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac100a80 0x7fceac100ee0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.164+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/3608253118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceac106a80 0x7fceac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.164+0000 7fceb3f8b640 1 -- 172.21.15.159:0/3608253118 >> 172.21.15.159:0/3608253118 conn(0x7fceac0fc7a0 msgr2=0x7fceac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.164+0000 7fceb3f8b640 1 -- 172.21.15.159:0/3608253118 shutdown_connections 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.164+0000 7fceb3f8b640 1 -- 172.21.15.159:0/3608253118 wait complete. 2024-09-19T06:48:49.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb3f8b640 1 Processor -- start 2024-09-19T06:48:49.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb3f8b640 1 -- start start 2024-09-19T06:48:49.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb3f8b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fceac100a80 0x7fceac198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb3f8b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac101420 0x7fceac1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb3f8b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceac106a80 0x7fceac19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb3f8b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fceac110e80 con 0x7fceac101420 2024-09-19T06:48:49.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb3f8b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fceac110d00 con 0x7fceac106a80 2024-09-19T06:48:49.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb3f8b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fceac111000 con 0x7fceac100a80 2024-09-19T06:48:49.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac101420 0x7fceac1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac101420 0x7fceac1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57658/0 (socket says 172.21.15.159:57658) 2024-09-19T06:48:49.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1526640 1 -- 172.21.15.159:0/1498810639 learned_addr learned my addr 172.21.15.159:0/1498810639 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:49.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1d27640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fceac100a80 0x7fceac198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb2528640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceac106a80 0x7fceac19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1526640 1 -- 172.21.15.159:0/1498810639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fceac100a80 msgr2=0x7fceac198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:49.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1526640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fceac100a80 0x7fceac198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1526640 1 -- 172.21.15.159:0/1498810639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceac106a80 msgr2=0x7fceac19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1526640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceac106a80 0x7fceac19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1526640 1 -- 172.21.15.159:0/1498810639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac19d410 con 0x7fceac101420 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.165+0000 7fceb1526640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac101420 0x7fceac1989a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009230 tx=0x7fcea0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.166+0000 7fceaaffd640 1 -- 172.21.15.159:0/1498810639 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea003f030 con 0x7fceac101420 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.166+0000 7fceb3f8b640 1 -- 172.21.15.159:0/1498810639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceac19d6a0 con 0x7fceac101420 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.166+0000 7fceaaffd640 1 -- 172.21.15.159:0/1498810639 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea0003ad0 con 0x7fceac101420 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.166+0000 7fceaaffd640 1 -- 172.21.15.159:0/1498810639 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0035070 con 0x7fceac101420 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.166+0000 7fceb3f8b640 1 -- 172.21.15.159:0/1498810639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceac1a4fe0 con 0x7fceac101420 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.168+0000 7fceaaffd640 1 -- 172.21.15.159:0/1498810639 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fcea0042030 con 0x7fceac101420 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.168+0000 7fceb6364740 1 Processor -- start 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb6364740 1 -- start start 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb6364740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75605b40 0x556a75604090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb6364740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75604a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb6364740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75613780 0x556a75615b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb6364740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x556a7556a2f0 con 0x556a75613780 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb6364740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556a75511cf0 con 0x556a756045d0 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb6364740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556a755662b0 con 0x556a75605b40 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceaaffd640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fce940a33b0 0x7fce940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75613780 0x556a75615b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75613780 0x556a75615b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57666/0 (socket says 172.21.15.159:57666) 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb1526640 1 -- 172.21.15.159:0/2773017785 learned_addr learned my addr 172.21.15.159:0/2773017785 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb2528640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fce940a33b0 0x7fce940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb2528640 1 --2- 172.21.15.159:0/2773017785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75605b40 0x556a75604090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb1d27640 1 --2- 172.21.15.159:0/2773017785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75604a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceaaffd640 1 -- 172.21.15.159:0/1498810639 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fcea00f02d0 con 0x7fceac101420 2024-09-19T06:48:49.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb1526640 1 -- 172.21.15.159:0/2773017785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75605b40 msgr2=0x556a75604090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb1526640 1 --2- 172.21.15.159:0/2773017785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75605b40 0x556a75604090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb1526640 1 -- 172.21.15.159:0/2773017785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 msgr2=0x556a75604a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb1526640 1 --2- 172.21.15.159:0/2773017785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75604a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb1526640 1 -- 172.21.15.159:0/2773017785 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a754f63a0 con 0x556a75613780 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.169+0000 7fceb2528640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fce940a33b0 0x7fce940a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fce9c005fd0 tx=0x7fce9c009d10 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fceb1526640 1 --2- 172.21.15.159:0/2773017785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75613780 0x556a75615b70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009a50 tx=0x7fcea008f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec717cf06c1304 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fce93fff640 1 -- 172.21.15.159:0/2773017785 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0049070 con 0x556a75613780 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fce93fff640 1 -- 172.21.15.159:0/2773017785 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea00bcc80 con 0x556a75613780 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fce93fff640 1 -- 172.21.15.159:0/2773017785 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0003c80 con 0x556a75613780 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fceb6364740 1 -- 172.21.15.159:0/2773017785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75613780 msgr2=0x556a75615b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fceb6364740 1 --2- 172.21.15.159:0/2773017785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75613780 0x556a75615b70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009a50 tx=0x7fcea008f3b0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fceb6364740 1 -- 172.21.15.159:0/2773017785 shutdown_connections 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fceb6364740 1 --2- 172.21.15.159:0/2773017785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75613780 0x556a75615b70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fceb6364740 1 --2- 172.21.15.159:0/2773017785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75604a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fceb6364740 1 --2- 172.21.15.159:0/2773017785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75605b40 0x556a75604090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.170+0000 7fceb6364740 1 -- 172.21.15.159:0/2773017785 >> 172.21.15.159:0/2773017785 conn(0x556a755cd310 msgr2=0x556a75600c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 -- 172.21.15.159:0/2773017785 shutdown_connections 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 -- 172.21.15.159:0/2773017785 wait complete. 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 -- start start 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 Processor -- start 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75613180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75610430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a75610a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x556a75616240 con 0x556a75605b40 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556a75525060 con 0x556a756045d0 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556a756163c0 con 0x556a75613780 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.171+0000 7fceb6364740 10 client.0 _ll_register_callbacks cb 0x556a752788c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75610430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75610430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57678/0 (socket says 172.21.15.159:57678) 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1526640 1 -- 172.21.15.159:0/3957038840 learned_addr learned my addr 172.21.15.159:0/3957038840 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1d27640 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75613180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb2528640 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a75610a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1526640 1 -- 172.21.15.159:0/3957038840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 msgr2=0x556a75610a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1526640 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a75610a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1526640 1 -- 172.21.15.159:0/3957038840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 msgr2=0x556a75613180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1526640 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75613180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1526640 1 -- 172.21.15.159:0/3957038840 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a752db3c0 con 0x556a75605b40 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1d27640 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75613180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb2528640 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a75610a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb1526640 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75610430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcea00bc510 tx=0x7fcea0005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceeae54f83415c37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:49.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fce917fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fce917fa640 1 -- 172.21.15.159:0/3957038840 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0049070 con 0x556a75605b40 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fce917fa640 1 -- 172.21.15.159:0/3957038840 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fcea0003c80 con 0x556a75605b40 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb6364740 1 -- 172.21.15.159:0/3957038840 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcea00bcc80 con 0x556a75605b40 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fce917fa640 1 -- 172.21.15.159:0/3957038840 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcea00b8bf0 con 0x556a75605b40 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb6364740 10 client.15807 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fceb6364740 1 -- 172.21.15.159:0/3957038840 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556a75616240 con 0x556a75605b40 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.172+0000 7fce917fa640 1 -- 172.21.15.159:0/3957038840 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea00bcc80 con 0x556a75605b40 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fce917fa640 1 -- 172.21.15.159:0/3957038840 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcea0031bd0 con 0x556a75605b40 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fceb6364740 10 client.15807 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fceb6364740 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fceb6364740 20 client.15807 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fceb6364740 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556a75622fa0 0x556a75625390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fceb6364740 4 client.15807 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fceb6364740 1 -- 172.21.15.159:0/3957038840 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a75577860 con 0x556a75622fa0 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fceb1d27640 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556a75622fa0 0x556a75625390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fceb1d27640 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556a75622fa0 0x556a75625390 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39efe38680c698d server_cookie=276171ed3f77e133 in_seq=0 out_seq=0 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.173+0000 7fce917fa640 10 client.15807 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fce917fa640 1 -- 172.21.15.159:0/3957038840 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a75577860 con 0x556a75622fa0 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fce917fa640 10 client.15807 handle_command_reply: tid=0 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fceb6364740 1 client.15807 shutdown 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fceb6364740 1 -- 172.21.15.159:0/3957038840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 msgr2=0x556a75610430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fceb6364740 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75610430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcea00bc510 tx=0x7fcea0005e50 comp rx=0 tx=0).stop 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fceb6364740 1 -- 172.21.15.159:0/3957038840 shutdown_connections 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fceb6364740 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556a75622fa0 0x556a75625390 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fceb6364740 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a75610a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fce917fa640 0 client.15807 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:49.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fceb6364740 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75610430 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fceb6364740 1 --2- 172.21.15.159:0/3957038840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75613180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.174+0000 7fceb6364740 1 -- 172.21.15.159:0/3957038840 >> 172.21.15.159:0/3957038840 conn(0x556a755cd310 msgr2=0x556a75606990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:49.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.175+0000 7fceb6364740 1 -- 172.21.15.159:0/3957038840 shutdown_connections 2024-09-19T06:48:49.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.175+0000 7fceb6364740 1 -- 172.21.15.159:0/3957038840 wait complete. 2024-09-19T06:48:49.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.175+0000 7fceb6364740 20 client.15807 trim_cache size 0 max 16384 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb6364740 1 Processor -- start 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb6364740 1 -- start start 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb6364740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a7561f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb6364740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a7560f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb6364740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a7562ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb6364740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1a96c0 con 0x556a75605b40 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb6364740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1abf40 con 0x556a756045d0 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb6364740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1a9d30 con 0x556a75613780 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a7560f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a7560f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57688/0 (socket says 172.21.15.159:57688) 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1526640 1 -- 172.21.15.159:0/115792804 learned_addr learned my addr 172.21.15.159:0/115792804 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:49.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1d27640 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a7561f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb2528640 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a7562ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1526640 1 -- 172.21.15.159:0/115792804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 msgr2=0x556a7562ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1526640 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a7562ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1526640 1 -- 172.21.15.159:0/115792804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 msgr2=0x556a7561f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1526640 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a7561f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1526640 1 -- 172.21.15.159:0/115792804 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a75625700 con 0x556a75605b40 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb2528640 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a7562ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.188+0000 7fceb1526640 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a7560f410 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcea00096c0 tx=0x7fcea00045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1695db593762d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fce937fe640 1 -- 172.21.15.159:0/115792804 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0049070 con 0x556a75605b40 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fce937fe640 1 -- 172.21.15.159:0/115792804 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea00bcc80 con 0x556a75605b40 2024-09-19T06:48:49.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fce937fe640 1 -- 172.21.15.159:0/115792804 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea00d0040 con 0x556a75605b40 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fceb6364740 1 -- 172.21.15.159:0/115792804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 msgr2=0x556a7560f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fceb6364740 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a7560f410 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcea00096c0 tx=0x7fcea00045f0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fceb6364740 1 -- 172.21.15.159:0/115792804 shutdown_connections 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fceb6364740 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a7562ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fceb6364740 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a7560f410 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fceb6364740 1 --2- 172.21.15.159:0/115792804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a7561f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fceb6364740 1 -- 172.21.15.159:0/115792804 >> 172.21.15.159:0/115792804 conn(0x556a755cd310 msgr2=0x556a7560ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fceb6364740 1 -- 172.21.15.159:0/115792804 shutdown_connections 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.189+0000 7fceb6364740 1 -- 172.21.15.159:0/115792804 wait complete. 2024-09-19T06:48:49.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb6364740 1 -- start start 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb6364740 1 Processor -- start 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb6364740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75685f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb6364740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75686480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb6364740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a75616b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb6364740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1aa400 con 0x556a75605b40 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb6364740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1ab870 con 0x556a756045d0 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb6364740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1aaad0 con 0x556a75613780 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb6364740 10 client.0 _ll_register_callbacks cb 0x7fcea400b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75686480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb1526640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75686480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57692/0 (socket says 172.21.15.159:57692) 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb1526640 1 -- 172.21.15.159:0/2997483067 learned_addr learned my addr 172.21.15.159:0/2997483067 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb1d27640 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75685f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.190+0000 7fceb2528640 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a75616b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb1526640 1 -- 172.21.15.159:0/2997483067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 msgr2=0x556a75616b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb1526640 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a75616b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb1526640 1 -- 172.21.15.159:0/2997483067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 msgr2=0x556a75685f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb1526640 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75685f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb1526640 1 -- 172.21.15.159:0/2997483067 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a75617370 con 0x556a75605b40 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb1526640 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75686480 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcea00bc280 tx=0x7fcea00a6e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25e6641dda11fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fce917fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fce917fa640 1 -- 172.21.15.159:0/2997483067 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0049050 con 0x556a75605b40 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fce917fa640 1 -- 172.21.15.159:0/2997483067 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fcea0031dd0 con 0x556a75605b40 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb6364740 1 -- 172.21.15.159:0/2997483067 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcea00bcc80 con 0x556a75605b40 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fce917fa640 1 -- 172.21.15.159:0/2997483067 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcea00d0070 con 0x556a75605b40 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb6364740 10 client.15813 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb6364740 1 -- 172.21.15.159:0/2997483067 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556a75617370 con 0x556a75605b40 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fce917fa640 1 -- 172.21.15.159:0/2997483067 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea00bcc80 con 0x556a75605b40 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fce917fa640 1 -- 172.21.15.159:0/2997483067 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcea0087290 con 0x556a75605b40 2024-09-19T06:48:49.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.191+0000 7fceb6364740 10 client.15813 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb6364740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb6364740 20 client.15813 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb6364740 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556a7568d8f0 0x556a7568fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb6364740 4 client.15813 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb6364740 1 -- 172.21.15.159:0/2997483067 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a75571d70 con 0x556a7568d8f0 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb1d27640 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556a7568d8f0 0x556a7568fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fce917fa640 10 client.15813 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb1d27640 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556a7568d8f0 0x556a7568fd10 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14b006178e00202a server_cookie=290912ae012f1db0 in_seq=0 out_seq=0 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fce917fa640 1 -- 172.21.15.159:0/2997483067 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a75571d70 con 0x556a7568d8f0 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fce917fa640 10 client.15813 handle_command_reply: tid=0 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb6364740 1 client.15813 shutdown 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb6364740 1 -- 172.21.15.159:0/2997483067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 msgr2=0x556a75686480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.192+0000 7fceb6364740 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75686480 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcea00bc280 tx=0x7fcea00a6e70 comp rx=0 tx=0).stop 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb6364740 1 -- 172.21.15.159:0/2997483067 shutdown_connections 2024-09-19T06:48:49.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb6364740 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556a7568d8f0 0x556a7568fd10 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb6364740 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556a75613780 0x556a75616b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb6364740 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a75605b40 0x556a75686480 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb6364740 1 --2- 172.21.15.159:0/2997483067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a756045d0 0x556a75685f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb6364740 1 -- 172.21.15.159:0/2997483067 >> 172.21.15.159:0/2997483067 conn(0x556a755cd310 msgr2=0x556a755ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:49.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fce917fa640 0 client.15813 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:49.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb6364740 1 -- 172.21.15.159:0/2997483067 shutdown_connections 2024-09-19T06:48:49.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb6364740 1 -- 172.21.15.159:0/2997483067 wait complete. 2024-09-19T06:48:49.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb6364740 20 client.15813 trim_cache size 0 max 16384 2024-09-19T06:48:49.200 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:48:49.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 -- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fce940a33b0 msgr2=0x7fce940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:49.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fce940a33b0 0x7fce940a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fce9c005fd0 tx=0x7fce9c009d10 comp rx=0 tx=0).stop 2024-09-19T06:48:49.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 -- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac101420 msgr2=0x7fceac1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:49.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac101420 0x7fceac1989a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009230 tx=0x7fcea0004270 comp rx=0 tx=0).stop 2024-09-19T06:48:49.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 -- 172.21.15.159:0/1498810639 shutdown_connections 2024-09-19T06:48:49.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fce940a33b0 0x7fce940a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceac106a80 0x7fceac19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac101420 0x7fceac1989a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 --2- 172.21.15.159:0/1498810639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fceac100a80 0x7fceac198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:49.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.193+0000 7fceb3f8b640 1 -- 172.21.15.159:0/1498810639 >> 172.21.15.159:0/1498810639 conn(0x7fceac0fc7a0 msgr2=0x7fceac06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:49.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.194+0000 7fceb3f8b640 1 -- 172.21.15.159:0/1498810639 shutdown_connections 2024-09-19T06:48:49.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:49.194+0000 7fceb3f8b640 1 -- 172.21.15.159:0/1498810639 wait complete. 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.030+0000 7fc704ff9640 1 -- 172.21.15.159:0/1848582095 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560f75f0abe0 con 0x560f75fb94c0 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.030+0000 7fc704ff9640 10 client.15789 handle_command_reply: tid=0 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 client.15789 shutdown 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 msgr2=0x560f75fac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fac990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc714098190 tx=0x7fc7140097f0 comp rx=0 tx=0).stop 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 shutdown_connections 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560f75fb94c0 0x560f76026f70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560f75fa9a30 0x560f75fac990 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560f75f9f170 0x560f75fb2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 --2- 172.21.15.159:0/1848582095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f75f9e850 0x560f75fb1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 >> 172.21.15.159:0/1848582095 conn(0x560f75f9ade0 msgr2=0x560f75f996c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc704ff9640 0 client.15789 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 shutdown_connections 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 1 -- 172.21.15.159:0/1848582095 wait complete. 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.031+0000 7fc725bcc740 20 client.15789 trim_cache size 0 max 16384 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 20, 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 10, 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:48:50.034 INFO:teuthology.orchestra.run.smithi159.stdout: "8b63d2f0": { 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 10, 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 140.3, 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:48:50.035 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:48:50.036 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:50.036 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:50.036 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:50.036 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:50.036 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:50.036 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:50.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 -- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7080a3430 msgr2=0x7fc7080a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:50.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7080a3430 0x7fc7080a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc718005fd0 tx=0x7fc718005850 comp rx=0 tx=0).stop 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 -- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c106a80 msgr2=0x7fc71c19cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c106a80 0x7fc71c19cd80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc714009fd0 tx=0x7fc71400b260 comp rx=0 tx=0).stop 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 -- 172.21.15.159:0/1051209420 shutdown_connections 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7080a3430 0x7fc7080a58f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c106a80 0x7fc71c19cd80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc71c101420 0x7fc71c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 --2- 172.21.15.159:0/1051209420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc71c100a80 0x7fc71c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 -- 172.21.15.159:0/1051209420 >> 172.21.15.159:0/1051209420 conn(0x7fc71c0fc7a0 msgr2=0x7fc71c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 -- 172.21.15.159:0/1051209420 shutdown_connections 2024-09-19T06:48:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:50.032+0000 7fc7237f3640 1 -- 172.21.15.159:0/1051209420 wait complete. 2024-09-19T06:48:50.759 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8b63d2f0', quiesce took 7.4 seconds. Will release after: 12.950000000000001 2024-09-19T06:48:50.936 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:48:50.936 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:48:50.960 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:50 smithi159 ceph-mon[30935]: pgmap v58: 97 pgs: 97 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-19T06:48:51.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:50 smithi203 ceph-mon[35473]: pgmap v58: 97 pgs: 97 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-19T06:48:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:50 smithi189 ceph-mon[34880]: pgmap v58: 97 pgs: 97 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-19T06:48:51.188 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:51.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.674+0000 7fc3c18ae640 1 -- 172.21.15.159:0/3909145075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 msgr2=0x7fc3bc10eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:51.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.674+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/3909145075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 0x7fc3bc10eab0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009ca0 tx=0x7fc3b402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.674+0000 7fc3c18ae640 1 -- 172.21.15.159:0/3909145075 shutdown_connections 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.674+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/3909145075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 0x7fc3bc10eab0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.674+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/3909145075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3bc100eb0 0x7fc3bc106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.674+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/3909145075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3bc100500 0x7fc3bc1008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.674+0000 7fc3c18ae640 1 -- 172.21.15.159:0/3909145075 >> 172.21.15.159:0/3909145075 conn(0x7fc3bc0fc5c0 msgr2=0x7fc3bc0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.674+0000 7fc3c18ae640 1 -- 172.21.15.159:0/3909145075 shutdown_connections 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.674+0000 7fc3c18ae640 1 -- 172.21.15.159:0/3909145075 wait complete. 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3c18ae640 1 Processor -- start 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3c18ae640 1 -- start start 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3c18ae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3bc100500 0x7fc3bc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3c18ae640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3bc100eb0 0x7fc3bc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3c18ae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 0x7fc3bc19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3c18ae640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc111fd0 con 0x7fc3bc106f70 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3c18ae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc111e50 con 0x7fc3bc100500 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3c18ae640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc112150 con 0x7fc3bc100eb0 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3bb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 0x7fc3bc19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3bb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 0x7fc3bc19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57714/0 (socket says 172.21.15.159:57714) 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3bb7fe640 1 -- 172.21.15.159:0/2123859525 learned_addr learned my addr 172.21.15.159:0/2123859525 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3baffd640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3bc100500 0x7fc3bc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3bc100eb0 0x7fc3bc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3bb7fe640 1 -- 172.21.15.159:0/2123859525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3bc100eb0 msgr2=0x7fc3bc1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3bc100eb0 0x7fc3bc1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3bb7fe640 1 -- 172.21.15.159:0/2123859525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3bc100500 msgr2=0x7fc3bc198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3bc100500 0x7fc3bc198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.675+0000 7fc3bb7fe640 1 -- 172.21.15.159:0/2123859525 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc19d420 con 0x7fc3bc106f70 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.676+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 0x7fc3bc19cd40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4005cc0 tx=0x7fc3b4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.676+0000 7fc3c08ac640 1 -- 172.21.15.159:0/2123859525 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4004240 con 0x7fc3bc106f70 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.676+0000 7fc3c18ae640 1 -- 172.21.15.159:0/2123859525 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc19d6b0 con 0x7fc3bc106f70 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.676+0000 7fc3c08ac640 1 -- 172.21.15.159:0/2123859525 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b4003e10 con 0x7fc3bc106f70 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.676+0000 7fc3c08ac640 1 -- 172.21.15.159:0/2123859525 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b403b400 con 0x7fc3bc106f70 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.676+0000 7fc3c18ae640 1 -- 172.21.15.159:0/2123859525 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc1a4ff0 con 0x7fc3bc106f70 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.678+0000 7fc3c08ac640 1 -- 172.21.15.159:0/2123859525 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc3b40043e0 con 0x7fc3bc106f70 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.678+0000 7fc3c3c87740 1 Processor -- start 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.678+0000 7fc3c3c87740 1 -- start start 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3c08ac640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc3a80a33b0 0x7fc3a80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40ed800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40edd40 0x5616b40f0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5616b4048280 con 0x5616b40e3480 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616b3fefb10 con 0x5616b40e2b60 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5616b4044240 con 0x5616b40edd40 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc3a80a33b0 0x7fc3a80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3baffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3b3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3baffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40e2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:44404/0 (socket says 172.21.15.159:44404) 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3baffd640 1 -- 172.21.15.159:0/2657470535 learned_addr learned my addr 172.21.15.159:0/2657470535 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3c08ac640 1 -- 172.21.15.159:0/2123859525 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc3b40f1110 con 0x7fc3bc106f70 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/2657470535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40edd40 0x5616b40f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3baffd640 1 -- 172.21.15.159:0/2657470535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40edd40 msgr2=0x5616b40f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:51.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3baffd640 1 --2- 172.21.15.159:0/2657470535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40edd40 0x5616b40f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3baffd640 1 -- 172.21.15.159:0/2657470535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 msgr2=0x5616b40ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3baffd640 1 --2- 172.21.15.159:0/2657470535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3baffd640 1 -- 172.21.15.159:0/2657470535 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b3ffc1f0 con 0x5616b40e2b60 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/2657470535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc3a80a33b0 0x7fc3a80a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc1047c0 tx=0x7fc3a400c750 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.679+0000 7fc3baffd640 1 --2- 172.21.15.159:0/2657470535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40e2f40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00abf0 tx=0x7fc3ac00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb9c97f05d06caa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3b1ffb640 1 -- 172.21.15.159:0/2657470535 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac004220 con 0x5616b40e2b60 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3b1ffb640 1 -- 172.21.15.159:0/2657470535 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3ac0043c0 con 0x5616b40e2b60 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3b1ffb640 1 -- 172.21.15.159:0/2657470535 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0187e0 con 0x5616b40e2b60 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2657470535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 msgr2=0x5616b40e2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2657470535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40e2f40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00abf0 tx=0x7fc3ac00f790 comp rx=0 tx=0).stop 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2657470535 shutdown_connections 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2657470535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40edd40 0x5616b40f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2657470535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2657470535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40e2f40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2657470535 >> 172.21.15.159:0/2657470535 conn(0x5616b40df0f0 msgr2=0x5616b40df4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2657470535 shutdown_connections 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.680+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2657470535 wait complete. 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3c3c87740 1 -- start start 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3c3c87740 1 Processor -- start 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e2b60 0x5616b40f2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e3480 0x5616b40f2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 0x5616b40f6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5616b40f0910 con 0x5616b40e2b60 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616b4002f10 con 0x5616b40edd40 2024-09-19T06:48:51.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5616b40f0a90 con 0x5616b40e3480 2024-09-19T06:48:51.725 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:51.725 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:48:51.725 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "5ce9c206-aa93-4887-918c-66a3bb569e77", 2024-09-19T06:48:51.725 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:48:51.725 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:51.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3c3c87740 10 client.0 _ll_register_callbacks cb 0x5616b3fcba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3baffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e2b60 0x5616b40f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3baffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e2b60 0x5616b40f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57740/0 (socket says 172.21.15.159:57740) 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3baffd640 1 -- 172.21.15.159:0/3196320019 learned_addr learned my addr 172.21.15.159:0/3196320019 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 0x5616b40f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.681+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e3480 0x5616b40f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc3baffd640 1 -- 172.21.15.159:0/3196320019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e3480 msgr2=0x5616b40f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc3baffd640 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e3480 0x5616b40f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc3baffd640 1 -- 172.21.15.159:0/3196320019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 msgr2=0x5616b40f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc3baffd640 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 0x5616b40f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc3baffd640 1 -- 172.21.15.159:0/3196320019 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b3db96a0 con 0x5616b40e2b60 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc3baffd640 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e2b60 0x5616b40f2150 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00abc0 tx=0x7fc3ac005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c9c7f817aa7e5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc39affd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc39affd640 1 -- 172.21.15.159:0/3196320019 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac027020 con 0x5616b40e2b60 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc39affd640 1 -- 172.21.15.159:0/3196320019 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc3ac003880 con 0x5616b40e2b60 2024-09-19T06:48:51.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc3c3c87740 1 -- 172.21.15.159:0/3196320019 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3ac0043c0 con 0x5616b40e2b60 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc39affd640 1 -- 172.21.15.159:0/3196320019 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc3ac032050 con 0x5616b40e2b60 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc3c3c87740 10 client.15825 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc3c3c87740 1 -- 172.21.15.159:0/3196320019 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5616b4100860 con 0x5616b40e2b60 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc39affd640 1 -- 172.21.15.159:0/3196320019 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3ac0043c0 con 0x5616b40e2b60 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.682+0000 7fc39affd640 1 -- 172.21.15.159:0/3196320019 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc3ac004b30 con 0x5616b40e2b60 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.683+0000 7fc3c3c87740 10 client.15825 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.683+0000 7fc3c3c87740 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.683+0000 7fc3c3c87740 20 client.15825 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.683+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5616b4101cc0 0x5616b41040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.683+0000 7fc3c3c87740 4 client.15825 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.683+0000 7fc3c3c87740 1 -- 172.21.15.159:0/3196320019 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616b40557f0 con 0x5616b4101cc0 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.683+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5616b4101cc0 0x5616b41040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.683+0000 7fc39affd640 10 client.15825 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.683+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5616b4101cc0 0x5616b41040b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c2bf8b204fb54c7 server_cookie=98810fcca066e03c in_seq=0 out_seq=0 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc39affd640 1 -- 172.21.15.159:0/3196320019 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616b40557f0 con 0x5616b4101cc0 2024-09-19T06:48:51.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc39affd640 10 client.15825 handle_command_reply: tid=0 2024-09-19T06:48:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc3c3c87740 1 client.15825 shutdown 2024-09-19T06:48:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc3c3c87740 1 -- 172.21.15.159:0/3196320019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e2b60 msgr2=0x5616b40f2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e2b60 0x5616b40f2150 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00abc0 tx=0x7fc3ac005de0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc3c3c87740 1 -- 172.21.15.159:0/3196320019 shutdown_connections 2024-09-19T06:48:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5616b4101cc0 0x5616b41040b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 0x5616b40f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e3480 0x5616b40f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc39affd640 0 client.15825 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/3196320019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e2b60 0x5616b40f2150 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.684+0000 7fc3c3c87740 1 -- 172.21.15.159:0/3196320019 >> 172.21.15.159:0/3196320019 conn(0x5616b40df0f0 msgr2=0x5616b40de270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.685+0000 7fc3c3c87740 1 -- 172.21.15.159:0/3196320019 shutdown_connections 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.685+0000 7fc3c3c87740 1 -- 172.21.15.159:0/3196320019 wait complete. 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.685+0000 7fc3c3c87740 20 client.15825 trim_cache size 0 max 16384 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.701+0000 7fc3c3c87740 1 Processor -- start 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.701+0000 7fc3c3c87740 1 -- start start 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40de160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e3480 0x5616b4109760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40edd40 0x5616b4109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc1a9730 con 0x5616b40edd40 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc1abfb0 con 0x5616b40e2b60 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc1a9da0 con 0x5616b40e3480 2024-09-19T06:48:51.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3bb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40edd40 0x5616b4109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3bb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40edd40 0x5616b4109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57756/0 (socket says 172.21.15.159:57756) 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3bb7fe640 1 -- 172.21.15.159:0/2460381334 learned_addr learned my addr 172.21.15.159:0/2460381334 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3baffd640 1 --2- 172.21.15.159:0/2460381334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3bb7fe640 1 -- 172.21.15.159:0/2460381334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e3480 msgr2=0x5616b4109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/2460381334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e3480 0x5616b4109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3bb7fe640 1 -- 172.21.15.159:0/2460381334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 msgr2=0x5616b40de160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/2460381334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40de160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3bb7fe640 1 -- 172.21.15.159:0/2460381334 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b40da830 con 0x5616b40edd40 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3baffd640 1 --2- 172.21.15.159:0/2460381334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40de160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/2460381334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40edd40 0x5616b4109ca0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40bd1d0 tx=0x7fc3b4030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab724f148d85167a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3b17fa640 1 -- 172.21.15.159:0/2460381334 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40bce30 con 0x5616b40edd40 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3b17fa640 1 -- 172.21.15.159:0/2460381334 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b4036040 con 0x5616b40edd40 2024-09-19T06:48:51.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.702+0000 7fc3b17fa640 1 -- 172.21.15.159:0/2460381334 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40046d0 con 0x5616b40edd40 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2460381334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40edd40 msgr2=0x5616b4109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2460381334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40edd40 0x5616b4109ca0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40bd1d0 tx=0x7fc3b4030f90 comp rx=0 tx=0).stop 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2460381334 shutdown_connections 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2460381334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40edd40 0x5616b4109ca0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2460381334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e3480 0x5616b4109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2460381334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40e2b60 0x5616b40de160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2460381334 >> 172.21.15.159:0/2460381334 conn(0x5616b40df0f0 msgr2=0x5616b40dda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2460381334 shutdown_connections 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2460381334 wait complete. 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 -- start start 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.703+0000 7fc3c3c87740 1 Processor -- start 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e2b60 0x5616b40fa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40fa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 0x5616b416b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc1aa470 con 0x5616b40e3480 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc1ab8e0 con 0x5616b40edd40 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc1aab40 con 0x5616b40e2b60 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 10 client.0 _ll_register_callbacks cb 0x7fc3a400cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3b3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3b3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40fa790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57764/0 (socket says 172.21.15.159:57764) 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3b3fff640 1 -- 172.21.15.159:0/2766081600 learned_addr learned my addr 172.21.15.159:0/2766081600 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 0x5616b416b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3baffd640 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e2b60 0x5616b40fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3b3fff640 1 -- 172.21.15.159:0/2766081600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e2b60 msgr2=0x5616b40fa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e2b60 0x5616b40fa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3b3fff640 1 -- 172.21.15.159:0/2766081600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 msgr2=0x5616b416b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 0x5616b416b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3b3fff640 1 -- 172.21.15.159:0/2766081600 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b416bc70 con 0x5616b40e3480 2024-09-19T06:48:51.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3bb7fe640 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 0x5616b416b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3b3fff640 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40fa790 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4000c00 tx=0x7fc3a4006b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e3024a95cb7f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc39affd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc39affd640 1 -- 172.21.15.159:0/2766081600 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400f040 con 0x5616b40e3480 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2766081600 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3b4036040 con 0x5616b40e3480 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc39affd640 1 -- 172.21.15.159:0/2766081600 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7fc3a4026e80 con 0x5616b40e3480 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc39affd640 1 -- 172.21.15.159:0/2766081600 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc3a4036050 con 0x5616b40e3480 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 10 client.15831 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.704+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2766081600 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5616b416cee0 con 0x5616b40e3480 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.705+0000 7fc39affd640 1 -- 172.21.15.159:0/2766081600 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b4036040 con 0x5616b40e3480 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.705+0000 7fc39affd640 1 -- 172.21.15.159:0/2766081600 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc3a4018640 con 0x5616b40e3480 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.705+0000 7fc3c3c87740 10 client.15831 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.705+0000 7fc3c3c87740 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.705+0000 7fc3c3c87740 20 client.15831 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:51.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.705+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5616b416d640 0x5616b416fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.705+0000 7fc3c3c87740 4 client.15831 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.705+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2766081600 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5616b404fd00 con 0x5616b416d640 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.705+0000 7fc3baffd640 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5616b416d640 0x5616b416fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.706+0000 7fc3baffd640 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5616b416d640 0x5616b416fa60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42a975e87c5359af server_cookie=ad4da008d1579c8f in_seq=0 out_seq=0 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.706+0000 7fc39affd640 10 client.15831 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.706+0000 7fc39affd640 1 -- 172.21.15.159:0/2766081600 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5616b404fd00 con 0x5616b416d640 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.706+0000 7fc39affd640 10 client.15831 handle_command_reply: tid=0 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 client.15831 shutdown 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2766081600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 msgr2=0x5616b40fa790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40fa790 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4000c00 tx=0x7fc3a4006b20 comp rx=0 tx=0).stop 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2766081600 shutdown_connections 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5616b416d640 0x5616b416fa60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616b40edd40 0x5616b416b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5616b40e3480 0x5616b40fa790 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc39affd640 0 client.15831 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 --2- 172.21.15.159:0/2766081600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5616b40e2b60 0x5616b40fa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2766081600 >> 172.21.15.159:0/2766081600 conn(0x5616b40df0f0 msgr2=0x5616b40e4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2766081600 shutdown_connections 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 1 -- 172.21.15.159:0/2766081600 wait complete. 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c3c87740 20 client.15831 trim_cache size 0 max 16384 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c18ae640 1 -- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc3a80a33b0 msgr2=0x7fc3a80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc3a80a33b0 0x7fc3a80a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc1047c0 tx=0x7fc3a400c750 comp rx=0 tx=0).stop 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c18ae640 1 -- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 msgr2=0x7fc3bc19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.707+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 0x7fc3bc19cd40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4005cc0 tx=0x7fc3b4003c20 comp rx=0 tx=0).stop 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.708+0000 7fc3c18ae640 1 -- 172.21.15.159:0/2123859525 shutdown_connections 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.708+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc3a80a33b0 0x7fc3a80a5870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.708+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3bc106f70 0x7fc3bc19cd40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.708+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3bc100eb0 0x7fc3bc1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.708+0000 7fc3c18ae640 1 --2- 172.21.15.159:0/2123859525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc3bc100500 0x7fc3bc198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:51.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.708+0000 7fc3c18ae640 1 -- 172.21.15.159:0/2123859525 >> 172.21.15.159:0/2123859525 conn(0x7fc3bc0fc5c0 msgr2=0x7fc3bc105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:51.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.708+0000 7fc3c18ae640 1 -- 172.21.15.159:0/2123859525 shutdown_connections 2024-09-19T06:48:51.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:51.708+0000 7fc3c18ae640 1 -- 172.21.15.159:0/2123859525 wait complete. 2024-09-19T06:48:52.451 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:48:52.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:52 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:48:52.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:52 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:52.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:52 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:48:52.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:52 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:52.739 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:52.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:52 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:48:52.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:52 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:52.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:52 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:48:52.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:52 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:52 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:48:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:52 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:52 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:48:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:52 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 -- 172.21.15.159:0/1089533437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074510 msgr2=0x7f56980748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 --2- 172.21.15.159:0/1089533437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074510 0x7f56980748f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5688009ca0 tx=0x7f568802a950 comp rx=0 tx=0).stop 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 -- 172.21.15.159:0/1089533437 shutdown_connections 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 --2- 172.21.15.159:0/1089533437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f569810e450 0x7f5698110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 --2- 172.21.15.159:0/1089533437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5698074e30 0x7f569810df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 --2- 172.21.15.159:0/1089533437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074510 0x7f56980748f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 -- 172.21.15.159:0/1089533437 >> 172.21.15.159:0/1089533437 conn(0x7f56980fd8f0 msgr2=0x7f56980ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 -- 172.21.15.159:0/1089533437 shutdown_connections 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 -- 172.21.15.159:0/1089533437 wait complete. 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 Processor -- start 2024-09-19T06:48:53.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.208+0000 7f569da51640 1 -- start start 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f569da51640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5698074510 0x7f569819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f569da51640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074e30 0x7f569819ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f569da51640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f569810e450 0x7f569819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f569da51640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f56981141f0 con 0x7f5698074e30 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f569da51640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5698114070 con 0x7f569810e450 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f569da51640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5698114370 con 0x7f5698074510 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56967fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074e30 0x7f569819ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56967fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074e30 0x7f569819ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57784/0 (socket says 172.21.15.159:57784) 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56967fc640 1 -- 172.21.15.159:0/371546895 learned_addr learned my addr 172.21.15.159:0/371546895 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56977fe640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f569810e450 0x7f569819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f5696ffd640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5698074510 0x7f569819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56967fc640 1 -- 172.21.15.159:0/371546895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5698074510 msgr2=0x7f569819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56967fc640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5698074510 0x7f569819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56967fc640 1 -- 172.21.15.159:0/371546895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f569810e450 msgr2=0x7f569819dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56967fc640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f569810e450 0x7f569819dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56967fc640 1 -- 172.21.15.159:0/371546895 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569819e720 con 0x7f5698074e30 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.209+0000 7f56967fc640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074e30 0x7f569819ad10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f568000d950 tx=0x7f568000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.210+0000 7f569ca4f640 1 -- 172.21.15.159:0/371546895 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680017070 con 0x7f5698074e30 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.210+0000 7f569ca4f640 1 -- 172.21.15.159:0/371546895 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5680009c30 con 0x7f5698074e30 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.210+0000 7f569da51640 1 -- 172.21.15.159:0/371546895 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569819ea10 con 0x7f5698074e30 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.210+0000 7f569ca4f640 1 -- 172.21.15.159:0/371546895 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568000f6b0 con 0x7f5698074e30 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.210+0000 7f569da51640 1 -- 172.21.15.159:0/371546895 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56981a7380 con 0x7f5698074e30 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f569ca4f640 1 -- 172.21.15.159:0/371546895 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f56800109d0 con 0x7f5698074e30 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f569fe2a740 1 Processor -- start 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f569fe2a740 1 -- start start 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e07880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e07dc0 0x560861e12140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e12680 0x560861e14a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f569fe2a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x560861d6d2e0 con 0x560861e07dc0 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f569fe2a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560861d14ce0 con 0x560861e12680 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f569fe2a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560861d692a0 con 0x560861e074a0 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.212+0000 7f5696ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e07dc0 0x560861e12140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f5696ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e07dc0 0x560861e12140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57792/0 (socket says 172.21.15.159:57792) 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f5696ffd640 1 -- 172.21.15.159:0/1037792214 learned_addr learned my addr 172.21.15.159:0/1037792214 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f56977fe640 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e07880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f569ca4f640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f56840a33b0 0x7f56840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f56967fc640 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e12680 0x560861e14a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f56977fe640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f56840a33b0 0x7f56840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f569ca4f640 1 -- 172.21.15.159:0/371546895 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f56800cf9e0 con 0x7f5698074e30 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f5696ffd640 1 -- 172.21.15.159:0/1037792214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 msgr2=0x560861e07880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:53.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f5696ffd640 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e07880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f5696ffd640 1 -- 172.21.15.159:0/1037792214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e12680 msgr2=0x560861e14a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f5696ffd640 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e12680 0x560861e14a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f5696ffd640 1 -- 172.21.15.159:0/1037792214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560861cf9440 con 0x560861e07dc0 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f56977fe640 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e07880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f5696ffd640 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e07dc0 0x560861e12140 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5688030030 tx=0x7f568802f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cd1616f796ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f56977fe640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f56840a33b0 0x7f56840a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56980754f0 tx=0x7f56900046c0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f568dffb640 1 -- 172.21.15.159:0/1037792214 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688034040 con 0x560861e07dc0 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f568dffb640 1 -- 172.21.15.159:0/1037792214 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5688003970 con 0x560861e07dc0 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.213+0000 7f568dffb640 1 -- 172.21.15.159:0/1037792214 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688004630 con 0x560861e07dc0 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.214+0000 7f569fe2a740 1 -- 172.21.15.159:0/1037792214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e07dc0 msgr2=0x560861e12140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.214+0000 7f569fe2a740 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e07dc0 0x560861e12140 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5688030030 tx=0x7f568802f940 comp rx=0 tx=0).stop 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.214+0000 7f569fe2a740 1 -- 172.21.15.159:0/1037792214 shutdown_connections 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.214+0000 7f569fe2a740 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e12680 0x560861e14a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.214+0000 7f569fe2a740 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e07dc0 0x560861e12140 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.214+0000 7f569fe2a740 1 --2- 172.21.15.159:0/1037792214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e07880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.214+0000 7f569fe2a740 1 -- 172.21.15.159:0/1037792214 >> 172.21.15.159:0/1037792214 conn(0x560861e03a30 msgr2=0x560861e03e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.214+0000 7f569fe2a740 1 -- 172.21.15.159:0/1037792214 shutdown_connections 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.214+0000 7f569fe2a740 1 -- 172.21.15.159:0/1037792214 wait complete. 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f569fe2a740 1 -- start start 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f569fe2a740 1 Processor -- start 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e11ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e0f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e12680 0x560861e0f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f569fe2a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x560861e15250 con 0x560861e12680 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f569fe2a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560861d28050 con 0x560861e07dc0 2024-09-19T06:48:53.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f569fe2a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560861e153d0 con 0x560861e074a0 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f569fe2a740 10 client.0 _ll_register_callbacks cb 0x560861d68160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f56977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e12680 0x560861e0f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f56977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e12680 0x560861e0f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57808/0 (socket says 172.21.15.159:57808) 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f56977fe640 1 -- 172.21.15.159:0/3010551752 learned_addr learned my addr 172.21.15.159:0/3010551752 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.215+0000 7f5696ffd640 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e11ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f56977fe640 1 -- 172.21.15.159:0/3010551752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 msgr2=0x560861e11ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f56977fe640 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e11ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f56977fe640 1 -- 172.21.15.159:0/3010551752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 msgr2=0x560861e0f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f56967fc640 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e0f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f56977fe640 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e0f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f56977fe640 1 -- 172.21.15.159:0/3010551752 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560861ade3c0 con 0x560861e12680 2024-09-19T06:48:53.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f5696ffd640 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e11ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f56977fe640 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e12680 0x560861e0f6e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5690017940 tx=0x7f56900047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e14a3b001bc2a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f5676ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f5676ffd640 1 -- 172.21.15.159:0/3010551752 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5690026020 con 0x560861e12680 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f5676ffd640 1 -- 172.21.15.159:0/3010551752 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f5690016af0 con 0x560861e12680 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f569fe2a740 1 -- 172.21.15.159:0/3010551752 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5688003970 con 0x560861e12680 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f5676ffd640 1 -- 172.21.15.159:0/3010551752 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5690031050 con 0x560861e12680 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f569fe2a740 10 client.15843 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f569fe2a740 1 -- 172.21.15.159:0/3010551752 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560861e20ba0 con 0x560861e12680 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f5676ffd640 1 -- 172.21.15.159:0/3010551752 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5688003970 con 0x560861e12680 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f5676ffd640 1 -- 172.21.15.159:0/3010551752 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f56900213a0 con 0x560861e12680 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f569fe2a740 10 client.15843 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:53.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.216+0000 7f569fe2a740 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.217+0000 7f569fe2a740 20 client.15843 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.217+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560861e22060 0x560861e24520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.217+0000 7f569fe2a740 4 client.15843 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.217+0000 7f569fe2a740 1 -- 172.21.15.159:0/3010551752 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560861d7a850 con 0x560861e22060 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.217+0000 7f5696ffd640 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560861e22060 0x560861e24520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.217+0000 7f5696ffd640 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560861e22060 0x560861e24520 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18e9016eef16924a server_cookie=da934e0a0f871d95 in_seq=0 out_seq=0 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.217+0000 7f5676ffd640 10 client.15843 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f5676ffd640 1 -- 172.21.15.159:0/3010551752 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560861d7a850 con 0x560861e22060 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f5676ffd640 10 client.15843 handle_command_reply: tid=0 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 client.15843 shutdown 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 -- 172.21.15.159:0/3010551752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e12680 msgr2=0x560861e0f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e12680 0x560861e0f6e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5690017940 tx=0x7f56900047d0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 -- 172.21.15.159:0/3010551752 shutdown_connections 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560861e22060 0x560861e24520 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e12680 0x560861e0f6e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e0f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3010551752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e074a0 0x560861e11ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f5676ffd640 0 client.15843 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 -- 172.21.15.159:0/3010551752 >> 172.21.15.159:0/3010551752 conn(0x560861e03a30 msgr2=0x560861e02b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 -- 172.21.15.159:0/3010551752 shutdown_connections 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 1 -- 172.21.15.159:0/3010551752 wait complete. 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.218+0000 7f569fe2a740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.235+0000 7f569fe2a740 1 Processor -- start 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.235+0000 7f569fe2a740 1 -- start start 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.235+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e1e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.235+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e0da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.235+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e12680 0x560861e11110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.235+0000 7f569fe2a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f56981adbf0 con 0x560861e074a0 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.235+0000 7f569fe2a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56981b0470 con 0x560861e07dc0 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.235+0000 7f569fe2a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56981ae260 con 0x560861e12680 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.235+0000 7f5696ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e1e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f5696ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e1e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57820/0 (socket says 172.21.15.159:57820) 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f5696ffd640 1 -- 172.21.15.159:0/45418937 learned_addr learned my addr 172.21.15.159:0/45418937 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f5696ffd640 1 -- 172.21.15.159:0/45418937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e12680 msgr2=0x560861e11110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f5696ffd640 1 --2- 172.21.15.159:0/45418937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e12680 0x560861e11110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f5696ffd640 1 -- 172.21.15.159:0/45418937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 msgr2=0x560861e0da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f5696ffd640 1 --2- 172.21.15.159:0/45418937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e0da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f5696ffd640 1 -- 172.21.15.159:0/45418937 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560861e0e150 con 0x560861e074a0 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f5696ffd640 1 --2- 172.21.15.159:0/45418937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e1e4b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f56880042a0 tx=0x7f5688005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1535fe54c2fa075 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:53.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f568d7fa640 1 -- 172.21.15.159:0/45418937 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688034040 con 0x560861e074a0 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f568d7fa640 1 -- 172.21.15.159:0/45418937 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f568802fc60 con 0x560861e074a0 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.236+0000 7f568d7fa640 1 -- 172.21.15.159:0/45418937 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56880045c0 con 0x560861e074a0 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 -- 172.21.15.159:0/45418937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 msgr2=0x560861e1e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 --2- 172.21.15.159:0/45418937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e1e4b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f56880042a0 tx=0x7f5688005fd0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 -- 172.21.15.159:0/45418937 shutdown_connections 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 --2- 172.21.15.159:0/45418937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e12680 0x560861e11110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 --2- 172.21.15.159:0/45418937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e0da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 --2- 172.21.15.159:0/45418937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e1e4b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 -- 172.21.15.159:0/45418937 >> 172.21.15.159:0/45418937 conn(0x560861e03a30 msgr2=0x560861e10a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 -- 172.21.15.159:0/45418937 shutdown_connections 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 -- 172.21.15.159:0/45418937 wait complete. 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 -- start start 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 Processor -- start 2024-09-19T06:48:53.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e16cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e17230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e12680 0x560861e1a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f56981ae930 con 0x560861e074a0 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56981afda0 con 0x560861e07dc0 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56981af000 con 0x560861e12680 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.237+0000 7f569fe2a740 10 client.0 _ll_register_callbacks cb 0x7f5690015e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5696ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e16cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5696ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e16cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57828/0 (socket says 172.21.15.159:57828) 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5696ffd640 1 -- 172.21.15.159:0/3656674450 learned_addr learned my addr 172.21.15.159:0/3656674450 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f56967fc640 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e17230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f56977fe640 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e12680 0x560861e1a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5696ffd640 1 -- 172.21.15.159:0/3656674450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e12680 msgr2=0x560861e1a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5696ffd640 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e12680 0x560861e1a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5696ffd640 1 -- 172.21.15.159:0/3656674450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 msgr2=0x560861e17230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5696ffd640 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e17230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5696ffd640 1 -- 172.21.15.159:0/3656674450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560861e12260 con 0x560861e074a0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5696ffd640 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e16cf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5688050040 tx=0x7f568802f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e9c1141b62bd71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5676ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5676ffd640 1 -- 172.21.15.159:0/3656674450 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688060060 con 0x560861e074a0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5676ffd640 1 -- 172.21.15.159:0/3656674450 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f5688003b70 con 0x560861e074a0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f569fe2a740 1 -- 172.21.15.159:0/3656674450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f568802fc60 con 0x560861e074a0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5676ffd640 1 -- 172.21.15.159:0/3656674450 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5688034040 con 0x560861e074a0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f569fe2a740 10 client.15849 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f569fe2a740 1 -- 172.21.15.159:0/3656674450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560861e8d6a0 con 0x560861e074a0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.238+0000 7f5676ffd640 1 -- 172.21.15.159:0/3656674450 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f568802fc60 con 0x560861e074a0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f5676ffd640 1 -- 172.21.15.159:0/3656674450 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f568804d050 con 0x560861e074a0 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f569fe2a740 10 client.15849 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:53.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f569fe2a740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f569fe2a740 20 client.15849 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560861e8d920 0x560861e8fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f569fe2a740 4 client.15849 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f569fe2a740 1 -- 172.21.15.159:0/3656674450 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560861d74d60 con 0x560861e8d920 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f56967fc640 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560861e8d920 0x560861e8fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f5676ffd640 10 client.15849 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f56967fc640 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560861e8d920 0x560861e8fd10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeea319ae7186f02 server_cookie=d1305eff389b59c6 in_seq=0 out_seq=0 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f5676ffd640 1 -- 172.21.15.159:0/3656674450 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x560861d74d60 con 0x560861e8d920 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f5676ffd640 10 client.15849 handle_command_reply: tid=0 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.239+0000 7f569fe2a740 1 client.15849 shutdown 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 -- 172.21.15.159:0/3656674450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 msgr2=0x560861e16cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e16cf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5688050040 tx=0x7f568802f940 comp rx=0 tx=0).stop 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 -- 172.21.15.159:0/3656674450 shutdown_connections 2024-09-19T06:48:53.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560861e8d920 0x560861e8fd10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560861e12680 0x560861e1a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560861e07dc0 0x560861e17230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f5676ffd640 0 client.15849 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 --2- 172.21.15.159:0/3656674450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560861e074a0 0x560861e16cf0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 -- 172.21.15.159:0/3656674450 >> 172.21.15.159:0/3656674450 conn(0x560861e03a30 msgr2=0x560861e08ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 -- 172.21.15.159:0/3656674450 shutdown_connections 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 1 -- 172.21.15.159:0/3656674450 wait complete. 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569fe2a740 20 client.15849 trim_cache size 0 max 16384 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 -- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f56840a33b0 msgr2=0x7f56840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f56840a33b0 0x7f56840a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56980754f0 tx=0x7f56900046c0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 -- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074e30 msgr2=0x7f569819ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:53.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074e30 0x7f569819ad10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f568000d950 tx=0x7f568000de10 comp rx=0 tx=0).stop 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout: "5ce9c206-aa93-4887-918c-66a3bb569e77": { 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "5ce9c206-aa93-4887-918c-66a3bb569e77", 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:48:53.262 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:48:53.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 -- 172.21.15.159:0/371546895 shutdown_connections 2024-09-19T06:48:53.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f56840a33b0 0x7f56840a5870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f569810e450 0x7f569819dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5698074e30 0x7f569819ad10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 --2- 172.21.15.159:0/371546895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5698074510 0x7f569819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:53.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 -- 172.21.15.159:0/371546895 >> 172.21.15.159:0/371546895 conn(0x7f56980fd8f0 msgr2=0x7f56980fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:53.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.240+0000 7f569da51640 1 -- 172.21.15.159:0/371546895 shutdown_connections 2024-09-19T06:48:53.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:48:53.241+0000 7f569da51640 1 -- 172.21.15.159:0/371546895 wait complete. 2024-09-19T06:48:53.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:53 smithi203 ceph-mon[35473]: pgmap v59: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-09-19T06:48:53.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:53 smithi189 ceph-mon[34880]: pgmap v59: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-09-19T06:48:53.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:53 smithi159 ceph-mon[30935]: pgmap v59: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-09-19T06:48:54.410 INFO:tasks.cephfs.filesystem:scrub status for tag:5ce9c206-aa93-4887-918c-66a3bb569e77 - {'path': '/', 'tag': '5ce9c206-aa93-4887-918c-66a3bb569e77', 'options': 'recursive,force'} 2024-09-19T06:48:54.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:54 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:48:54.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:54 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:48:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:54 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:48:55.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:55 smithi203 ceph-mon[35473]: pgmap v60: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 1.3 MiB/s wr, 49 op/s 2024-09-19T06:48:55.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:55 smithi189 ceph-mon[34880]: pgmap v60: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 1.3 MiB/s wr, 49 op/s 2024-09-19T06:48:55.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:55 smithi159 ceph-mon[30935]: pgmap v60: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 1.3 MiB/s wr, 49 op/s 2024-09-19T06:48:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.024+0000 7f92c115b640 1 -- 172.21.15.159:0/3916126892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc101ac0 msgr2=0x7f92bc101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.024+0000 7f92c115b640 1 --2- 172.21.15.159:0/3916126892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc101ac0 0x7f92bc101f20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009930 tx=0x7f92ac02a420 comp rx=0 tx=0).stop 2024-09-19T06:48:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.024+0000 7f92c115b640 1 -- 172.21.15.159:0/3916126892 shutdown_connections 2024-09-19T06:48:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.024+0000 7f92c115b640 1 --2- 172.21.15.159:0/3916126892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92bc102460 0x7f92bc10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.024+0000 7f92c115b640 1 --2- 172.21.15.159:0/3916126892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc101ac0 0x7f92bc101f20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.024+0000 7f92c115b640 1 --2- 172.21.15.159:0/3916126892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92bc107ad0 0x7f92bc107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.024+0000 7f92c115b640 1 -- 172.21.15.159:0/3916126892 >> 172.21.15.159:0/3916126892 conn(0x7f92bc0fd7e0 msgr2=0x7f92bc0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:57.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.024+0000 7f92c115b640 1 -- 172.21.15.159:0/3916126892 shutdown_connections 2024-09-19T06:48:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.024+0000 7f92c115b640 1 -- 172.21.15.159:0/3916126892 wait complete. 2024-09-19T06:48:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.025+0000 7f92c115b640 1 Processor -- start 2024-09-19T06:48:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.025+0000 7f92c115b640 1 -- start start 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92c115b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92bc101ac0 0x7f92bc1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92c115b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92bc102460 0x7f92bc1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92c115b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc107ad0 0x7f92bc19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92c115b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc111f10 con 0x7f92bc107ad0 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92c115b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc111d90 con 0x7f92bc101ac0 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92c115b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc112090 con 0x7f92bc102460 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bb59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc107ad0 0x7f92bc19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bb59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc107ad0 0x7f92bc19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57842/0 (socket says 172.21.15.159:57842) 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bb59e640 1 -- 172.21.15.159:0/2069901089 learned_addr learned my addr 172.21.15.159:0/2069901089 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92ba59c640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92bc102460 0x7f92bc1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bad9d640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92bc101ac0 0x7f92bc1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bb59e640 1 -- 172.21.15.159:0/2069901089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92bc102460 msgr2=0x7f92bc1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bb59e640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92bc102460 0x7f92bc1988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bb59e640 1 -- 172.21.15.159:0/2069901089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92bc101ac0 msgr2=0x7f92bc1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bb59e640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92bc101ac0 0x7f92bc1983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bb59e640 1 -- 172.21.15.159:0/2069901089 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc19d390 con 0x7f92bc107ad0 2024-09-19T06:48:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92bb59e640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc107ad0 0x7f92bc19cc60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f92b400eb10 tx=0x7f92b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92b3fff640 1 -- 172.21.15.159:0/2069901089 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4004b20 con 0x7f92bc107ad0 2024-09-19T06:48:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92c115b640 1 -- 172.21.15.159:0/2069901089 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92bc19d680 con 0x7f92bc107ad0 2024-09-19T06:48:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92b3fff640 1 -- 172.21.15.159:0/2069901089 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92b4004cc0 con 0x7f92bc107ad0 2024-09-19T06:48:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92b3fff640 1 -- 172.21.15.159:0/2069901089 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4010760 con 0x7f92bc107ad0 2024-09-19T06:48:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.026+0000 7f92c115b640 1 -- 172.21.15.159:0/2069901089 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92bc1a4f10 con 0x7f92bc107ad0 2024-09-19T06:48:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.028+0000 7f92b3fff640 1 -- 172.21.15.159:0/2069901089 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f92b4005020 con 0x7f92bc107ad0 2024-09-19T06:48:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92c3fcf740 1 Processor -- start 2024-09-19T06:48:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92c3fcf740 1 -- start start 2024-09-19T06:48:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x563943681df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 0x563943690b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x5639436934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5639435e62f0 con 0x5639436910c0 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56394358e270 con 0x563943682330 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5639435e22b0 con 0x563943681a10 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92b3fff640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f92a80a3460 0x7f92a80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92ba59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x5639436934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92ba59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x5639436934b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57852/0 (socket says 172.21.15.159:57852) 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92ba59c640 1 -- 172.21.15.159:0/1612526283 learned_addr learned my addr 172.21.15.159:0/1612526283 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92bad9d640 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 0x563943690b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92bb59e640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f92a80a3460 0x7f92a80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.029+0000 7f92ba59c640 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x563943681df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92b3fff640 1 -- 172.21.15.159:0/2069901089 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f92b40d0430 con 0x7f92bc107ad0 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92ba59c640 1 -- 172.21.15.159:0/1612526283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 msgr2=0x563943681df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92ba59c640 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x563943681df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92ba59c640 1 -- 172.21.15.159:0/1612526283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 msgr2=0x563943690b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92ba59c640 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 0x563943690b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92ba59c640 1 -- 172.21.15.159:0/1612526283 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394358d340 con 0x5639436910c0 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92bad9d640 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 0x563943690b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92ba59c640 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x5639436934b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f92ac005c20 tx=0x7f92ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba3f486a3878b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92bb59e640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f92a80a3460 0x7f92a80a5920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92b409c3e0 tx=0x7f92b406e460 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92b17fa640 1 -- 172.21.15.159:0/1612526283 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac045070 con 0x5639436910c0 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92b17fa640 1 -- 172.21.15.159:0/1612526283 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92ac0317b0 con 0x5639436910c0 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.030+0000 7f92b17fa640 1 -- 172.21.15.159:0/1612526283 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac035040 con 0x5639436910c0 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1612526283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 msgr2=0x5639436934b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x5639436934b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f92ac005c20 tx=0x7f92ac000bc0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1612526283 shutdown_connections 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x5639436934b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 0x563943690b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1612526283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x563943681df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1612526283 >> 172.21.15.159:0/1612526283 conn(0x56394367e060 msgr2=0x56394367e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1612526283 shutdown_connections 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1612526283 wait complete. 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 -- start start 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.031+0000 7f92c3fcf740 1 Processor -- start 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x56394368dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x56394368e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x56394368ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563943693c90 con 0x563943682330 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56394356f290 con 0x5639436910c0 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563943693e10 con 0x563943681a10 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 10 client.0 _ll_register_callbacks cb 0x5639435a0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92bad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x56394368e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92bad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x56394368e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57858/0 (socket says 172.21.15.159:57858) 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92bad9d640 1 -- 172.21.15.159:0/649647719 learned_addr learned my addr 172.21.15.159:0/649647719 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92ba59c640 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x56394368ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92bad9d640 1 -- 172.21.15.159:0/649647719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 msgr2=0x56394368dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92bad9d640 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x56394368dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92bad9d640 1 -- 172.21.15.159:0/649647719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 msgr2=0x56394368ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92bad9d640 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x56394368ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92bad9d640 1 -- 172.21.15.159:0/649647719 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639432f9210 con 0x563943682330 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92ba59c640 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x56394368ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92bad9d640 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x56394368e530 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f92a40136e0 tx=0x7f92a4013ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2172f447fe3c1a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92a27fc640 1 -- 172.21.15.159:0/649647719 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a4011d70 con 0x563943682330 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 1 -- 172.21.15.159:0/649647719 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92ac0317b0 con 0x563943682330 2024-09-19T06:48:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92a27fc640 1 -- 172.21.15.159:0/649647719 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f92a401b3e0 con 0x563943682330 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92a27fc640 1 -- 172.21.15.159:0/649647719 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f92a401b5e0 con 0x563943682330 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 10 client.15861 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.032+0000 7f92c3fcf740 1 -- 172.21.15.159:0/649647719 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5639433c5620 con 0x563943682330 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92a27fc640 1 -- 172.21.15.159:0/649647719 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92ac0317b0 con 0x563943682330 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92a27fc640 1 -- 172.21.15.159:0/649647719 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f92a401a070 con 0x563943682330 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92c3fcf740 10 client.15861 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92c3fcf740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92c3fcf740 20 client.15861 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5639436a1170 0x5639436a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92c3fcf740 4 client.15861 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92c3fcf740 1 -- 172.21.15.159:0/649647719 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639435f3a20 con 0x5639436a1170 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92ba59c640 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5639436a1170 0x5639436a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92ba59c640 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5639436a1170 0x5639436a35d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1fd8d4db29c44aa server_cookie=dbc3af44a9446adc in_seq=0 out_seq=0 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.033+0000 7f92a27fc640 10 client.15861 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92a27fc640 1 -- 172.21.15.159:0/649647719 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5639435f3a20 con 0x5639436a1170 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92a27fc640 10 client.15861 handle_command_reply: tid=0 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 client.15861 shutdown 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 -- 172.21.15.159:0/649647719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 msgr2=0x56394368e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x56394368e530 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f92a40136e0 tx=0x7f92a4013ba0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 -- 172.21.15.159:0/649647719 shutdown_connections 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5639436a1170 0x5639436a35d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x56394368ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x56394368e530 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92a27fc640 0 client.15861 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/649647719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x56394368dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 -- 172.21.15.159:0/649647719 >> 172.21.15.159:0/649647719 conn(0x56394367e060 msgr2=0x563943683d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 -- 172.21.15.159:0/649647719 shutdown_connections 2024-09-19T06:48:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.034+0000 7f92c3fcf740 1 -- 172.21.15.159:0/649647719 wait complete. 2024-09-19T06:48:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.035+0000 7f92c3fcf740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T06:48:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.048+0000 7f92c3fcf740 1 Processor -- start 2024-09-19T06:48:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.048+0000 7f92c3fcf740 1 -- start start 2024-09-19T06:48:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x563943690860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x5639436a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x5639436a9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc1a96f0 con 0x563943682330 2024-09-19T06:48:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc1abf70 con 0x5639436910c0 2024-09-19T06:48:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc1a9d60 con 0x563943681a10 2024-09-19T06:48:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92bad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x5639436a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92bad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x5639436a8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57868/0 (socket says 172.21.15.159:57868) 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92bad9d640 1 -- 172.21.15.159:0/965914318 learned_addr learned my addr 172.21.15.159:0/965914318 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92ba59c640 1 --2- 172.21.15.159:0/965914318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x5639436a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92bad9d640 1 -- 172.21.15.159:0/965914318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 msgr2=0x563943690860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92bad9d640 1 --2- 172.21.15.159:0/965914318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x563943690860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92bad9d640 1 -- 172.21.15.159:0/965914318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 msgr2=0x5639436a9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92bad9d640 1 --2- 172.21.15.159:0/965914318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x5639436a9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92bad9d640 1 -- 172.21.15.159:0/965914318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639436782f0 con 0x563943682330 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92ba59c640 1 --2- 172.21.15.159:0/965914318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x5639436a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92bad9d640 1 --2- 172.21.15.159:0/965914318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x5639436a8ee0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f92a401cc70 tx=0x7f92a40096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ddf303678519a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.049+0000 7f92b0ff9640 1 -- 172.21.15.159:0/965914318 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a4011d70 con 0x563943682330 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92b0ff9640 1 -- 172.21.15.159:0/965914318 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92a4005030 con 0x563943682330 2024-09-19T06:48:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92b0ff9640 1 -- 172.21.15.159:0/965914318 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a401ba70 con 0x563943682330 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92c3fcf740 1 -- 172.21.15.159:0/965914318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 msgr2=0x5639436a8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/965914318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x5639436a8ee0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f92a401cc70 tx=0x7f92a40096f0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92c3fcf740 1 -- 172.21.15.159:0/965914318 shutdown_connections 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/965914318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639436910c0 0x5639436a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/965914318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563943682330 0x5639436a8ee0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/965914318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x563943690860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92c3fcf740 1 -- 172.21.15.159:0/965914318 >> 172.21.15.159:0/965914318 conn(0x56394367e060 msgr2=0x56394367d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92c3fcf740 1 -- 172.21.15.159:0/965914318 shutdown_connections 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.050+0000 7f92c3fcf740 1 -- 172.21.15.159:0/965914318 wait complete. 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92c3fcf740 1 -- start start 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92c3fcf740 1 Processor -- start 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x5639436950f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 0x563943695630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92c3fcf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x563943695b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc1aa430 con 0x5639436910c0 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc1ab8a0 con 0x563943682330 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92c3fcf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc1aab00 con 0x563943681a10 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92c3fcf740 10 client.0 _ll_register_callbacks cb 0x7f92a4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x563943695b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x563943695b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57884/0 (socket says 172.21.15.159:57884) 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 -- 172.21.15.159:0/1904197967 learned_addr learned my addr 172.21.15.159:0/1904197967 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x5639436950f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92bad9d640 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 0x563943695630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 -- 172.21.15.159:0/1904197967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 msgr2=0x5639436950f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x5639436950f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 -- 172.21.15.159:0/1904197967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 msgr2=0x563943695630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 0x563943695630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 -- 172.21.15.159:0/1904197967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56394370b150 con 0x5639436910c0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92ba59c640 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x563943695b70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f92ac033000 tx=0x7f92ac0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7466cd4240c3a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.051+0000 7f92a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92a27fc640 1 -- 172.21.15.159:0/1904197967 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac035040 con 0x5639436910c0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92a27fc640 1 -- 172.21.15.159:0/1904197967 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f92ac0319c0 con 0x5639436910c0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1904197967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92a4005030 con 0x5639436910c0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92a27fc640 1 -- 172.21.15.159:0/1904197967 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f92ac045040 con 0x5639436910c0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92c3fcf740 10 client.15867 fetch_fsmap learned FSMap version 20 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1904197967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56394370c460 con 0x5639436910c0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92a27fc640 1 -- 172.21.15.159:0/1904197967 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92a4005030 con 0x5639436910c0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92a27fc640 1 -- 172.21.15.159:0/1904197967 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f92ac03a040 con 0x5639436910c0 2024-09-19T06:48:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92c3fcf740 10 client.15867 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:48:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92c3fcf740 10 client.15867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:48:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92c3fcf740 20 client.15867 populate_metadata read hostname 'smithi159' 2024-09-19T06:48:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56394370c6e0 0x56394370ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92c3fcf740 4 client.15867 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1904197967 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5639435edd70 con 0x56394370c6e0 2024-09-19T06:48:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.052+0000 7f92bad9d640 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56394370c6e0 0x56394370ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.053+0000 7f92a27fc640 10 client.15867 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.053+0000 7f92bad9d640 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56394370c6e0 0x56394370ead0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99f31ecce90c37b7 server_cookie=65ec3aab58502738 in_seq=0 out_seq=0 2024-09-19T06:48:57.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:56 smithi203 ceph-mon[35473]: pgmap v61: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.3 MiB/s wr, 55 op/s 2024-09-19T06:48:57.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:56 smithi189 ceph-mon[34880]: pgmap v61: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.3 MiB/s wr, 55 op/s 2024-09-19T06:48:57.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:56 smithi159 ceph-mon[30935]: pgmap v61: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.3 MiB/s wr, 55 op/s 2024-09-19T06:48:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.150+0000 7f92a27fc640 1 -- 172.21.15.159:0/1904197967 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5639435edd70 con 0x56394370c6e0 2024-09-19T06:48:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.150+0000 7f92a27fc640 10 client.15867 handle_command_reply: tid=0 2024-09-19T06:48:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 client.15867 shutdown 2024-09-19T06:48:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1904197967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 msgr2=0x563943695b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x563943695b70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f92ac033000 tx=0x7f92ac0058b0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1904197967 shutdown_connections 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56394370c6e0 0x56394370ead0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5639436910c0 0x563943695b70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92a27fc640 0 client.15867 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563943682330 0x563943695630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 --2- 172.21.15.159:0/1904197967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563943681a10 0x5639436950f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1904197967 >> 172.21.15.159:0/1904197967 conn(0x56394367e060 msgr2=0x56394368df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1904197967 shutdown_connections 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 1 -- 172.21.15.159:0/1904197967 wait complete. 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c3fcf740 20 client.15867 trim_cache size 0 max 16384 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:48:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:48:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:48:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:48:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c115b640 1 -- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f92a80a3460 msgr2=0x7f92a80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c115b640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f92a80a3460 0x7f92a80a5920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92b409c3e0 tx=0x7f92b406e460 comp rx=0 tx=0).stop 2024-09-19T06:48:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c115b640 1 -- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc107ad0 msgr2=0x7f92bc19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.151+0000 7f92c115b640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc107ad0 0x7f92bc19cc60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f92b400eb10 tx=0x7f92b400c2d0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.152+0000 7f92c115b640 1 -- 172.21.15.159:0/2069901089 shutdown_connections 2024-09-19T06:48:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.152+0000 7f92c115b640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f92a80a3460 0x7f92a80a5920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.152+0000 7f92c115b640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92bc107ad0 0x7f92bc19cc60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.152+0000 7f92c115b640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92bc102460 0x7f92bc1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.152+0000 7f92c115b640 1 --2- 172.21.15.159:0/2069901089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92bc101ac0 0x7f92bc1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.152+0000 7f92c115b640 1 -- 172.21.15.159:0/2069901089 >> 172.21.15.159:0/2069901089 conn(0x7f92bc0fd7e0 msgr2=0x7f92bc0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.152+0000 7f92c115b640 1 -- 172.21.15.159:0/2069901089 shutdown_connections 2024-09-19T06:48:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:48:57.152+0000 7f92c115b640 1 -- 172.21.15.159:0/2069901089 wait complete. 2024-09-19T06:48:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:48:58 smithi203 ceph-mon[35473]: pgmap v62: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 38 op/s 2024-09-19T06:48:59.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:48:58 smithi189 ceph-mon[34880]: pgmap v62: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 38 op/s 2024-09-19T06:48:59.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:48:58 smithi159 ceph-mon[30935]: pgmap v62: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 38 op/s 2024-09-19T06:49:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:00 smithi203 ceph-mon[35473]: pgmap v63: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 38 op/s 2024-09-19T06:49:01.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:00 smithi189 ceph-mon[34880]: pgmap v63: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 38 op/s 2024-09-19T06:49:01.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:00 smithi159 ceph-mon[30935]: pgmap v63: 97 pgs: 97 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 38 op/s 2024-09-19T06:49:03.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:02 smithi203 ceph-mon[35473]: pgmap v64: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 212 KiB/s wr, 126 op/s 2024-09-19T06:49:03.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:02 smithi189 ceph-mon[34880]: pgmap v64: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 212 KiB/s wr, 126 op/s 2024-09-19T06:49:03.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:02 smithi159 ceph-mon[30935]: pgmap v64: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 212 KiB/s wr, 126 op/s 2024-09-19T06:49:03.710 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:49:03.974 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.444+0000 7f839de7c640 1 -- 172.21.15.159:0/3274430223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 msgr2=0x7f83981021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.444+0000 7f839de7c640 1 --2- 172.21.15.159:0/3274430223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 0x7f83981021d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8388009900 tx=0x7f838802a410 comp rx=0 tx=0).stop 2024-09-19T06:49:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.444+0000 7f839de7c640 1 -- 172.21.15.159:0/3274430223 shutdown_connections 2024-09-19T06:49:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.444+0000 7f839de7c640 1 --2- 172.21.15.159:0/3274430223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8398106f20 0x7f839810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.444+0000 7f839de7c640 1 --2- 172.21.15.159:0/3274430223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83981027a0 0x7f83981067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.444+0000 7f839de7c640 1 --2- 172.21.15.159:0/3274430223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 0x7f83981021d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.444+0000 7f839de7c640 1 -- 172.21.15.159:0/3274430223 >> 172.21.15.159:0/3274430223 conn(0x7f83980fd8f0 msgr2=0x7f83980ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.444+0000 7f839de7c640 1 -- 172.21.15.159:0/3274430223 shutdown_connections 2024-09-19T06:49:04.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.444+0000 7f839de7c640 1 -- 172.21.15.159:0/3274430223 wait complete. 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f839de7c640 1 Processor -- start 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f839de7c640 1 -- start start 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f839de7c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 0x7f83980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f839de7c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83981027a0 0x7f8398074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f839de7c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8398106f20 0x7f8398074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f839de7c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8398111fa0 con 0x7f8398101df0 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f839de7c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8398111e20 con 0x7f83981027a0 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f839de7c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8398112120 con 0x7f8398106f20 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f83977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 0x7f83980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f83977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 0x7f83980744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56288/0 (socket says 172.21.15.159:56288) 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f83977fe640 1 -- 172.21.15.159:0/3210744981 learned_addr learned my addr 172.21.15.159:0/3210744981 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f8396ffd640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83981027a0 0x7f8398074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:04.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f83977fe640 1 -- 172.21.15.159:0/3210744981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8398106f20 msgr2=0x7f8398074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f8397fff640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8398106f20 0x7f8398074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f83977fe640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8398106f20 0x7f8398074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f83977fe640 1 -- 172.21.15.159:0/3210744981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83981027a0 msgr2=0x7f8398074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f83977fe640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83981027a0 0x7f8398074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f83977fe640 1 -- 172.21.15.159:0/3210744981 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83981a6920 con 0x7f8398101df0 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f8396ffd640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83981027a0 0x7f8398074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.445+0000 7f8397fff640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8398106f20 0x7f8398074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.446+0000 7f83977fe640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 0x7f83980744f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8388005ab0 tx=0x7f83880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.446+0000 7f8394ff9640 1 -- 172.21.15.159:0/3210744981 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838803f030 con 0x7f8398101df0 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.446+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83981a6bb0 con 0x7f8398101df0 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.446+0000 7f8394ff9640 1 -- 172.21.15.159:0/3210744981 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8388003ce0 con 0x7f8398101df0 2024-09-19T06:49:04.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.446+0000 7f8394ff9640 1 -- 172.21.15.159:0/3210744981 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388035070 con 0x7f8398101df0 2024-09-19T06:49:04.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.446+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83981a70e0 con 0x7f8398101df0 2024-09-19T06:49:04.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.447+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83981021d0 con 0x7f8398101df0 2024-09-19T06:49:04.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.448+0000 7f8394ff9640 1 -- 172.21.15.159:0/3210744981 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f8388042030 con 0x7f8398101df0 2024-09-19T06:49:04.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.449+0000 7f8394ff9640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f83800a33b0 0x7f83800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:04.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.449+0000 7f8396ffd640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f83800a33b0 0x7f83800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:04.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.449+0000 7f8394ff9640 1 -- 172.21.15.159:0/3210744981 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f83880f0a10 con 0x7f8398101df0 2024-09-19T06:49:04.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.449+0000 7f8396ffd640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f83800a33b0 0x7f83800a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8398075f80 tx=0x7f838c005d30 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:04.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.452+0000 7f8394ff9640 1 -- 172.21.15.159:0/3210744981 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83880bd3c0 con 0x7f8398101df0 2024-09-19T06:49:04.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.654+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f839810a100 con 0x7f8398101df0 2024-09-19T06:49:04.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.655+0000 7f8394ff9640 1 -- 172.21.15.159:0/3210744981 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11873 (secure 0 0 0) 0x7f83880bccc0 con 0x7f8398101df0 2024-09-19T06:49:04.656 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:49:04.656 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"btime":"2024-09-19T06:45:32:821073+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:45:32.442633+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1818858628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1818858628},{"type":"v1","addr":"172.21.15.189:6839","nonce":1818858628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:49:04.656 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-09-19T06:49:04.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f83800a33b0 msgr2=0x7f83800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:04.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f83800a33b0 0x7f83800a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8398075f80 tx=0x7f838c005d30 comp rx=0 tx=0).stop 2024-09-19T06:49:04.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 msgr2=0x7f83980744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:04.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 0x7f83980744f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8388005ab0 tx=0x7f83880042f0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 shutdown_connections 2024-09-19T06:49:04.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f83800a33b0 0x7f83800a5870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8398106f20 0x7f8398074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83981027a0 0x7f8398074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 --2- 172.21.15.159:0/3210744981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8398101df0 0x7f83980744f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:04.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 >> 172.21.15.159:0/3210744981 conn(0x7f83980fd8f0 msgr2=0x7f83980fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:04.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 shutdown_connections 2024-09-19T06:49:04.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:04.657+0000 7f839de7c640 1 -- 172.21.15.159:0/3210744981 wait complete. 2024-09-19T06:49:05.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:04 smithi203 ceph-mon[35473]: pgmap v65: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 57 KiB/s wr, 93 op/s 2024-09-19T06:49:05.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:04 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3210744981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:49:05.112 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:04 smithi159 ceph-mon[30935]: pgmap v65: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 57 KiB/s wr, 93 op/s 2024-09-19T06:49:05.112 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:04 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3210744981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:49:05.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:04 smithi189 ceph-mon[34880]: pgmap v65: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 57 KiB/s wr, 93 op/s 2024-09-19T06:49:05.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:04 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3210744981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:49:05.363 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id 8b63d2f0 --release --await' 2024-09-19T06:49:05.364 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id 8b63d2f0 --release --await 2024-09-19T06:49:05.611 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:06.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 -- 172.21.15.159:0/218277231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 msgr2=0x7f17b010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 --2- 172.21.15.159:0/218277231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 0x7f17b010ec70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009cd0 tx=0x7f17a802a8d0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 -- 172.21.15.159:0/218277231 shutdown_connections 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 --2- 172.21.15.159:0/218277231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 0x7f17b010ec70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 --2- 172.21.15.159:0/218277231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17b0103780 0x7f17b0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 --2- 172.21.15.159:0/218277231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17b0102dd0 0x7f17b01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 -- 172.21.15.159:0/218277231 >> 172.21.15.159:0/218277231 conn(0x7f17b00fc7d0 msgr2=0x7f17b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 -- 172.21.15.159:0/218277231 shutdown_connections 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 -- 172.21.15.159:0/218277231 wait complete. 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 Processor -- start 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.116+0000 7f17b654b640 1 -- start start 2024-09-19T06:49:06.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b654b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17b0102dd0 0x7f17b0100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b654b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17b0103780 0x7f17b0100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b654b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 0x7f17b01014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b654b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f17b01120d0 con 0x7f17b0108300 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b654b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17b0111f50 con 0x7f17b0103780 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b654b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17b0112250 con 0x7f17b0102dd0 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b4ae8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 0x7f17b01014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b4ae8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 0x7f17b01014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56302/0 (socket says 172.21.15.159:56302) 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b4ae8640 1 -- 172.21.15.159:0/1887896229 learned_addr learned my addr 172.21.15.159:0/1887896229 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17affff640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17b0102dd0 0x7f17b0100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17af7fe640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17b0103780 0x7f17b0100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b4ae8640 1 -- 172.21.15.159:0/1887896229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17b0102dd0 msgr2=0x7f17b0100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b4ae8640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17b0102dd0 0x7f17b0100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b4ae8640 1 -- 172.21.15.159:0/1887896229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17b0103780 msgr2=0x7f17b0100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b4ae8640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17b0103780 0x7f17b0100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b4ae8640 1 -- 172.21.15.159:0/1887896229 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b01a69d0 con 0x7f17b0108300 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.117+0000 7f17b4ae8640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 0x7f17b01014b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009ca0 tx=0x7f17a802f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.118+0000 7f17ad7fa640 1 -- 172.21.15.159:0/1887896229 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a80317a0 con 0x7f17b0108300 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.118+0000 7f17ad7fa640 1 -- 172.21.15.159:0/1887896229 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a8003e50 con 0x7f17b0108300 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.118+0000 7f17b654b640 1 -- 172.21.15.159:0/1887896229 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b01a6c60 con 0x7f17b0108300 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.118+0000 7f17ad7fa640 1 -- 172.21.15.159:0/1887896229 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8030590 con 0x7f17b0108300 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.118+0000 7f17b654b640 1 -- 172.21.15.159:0/1887896229 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b01a71a0 con 0x7f17b0108300 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17ad7fa640 1 -- 172.21.15.159:0/1887896229 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f17a8004160 con 0x7f17b0108300 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17b8924740 1 Processor -- start 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17b8924740 1 -- start start 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17b8924740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872362440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17b8924740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17b8924740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17b8924740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f8722c7620 con 0x55f872362060 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17b8924740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f87226ee50 con 0x55f87236d240 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17b8924740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f8722c35e0 con 0x55f872362980 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872362440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872362440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56318/0 (socket says 172.21.15.159:56318) 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.120+0000 7f17af7fe640 1 -- 172.21.15.159:0/476632260 learned_addr learned my addr 172.21.15.159:0/476632260 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17af7fe640 1 --2- 172.21.15.159:0/476632260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17affff640 1 --2- 172.21.15.159:0/476632260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17ad7fa640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f17980a33b0 0x7f17980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17b4ae8640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f17980a33b0 0x7f17980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17af7fe640 1 -- 172.21.15.159:0/476632260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 msgr2=0x55f87236cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17af7fe640 1 --2- 172.21.15.159:0/476632260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17af7fe640 1 -- 172.21.15.159:0/476632260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 msgr2=0x55f87236f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17af7fe640 1 --2- 172.21.15.159:0/476632260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17af7fe640 1 -- 172.21.15.159:0/476632260 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f87225fd40 con 0x55f872362060 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17ad7fa640 1 -- 172.21.15.159:0/1887896229 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f17a80f0bf0 con 0x7f17b0108300 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17af7fe640 1 --2- 172.21.15.159:0/476632260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872362440 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f17a4005d80 tx=0x7f17a400b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7deb72b7e1ff50d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17967fc640 1 -- 172.21.15.159:0/476632260 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4014270 con 0x55f872362060 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17b4ae8640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f17980a33b0 0x7f17980a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17a80bcf40 tx=0x7f17a8087d90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17967fc640 1 -- 172.21.15.159:0/476632260 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a4005500 con 0x55f872362060 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.121+0000 7f17967fc640 1 -- 172.21.15.159:0/476632260 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4004e30 con 0x55f872362060 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 -- 172.21.15.159:0/476632260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 msgr2=0x55f872362440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 --2- 172.21.15.159:0/476632260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872362440 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f17a4005d80 tx=0x7f17a400b400 comp rx=0 tx=0).stop 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 -- 172.21.15.159:0/476632260 shutdown_connections 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 --2- 172.21.15.159:0/476632260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 --2- 172.21.15.159:0/476632260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 --2- 172.21.15.159:0/476632260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872362440 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 -- 172.21.15.159:0/476632260 >> 172.21.15.159:0/476632260 conn(0x55f87235e5f0 msgr2=0x55f87235e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 -- 172.21.15.159:0/476632260 shutdown_connections 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 -- 172.21.15.159:0/476632260 wait complete. 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.122+0000 7f17b8924740 1 -- start start 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17b8924740 1 Processor -- start 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17b8924740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f87236a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17b8924740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17b8924740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17b8924740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f87236fe10 con 0x55f872362060 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17b8924740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f87224ff10 con 0x55f87236d240 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17b8924740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f87236ff90 con 0x55f872362980 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17b8924740 10 client.0 _ll_register_callbacks cb 0x55f872273db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:06.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f87236a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f87236a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56332/0 (socket says 172.21.15.159:56332) 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17af7fe640 1 -- 172.21.15.159:0/1733818901 learned_addr learned my addr 172.21.15.159:0/1733818901 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17af7fe640 1 -- 172.21.15.159:0/1733818901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 msgr2=0x55f87236a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17af7fe640 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17af7fe640 1 -- 172.21.15.159:0/1733818901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 msgr2=0x55f87236ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17af7fe640 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17af7fe640 1 -- 172.21.15.159:0/1733818901 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f871fd6580 con 0x55f872362060 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f17af7fe640 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f87236a0e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f17a4005d20 tx=0x7f17a4014e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e9fb1c45229655 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f178f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f178f7fe640 1 -- 172.21.15.159:0/1733818901 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40046c0 con 0x55f872362060 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.123+0000 7f178f7fe640 1 -- 172.21.15.159:0/1733818901 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f17a4004860 con 0x55f872362060 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17b8924740 1 -- 172.21.15.159:0/1733818901 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17a4005500 con 0x55f872362060 2024-09-19T06:49:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f178f7fe640 1 -- 172.21.15.159:0/1733818901 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f17a4031050 con 0x55f872362060 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17b8924740 10 client.15885 fetch_fsmap learned FSMap version 20 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17b8924740 1 -- 172.21.15.159:0/1733818901 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f8720a0960 con 0x55f872362060 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f178f7fe640 1 -- 172.21.15.159:0/1733818901 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a4005500 con 0x55f872362060 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f178f7fe640 1 -- 172.21.15.159:0/1733818901 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f17a400fb40 con 0x55f872362060 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17b8924740 10 client.15885 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17b8924740 10 client.15885 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17b8924740 20 client.15885 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17b8924740 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f87237cc20 0x55f87237f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17b8924740 4 client.15885 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17b8924740 1 -- 172.21.15.159:0/1733818901 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8722d4b90 con 0x55f87237cc20 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.124+0000 7f17affff640 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f87237cc20 0x55f87237f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.125+0000 7f178f7fe640 10 client.15885 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.125+0000 7f17affff640 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f87237cc20 0x55f87237f010 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f803cd25a32005f server_cookie=ebb43c6add07fbd7 in_seq=0 out_seq=0 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.125+0000 7f178f7fe640 1 -- 172.21.15.159:0/1733818901 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8722d4b90 con 0x55f87237cc20 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.125+0000 7f178f7fe640 10 client.15885 handle_command_reply: tid=0 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.125+0000 7f17b8924740 1 client.15885 shutdown 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 -- 172.21.15.159:0/1733818901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 msgr2=0x55f87236a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f87236a0e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f17a4005d20 tx=0x7f17a4014e80 comp rx=0 tx=0).stop 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 -- 172.21.15.159:0/1733818901 shutdown_connections 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f87237cc20 0x55f87237f010 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f178f7fe640 0 client.15885 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 --2- 172.21.15.159:0/1733818901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f87236a0e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 -- 172.21.15.159:0/1733818901 >> 172.21.15.159:0/1733818901 conn(0x55f87235e5f0 msgr2=0x55f8723642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:06.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 -- 172.21.15.159:0/1733818901 shutdown_connections 2024-09-19T06:49:06.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 1 -- 172.21.15.159:0/1733818901 wait complete. 2024-09-19T06:49:06.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.126+0000 7f17b8924740 20 client.15885 trim_cache size 0 max 16384 2024-09-19T06:49:06.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.143+0000 7f17b8924740 1 Processor -- start 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.143+0000 7f17b8924740 1 -- start start 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.143+0000 7f17b8924740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872364ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17b8924740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17b8924740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17b8924740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f17b01adac0 con 0x55f872362060 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17b8924740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17b01b0340 con 0x55f87236d240 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17b8924740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17b01ae130 con 0x55f872362980 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872364ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872364ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56346/0 (socket says 172.21.15.159:56346) 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 -- 172.21.15.159:0/1636146743 learned_addr learned my addr 172.21.15.159:0/1636146743 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:06.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17affff640 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 -- 172.21.15.159:0/1636146743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 msgr2=0x55f87236a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 -- 172.21.15.159:0/1636146743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 msgr2=0x55f87236acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 -- 172.21.15.159:0/1636146743 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f87235f280 con 0x55f872362060 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17affff640 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f17af7fe640 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872364ac0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f17a4018020 tx=0x7f17a4005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860e32c2841688c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f1795ffb640 1 -- 172.21.15.159:0/1636146743 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a401f6d0 con 0x55f872362060 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f1795ffb640 1 -- 172.21.15.159:0/1636146743 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a401f910 con 0x55f872362060 2024-09-19T06:49:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.144+0000 7f1795ffb640 1 -- 172.21.15.159:0/1636146743 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a400faa0 con 0x55f872362060 2024-09-19T06:49:06.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 -- 172.21.15.159:0/1636146743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 msgr2=0x55f872364ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:06.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872364ac0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f17a4018020 tx=0x7f17a4005970 comp rx=0 tx=0).stop 2024-09-19T06:49:06.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 -- 172.21.15.159:0/1636146743 shutdown_connections 2024-09-19T06:49:06.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f87236d240 0x55f87236acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362980 0x55f87236a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 --2- 172.21.15.159:0/1636146743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f872362060 0x55f872364ac0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 -- 172.21.15.159:0/1636146743 >> 172.21.15.159:0/1636146743 conn(0x55f87235e5f0 msgr2=0x55f87236a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:06.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 -- 172.21.15.159:0/1636146743 shutdown_connections 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 -- 172.21.15.159:0/1636146743 wait complete. 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.145+0000 7f17b8924740 1 -- start start 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17b8924740 1 Processor -- start 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17b8924740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362060 0x55f872371770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17b8924740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f872362980 0x55f872371cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17b8924740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f87236d240 0x55f8723e6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17b8924740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f17b01ae800 con 0x55f87236d240 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17b8924740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17b01afc70 con 0x55f872362980 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17b8924740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17b01aeed0 con 0x55f872362060 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17b8924740 10 client.0 _ll_register_callbacks cb 0x7f17a4014770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f87236d240 0x55f8723e6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f87236d240 0x55f8723e6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56350/0 (socket says 172.21.15.159:56350) 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17af7fe640 1 -- 172.21.15.159:0/3465248275 learned_addr learned my addr 172.21.15.159:0/3465248275 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17af7fe640 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362060 0x55f872371770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.146+0000 7f17affff640 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f872362980 0x55f872371cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f17af7fe640 1 -- 172.21.15.159:0/3465248275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362060 msgr2=0x55f872371770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f17af7fe640 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362060 0x55f872371770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f17af7fe640 1 -- 172.21.15.159:0/3465248275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f872362980 msgr2=0x55f872371cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f17af7fe640 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f872362980 0x55f872371cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f17af7fe640 1 -- 172.21.15.159:0/3465248275 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8723e6c80 con 0x55f87236d240 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f17af7fe640 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f87236d240 0x55f8723e6640 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b440 tx=0x7f17a4005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bde632a3b355e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f178f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:06.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f178f7fe640 1 -- 172.21.15.159:0/3465248275 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a400f6d0 con 0x55f87236d240 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f178f7fe640 1 -- 172.21.15.159:0/3465248275 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f17a400f870 con 0x55f87236d240 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f17b8924740 1 -- 172.21.15.159:0/3465248275 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17a401f910 con 0x55f87236d240 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f178f7fe640 1 -- 172.21.15.159:0/3465248275 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f17a404a050 con 0x55f87236d240 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f17b8924740 10 client.15891 fetch_fsmap learned FSMap version 20 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f17b8924740 1 -- 172.21.15.159:0/3465248275 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f8723e7ef0 con 0x55f87236d240 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.147+0000 7f178f7fe640 1 -- 172.21.15.159:0/3465248275 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a401f910 con 0x55f87236d240 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f178f7fe640 1 -- 172.21.15.159:0/3465248275 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f17a4005330 con 0x55f87236d240 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f17b8924740 10 client.15891 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f17b8924740 10 client.15891 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f17b8924740 20 client.15891 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f17b8924740 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f8723e8540 0x55f8723ea930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f17b8924740 4 client.15891 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8b63d2f0", "release": true, "await": true}] 2024-09-19T06:49:06.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f17b8924740 1 -- 172.21.15.159:0/3465248275 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8b63d2f0", "release": true, "await": true}) -- 0x55f872359950 con 0x55f8723e8540 2024-09-19T06:49:06.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f17affff640 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f8723e8540 0x55f8723ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:06.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f178f7fe640 10 client.15891 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:06.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.148+0000 7f17affff640 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f8723e8540 0x55f8723ea930 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9d07153e0418a12 server_cookie=fae7b8a29a7a9b9f in_seq=0 out_seq=0 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f178f7fe640 1 -- 172.21.15.159:0/3465248275 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f872359950 con 0x55f8723e8540 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f178f7fe640 10 client.15891 handle_command_reply: tid=0 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 client.15891 shutdown 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 -- 172.21.15.159:0/3465248275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f87236d240 msgr2=0x55f8723e6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f87236d240 0x55f8723e6640 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b440 tx=0x7f17a4005b90 comp rx=0 tx=0).stop 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 -- 172.21.15.159:0/3465248275 shutdown_connections 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f8723e8540 0x55f8723ea930 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f87236d240 0x55f8723e6640 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f872362980 0x55f872371cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 --2- 172.21.15.159:0/3465248275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f872362060 0x55f872371770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f178f7fe640 0 client.15891 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:06.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 -- 172.21.15.159:0/3465248275 >> 172.21.15.159:0/3465248275 conn(0x55f87235e5f0 msgr2=0x55f87236a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:06.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 -- 172.21.15.159:0/3465248275 shutdown_connections 2024-09-19T06:49:06.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 1 -- 172.21.15.159:0/3465248275 wait complete. 2024-09-19T06:49:06.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.185+0000 7f17b8924740 20 client.15891 trim_cache size 0 max 16384 2024-09-19T06:49:06.188 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:49:06.188 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 20, 2024-09-19T06:49:06.188 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:49:06.188 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 12, 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "8b63d2f0": { 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 12, 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 140.3, 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:49:06.189 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:49:06.190 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:49:06.190 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:49:06.190 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:49:06.190 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:49:06.190 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:49:06.190 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:49:06.190 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:49:06.190 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:49:06.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 -- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f17980a33b0 msgr2=0x7f17980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f17980a33b0 0x7f17980a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17a80bcf40 tx=0x7f17a8087d90 comp rx=0 tx=0).stop 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 -- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 msgr2=0x7f17b01014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 0x7f17b01014b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009ca0 tx=0x7f17a802f420 comp rx=0 tx=0).stop 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 -- 172.21.15.159:0/1887896229 shutdown_connections 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f17980a33b0 0x7f17980a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b0108300 0x7f17b01014b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17b0103780 0x7f17b0100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 --2- 172.21.15.159:0/1887896229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17b0102dd0 0x7f17b0100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 -- 172.21.15.159:0/1887896229 >> 172.21.15.159:0/1887896229 conn(0x7f17b00fc7d0 msgr2=0x7f17b01063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 -- 172.21.15.159:0/1887896229 shutdown_connections 2024-09-19T06:49:06.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:06.186+0000 7f17b654b640 1 -- 172.21.15.159:0/1887896229 wait complete. 2024-09-19T06:49:06.880 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8b63d2f0', total seconds elapsed: 23.5 2024-09-19T06:49:06.952 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:06 smithi159 ceph-mon[30935]: pgmap v66: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 72 KiB/s wr, 97 op/s 2024-09-19T06:49:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:06 smithi203 ceph-mon[35473]: pgmap v66: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 72 KiB/s wr, 97 op/s 2024-09-19T06:49:07.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:06 smithi189 ceph-mon[34880]: pgmap v66: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 72 KiB/s wr, 97 op/s 2024-09-19T06:49:09.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:08 smithi203 ceph-mon[35473]: pgmap v67: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 65 KiB/s wr, 91 op/s 2024-09-19T06:49:09.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:08 smithi189 ceph-mon[34880]: pgmap v67: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 65 KiB/s wr, 91 op/s 2024-09-19T06:49:09.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:08 smithi159 ceph-mon[30935]: pgmap v67: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 65 KiB/s wr, 91 op/s 2024-09-19T06:49:10.245 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 -- 172.21.15.159:0/2884018270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11681007f0 msgr2=0x7f1168100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2884018270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11681007f0 0x7f1168100c50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1154009930 tx=0x7f115402a420 comp rx=0 tx=0).stop 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 -- 172.21.15.159:0/2884018270 shutdown_connections 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2884018270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1168101190 0x7f116810d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2884018270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11681007f0 0x7f1168100c50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2884018270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1168106800 0x7f1168106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 -- 172.21.15.159:0/2884018270 >> 172.21.15.159:0/2884018270 conn(0x7f11680fc4f0 msgr2=0x7f11680fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 -- 172.21.15.159:0/2884018270 shutdown_connections 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 -- 172.21.15.159:0/2884018270 wait complete. 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.242+0000 7f116dd9f640 1 Processor -- start 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116dd9f640 1 -- start start 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116dd9f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11681007f0 0x7f1168198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116dd9f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1168101190 0x7f11681987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116dd9f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1168106800 0x7f116819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116dd9f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1168110c40 con 0x7f1168106800 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116dd9f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1168110ac0 con 0x7f11681007f0 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116dd9f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1168110dc0 con 0x7f1168101190 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116d59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1168106800 0x7f116819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116d59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1168106800 0x7f116819cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47680/0 (socket says 172.21.15.159:47680) 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116d59e640 1 -- 172.21.15.159:0/2874200517 learned_addr learned my addr 172.21.15.159:0/2874200517 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f1167fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1168101190 0x7f11681987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116cd9d640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11681007f0 0x7f1168198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116d59e640 1 -- 172.21.15.159:0/2874200517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1168101190 msgr2=0x7f11681987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116d59e640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1168101190 0x7f11681987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116d59e640 1 -- 172.21.15.159:0/2874200517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11681007f0 msgr2=0x7f1168198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116d59e640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11681007f0 0x7f1168198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116d59e640 1 -- 172.21.15.159:0/2874200517 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116819d250 con 0x7f1168106800 2024-09-19T06:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116cd9d640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11681007f0 0x7f1168198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.243+0000 7f116d59e640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1168106800 0x7f116819cb20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f116000eb10 tx=0x7f116000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.244+0000 7f1165ffb640 1 -- 172.21.15.159:0/2874200517 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160004b20 con 0x7f1168106800 2024-09-19T06:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.244+0000 7f116dd9f640 1 -- 172.21.15.159:0/2874200517 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116819d540 con 0x7f1168106800 2024-09-19T06:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.244+0000 7f1165ffb640 1 -- 172.21.15.159:0/2874200517 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1160004cc0 con 0x7f1168106800 2024-09-19T06:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.244+0000 7f1165ffb640 1 -- 172.21.15.159:0/2874200517 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160010760 con 0x7f1168106800 2024-09-19T06:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.244+0000 7f116dd9f640 1 -- 172.21.15.159:0/2874200517 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11681a4dd0 con 0x7f1168106800 2024-09-19T06:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.246+0000 7f1165ffb640 1 -- 172.21.15.159:0/2874200517 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1160005020 con 0x7f1168106800 2024-09-19T06:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.246+0000 7f1171e73740 1 Processor -- start 2024-09-19T06:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1171e73740 1 -- start start 2024-09-19T06:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1171e73740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1171e73740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1171e73740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f6f290 0x557c29f71680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1171e73740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557c29ec42f0 con 0x557c29f640d0 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1171e73740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c29e6c270 con 0x557c29f6f290 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1171e73740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557c29ec02b0 con 0x557c29f649f0 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1165ffb640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f11580a33b0 0x7f11580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1167fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116cd9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116cd9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:59142/0 (socket says 172.21.15.159:59142) 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116cd9d640 1 -- 172.21.15.159:0/3583488829 learned_addr learned my addr 172.21.15.159:0/3583488829 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116d59e640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f11580a33b0 0x7f11580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1165ffb640 1 -- 172.21.15.159:0/2874200517 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f11600d03b0 con 0x7f1168106800 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1167fff640 1 --2- 172.21.15.159:0/3583488829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f6f290 0x557c29f71680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116cd9d640 1 -- 172.21.15.159:0/3583488829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f6f290 msgr2=0x557c29f71680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116cd9d640 1 --2- 172.21.15.159:0/3583488829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f6f290 0x557c29f71680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116cd9d640 1 -- 172.21.15.159:0/3583488829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 msgr2=0x557c29f644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116cd9d640 1 --2- 172.21.15.159:0/3583488829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116cd9d640 1 -- 172.21.15.159:0/3583488829 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c29e6b340 con 0x557c29f649f0 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f1167fff640 1 --2- 172.21.15.159:0/3583488829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f6f290 0x557c29f71680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116d59e640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f11580a33b0 0x7f11580a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11600ce0d0 tx=0x7f116006e3e0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.247+0000 7f116cd9d640 1 --2- 172.21.15.159:0/3583488829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6ed50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f115c009cd0 tx=0x7f115c0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f00782b93a256b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1152ffd640 1 -- 172.21.15.159:0/3583488829 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c012450 con 0x557c29f649f0 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1152ffd640 1 -- 172.21.15.159:0/3583488829 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115c012ad0 con 0x557c29f649f0 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1152ffd640 1 -- 172.21.15.159:0/3583488829 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c00fcc0 con 0x557c29f649f0 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1171e73740 1 -- 172.21.15.159:0/3583488829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 msgr2=0x557c29f6ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1171e73740 1 --2- 172.21.15.159:0/3583488829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6ed50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f115c009cd0 tx=0x7f115c0117b0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1171e73740 1 -- 172.21.15.159:0/3583488829 shutdown_connections 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1171e73740 1 --2- 172.21.15.159:0/3583488829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f6f290 0x557c29f71680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1171e73740 1 --2- 172.21.15.159:0/3583488829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6ed50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1171e73740 1 --2- 172.21.15.159:0/3583488829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1171e73740 1 -- 172.21.15.159:0/3583488829 >> 172.21.15.159:0/3583488829 conn(0x557c29f60640 msgr2=0x557c29f60a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1171e73740 1 -- 172.21.15.159:0/3583488829 shutdown_connections 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.248+0000 7f1171e73740 1 -- 172.21.15.159:0/3583488829 wait complete. 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1171e73740 1 -- start start 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1171e73740 1 Processor -- start 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1171e73740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f640d0 0x557c29f6c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1171e73740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1171e73740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f6cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1171e73740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557c29f71e60 con 0x557c29f6f290 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1171e73740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c29e4d290 con 0x557c29f640d0 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1171e73740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557c29f71fe0 con 0x557c29f649f0 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1171e73740 10 client.0 _ll_register_callbacks cb 0x557c29e7e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f1167fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f6cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f116cd9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f116cd9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:59156/0 (socket says 172.21.15.159:59156) 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.249+0000 7f116cd9d640 1 -- 172.21.15.159:0/1996322434 learned_addr learned my addr 172.21.15.159:0/1996322434 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f1167fff640 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f640d0 0x557c29f6c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f116cd9d640 1 -- 172.21.15.159:0/1996322434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f640d0 msgr2=0x557c29f6c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f116cd9d640 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f640d0 0x557c29f6c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f116cd9d640 1 -- 172.21.15.159:0/1996322434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 msgr2=0x557c29f6cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f116cd9d640 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f6cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f116cd9d640 1 -- 172.21.15.159:0/1996322434 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c29bd7210 con 0x557c29f649f0 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f116cd9d640 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6c620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f115c00f8e0 tx=0x7f115c00ffb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6606046291fd5cde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f1147fff640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f1147fff640 1 -- 172.21.15.159:0/1996322434 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c027020 con 0x557c29f649f0 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f1147fff640 1 -- 172.21.15.159:0/1996322434 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f115c004240 con 0x557c29f649f0 2024-09-19T06:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f1171e73740 1 -- 172.21.15.159:0/1996322434 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f115c012ad0 con 0x557c29f649f0 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f1147fff640 1 -- 172.21.15.159:0/1996322434 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f115c032050 con 0x557c29f649f0 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f1171e73740 10 client.25351 fetch_fsmap learned FSMap version 20 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f1171e73740 1 -- 172.21.15.159:0/1996322434 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557c29ca3620 con 0x557c29f649f0 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.250+0000 7f1147fff640 1 -- 172.21.15.159:0/1996322434 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115c012ad0 con 0x557c29f649f0 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1147fff640 1 -- 172.21.15.159:0/1996322434 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f115c005420 con 0x557c29f649f0 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1171e73740 10 client.25351 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1171e73740 10 client.25351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1171e73740 20 client.25351 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1171e73740 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557c29f7f000 0x557c29f813f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1171e73740 4 client.25351 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1171e73740 1 -- 172.21.15.159:0/1996322434 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c29ed1a20 con 0x557c29f7f000 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1167fff640 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557c29f7f000 0x557c29f813f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1167fff640 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557c29f7f000 0x557c29f813f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1947e5f81976bd45 server_cookie=560986debec67850 in_seq=0 out_seq=0 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.251+0000 7f1147fff640 10 client.25351 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.252+0000 7f1147fff640 1 -- 172.21.15.159:0/1996322434 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c29ed1a20 con 0x557c29f7f000 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.252+0000 7f1147fff640 10 client.25351 handle_command_reply: tid=0 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.252+0000 7f1171e73740 1 client.25351 shutdown 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.252+0000 7f1171e73740 1 -- 172.21.15.159:0/1996322434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 msgr2=0x557c29f6c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.252+0000 7f1171e73740 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6c620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f115c00f8e0 tx=0x7f115c00ffb0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1171e73740 1 -- 172.21.15.159:0/1996322434 shutdown_connections 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1171e73740 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557c29f7f000 0x557c29f813f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1171e73740 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f6cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1171e73740 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f649f0 0x557c29f6c620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1147fff640 0 client.25351 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1171e73740 1 --2- 172.21.15.159:0/1996322434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f640d0 0x557c29f6c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1171e73740 1 -- 172.21.15.159:0/1996322434 >> 172.21.15.159:0/1996322434 conn(0x557c29f60640 msgr2=0x557c29f663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1171e73740 1 -- 172.21.15.159:0/1996322434 shutdown_connections 2024-09-19T06:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1171e73740 1 -- 172.21.15.159:0/1996322434 wait complete. 2024-09-19T06:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.253+0000 7f1171e73740 20 client.25351 trim_cache size 0 max 16384 2024-09-19T06:49:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.271+0000 7f1171e73740 1 Processor -- start 2024-09-19T06:49:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.271+0000 7f1171e73740 1 -- start start 2024-09-19T06:49:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1171e73740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f640d0 0x557c29f6e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1171e73740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f649f0 0x557c29f86b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1171e73740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f87050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1171e73740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f11681a9540 con 0x557c29f6f290 2024-09-19T06:49:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1171e73740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11681abdc0 con 0x557c29f649f0 2024-09-19T06:49:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1171e73740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11681a9bb0 con 0x557c29f640d0 2024-09-19T06:49:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f87050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f87050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47706/0 (socket says 172.21.15.159:47706) 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 -- 172.21.15.159:0/3609763221 learned_addr learned my addr 172.21.15.159:0/3609763221 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 --2- 172.21.15.159:0/3609763221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f640d0 0x557c29f6e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 -- 172.21.15.159:0/3609763221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f640d0 msgr2=0x557c29f6e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 --2- 172.21.15.159:0/3609763221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f640d0 0x557c29f6e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 -- 172.21.15.159:0/3609763221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f649f0 msgr2=0x557c29f86b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f116cd9d640 1 --2- 172.21.15.159:0/3609763221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f649f0 0x557c29f86b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 --2- 172.21.15.159:0/3609763221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f649f0 0x557c29f86b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 -- 172.21.15.159:0/3609763221 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c29f71d40 con 0x557c29f6f290 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f1167fff640 1 --2- 172.21.15.159:0/3609763221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f87050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1154009900 tx=0x7f11540058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a817a5dbb0b7fd8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f11527fc640 1 -- 172.21.15.159:0/3609763221 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154051040 con 0x557c29f6f290 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f11527fc640 1 -- 172.21.15.159:0/3609763221 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115404d780 con 0x557c29f6f290 2024-09-19T06:49:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.272+0000 7f11527fc640 1 -- 172.21.15.159:0/3609763221 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154035040 con 0x557c29f6f290 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 -- 172.21.15.159:0/3609763221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 msgr2=0x557c29f87050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 --2- 172.21.15.159:0/3609763221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f87050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1154009900 tx=0x7f11540058d0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 -- 172.21.15.159:0/3609763221 shutdown_connections 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 --2- 172.21.15.159:0/3609763221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f6f290 0x557c29f87050 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 --2- 172.21.15.159:0/3609763221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f649f0 0x557c29f86b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 --2- 172.21.15.159:0/3609763221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f640d0 0x557c29f6e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 -- 172.21.15.159:0/3609763221 >> 172.21.15.159:0/3609763221 conn(0x557c29f60640 msgr2=0x557c29f6d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 -- 172.21.15.159:0/3609763221 shutdown_connections 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 -- 172.21.15.159:0/3609763221 wait complete. 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 -- start start 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.273+0000 7f1171e73740 1 Processor -- start 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1171e73740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f77280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1171e73740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f649f0 0x557c29f777c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1171e73740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f6f290 0x557c29f72230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1171e73740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f11681aa280 con 0x557c29f640d0 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1171e73740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11681ab6f0 con 0x557c29f649f0 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1171e73740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11681aa950 con 0x557c29f6f290 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1171e73740 10 client.0 _ll_register_callbacks cb 0x7f115c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f77280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f77280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47714/0 (socket says 172.21.15.159:47714) 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 -- 172.21.15.159:0/301238889 learned_addr learned my addr 172.21.15.159:0/301238889 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f6f290 0x557c29f72230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 -- 172.21.15.159:0/301238889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f6f290 msgr2=0x557c29f72230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f6f290 0x557c29f72230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 -- 172.21.15.159:0/301238889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f649f0 msgr2=0x557c29f777c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f649f0 0x557c29f777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 -- 172.21.15.159:0/301238889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c29f72770 con 0x557c29f640d0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1167fff640 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f77280 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1154006010 tx=0x7f11540050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727fc25f7966cbcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1147fff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1147fff640 1 -- 172.21.15.159:0/301238889 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154035070 con 0x557c29f640d0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1147fff640 1 -- 172.21.15.159:0/301238889 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f1154004110 con 0x557c29f640d0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.274+0000 7f1171e73740 1 -- 172.21.15.159:0/301238889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f115404d780 con 0x557c29f640d0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1147fff640 1 -- 172.21.15.159:0/301238889 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1154004310 con 0x557c29f640d0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1171e73740 10 client.15909 fetch_fsmap learned FSMap version 20 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1171e73740 1 -- 172.21.15.159:0/301238889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557c29fea2b0 con 0x557c29f640d0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1147fff640 1 -- 172.21.15.159:0/301238889 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115404d780 con 0x557c29f640d0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1147fff640 1 -- 172.21.15.159:0/301238889 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1154004c50 con 0x557c29f640d0 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1171e73740 10 client.15909 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1171e73740 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1171e73740 20 client.15909 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1171e73740 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557c29fea900 0x557c29fecd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1171e73740 4 client.15909 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:49:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f1171e73740 1 -- 172.21.15.159:0/301238889 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557c29ecbd70 con 0x557c29fea900 2024-09-19T06:49:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.275+0000 7f116cd9d640 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557c29fea900 0x557c29fecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.276+0000 7f116cd9d640 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557c29fea900 0x557c29fecd20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7577f42056cfc74 server_cookie=208c1bae9aaaf0a0 in_seq=0 out_seq=0 2024-09-19T06:49:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:10.276+0000 7f1147fff640 10 client.15909 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:10 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:49:10.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:10 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:49:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:10 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:49:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1147fff640 1 -- 172.21.15.159:0/301238889 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557c29ecbd70 con 0x557c29fea900 2024-09-19T06:49:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1147fff640 10 client.15909 handle_command_reply: tid=0 2024-09-19T06:49:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1171e73740 1 client.15909 shutdown 2024-09-19T06:49:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1171e73740 1 -- 172.21.15.159:0/301238889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 msgr2=0x557c29f77280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1171e73740 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f77280 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1154006010 tx=0x7f11540050c0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1171e73740 1 -- 172.21.15.159:0/301238889 shutdown_connections 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1171e73740 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557c29fea900 0x557c29fecd20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1171e73740 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c29f6f290 0x557c29f72230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1171e73740 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c29f649f0 0x557c29f777c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1171e73740 1 --2- 172.21.15.159:0/301238889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557c29f640d0 0x557c29f77280 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1147fff640 0 client.15909 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.190+0000 7f1171e73740 1 -- 172.21.15.159:0/301238889 >> 172.21.15.159:0/301238889 conn(0x557c29f60640 msgr2=0x557c29f5b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f1171e73740 1 -- 172.21.15.159:0/301238889 shutdown_connections 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f1171e73740 1 -- 172.21.15.159:0/301238889 wait complete. 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f1171e73740 20 client.15909 trim_cache size 0 max 16384 2024-09-19T06:49:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:49:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:49:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:49:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:49:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 -- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f11580a33b0 msgr2=0x7f11580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f11580a33b0 0x7f11580a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11600ce0d0 tx=0x7f116006e3e0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 -- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1168106800 msgr2=0x7f116819cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1168106800 0x7f116819cb20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f116000eb10 tx=0x7f116000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 -- 172.21.15.159:0/2874200517 shutdown_connections 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f11580a33b0 0x7f11580a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1168106800 0x7f116819cb20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1168101190 0x7f11681987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 --2- 172.21.15.159:0/2874200517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11681007f0 0x7f1168198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.191+0000 7f116dd9f640 1 -- 172.21.15.159:0/2874200517 >> 172.21.15.159:0/2874200517 conn(0x7f11680fc4f0 msgr2=0x7f116806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.192+0000 7f116dd9f640 1 -- 172.21.15.159:0/2874200517 shutdown_connections 2024-09-19T06:49:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:11.192+0000 7f116dd9f640 1 -- 172.21.15.159:0/2874200517 wait complete. 2024-09-19T06:49:11.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: pgmap v68: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 65 KiB/s wr, 91 op/s 2024-09-19T06:49:11.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:49:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:49:11.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: pgmap v68: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 65 KiB/s wr, 91 op/s 2024-09-19T06:49:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:49:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:49:11.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: pgmap v68: 97 pgs: 97 active+clean; 17 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 65 KiB/s wr, 91 op/s 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:49:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:49:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:12 smithi203 ceph-mon[35473]: pgmap v69: 97 pgs: 97 active+clean; 22 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1015 KiB/s wr, 436 op/s 2024-09-19T06:49:13.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:12 smithi189 ceph-mon[34880]: pgmap v69: 97 pgs: 97 active+clean; 22 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1015 KiB/s wr, 436 op/s 2024-09-19T06:49:13.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:12 smithi159 ceph-mon[30935]: pgmap v69: 97 pgs: 97 active+clean; 22 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1015 KiB/s wr, 436 op/s 2024-09-19T06:49:13.870 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[65115]: *** Caught signal (Segmentation fault) ** 2024-09-19T06:49:13.870 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[65115]: in thread 7fbdf0f4f640 thread_name:MR_Finisher 2024-09-19T06:49:13.870 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:13 smithi189 podman[68371]: 2024-09-19 06:49:13.564745834 +0000 UTC m=+0.020694080 container died 1930efd25bf7095010e1c5758f50722fcb53c094f92378992a210708524162f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T06:49:14.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:14 smithi189 podman[68371]: 2024-09-19 06:49:14.296100075 +0000 UTC m=+0.752048322 container remove 1930efd25bf7095010e1c5758f50722fcb53c094f92378992a210708524162f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T06:49:14.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:14 smithi189 systemd[1]: ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.b.service: Main process exited, code=exited, status=139/n/a 2024-09-19T06:49:14.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:14 smithi189 systemd[1]: ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-09-19T06:49:14.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:14 smithi189 systemd[1]: ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.b.service: Consumed 1.529s CPU time. 2024-09-19T06:49:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:14 smithi203 ceph-mon[35473]: pgmap v70: 97 pgs: 97 active+clean; 22 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 965 KiB/s wr, 348 op/s 2024-09-19T06:49:15.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:14 smithi189 ceph-mon[34880]: pgmap v70: 97 pgs: 97 active+clean; 22 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 965 KiB/s wr, 348 op/s 2024-09-19T06:49:15.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:14 smithi159 ceph-mon[30935]: pgmap v70: 97 pgs: 97 active+clean; 22 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 965 KiB/s wr, 348 op/s 2024-09-19T06:49:16.416 INFO:tasks.workunit.client.0.smithi159.stderr:Updating files: 7% (322/4351) Updating files: 8% (349/4351) Updating files: 9% (392/4351) Updating files: 10% (436/4351) Updating files: 11% (479/4351) Updating files: 11% (493/4351) Updating files: 12% (523/4351) Updating files: 13% (566/4351) Updating files: 14% (610/4351) Updating files: 15% (653/4351) Updating files: 16% (697/4351) Updating files: 17% (740/4351) Updating files: 18% (784/4351) Updating files: 18% (797/4351) Updating files: 19% (827/4351) Updating files: 20% (871/4351) Updating files: 21% (914/4351) Updating files: 22% (958/4351) Updating files: 23% (1001/4351) Updating files: 24% (1045/4351) Updating files: 25% (1088/4351) Updating files: 26% (1132/4351) Updating files: 27% (1175/4351) Updating files: 28% (1219/4351) Updating files: 29% (1262/4351) Updating files: 30% (1306/4351) Updating files: 31% (1349/4351) Updating files: 32% (1393/4351) Updating files: 33% (1436/4351) Updating files: 34% (1480/4351) Updating files: 35% (1523/4351) Updating files: 36% (1567/4351) Updating files: 36% (1581/4351) Updating files: 37% (1610/4351) Updating files: 38% (1654/4351) Updating files: 39% (1697/4351) Updating files: 40% (1741/4351) Updating files: 41% (1784/4351) Updating files: 42% (1828/4351) Updating files: 43% (1871/4351) Updating files: 44% (1915/4351) Updating files: 45% (1958/4351) Updating files: 46% (2002/4351) Updating files: 47% (2045/4351) Updating files: 48% (2089/4351) Updating files: 49% (2132/4351) Updating files: 50% (2176/4351) Updating files: 51% (2220/4351) Updating files: 52% (2263/4351) Updating files: 52% (2265/4351) Updating files: 53% (2307/4351) Updating files: 54% (2350/4351) Updating files: 55% (2394/4351) Updating files: 56% (2437/4351) Updating files: 57% (2481/4351) Updating files: 58% (2524/4351) Updating files: 59% (2568/4351) Updating files: 60% (2611/4351) Updating files: 61% (2655/4351) Updating files: 62% (2698/4351) Updating files: 63% (2742/4351) Updating files: 64% (2785/4351) Updating files: 64% (2795/4351) Updating files: 64% (2809/4351) Updating files: 65% (2829/4351) Updating files: 66% (2872/4351) Updating files: 67% (2916/4351) Updating files: 68% (2959/4351) Updating files: 69% (3003/4351) Updating files: 70% (3046/4351) Updating files: 71% (3090/4351) Updating files: 72% (3133/4351) Updating files: 73% (3177/4351) Updating files: 74% (3220/4351) Updating files: 75% (3264/4351) Updating files: 75% (3296/4351) Updating files: 76% (3307/4351) Updating files: 77% (3351/4351) Updating files: 78% (3394/4351) Updating files: 79% (3438/4351) Updating files: 80% (3481/4351) Updating files: 81% (3525/4351) Updating files: 82% (3568/4351) Updating files: 83% (3612/4351) Updating files: 84% (3655/4351) Updating files: 85% (3699/4351) Updating files: 86% (3742/4351) Updating files: 87% (3786/4351) Updating files: 88% (3829/4351) Updating files: 89% (3873/4351) Updating files: 90% (3916/4351) Updating files: 91% (3960/4351) Updating files: 92% (4003/4351) Updating files: 92% (4005/4351) Updating files: 93% (4047/4351) Updating files: 94% (4090/4351) Updating files: 95% (4134/4351) Updating files: 96% (4177/4351) Updating files: 97% (4221/4351) Updating files: 98% (4264/4351) Updating files: 99% (4308/4351) Updating files: 100% (4351/4351) Updating files: 100% (4351/4351), done. 2024-09-19T06:49:16.427 INFO:tasks.workunit.client.0.smithi159.stderr:+ cd xfstests-dev 2024-09-19T06:49:16.428 INFO:tasks.workunit.client.0.smithi159.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-09-19T06:49:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:16 smithi203 ceph-mon[35473]: pgmap v71: 97 pgs: 97 active+clean; 26 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 371 op/s 2024-09-19T06:49:17.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:16 smithi189 ceph-mon[34880]: pgmap v71: 97 pgs: 97 active+clean; 26 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 371 op/s 2024-09-19T06:49:17.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:16 smithi159 ceph-mon[30935]: pgmap v71: 97 pgs: 97 active+clean; 26 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 371 op/s 2024-09-19T06:49:19.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:18 smithi203 ceph-mon[35473]: pgmap v72: 97 pgs: 97 active+clean; 26 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 367 op/s 2024-09-19T06:49:19.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:18 smithi189 ceph-mon[34880]: pgmap v72: 97 pgs: 97 active+clean; 26 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 367 op/s 2024-09-19T06:49:19.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:18 smithi159 ceph-mon[30935]: pgmap v72: 97 pgs: 97 active+clean; 26 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 367 op/s 2024-09-19T06:49:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:20 smithi203 ceph-mon[35473]: pgmap v73: 97 pgs: 97 active+clean; 26 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 367 op/s 2024-09-19T06:49:21.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:20 smithi189 ceph-mon[34880]: pgmap v73: 97 pgs: 97 active+clean; 26 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 367 op/s 2024-09-19T06:49:21.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:20 smithi159 ceph-mon[30935]: pgmap v73: 97 pgs: 97 active+clean; 26 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 367 op/s 2024-09-19T06:49:23.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:22 smithi203 ceph-mon[35473]: pgmap v74: 97 pgs: 97 active+clean; 34 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 369 op/s 2024-09-19T06:49:23.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:22 smithi189 ceph-mon[34880]: pgmap v74: 97 pgs: 97 active+clean; 34 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 369 op/s 2024-09-19T06:49:23.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:22 smithi159 ceph-mon[30935]: pgmap v74: 97 pgs: 97 active+clean; 34 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 369 op/s 2024-09-19T06:49:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.356+0000 7f0f72bf1640 1 -- 172.21.15.159:0/1943630657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6c1095d0 msgr2=0x7f0f6c109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.356+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/1943630657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6c1095d0 0x7f0f6c109a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009930 tx=0x7f0f6002a480 comp rx=0 tx=0).stop 2024-09-19T06:49:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.357+0000 7f0f72bf1640 1 -- 172.21.15.159:0/1943630657 shutdown_connections 2024-09-19T06:49:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.357+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/1943630657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6c11b140 0x7f0f6c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.357+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/1943630657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6c1095d0 0x7f0f6c109a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.357+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/1943630657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c1091f0 0x7f0f6c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.357+0000 7f0f72bf1640 1 -- 172.21.15.159:0/1943630657 >> 172.21.15.159:0/1943630657 conn(0x7f0f6c06ce00 msgr2=0x7f0f6c06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.359+0000 7f0f72bf1640 1 -- 172.21.15.159:0/1943630657 shutdown_connections 2024-09-19T06:49:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.360+0000 7f0f72bf1640 1 -- 172.21.15.159:0/1943630657 wait complete. 2024-09-19T06:49:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.361+0000 7f0f72bf1640 1 Processor -- start 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.361+0000 7f0f72bf1640 1 -- start start 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.362+0000 7f0f72bf1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6c1091f0 0x7f0f6c1a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.362+0000 7f0f72bf1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c1095d0 0x7f0f6c1a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.362+0000 7f0f72bf1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6c11b140 0x7f0f6c1ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.362+0000 7f0f72bf1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c120d50 con 0x7f0f6c1095d0 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.362+0000 7f0f72bf1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c120bd0 con 0x7f0f6c1091f0 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.362+0000 7f0f72bf1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c120ed0 con 0x7f0f6c11b140 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.362+0000 7f0f6bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c1095d0 0x7f0f6c1a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.362+0000 7f0f6bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c1095d0 0x7f0f6c1a7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46400/0 (socket says 172.21.15.159:46400) 2024-09-19T06:49:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.362+0000 7f0f6bfff640 1 -- 172.21.15.159:0/2742330564 learned_addr learned my addr 172.21.15.159:0/2742330564 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.363+0000 7f0f6bfff640 1 -- 172.21.15.159:0/2742330564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6c11b140 msgr2=0x7f0f6c1ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.364+0000 7f0f7098d640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6c1091f0 0x7f0f6c1a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.363+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6c11b140 0x7f0f6c1ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.366+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6c11b140 0x7f0f6c1ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.366+0000 7f0f6bfff640 1 -- 172.21.15.159:0/2742330564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6c1091f0 msgr2=0x7f0f6c1a70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.366+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6c1091f0 0x7f0f6c1a70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.366+0000 7f0f6bfff640 1 -- 172.21.15.159:0/2742330564 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c1ac0a0 con 0x7f0f6c1095d0 2024-09-19T06:49:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.367+0000 7f0f7098d640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6c1091f0 0x7f0f6c1a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.367+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6c11b140 0x7f0f6c1ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.367+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c1095d0 0x7f0f6c1a7620 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002a9f0 tx=0x7f0f600055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.368+0000 7f0f69ffb640 1 -- 172.21.15.159:0/2742330564 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60040070 con 0x7f0f6c1095d0 2024-09-19T06:49:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.368+0000 7f0f72bf1640 1 -- 172.21.15.159:0/2742330564 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c1ac330 con 0x7f0f6c1095d0 2024-09-19T06:49:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.368+0000 7f0f72bf1640 1 -- 172.21.15.159:0/2742330564 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c110920 con 0x7f0f6c1095d0 2024-09-19T06:49:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.368+0000 7f0f69ffb640 1 -- 172.21.15.159:0/2742330564 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f60004460 con 0x7f0f6c1095d0 2024-09-19T06:49:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.368+0000 7f0f69ffb640 1 -- 172.21.15.159:0/2742330564 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6002f300 con 0x7f0f6c1095d0 2024-09-19T06:49:24.375 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.373+0000 7f0f75a63740 1 Processor -- start 2024-09-19T06:49:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.375+0000 7f0f69ffb640 1 -- 172.21.15.159:0/2742330564 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0f60043070 con 0x7f0f6c1095d0 2024-09-19T06:49:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.376+0000 7f0f69ffb640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0f540a3600 0x7f0f540a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.376+0000 7f0f69ffb640 1 -- 172.21.15.159:0/2742330564 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f0f600f09d0 con 0x7f0f6c1095d0 2024-09-19T06:49:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.377+0000 7f0f75a63740 1 -- start start 2024-09-19T06:49:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.377+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.377+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.377+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.377+0000 7f0f75a63740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5614ea30c2f0 con 0x5614ea3b2cb0 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.377+0000 7f0f75a63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5614ea2b4270 con 0x5614ea3a8410 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.377+0000 7f0f75a63740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5614ea3082b0 con 0x5614ea3a7af0 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.379+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0f540a3600 0x7f0f540a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.379+0000 7f0f7118e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.379+0000 7f0f7118e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46412/0 (socket says 172.21.15.159:46412) 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.379+0000 7f0f7118e640 1 -- 172.21.15.159:0/2440249233 learned_addr learned my addr 172.21.15.159:0/2440249233 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.379+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/2440249233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.380+0000 7f0f7098d640 1 --2- 172.21.15.159:0/2440249233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.381+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0f540a3600 0x7f0f540a5ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009db0 tx=0x7f0f5c009810 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.381+0000 7f0f7118e640 1 -- 172.21.15.159:0/2440249233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 msgr2=0x5614ea3a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.381+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2440249233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3a7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.381+0000 7f0f7118e640 1 -- 172.21.15.159:0/2440249233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 msgr2=0x5614ea3b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:24.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.381+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2440249233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.381+0000 7f0f7118e640 1 -- 172.21.15.159:0/2440249233 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614ea2b3340 con 0x5614ea3b2cb0 2024-09-19T06:49:24.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.381+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2440249233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b50a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c013fd0 tx=0x7f0f5c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba885778b02f0081 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:24.387 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.385+0000 7f0f52ffd640 1 -- 172.21.15.159:0/2440249233 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00f040 con 0x5614ea3b2cb0 2024-09-19T06:49:24.387 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.385+0000 7f0f52ffd640 1 -- 172.21.15.159:0/2440249233 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5c003b70 con 0x5614ea3b2cb0 2024-09-19T06:49:24.387 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.386+0000 7f0f75a63740 1 -- 172.21.15.159:0/2440249233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 msgr2=0x5614ea3b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:24.387 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.386+0000 7f0f75a63740 1 --2- 172.21.15.159:0/2440249233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b50a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c013fd0 tx=0x7f0f5c01a000 comp rx=0 tx=0).stop 2024-09-19T06:49:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.389+0000 7f0f75a63740 1 -- 172.21.15.159:0/2440249233 shutdown_connections 2024-09-19T06:49:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.389+0000 7f0f75a63740 1 --2- 172.21.15.159:0/2440249233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b50a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.389+0000 7f0f75a63740 1 --2- 172.21.15.159:0/2440249233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.389+0000 7f0f75a63740 1 --2- 172.21.15.159:0/2440249233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3a7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.389+0000 7f0f75a63740 1 -- 172.21.15.159:0/2440249233 >> 172.21.15.159:0/2440249233 conn(0x5614ea3a4060 msgr2=0x5614ea3a4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:24.393 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.390+0000 7f0f75a63740 1 -- 172.21.15.159:0/2440249233 shutdown_connections 2024-09-19T06:49:24.393 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.391+0000 7f0f75a63740 1 -- 172.21.15.159:0/2440249233 wait complete. 2024-09-19T06:49:24.393 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.391+0000 7f0f75a63740 1 -- start start 2024-09-19T06:49:24.393 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.392+0000 7f0f75a63740 1 Processor -- start 2024-09-19T06:49:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.393+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.393+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.393+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.393+0000 7f0f75a63740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5614ea3b58d0 con 0x5614ea3b2cb0 2024-09-19T06:49:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.393+0000 7f0f75a63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5614ea295290 con 0x5614ea3a8410 2024-09-19T06:49:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.393+0000 7f0f75a63740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5614ea3b5a50 con 0x5614ea3a7af0 2024-09-19T06:49:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.393+0000 7f0f75a63740 10 client.0 _ll_register_callbacks cb 0x5614ea2c6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.394+0000 7f0f7098d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.394+0000 7f0f7098d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:48648/0 (socket says 172.21.15.159:48648) 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.394+0000 7f0f7098d640 1 -- 172.21.15.159:0/818394188 learned_addr learned my addr 172.21.15.159:0/818394188 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.396+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.396+0000 7f0f7098d640 1 -- 172.21.15.159:0/818394188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 msgr2=0x5614ea3b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.396+0000 7f0f7098d640 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.396+0000 7f0f7098d640 1 -- 172.21.15.159:0/818394188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 msgr2=0x5614ea3b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.396+0000 7f0f7098d640 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.396+0000 7f0f7098d640 1 -- 172.21.15.159:0/818394188 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614ea01f210 con 0x5614ea3a7af0 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.397+0000 7f0f7098d640 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3afb70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f64011710 tx=0x7f0f64011bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f93eb041a0548ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.397+0000 7f0f4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:49:24.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.397+0000 7f0f4bfff640 1 -- 172.21.15.159:0/818394188 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64003b70 con 0x5614ea3a7af0 2024-09-19T06:49:24.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.397+0000 7f0f4bfff640 1 -- 172.21.15.159:0/818394188 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f0f64003d10 con 0x5614ea3a7af0 2024-09-19T06:49:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.400+0000 7f0f75a63740 1 -- 172.21.15.159:0/818394188 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f5c003b70 con 0x5614ea3a7af0 2024-09-19T06:49:24.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.400+0000 7f0f4bfff640 1 -- 172.21.15.159:0/818394188 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0f6400f940 con 0x5614ea3a7af0 2024-09-19T06:49:24.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.403+0000 7f0f75a63740 10 client.25366 fetch_fsmap learned FSMap version 20 2024-09-19T06:49:24.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.403+0000 7f0f75a63740 1 -- 172.21.15.159:0/818394188 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5614ea0eb620 con 0x5614ea3a7af0 2024-09-19T06:49:24.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.404+0000 7f0f4bfff640 1 -- 172.21.15.159:0/818394188 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5c003b70 con 0x5614ea3a7af0 2024-09-19T06:49:24.406 INFO:tasks.workunit.client.0.smithi159.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr: git switch -c 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr:Or undo this operation with: 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:49:24.407 INFO:tasks.workunit.client.0.smithi159.stderr: git switch - 2024-09-19T06:49:24.408 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:49:24.408 INFO:tasks.workunit.client.0.smithi159.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:49:24.408 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-09-19T06:49:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.405+0000 7f0f4bfff640 1 -- 172.21.15.159:0/818394188 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0f64012450 con 0x5614ea3a7af0 2024-09-19T06:49:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.406+0000 7f0f75a63740 10 client.25366 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:49:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.406+0000 7f0f75a63740 10 client.25366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.406+0000 7f0f75a63740 20 client.25366 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.406+0000 7f0f75a63740 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5614ea3c2db0 0x5614ea3c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.406+0000 7f0f75a63740 4 client.25366 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.406+0000 7f0f75a63740 1 -- 172.21.15.159:0/818394188 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614ea319a20 con 0x5614ea3c2db0 2024-09-19T06:49:24.411 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:49:24.412 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.410+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5614ea3c2db0 0x5614ea3c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.415+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5614ea3c2db0 0x5614ea3c5240 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=185da014f3fb5fb7 server_cookie=2c69aac8e8f0e9f5 in_seq=0 out_seq=0 2024-09-19T06:49:24.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.416+0000 7f0f4bfff640 10 client.25366 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.419+0000 7f0f4bfff640 1 -- 172.21.15.159:0/818394188 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614ea319a20 con 0x5614ea3c2db0 2024-09-19T06:49:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.419+0000 7f0f4bfff640 10 client.25366 handle_command_reply: tid=0 2024-09-19T06:49:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.419+0000 7f0f75a63740 1 client.25366 shutdown 2024-09-19T06:49:24.421 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.420+0000 7f0f75a63740 1 -- 172.21.15.159:0/818394188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 msgr2=0x5614ea3afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:24.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.420+0000 7f0f75a63740 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3afb70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f64011710 tx=0x7f0f64011bd0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.425 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.424+0000 7f0f75a63740 1 -- 172.21.15.159:0/818394188 shutdown_connections 2024-09-19T06:49:24.425 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.424+0000 7f0f75a63740 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5614ea3c2db0 0x5614ea3c5240 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.425 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.424+0000 7f0f75a63740 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.426 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.424+0000 7f0f75a63740 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.426 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.424+0000 7f0f75a63740 1 --2- 172.21.15.159:0/818394188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3afb70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.426 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.424+0000 7f0f75a63740 1 -- 172.21.15.159:0/818394188 >> 172.21.15.159:0/818394188 conn(0x5614ea3a4060 msgr2=0x5614ea3a9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:24.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.427+0000 7f0f4bfff640 0 client.25366 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:24.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.427+0000 7f0f75a63740 1 -- 172.21.15.159:0/818394188 shutdown_connections 2024-09-19T06:49:24.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.430+0000 7f0f75a63740 1 -- 172.21.15.159:0/818394188 wait complete. 2024-09-19T06:49:24.432 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.430+0000 7f0f75a63740 20 client.25366 trim_cache size 0 max 16384 2024-09-19T06:49:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.477+0000 7f0f75a63740 1 Processor -- start 2024-09-19T06:49:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.477+0000 7f0f75a63740 1 -- start start 2024-09-19T06:49:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.477+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3b0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.477+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.477+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.477+0000 7f0f75a63740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5800c7c0 con 0x5614ea3b2cb0 2024-09-19T06:49:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.477+0000 7f0f75a63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5800ef90 con 0x5614ea3a8410 2024-09-19T06:49:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.477+0000 7f0f75a63740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5800cd80 con 0x5614ea3a7af0 2024-09-19T06:49:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f7118e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f7118e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46424/0 (socket says 172.21.15.159:46424) 2024-09-19T06:49:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f7118e640 1 -- 172.21.15.159:0/2904052947 learned_addr learned my addr 172.21.15.159:0/2904052947 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/2904052947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f7118e640 1 -- 172.21.15.159:0/2904052947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 msgr2=0x5614ea3b0420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:49:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2904052947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3b0420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f7118e640 1 -- 172.21.15.159:0/2904052947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 msgr2=0x5614ea3cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2904052947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f7118e640 1 -- 172.21.15.159:0/2904052947 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614ea3a3e90 con 0x5614ea3b2cb0 2024-09-19T06:49:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.478+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/2904052947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.479+0000 7f0f7118e640 1 --2- 172.21.15.159:0/2904052947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3cb090 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c013b80 tx=0x7f0f5c006b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ca9c020466da14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.479+0000 7f0f527fc640 1 -- 172.21.15.159:0/2904052947 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c02e070 con 0x5614ea3b2cb0 2024-09-19T06:49:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.479+0000 7f0f527fc640 1 -- 172.21.15.159:0/2904052947 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5c026070 con 0x5614ea3b2cb0 2024-09-19T06:49:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.479+0000 7f0f527fc640 1 -- 172.21.15.159:0/2904052947 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0038f0 con 0x5614ea3b2cb0 2024-09-19T06:49:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.481+0000 7f0f75a63740 1 -- 172.21.15.159:0/2904052947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 msgr2=0x5614ea3cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.481+0000 7f0f75a63740 1 --2- 172.21.15.159:0/2904052947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3cb090 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c013b80 tx=0x7f0f5c006b50 comp rx=0 tx=0).stop 2024-09-19T06:49:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.481+0000 7f0f75a63740 1 -- 172.21.15.159:0/2904052947 shutdown_connections 2024-09-19T06:49:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.481+0000 7f0f75a63740 1 --2- 172.21.15.159:0/2904052947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3cb090 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.481+0000 7f0f75a63740 1 --2- 172.21.15.159:0/2904052947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a8410 0x5614ea3cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.482+0000 7f0f75a63740 1 --2- 172.21.15.159:0/2904052947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a7af0 0x5614ea3b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.482+0000 7f0f75a63740 1 -- 172.21.15.159:0/2904052947 >> 172.21.15.159:0/2904052947 conn(0x5614ea3a4060 msgr2=0x5614ea3b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.484+0000 7f0f75a63740 1 -- 172.21.15.159:0/2904052947 shutdown_connections 2024-09-19T06:49:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.484+0000 7f0f75a63740 1 -- 172.21.15.159:0/2904052947 wait complete. 2024-09-19T06:49:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.485+0000 7f0f75a63740 1 -- start start 2024-09-19T06:49:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.485+0000 7f0f75a63740 1 Processor -- start 2024-09-19T06:49:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a7af0 0x5614ea3bb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a8410 0x5614ea3b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f75a63740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f75a63740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5800d450 con 0x5614ea3b2cb0 2024-09-19T06:49:24.488 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f75a63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5800e8c0 con 0x5614ea3a7af0 2024-09-19T06:49:24.488 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f75a63740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5800db20 con 0x5614ea3a8410 2024-09-19T06:49:24.488 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f7118e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.488 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f7118e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46436/0 (socket says 172.21.15.159:46436) 2024-09-19T06:49:24.488 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f75a63740 10 client.0 _ll_register_callbacks cb 0x7f0f64009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:24.488 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.486+0000 7f0f7118e640 1 -- 172.21.15.159:0/24522269 learned_addr learned my addr 172.21.15.159:0/24522269 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.488+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a8410 0x5614ea3b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.492+0000 7f0f7098d640 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a7af0 0x5614ea3bb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.494+0000 7f0f6bfff640 1 -- 172.21.15.159:0/24522269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a7af0 msgr2=0x5614ea3bb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.494+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a7af0 0x5614ea3bb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.494+0000 7f0f6bfff640 1 -- 172.21.15.159:0/24522269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 msgr2=0x5614ea3b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.494+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.494+0000 7f0f6bfff640 1 -- 172.21.15.159:0/24522269 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614ea3b7600 con 0x5614ea3a8410 2024-09-19T06:49:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.498+0000 7f0f6bfff640 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a8410 0x5614ea3b6890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f600ee0f0 tx=0x7f0f60009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44b97c54c86b5b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.499+0000 7f0f4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:49:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.502+0000 7f0f4bfff640 1 -- 172.21.15.159:0/24522269 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6004a040 con 0x5614ea3a8410 2024-09-19T06:49:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.502+0000 7f0f4bfff640 1 -- 172.21.15.159:0/24522269 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8570+0+0 (secure 0 0 0) 0x7f0f600b92f0 con 0x5614ea3a8410 2024-09-19T06:49:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.502+0000 7f0f75a63740 1 -- 172.21.15.159:0/24522269 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f5c026070 con 0x5614ea3a8410 2024-09-19T06:49:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.507+0000 7f0f4bfff640 1 -- 172.21.15.159:0/24522269 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0f600c1030 con 0x5614ea3a8410 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.507+0000 7f0f75a63740 10 client.25369 fetch_fsmap learned FSMap version 20 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.507+0000 7f0f75a63740 1 -- 172.21.15.159:0/24522269 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5614ea42db60 con 0x5614ea3a8410 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.510+0000 7f0f4bfff640 1 -- 172.21.15.159:0/24522269 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5c026070 con 0x5614ea3a8410 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.510+0000 7f0f4bfff640 1 -- 172.21.15.159:0/24522269 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0f600c5b40 con 0x5614ea3a8410 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.510+0000 7f0f75a63740 10 client.25369 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.510+0000 7f0f75a63740 10 client.25369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.510+0000 7f0f75a63740 20 client.25369 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.510+0000 7f0f75a63740 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5614ea42e0b0 0x5614ea4304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.510+0000 7f0f75a63740 4 client.25369 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.510+0000 7f0f75a63740 1 -- 172.21.15.159:0/24522269 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5614ea313d70 con 0x5614ea42e0b0 2024-09-19T06:49:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.512+0000 7f0f7098d640 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5614ea42e0b0 0x5614ea4304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.533+0000 7f0f7098d640 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5614ea42e0b0 0x5614ea4304d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3404a303e8c2e3d0 server_cookie=dc4678563bf67ef1 in_seq=0 out_seq=0 2024-09-19T06:49:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:24.534+0000 7f0f4bfff640 10 client.25369 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:24.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:24 smithi159 ceph-mon[30935]: pgmap v75: 97 pgs: 97 active+clean; 34 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2024-09-19T06:49:24.906 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:24.929 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:24 smithi189 ceph-mon[34880]: pgmap v75: 97 pgs: 97 active+clean; 34 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2024-09-19T06:49:24.929 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:24 smithi189 systemd[1]: ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 1. 2024-09-19T06:49:24.929 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:24 smithi189 systemd[1]: Stopped Ceph mds.b for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:49:24.929 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:24 smithi189 systemd[1]: ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.b.service: Consumed 1.529s CPU time. 2024-09-19T06:49:24.929 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:24 smithi189 systemd[1]: Starting Ceph mds.b for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:49:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:24 smithi203 ceph-mon[35473]: pgmap v75: 97 pgs: 97 active+clean; 34 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2024-09-19T06:49:25.285 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:24 smithi189 podman[68466]: 2024-09-19 06:49:24.83361636 +0000 UTC m=+0.023103244 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:49:25.285 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:25 smithi189 podman[68466]: 2024-09-19 06:49:25.022731641 +0000 UTC m=+0.212218565 container create 01dd6900350242335a3cd0af9a763fb1e4b2b14dd6faa70a6117321eb4a5f536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T06:49:25.529 INFO:tasks.workunit.client.0.smithi159.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-09-19T06:49:25.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:25 smithi189 podman[68466]: 2024-09-19 06:49:25.285080665 +0000 UTC m=+0.474567536 container init 01dd6900350242335a3cd0af9a763fb1e4b2b14dd6faa70a6117321eb4a5f536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T06:49:25.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:25 smithi189 podman[68466]: 2024-09-19 06:49:25.299707536 +0000 UTC m=+0.489194400 container start 01dd6900350242335a3cd0af9a763fb1e4b2b14dd6faa70a6117321eb4a5f536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:49:25.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[68480]: starting mds.b at 2024-09-19T06:49:25.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:25 smithi189 bash[68466]: 01dd6900350242335a3cd0af9a763fb1e4b2b14dd6faa70a6117321eb4a5f536 2024-09-19T06:49:25.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:25 smithi189 systemd[1]: Started Ceph mds.b for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:49:25.816 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:25 smithi159 ceph-mon[30935]: daemon mds.b restarted 2024-09-19T06:49:25.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.902+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/1417745199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 msgr2=0x7f9c481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.902+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/1417745199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 0x7f9c481029b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009900 tx=0x7f9c3002a480 comp rx=0 tx=0).stop 2024-09-19T06:49:25.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.902+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/1417745199 shutdown_connections 2024-09-19T06:49:25.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.902+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/1417745199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c48102ef0 0x7f9c4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.902+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/1417745199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 0x7f9c481029b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.902+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/1417745199 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c48100e20 0x7f9c48101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.902+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/1417745199 >> 172.21.15.159:0/1417745199 conn(0x7f9c480fc7d0 msgr2=0x7f9c480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.902+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/1417745199 shutdown_connections 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.902+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/1417745199 wait complete. 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4e3ad640 1 Processor -- start 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4e3ad640 1 -- start start 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4e3ad640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c48100e20 0x7f9c48199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4e3ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 0x7f9c481998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4e3ad640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c48102ef0 0x7f9c481a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4e3ad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9c48110fd0 con 0x7f9c48102570 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4e3ad640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c48110e50 con 0x7f9c48102ef0 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4e3ad640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c48111150 con 0x7f9c48100e20 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c3ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 0x7f9c481998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c48100e20 0x7f9c48199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c3ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 0x7f9c481998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46454/0 (socket says 172.21.15.159:46454) 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c3ffff640 1 -- 172.21.15.159:0/172676162 learned_addr learned my addr 172.21.15.159:0/172676162 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:25.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c48102ef0 0x7f9c481a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c3ffff640 1 -- 172.21.15.159:0/172676162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c48100e20 msgr2=0x7f9c48199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c48100e20 0x7f9c48199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c3ffff640 1 -- 172.21.15.159:0/172676162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c48102ef0 msgr2=0x7f9c481a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c48102ef0 0x7f9c481a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c3ffff640 1 -- 172.21.15.159:0/172676162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c481a4920 con 0x7f9c48102570 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c47fff640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c48100e20 0x7f9c48199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.903+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c48102ef0 0x7f9c481a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.904+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 0x7f9c481998a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9c3002aa70 tx=0x7f9c30003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.904+0000 7f9c45ffb640 1 -- 172.21.15.159:0/172676162 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3003f070 con 0x7f9c48102570 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.904+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/172676162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c481a4af0 con 0x7f9c48102570 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.904+0000 7f9c45ffb640 1 -- 172.21.15.159:0/172676162 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c30031c30 con 0x7f9c48102570 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.904+0000 7f9c45ffb640 1 -- 172.21.15.159:0/172676162 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30035030 con 0x7f9c48102570 2024-09-19T06:49:25.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.904+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/172676162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c481a4f40 con 0x7f9c48102570 2024-09-19T06:49:25.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.906+0000 7f9c45ffb640 1 -- 172.21.15.159:0/172676162 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9c30042070 con 0x7f9c48102570 2024-09-19T06:49:25.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.906+0000 7f9c50786740 1 Processor -- start 2024-09-19T06:49:25.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.906+0000 7f9c50786740 1 -- start start 2024-09-19T06:49:25.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c50786740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 0x560eb4b8f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c50786740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8fca0 0x560eb4b9e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c50786740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 0x560eb4ba0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c50786740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x560eb4af52e0 con 0x560eb4b8fca0 2024-09-19T06:49:25.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c50786740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560eb4a9cce0 con 0x560eb4b8f380 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c50786740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560eb4af12a0 con 0x560eb4b9ea90 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8fca0 0x560eb4b9e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c45ffb640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c340a33b0 0x7f9c340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8fca0 0x560eb4b9e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46470/0 (socket says 172.21.15.159:46470) 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c47fff640 1 -- 172.21.15.159:0/927026895 learned_addr learned my addr 172.21.15.159:0/927026895 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/927026895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 0x560eb4ba0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/927026895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 0x560eb4b8f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c340a33b0 0x7f9c340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c45ffb640 1 -- 172.21.15.159:0/172676162 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f9c300f0330 con 0x7f9c48102570 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c47fff640 1 -- 172.21.15.159:0/927026895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 msgr2=0x560eb4ba0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c47fff640 1 --2- 172.21.15.159:0/927026895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 0x560eb4ba0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c47fff640 1 -- 172.21.15.159:0/927026895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 msgr2=0x560eb4b8f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c47fff640 1 --2- 172.21.15.159:0/927026895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 0x560eb4b8f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c47fff640 1 -- 172.21.15.159:0/927026895 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb4a81440 con 0x560eb4b8fca0 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.907+0000 7f9c47fff640 1 --2- 172.21.15.159:0/927026895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8fca0 0x560eb4b9e550 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9c380115c0 tx=0x7f9c380119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d5b345b283b4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c340a33b0 0x7f9c340a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c400099e0 tx=0x7f9c40009500 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c3e7fc640 1 -- 172.21.15.159:0/927026895 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3801e070 con 0x560eb4b8fca0 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c3e7fc640 1 -- 172.21.15.159:0/927026895 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c3800fa20 con 0x560eb4b8fca0 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c3e7fc640 1 -- 172.21.15.159:0/927026895 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38019b00 con 0x560eb4b8fca0 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c50786740 1 -- 172.21.15.159:0/927026895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8fca0 msgr2=0x560eb4b9e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c50786740 1 --2- 172.21.15.159:0/927026895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8fca0 0x560eb4b9e550 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9c380115c0 tx=0x7f9c380119c0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c50786740 1 -- 172.21.15.159:0/927026895 shutdown_connections 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c50786740 1 --2- 172.21.15.159:0/927026895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 0x560eb4ba0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c50786740 1 --2- 172.21.15.159:0/927026895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8fca0 0x560eb4b9e550 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c50786740 1 --2- 172.21.15.159:0/927026895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 0x560eb4b8f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c50786740 1 -- 172.21.15.159:0/927026895 >> 172.21.15.159:0/927026895 conn(0x560eb4b8ba30 msgr2=0x560eb4b8be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c50786740 1 -- 172.21.15.159:0/927026895 shutdown_connections 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.908+0000 7f9c50786740 1 -- 172.21.15.159:0/927026895 wait complete. 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.909+0000 7f9c50786740 1 -- start start 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.909+0000 7f9c50786740 1 Processor -- start 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c50786740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8f380 0x560eb4b9e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c50786740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 0x560eb4b9b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c50786740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4b9bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c50786740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x560eb4ba1660 con 0x560eb4b9ea90 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c50786740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560eb4ab0050 con 0x560eb4b8fca0 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c50786740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560eb4ba17e0 con 0x560eb4b8f380 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c50786740 10 client.0 _ll_register_callbacks cb 0x560eb4af0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c4c94a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4b9bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8f380 0x560eb4b9e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8f380 0x560eb4b9e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:48708/0 (socket says 172.21.15.159:48708) 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c4c94a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4b9bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46478/0 (socket says 172.21.15.159:46478) 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c47fff640 1 -- 172.21.15.159:0/314186113 learned_addr learned my addr 172.21.15.159:0/314186113 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 0x560eb4b9b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c47fff640 1 -- 172.21.15.159:0/314186113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 msgr2=0x560eb4b9b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c47fff640 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 0x560eb4b9b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c47fff640 1 -- 172.21.15.159:0/314186113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 msgr2=0x560eb4b9bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c47fff640 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4b9bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c47fff640 1 -- 172.21.15.159:0/314186113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb48663c0 con 0x560eb4b8f380 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4b9bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 0x560eb4b9b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:25.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c47fff640 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8f380 0x560eb4b9e400 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c38014040 tx=0x7f9c38005750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b6a96faf8127354 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c277fe640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.910+0000 7f9c277fe640 1 -- 172.21.15.159:0/314186113 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3801e040 con 0x560eb4b8f380 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c277fe640 1 -- 172.21.15.159:0/314186113 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f9c3800f600 con 0x560eb4b8f380 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c50786740 1 -- 172.21.15.159:0/314186113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c3800fa20 con 0x560eb4b8f380 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c277fe640 1 -- 172.21.15.159:0/314186113 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9c3802f050 con 0x560eb4b8f380 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c50786740 10 client.25381 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c50786740 1 -- 172.21.15.159:0/314186113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560eb4bad160 con 0x560eb4b8f380 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c277fe640 1 -- 172.21.15.159:0/314186113 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c3800fa20 con 0x560eb4b8f380 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c277fe640 1 -- 172.21.15.159:0/314186113 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f9c3802a030 con 0x560eb4b8f380 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c50786740 10 client.25381 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c50786740 10 client.25381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c50786740 20 client.25381 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c50786740 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560eb4bae620 0x560eb4bb0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c50786740 4 client.25381 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:25.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c50786740 1 -- 172.21.15.159:0/314186113 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eb4b02850 con 0x560eb4bae620 2024-09-19T06:49:25.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.911+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560eb4bae620 0x560eb4bb0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.912+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560eb4bae620 0x560eb4bb0a10 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaaf0d20ea557167 server_cookie=3b591abb40706ce0 in_seq=0 out_seq=0 2024-09-19T06:49:25.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.912+0000 7f9c277fe640 10 client.25381 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:25.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.913+0000 7f9c277fe640 1 -- 172.21.15.159:0/314186113 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560eb4b02850 con 0x560eb4bae620 2024-09-19T06:49:25.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.913+0000 7f9c277fe640 10 client.25381 handle_command_reply: tid=0 2024-09-19T06:49:25.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.913+0000 7f9c50786740 1 client.25381 shutdown 2024-09-19T06:49:25.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.913+0000 7f9c50786740 1 -- 172.21.15.159:0/314186113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8f380 msgr2=0x560eb4b9e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.913+0000 7f9c50786740 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8f380 0x560eb4b9e400 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c38014040 tx=0x7f9c38005750 comp rx=0 tx=0).stop 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c50786740 1 -- 172.21.15.159:0/314186113 shutdown_connections 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c50786740 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560eb4bae620 0x560eb4bb0a10 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c50786740 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4b9bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c50786740 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 0x560eb4b9b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c50786740 1 --2- 172.21.15.159:0/314186113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8f380 0x560eb4b9e400 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c50786740 1 -- 172.21.15.159:0/314186113 >> 172.21.15.159:0/314186113 conn(0x560eb4b8ba30 msgr2=0x560eb4b91790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c277fe640 0 client.25381 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c50786740 1 -- 172.21.15.159:0/314186113 shutdown_connections 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c50786740 1 -- 172.21.15.159:0/314186113 wait complete. 2024-09-19T06:49:25.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.914+0000 7f9c50786740 20 client.25381 trim_cache size 0 max 16384 2024-09-19T06:49:25.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c50786740 1 Processor -- start 2024-09-19T06:49:25.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c50786740 1 -- start start 2024-09-19T06:49:25.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c50786740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 0x560eb4baa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c50786740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8fca0 0x560eb4bb61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c50786740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4bb6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c50786740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481a9680 con 0x560eb4b9ea90 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c50786740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481abf00 con 0x560eb4b8f380 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c50786740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481a9cf0 con 0x560eb4b8fca0 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c4c94a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4bb6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c4c94a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4bb6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46484/0 (socket says 172.21.15.159:46484) 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c4c94a640 1 -- 172.21.15.159:0/686552522 learned_addr learned my addr 172.21.15.159:0/686552522 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8fca0 0x560eb4bb61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.944+0000 7f9c47fff640 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 0x560eb4baa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c4c94a640 1 -- 172.21.15.159:0/686552522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8fca0 msgr2=0x560eb4bb61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8fca0 0x560eb4bb61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c4c94a640 1 -- 172.21.15.159:0/686552522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 msgr2=0x560eb4baa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 0x560eb4baa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c4c94a640 1 -- 172.21.15.159:0/686552522 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb4b99c50 con 0x560eb4b9ea90 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c3ffff640 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8fca0 0x560eb4bb61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4bb6730 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9c40011750 tx=0x7f9c40008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de865469100fbdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c3dffb640 1 -- 172.21.15.159:0/686552522 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40003970 con 0x560eb4b9ea90 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c3dffb640 1 -- 172.21.15.159:0/686552522 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c40004020 con 0x560eb4b9ea90 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.945+0000 7f9c3dffb640 1 -- 172.21.15.159:0/686552522 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4002b750 con 0x560eb4b9ea90 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 -- 172.21.15.159:0/686552522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 msgr2=0x560eb4bb6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4bb6730 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9c40011750 tx=0x7f9c40008000 comp rx=0 tx=0).stop 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 -- 172.21.15.159:0/686552522 shutdown_connections 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b9ea90 0x560eb4bb6730 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b8fca0 0x560eb4bb61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 --2- 172.21.15.159:0/686552522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8f380 0x560eb4baa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 -- 172.21.15.159:0/686552522 >> 172.21.15.159:0/686552522 conn(0x560eb4b8ba30 msgr2=0x560eb4b96d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 -- 172.21.15.159:0/686552522 shutdown_connections 2024-09-19T06:49:25.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 -- 172.21.15.159:0/686552522 wait complete. 2024-09-19T06:49:25.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 -- start start 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.946+0000 7f9c50786740 1 Processor -- start 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c50786740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8f380 0x560eb4ba6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c50786740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 0x560eb4ba6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c50786740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 0x560eb4b979b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c50786740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481aa3c0 con 0x560eb4b8f380 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c50786740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481ab830 con 0x560eb4b8fca0 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c50786740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481aaa90 con 0x560eb4b9ea90 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c50786740 10 client.0 _ll_register_callbacks cb 0x7f9c3801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8f380 0x560eb4ba6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c3ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 0x560eb4ba6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8f380 0x560eb4ba6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46492/0 (socket says 172.21.15.159:46492) 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 0x560eb4b979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c47fff640 1 -- 172.21.15.159:0/3890372847 learned_addr learned my addr 172.21.15.159:0/3890372847 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c4c94a640 1 -- 172.21.15.159:0/3890372847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 msgr2=0x560eb4ba6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 0x560eb4ba6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c4c94a640 1 -- 172.21.15.159:0/3890372847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8f380 msgr2=0x560eb4ba6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8f380 0x560eb4ba6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c4c94a640 1 -- 172.21.15.159:0/3890372847 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb4ba75f0 con 0x560eb4b9ea90 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c4c94a640 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 0x560eb4b979b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9c40011fd0 tx=0x7f9c40011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a672895cb978ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.947+0000 7f9c277fe640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c277fe640 1 -- 172.21.15.159:0/3890372847 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4003a020 con 0x560eb4b9ea90 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c277fe640 1 -- 172.21.15.159:0/3890372847 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f9c40004c50 con 0x560eb4b9ea90 2024-09-19T06:49:25.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c50786740 1 -- 172.21.15.159:0/3890372847 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c40004020 con 0x560eb4b9ea90 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c277fe640 1 -- 172.21.15.159:0/3890372847 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9c40045050 con 0x560eb4b9ea90 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c50786740 10 client.25387 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c50786740 1 -- 172.21.15.159:0/3890372847 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560eb4c18710 con 0x560eb4b9ea90 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c277fe640 1 -- 172.21.15.159:0/3890372847 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c40004020 con 0x560eb4b9ea90 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c277fe640 1 -- 172.21.15.159:0/3890372847 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f9c4001d070 con 0x560eb4b9ea90 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c50786740 10 client.25387 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c50786740 10 client.25387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c50786740 20 client.25387 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c50786740 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560eb4c18e50 0x560eb4c1b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c50786740 4 client.25387 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.948+0000 7f9c50786740 1 -- 172.21.15.159:0/3890372847 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560eb4afcd60 con 0x560eb4c18e50 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.949+0000 7f9c47fff640 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560eb4c18e50 0x560eb4c1b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.949+0000 7f9c277fe640 10 client.25387 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.949+0000 7f9c47fff640 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560eb4c18e50 0x560eb4c1b270 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ef7e43acd739211 server_cookie=a50f3699ff594d04 in_seq=0 out_seq=0 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c277fe640 1 -- 172.21.15.159:0/3890372847 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560eb4afcd60 con 0x560eb4c18e50 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c277fe640 10 client.25387 handle_command_reply: tid=0 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 client.25387 shutdown 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 -- 172.21.15.159:0/3890372847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 msgr2=0x560eb4b979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 0x560eb4b979b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9c40011fd0 tx=0x7f9c40011900 comp rx=0 tx=0).stop 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 -- 172.21.15.159:0/3890372847 shutdown_connections 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x560eb4c18e50 0x560eb4c1b270 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560eb4b9ea90 0x560eb4b979b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560eb4b8fca0 0x560eb4ba6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 --2- 172.21.15.159:0/3890372847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560eb4b8f380 0x560eb4ba6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 -- 172.21.15.159:0/3890372847 >> 172.21.15.159:0/3890372847 conn(0x560eb4b8ba30 msgr2=0x560eb4b8a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c277fe640 0 client.25387 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:25.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 -- 172.21.15.159:0/3890372847 shutdown_connections 2024-09-19T06:49:25.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 1 -- 172.21.15.159:0/3890372847 wait complete. 2024-09-19T06:49:25.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.951+0000 7f9c50786740 20 client.25387 trim_cache size 0 max 16384 2024-09-19T06:49:25.957 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:49:25.957 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:49:25.957 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:49:25.957 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:49:25.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c340a33b0 msgr2=0x7f9c340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c340a33b0 0x7f9c340a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c400099e0 tx=0x7f9c40009500 comp rx=0 tx=0).stop 2024-09-19T06:49:25.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 msgr2=0x7f9c481998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 0x7f9c481998a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9c3002aa70 tx=0x7f9c30003c10 comp rx=0 tx=0).stop 2024-09-19T06:49:25.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/172676162 shutdown_connections 2024-09-19T06:49:25.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c340a33b0 0x7f9c340a5870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c48102ef0 0x7f9c481a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c48102570 0x7f9c481998a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 --2- 172.21.15.159:0/172676162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c48100e20 0x7f9c48199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/172676162 >> 172.21.15.159:0/172676162 conn(0x7f9c480fc7d0 msgr2=0x7f9c480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/172676162 shutdown_connections 2024-09-19T06:49:25.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:25.952+0000 7f9c4e3ad640 1 -- 172.21.15.159:0/172676162 wait complete. 2024-09-19T06:49:26.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:25 smithi203 ceph-mon[35473]: daemon mds.b restarted 2024-09-19T06:49:26.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:25 smithi189 ceph-mon[34880]: daemon mds.b restarted 2024-09-19T06:49:26.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:26 smithi159 ceph-mon[30935]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:49:26.903 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:26 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.189:6838/1030263706,v1:172.21.15.189:6839/1030263706] up:boot 2024-09-19T06:49:26.903 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:26 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:49:26.903 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:26 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:49:26.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:26 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:49:26.904 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:26 smithi159 ceph-mon[30935]: pgmap v77: 97 pgs: 97 active+clean; 57 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 1.71k op/s 2024-09-19T06:49:26.969 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:49:26.969 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:49:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:26 smithi203 ceph-mon[35473]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:49:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:26 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.189:6838/1030263706,v1:172.21.15.189:6839/1030263706] up:boot 2024-09-19T06:49:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:26 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:49:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:26 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:49:27.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:26 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:49:27.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:26 smithi203 ceph-mon[35473]: pgmap v77: 97 pgs: 97 active+clean; 57 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 1.71k op/s 2024-09-19T06:49:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:26 smithi189 ceph-mon[34880]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:49:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:26 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.189:6838/1030263706,v1:172.21.15.189:6839/1030263706] up:boot 2024-09-19T06:49:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:26 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:49:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:26 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:49:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:26 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:49:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:26 smithi189 ceph-mon[34880]: pgmap v77: 97 pgs: 97 active+clean; 57 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 1.71k op/s 2024-09-19T06:49:27.263 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:27.272 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f4bfff640 1 -- 172.21.15.159:0/24522269 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5614ea313d70 con 0x5614ea42e0b0 2024-09-19T06:49:27.272 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f4bfff640 10 client.25369 handle_command_reply: tid=0 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 client.25369 shutdown 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 -- 172.21.15.159:0/24522269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a8410 msgr2=0x5614ea3b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a8410 0x5614ea3b6890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f600ee0f0 tx=0x7f0f60009680 comp rx=0 tx=0).stop 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 -- 172.21.15.159:0/24522269 shutdown_connections 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5614ea42e0b0 0x5614ea4304d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5614ea3b2cb0 0x5614ea3b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614ea3a8410 0x5614ea3b6890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 --2- 172.21.15.159:0/24522269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ea3a7af0 0x5614ea3bb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f4bfff640 0 client.25369 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 -- 172.21.15.159:0/24522269 >> 172.21.15.159:0/24522269 conn(0x5614ea3a4060 msgr2=0x5614ea3a9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 -- 172.21.15.159:0/24522269 shutdown_connections 2024-09-19T06:49:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 1 -- 172.21.15.159:0/24522269 wait complete. 2024-09-19T06:49:27.274 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.271+0000 7f0f75a63740 20 client.25369 trim_cache size 0 max 16384 2024-09-19T06:49:27.274 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:49:27.274 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:49:27.274 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:49:27.274 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 -- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0f540a3600 msgr2=0x7f0f540a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0f540a3600 0x7f0f540a5ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009db0 tx=0x7f0f5c009810 comp rx=0 tx=0).stop 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 -- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c1095d0 msgr2=0x7f0f6c1a7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c1095d0 0x7f0f6c1a7620 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002a9f0 tx=0x7f0f600055e0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 -- 172.21.15.159:0/2742330564 shutdown_connections 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0f540a3600 0x7f0f540a5ac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6c11b140 0x7f0f6c1ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c1095d0 0x7f0f6c1a7620 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 --2- 172.21.15.159:0/2742330564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6c1091f0 0x7f0f6c1a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 -- 172.21.15.159:0/2742330564 >> 172.21.15.159:0/2742330564 conn(0x7f0f6c06ce00 msgr2=0x7f0f6c11b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 -- 172.21.15.159:0/2742330564 shutdown_connections 2024-09-19T06:49:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:27.272+0000 7f0f72bf1640 1 -- 172.21.15.159:0/2742330564 wait complete. 2024-09-19T06:49:27.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.791+0000 7f8d64f92640 1 -- 172.21.15.159:0/2646459507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102570 msgr2=0x7f8d601029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.791+0000 7f8d64f92640 1 --2- 172.21.15.159:0/2646459507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102570 0x7f8d601029b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009900 tx=0x7f8d4802a480 comp rx=0 tx=0).stop 2024-09-19T06:49:27.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.791+0000 7f8d64f92640 1 -- 172.21.15.159:0/2646459507 shutdown_connections 2024-09-19T06:49:27.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.791+0000 7f8d64f92640 1 --2- 172.21.15.159:0/2646459507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d60102ef0 0x7f8d6010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.791+0000 7f8d64f92640 1 --2- 172.21.15.159:0/2646459507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102570 0x7f8d601029b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.791+0000 7f8d64f92640 1 --2- 172.21.15.159:0/2646459507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60100e20 0x7f8d60101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.791+0000 7f8d64f92640 1 -- 172.21.15.159:0/2646459507 >> 172.21.15.159:0/2646459507 conn(0x7f8d600fc7d0 msgr2=0x7f8d600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:27.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.791+0000 7f8d64f92640 1 -- 172.21.15.159:0/2646459507 shutdown_connections 2024-09-19T06:49:27.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.791+0000 7f8d64f92640 1 -- 172.21.15.159:0/2646459507 wait complete. 2024-09-19T06:49:27.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d64f92640 1 Processor -- start 2024-09-19T06:49:27.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d64f92640 1 -- start start 2024-09-19T06:49:27.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d64f92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60100e20 0x7f8d601973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d64f92640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d60102570 0x7f8d60197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d64f92640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102ef0 0x7f8d6019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d64f92640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60110f80 con 0x7f8d60102ef0 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d64f92640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60110e00 con 0x7f8d60100e20 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d64f92640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60111100 con 0x7f8d60102570 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102ef0 0x7f8d6019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102ef0 0x7f8d6019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46498/0 (socket says 172.21.15.159:46498) 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d5dd9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d60102570 0x7f8d60197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d5ed9d640 1 -- 172.21.15.159:0/1303783936 learned_addr learned my addr 172.21.15.159:0/1303783936 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.792+0000 7f8d5e59c640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60100e20 0x7f8d601973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d5ed9d640 1 -- 172.21.15.159:0/1303783936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d60102570 msgr2=0x7f8d60197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d5ed9d640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d60102570 0x7f8d60197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d5ed9d640 1 -- 172.21.15.159:0/1303783936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60100e20 msgr2=0x7f8d601973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d5ed9d640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60100e20 0x7f8d601973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d5ed9d640 1 -- 172.21.15.159:0/1303783936 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6019c390 con 0x7f8d60102ef0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d5dd9b640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d60102570 0x7f8d60197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d5ed9d640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102ef0 0x7f8d6019bcb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000e970 tx=0x7f8d5000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d577fe640 1 -- 172.21.15.159:0/1303783936 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5000ccc0 con 0x7f8d60102ef0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6019c680 con 0x7f8d60102ef0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d577fe640 1 -- 172.21.15.159:0/1303783936 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d5000ce60 con 0x7f8d60102ef0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d577fe640 1 -- 172.21.15.159:0/1303783936 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d50010450 con 0x7f8d60102ef0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.793+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d601a3f60 con 0x7f8d60102ef0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.794+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d60101200 con 0x7f8d60102ef0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.795+0000 7f8d577fe640 1 -- 172.21.15.159:0/1303783936 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f8d50005020 con 0x7f8d60102ef0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.796+0000 7f8d577fe640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8d4c0a33b0 0x7f8d4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.796+0000 7f8d5e59c640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8d4c0a33b0 0x7f8d4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.796+0000 7f8d577fe640 1 -- 172.21.15.159:0/1303783936 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f8d500d0140 con 0x7f8d60102ef0 2024-09-19T06:49:27.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.797+0000 7f8d5e59c640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8d4c0a33b0 0x7f8d4c0a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d58005fd0 tx=0x7f8d58009680 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:27.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:27.800+0000 7f8d577fe640 1 -- 172.21.15.159:0/1303783936 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d5009caf0 con 0x7f8d60102ef0 2024-09-19T06:49:28.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.007+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d60109090 con 0x7f8d60102ef0 2024-09-19T06:49:28.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.008+0000 7f8d577fe640 1 -- 172.21.15.159:0/1303783936 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11873 (secure 0 0 0) 0x7f8d5009c3f0 con 0x7f8d60102ef0 2024-09-19T06:49:28.010 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:49:28.010 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":22,"btime":"2024-09-19T06:49:25:683734+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:25.683716+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25328":{"gid":25328,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/1030263706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1030263706},{"type":"v1","addr":"172.21.15.189:6839","nonce":1030263706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:49:28.010 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 22 2024-09-19T06:49:28.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8d4c0a33b0 msgr2=0x7f8d4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:28.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8d4c0a33b0 0x7f8d4c0a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d58005fd0 tx=0x7f8d58009680 comp rx=0 tx=0).stop 2024-09-19T06:49:28.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102ef0 msgr2=0x7f8d6019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:28.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102ef0 0x7f8d6019bcb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000e970 tx=0x7f8d5000ed70 comp rx=0 tx=0).stop 2024-09-19T06:49:28.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 shutdown_connections 2024-09-19T06:49:28.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f8d4c0a33b0 0x7f8d4c0a5870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:28.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d60102ef0 0x7f8d6019bcb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:28.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d60102570 0x7f8d60197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:28.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 --2- 172.21.15.159:0/1303783936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60100e20 0x7f8d601973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:28.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 >> 172.21.15.159:0/1303783936 conn(0x7f8d600fc7d0 msgr2=0x7f8d601068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:28.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 shutdown_connections 2024-09-19T06:49:28.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:28.011+0000 7f8d64f92640 1 -- 172.21.15.159:0/1303783936 wait complete. 2024-09-19T06:49:28.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:28 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1303783936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:49:28.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:28 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1303783936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:49:28.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:28 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1303783936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:49:28.415 INFO:tasks.workunit.client.0.smithi159.stderr:+ make -j4 2024-09-19T06:49:28.426 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize -cfi 2024-09-19T06:49:28.719 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:49:28.980 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:29.123 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-19T06:49:29.123 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: copying file './config.guess' 2024-09-19T06:49:29.128 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: copying file './config.sub' 2024-09-19T06:49:29.133 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: copying file './install-sh' 2024-09-19T06:49:29.138 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: copying file './ltmain.sh' 2024-09-19T06:49:29.165 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-19T06:49:29.165 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-19T06:49:29.171 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-19T06:49:29.177 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-19T06:49:29.182 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-19T06:49:29.188 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-19T06:49:29.194 INFO:tasks.workunit.client.0.smithi159.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-19T06:49:29.195 INFO:tasks.workunit.client.0.smithi159.stdout:cp include/install-sh . 2024-09-19T06:49:29.288 INFO:tasks.workunit.client.0.smithi159.stdout:aclocal -I m4 2024-09-19T06:49:29.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:29 smithi203 ceph-mon[35473]: pgmap v78: 97 pgs: 97 active+clean; 57 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 1.71k op/s 2024-09-19T06:49:29.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:29 smithi189 ceph-mon[34880]: pgmap v78: 97 pgs: 97 active+clean; 57 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 1.71k op/s 2024-09-19T06:49:29.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:29 smithi159 ceph-mon[30935]: pgmap v78: 97 pgs: 97 active+clean; 57 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 1.71k op/s 2024-09-19T06:49:29.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.522+0000 7f2459d6e640 1 -- 172.21.15.159:0/3720900057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102570 msgr2=0x7f24541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.522+0000 7f2459d6e640 1 --2- 172.21.15.159:0/3720900057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102570 0x7f24541029b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f243c009900 tx=0x7f243c02a480 comp rx=0 tx=0).stop 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.522+0000 7f2459d6e640 1 -- 172.21.15.159:0/3720900057 shutdown_connections 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.522+0000 7f2459d6e640 1 --2- 172.21.15.159:0/3720900057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2454102ef0 0x7f245410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.522+0000 7f2459d6e640 1 --2- 172.21.15.159:0/3720900057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102570 0x7f24541029b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.522+0000 7f2459d6e640 1 --2- 172.21.15.159:0/3720900057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2454100e20 0x7f2454101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.522+0000 7f2459d6e640 1 -- 172.21.15.159:0/3720900057 >> 172.21.15.159:0/3720900057 conn(0x7f24540fc7d0 msgr2=0x7f24540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.522+0000 7f2459d6e640 1 -- 172.21.15.159:0/3720900057 shutdown_connections 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.522+0000 7f2459d6e640 1 -- 172.21.15.159:0/3720900057 wait complete. 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2459d6e640 1 Processor -- start 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2459d6e640 1 -- start start 2024-09-19T06:49:29.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2459d6e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2454100e20 0x7f24540fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2459d6e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2454102570 0x7f24540fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2459d6e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102ef0 0x7f24540fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2459d6e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2454110f80 con 0x7f2454102ef0 2024-09-19T06:49:29.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2459d6e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2454110e00 con 0x7f2454100e20 2024-09-19T06:49:29.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2459d6e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2454111100 con 0x7f2454102570 2024-09-19T06:49:29.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2453fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102ef0 0x7f24540fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2453fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102ef0 0x7f24540fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48766/0 (socket says 172.21.15.159:48766) 2024-09-19T06:49:29.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f24537fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2454100e20 0x7f24540fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2453fff640 1 -- 172.21.15.159:0/2439037301 learned_addr learned my addr 172.21.15.159:0/2439037301 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:29.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f244bfff640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2454102570 0x7f24540fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2453fff640 1 -- 172.21.15.159:0/2439037301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2454102570 msgr2=0x7f24540fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:29.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2453fff640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2454102570 0x7f24540fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2453fff640 1 -- 172.21.15.159:0/2439037301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2454100e20 msgr2=0x7f24540fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:29.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2453fff640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2454100e20 0x7f24540fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.523+0000 7f2453fff640 1 -- 172.21.15.159:0/2439037301 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24541a68d0 con 0x7f2454102ef0 2024-09-19T06:49:29.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.524+0000 7f2453fff640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102ef0 0x7f24540fd700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f244c00eb10 tx=0x7f244c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:29.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.524+0000 7f24517fa640 1 -- 172.21.15.159:0/2439037301 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c00ce20 con 0x7f2454102ef0 2024-09-19T06:49:29.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.524+0000 7f24517fa640 1 -- 172.21.15.159:0/2439037301 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f244c005020 con 0x7f2454102ef0 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.524+0000 7f2459d6e640 1 -- 172.21.15.159:0/2439037301 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24541a6bc0 con 0x7f2454102ef0 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.524+0000 7f24517fa640 1 -- 172.21.15.159:0/2439037301 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c010690 con 0x7f2454102ef0 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.524+0000 7f2459d6e640 1 -- 172.21.15.159:0/2439037301 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24541a7120 con 0x7f2454102ef0 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f245c147740 1 Processor -- start 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f24517fa640 1 -- 172.21.15.159:0/2439037301 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f244c005540 con 0x7f2454102ef0 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f245c147740 1 -- start start 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f245c147740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 0x564ea91f3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f245c147740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f245c147740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea9200760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f245c147740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564ea91592f0 con 0x564ea91fe370 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f245c147740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ea9100cf0 con 0x564ea91f4b40 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f245c147740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564ea91552b0 con 0x564ea91f35d0 2024-09-19T06:49:29.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f244bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea9200760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f244bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea9200760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48770/0 (socket says 172.21.15.159:48770) 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f244bfff640 1 -- 172.21.15.159:0/93247628 learned_addr learned my addr 172.21.15.159:0/93247628 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.527+0000 7f24537fe640 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f244bfff640 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 0x564ea91f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f24537fe640 1 -- 172.21.15.159:0/93247628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 msgr2=0x564ea91f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f24537fe640 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 0x564ea91f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f24537fe640 1 -- 172.21.15.159:0/93247628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 msgr2=0x564ea9200760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f24537fe640 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea9200760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f24537fe640 1 -- 172.21.15.159:0/93247628 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ea90e53a0 con 0x564ea91f35d0 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f24517fa640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f24400a3430 0x7f24400a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f244bfff640 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea9200760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:29.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f24517fa640 1 -- 172.21.15.159:0/2439037301 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f244c0d0310 con 0x7f2454102ef0 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f244bfff640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f24400a3430 0x7f24400a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f24537fe640 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91f3a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f244400abf0 tx=0x7f244400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ce49e7957316ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f2449ffb640 1 -- 172.21.15.159:0/93247628 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444005220 con 0x564ea91f35d0 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f244bfff640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f24400a3430 0x7f24400a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x564ea91f4070 tx=0x7f243c000bc0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f2449ffb640 1 -- 172.21.15.159:0/93247628 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2444004c80 con 0x564ea91f35d0 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.528+0000 7f2449ffb640 1 -- 172.21.15.159:0/93247628 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444018840 con 0x564ea91f35d0 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 -- 172.21.15.159:0/93247628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 msgr2=0x564ea91f3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91f3a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f244400abf0 tx=0x7f244400f790 comp rx=0 tx=0).stop 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 -- 172.21.15.159:0/93247628 shutdown_connections 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea9200760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91f3a10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 --2- 172.21.15.159:0/93247628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 0x564ea91f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 -- 172.21.15.159:0/93247628 >> 172.21.15.159:0/93247628 conn(0x564ea91bc310 msgr2=0x564ea91efc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 -- 172.21.15.159:0/93247628 shutdown_connections 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 -- 172.21.15.159:0/93247628 wait complete. 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.529+0000 7f245c147740 1 -- start start 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f245c147740 1 Processor -- start 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f245c147740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f35d0 0x564ea91fdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f245c147740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f4b40 0x564ea91faef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f245c147740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea91fb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f245c147740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564ea9201070 con 0x564ea91fe370 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f245c147740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ea9114060 con 0x564ea91f35d0 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f245c147740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564ea92011f0 con 0x564ea91f4b40 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f245c147740 10 client.0 _ll_register_callbacks cb 0x564ea8e678c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f2453fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea91fb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f244bfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f4b40 0x564ea91faef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f244bfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f4b40 0x564ea91faef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:53362/0 (socket says 172.21.15.159:53362) 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f2453fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea91fb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48780/0 (socket says 172.21.15.159:48780) 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f244bfff640 1 -- 172.21.15.159:0/794338109 learned_addr learned my addr 172.21.15.159:0/794338109 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f24537fe640 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f35d0 0x564ea91fdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f244bfff640 1 -- 172.21.15.159:0/794338109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f35d0 msgr2=0x564ea91fdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f244bfff640 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f35d0 0x564ea91fdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f244bfff640 1 -- 172.21.15.159:0/794338109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 msgr2=0x564ea91fb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f244bfff640 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea91fb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.530+0000 7f244bfff640 1 -- 172.21.15.159:0/794338109 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ea8eca3c0 con 0x564ea91f4b40 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f244bfff640 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f4b40 0x564ea91faef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f243c0043e0 tx=0x7f243c0058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15eff70222c3c4bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f2432ffd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f2432ffd640 1 -- 172.21.15.159:0/794338109 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c035040 con 0x564ea91f4b40 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f245c147740 1 -- 172.21.15.159:0/794338109 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2444004c80 con 0x564ea91f4b40 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f2432ffd640 1 -- 172.21.15.159:0/794338109 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f243c031740 con 0x564ea91f4b40 2024-09-19T06:49:29.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f2432ffd640 1 -- 172.21.15.159:0/794338109 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f243c031940 con 0x564ea91f4b40 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f245c147740 10 client.25405 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f245c147740 1 -- 172.21.15.159:0/794338109 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564ea920ca60 con 0x564ea91f4b40 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f2432ffd640 1 -- 172.21.15.159:0/794338109 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2444004c80 con 0x564ea91f4b40 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.531+0000 7f2432ffd640 1 -- 172.21.15.159:0/794338109 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f243c047070 con 0x564ea91f4b40 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.532+0000 7f245c147740 10 client.25405 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.532+0000 7f245c147740 10 client.25405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.532+0000 7f245c147740 20 client.25405 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.532+0000 7f245c147740 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564ea920dec0 0x564ea9210360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.532+0000 7f245c147740 4 client.25405 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.532+0000 7f245c147740 1 -- 172.21.15.159:0/794338109 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ea9166860 con 0x564ea920dec0 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.532+0000 7f24537fe640 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564ea920dec0 0x564ea9210360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.532+0000 7f24537fe640 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564ea920dec0 0x564ea9210360 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=590851097de0ab2b server_cookie=1072f009120e5020 in_seq=0 out_seq=0 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.532+0000 7f2432ffd640 10 client.25405 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f2432ffd640 1 -- 172.21.15.159:0/794338109 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ea9166860 con 0x564ea920dec0 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f2432ffd640 10 client.25405 handle_command_reply: tid=0 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 client.25405 shutdown 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 -- 172.21.15.159:0/794338109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f4b40 msgr2=0x564ea91faef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f4b40 0x564ea91faef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f243c0043e0 tx=0x7f243c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 -- 172.21.15.159:0/794338109 shutdown_connections 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564ea920dec0 0x564ea9210360 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea91fb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f4b40 0x564ea91faef0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f2432ffd640 0 client.25405 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 --2- 172.21.15.159:0/794338109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f35d0 0x564ea91fdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 -- 172.21.15.159:0/794338109 >> 172.21.15.159:0/794338109 conn(0x564ea91bc310 msgr2=0x564ea91f5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:29.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 -- 172.21.15.159:0/794338109 shutdown_connections 2024-09-19T06:49:29.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 1 -- 172.21.15.159:0/794338109 wait complete. 2024-09-19T06:49:29.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.533+0000 7f245c147740 20 client.25405 trim_cache size 0 max 16384 2024-09-19T06:49:29.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f245c147740 1 Processor -- start 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f245c147740 1 -- start start 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f245c147740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91fce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f245c147740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91f4b40 0x564ea91f6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f245c147740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91fe370 0x564ea91f6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f245c147740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f24541ada60 con 0x564ea91f4b40 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f245c147740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24541b02e0 con 0x564ea91fe370 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f245c147740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f24541ae0d0 con 0x564ea91f35d0 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f244bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91f4b40 0x564ea91f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f244bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91f4b40 0x564ea91f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48786/0 (socket says 172.21.15.159:48786) 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f244bfff640 1 -- 172.21.15.159:0/2239174636 learned_addr learned my addr 172.21.15.159:0/2239174636 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f24537fe640 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91fce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.546+0000 7f2453fff640 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91fe370 0x564ea91f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f244bfff640 1 -- 172.21.15.159:0/2239174636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 msgr2=0x564ea91fce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f244bfff640 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91fce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f244bfff640 1 -- 172.21.15.159:0/2239174636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91fe370 msgr2=0x564ea91f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f244bfff640 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91fe370 0x564ea91f6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f244bfff640 1 -- 172.21.15.159:0/2239174636 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ea91ef4f0 con 0x564ea91f4b40 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f24537fe640 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91fce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f2453fff640 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91fe370 0x564ea91f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f244bfff640 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91f4b40 0x564ea91f6120 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f243c0314e0 tx=0x7f243c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0adc5b43e69ea38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f24497fa640 1 -- 172.21.15.159:0/2239174636 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c035040 con 0x564ea91f4b40 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f24497fa640 1 -- 172.21.15.159:0/2239174636 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f243c031540 con 0x564ea91f4b40 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.547+0000 7f24497fa640 1 -- 172.21.15.159:0/2239174636 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c03d6b0 con 0x564ea91f4b40 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 -- 172.21.15.159:0/2239174636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91f4b40 msgr2=0x564ea91f6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91f4b40 0x564ea91f6120 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f243c0314e0 tx=0x7f243c005a20 comp rx=0 tx=0).stop 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 -- 172.21.15.159:0/2239174636 shutdown_connections 2024-09-19T06:49:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91fe370 0x564ea91f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91f4b40 0x564ea91f6120 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 --2- 172.21.15.159:0/2239174636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea91fce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 -- 172.21.15.159:0/2239174636 >> 172.21.15.159:0/2239174636 conn(0x564ea91bc310 msgr2=0x564ea91fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 -- 172.21.15.159:0/2239174636 shutdown_connections 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 -- 172.21.15.159:0/2239174636 wait complete. 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 -- start start 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.548+0000 7f245c147740 1 Processor -- start 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f245c147740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea92064e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f245c147740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 0x564ea9206a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f245c147740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea92034b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f245c147740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f24541ae7a0 con 0x564ea91fe370 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f245c147740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24541afc10 con 0x564ea91f4b40 2024-09-19T06:49:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f245c147740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f24541aee70 con 0x564ea91f35d0 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f245c147740 10 client.0 _ll_register_callbacks cb 0x7f243c004310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2453fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea92034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2453fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea92034b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48802/0 (socket says 172.21.15.159:48802) 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2453fff640 1 -- 172.21.15.159:0/2139943822 learned_addr learned my addr 172.21.15.159:0/2139943822 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f244bfff640 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 0x564ea9206a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f24537fe640 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea92064e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2453fff640 1 -- 172.21.15.159:0/2139943822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 msgr2=0x564ea92064e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2453fff640 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea92064e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2453fff640 1 -- 172.21.15.159:0/2139943822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 msgr2=0x564ea9206a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2453fff640 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 0x564ea9206a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2453fff640 1 -- 172.21.15.159:0/2139943822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ea9203a20 con 0x564ea91fe370 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2453fff640 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea92034b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f244c000f80 tx=0x7f244c09c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef20cfc8e9d3b286 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2432ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.549+0000 7f2432ffd640 1 -- 172.21.15.159:0/2139943822 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0a4fa0 con 0x564ea91fe370 2024-09-19T06:49:29.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f2432ffd640 1 -- 172.21.15.159:0/2139943822 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f244c0b52a0 con 0x564ea91fe370 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f245c147740 1 -- 172.21.15.159:0/2139943822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f243c031540 con 0x564ea91fe370 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f2432ffd640 1 -- 172.21.15.159:0/2139943822 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f244c09c5c0 con 0x564ea91fe370 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f245c147740 10 client.15969 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f245c147740 1 -- 172.21.15.159:0/2139943822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564ea9279450 con 0x564ea91fe370 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f2432ffd640 1 -- 172.21.15.159:0/2139943822 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f243c031540 con 0x564ea91fe370 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f2432ffd640 1 -- 172.21.15.159:0/2139943822 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f244c09bb30 con 0x564ea91fe370 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f245c147740 10 client.15969 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f245c147740 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f245c147740 20 client.15969 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f245c147740 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564ea9279bc0 0x564ea927bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f245c147740 4 client.15969 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f245c147740 1 -- 172.21.15.159:0/2139943822 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ea9160d70 con 0x564ea9279bc0 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.550+0000 7f24537fe640 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564ea9279bc0 0x564ea927bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f2432ffd640 10 client.15969 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f24537fe640 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564ea9279bc0 0x564ea927bfb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9d4372bcf964286 server_cookie=1dec289d7f0cb65f in_seq=0 out_seq=0 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f2432ffd640 1 -- 172.21.15.159:0/2139943822 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ea9160d70 con 0x564ea9279bc0 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f2432ffd640 10 client.15969 handle_command_reply: tid=0 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 client.15969 shutdown 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 -- 172.21.15.159:0/2139943822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 msgr2=0x564ea92034b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea92034b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f244c000f80 tx=0x7f244c09c050 comp rx=0 tx=0).stop 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 -- 172.21.15.159:0/2139943822 shutdown_connections 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564ea9279bc0 0x564ea927bfb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f2432ffd640 0 client.15969 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564ea91fe370 0x564ea92034b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ea91f4b40 0x564ea9206a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 --2- 172.21.15.159:0/2139943822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564ea91f35d0 0x564ea92064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 -- 172.21.15.159:0/2139943822 >> 172.21.15.159:0/2139943822 conn(0x564ea91bc310 msgr2=0x564ea91fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 -- 172.21.15.159:0/2139943822 shutdown_connections 2024-09-19T06:49:29.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 1 -- 172.21.15.159:0/2139943822 wait complete. 2024-09-19T06:49:29.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.551+0000 7f245c147740 20 client.15969 trim_cache size 0 max 16384 2024-09-19T06:49:29.561 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:49:29.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 -- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f24400a3430 msgr2=0x7f24400a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f24400a3430 0x7f24400a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x564ea91f4070 tx=0x7f243c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 -- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102ef0 msgr2=0x7f24540fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102ef0 0x7f24540fd700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f244c00eb10 tx=0x7f244c00ef10 comp rx=0 tx=0).stop 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 -- 172.21.15.159:0/2439037301 shutdown_connections 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f24400a3430 0x7f24400a58f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454102ef0 0x7f24540fd700 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2454102570 0x7f24540fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 --2- 172.21.15.159:0/2439037301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2454100e20 0x7f24540fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 -- 172.21.15.159:0/2439037301 >> 172.21.15.159:0/2439037301 conn(0x7f24540fc7d0 msgr2=0x7f245406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 -- 172.21.15.159:0/2439037301 shutdown_connections 2024-09-19T06:49:29.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:29.552+0000 7f2459d6e640 1 -- 172.21.15.159:0/2439037301 wait complete. 2024-09-19T06:49:30.594 INFO:tasks.workunit.client.0.smithi159.stdout:autoheader 2024-09-19T06:49:30.907 INFO:tasks.workunit.client.0.smithi159.stdout:autoconf 2024-09-19T06:49:31.087 INFO:tasks.workunit.client.0.smithi159.stdout:./configure \ 2024-09-19T06:49:31.087 INFO:tasks.workunit.client.0.smithi159.stdout: --libexecdir=/usr/lib \ 2024-09-19T06:49:31.087 INFO:tasks.workunit.client.0.smithi159.stdout: --exec_prefix=/var/lib 2024-09-19T06:49:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:30 smithi203 ceph-mon[35473]: pgmap v79: 97 pgs: 97 active+clean; 57 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 1.71k op/s 2024-09-19T06:49:31.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:30 smithi189 ceph-mon[34880]: pgmap v79: 97 pgs: 97 active+clean; 57 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 1.71k op/s 2024-09-19T06:49:31.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:30 smithi159 ceph-mon[30935]: pgmap v79: 97 pgs: 97 active+clean; 57 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.9 MiB/s wr, 1.71k op/s 2024-09-19T06:49:31.313 INFO:tasks.workunit.client.0.smithi159.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-19T06:49:31.313 INFO:tasks.workunit.client.0.smithi159.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-19T06:49:31.314 INFO:tasks.workunit.client.0.smithi159.stdout:checking how to print strings... printf 2024-09-19T06:49:31.315 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gcc... gcc 2024-09-19T06:49:31.361 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:49:31.361 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:49:31.491 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether the C compiler works... yes 2024-09-19T06:49:31.491 INFO:tasks.workunit.client.0.smithi159.stdout:checking for C compiler default output file name... a.out 2024-09-19T06:49:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:31.634 INFO:tasks.workunit.client.0.smithi159.stdout:checking for suffix of executables... 2024-09-19T06:49:31.698 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether we are cross compiling... no 2024-09-19T06:49:31.764 INFO:tasks.workunit.client.0.smithi159.stdout:checking for suffix of object files... o 2024-09-19T06:49:31.788 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T06:49:31.821 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether gcc accepts -g... yes 2024-09-19T06:49:32.000 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T06:49:32.003 INFO:tasks.workunit.client.0.smithi159.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-09-19T06:49:32.007 INFO:tasks.workunit.client.0.smithi159.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T06:49:32.009 INFO:tasks.workunit.client.0.smithi159.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T06:49:32.010 INFO:tasks.workunit.client.0.smithi159.stdout:checking for fgrep... /usr/bin/grep -F 2024-09-19T06:49:32.013 INFO:tasks.workunit.client.0.smithi159.stdout:checking for ld used by gcc... /usr/bin/ld 2024-09-19T06:49:32.014 INFO:tasks.workunit.client.0.smithi159.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-09-19T06:49:32.034 INFO:tasks.workunit.client.0.smithi159.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-09-19T06:49:32.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.293+0000 7fc4349bc640 1 -- 172.21.15.159:0/3176450523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 msgr2=0x7fc430107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.293+0000 7fc4349bc640 1 --2- 172.21.15.159:0/3176450523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 0x7fc430107b90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc418009930 tx=0x7fc41802a420 comp rx=0 tx=0).stop 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.293+0000 7fc4349bc640 1 -- 172.21.15.159:0/3176450523 shutdown_connections 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.293+0000 7fc4349bc640 1 --2- 172.21.15.159:0/3176450523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4301082a0 0x7fc43010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.293+0000 7fc4349bc640 1 --2- 172.21.15.159:0/3176450523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 0x7fc430107b90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.293+0000 7fc4349bc640 1 --2- 172.21.15.159:0/3176450523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc430102d30 0x7fc430103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.294+0000 7fc4349bc640 1 -- 172.21.15.159:0/3176450523 >> 172.21.15.159:0/3176450523 conn(0x7fc4300fc7d0 msgr2=0x7fc4300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.294+0000 7fc4349bc640 1 -- 172.21.15.159:0/3176450523 shutdown_connections 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.294+0000 7fc4349bc640 1 -- 172.21.15.159:0/3176450523 wait complete. 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.294+0000 7fc4349bc640 1 Processor -- start 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.294+0000 7fc4349bc640 1 -- start start 2024-09-19T06:49:32.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4349bc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc430102d30 0x7fc4301985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4349bc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 0x7fc430198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4349bc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4301082a0 0x7fc43019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4349bc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301120a0 con 0x7fc4301036e0 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4349bc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc430111f20 con 0x7fc4301082a0 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4349bc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc430112220 con 0x7fc430102d30 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 0x7fc430198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 0x7fc430198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48826/0 (socket says 172.21.15.159:48826) 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42dd9b640 1 -- 172.21.15.159:0/2546441933 learned_addr learned my addr 172.21.15.159:0/2546441933 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4301082a0 0x7fc43019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42dd9b640 1 -- 172.21.15.159:0/2546441933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc430102d30 msgr2=0x7fc4301985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42e59c640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc430102d30 0x7fc4301985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42dd9b640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc430102d30 0x7fc4301985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42dd9b640 1 -- 172.21.15.159:0/2546441933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4301082a0 msgr2=0x7fc43019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42dd9b640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4301082a0 0x7fc43019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42dd9b640 1 -- 172.21.15.159:0/2546441933 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43019d590 con 0x7fc4301036e0 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42e59c640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc430102d30 0x7fc4301985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4301082a0 0x7fc43019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc42dd9b640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 0x7fc430198b20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc418005940 tx=0x7fc4180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4277fe640 1 -- 172.21.15.159:0/2546441933 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41803f030 con 0x7fc4301036e0 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4349bc640 1 -- 172.21.15.159:0/2546441933 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43019d820 con 0x7fc4301036e0 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4277fe640 1 -- 172.21.15.159:0/2546441933 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc418003ce0 con 0x7fc4301036e0 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4277fe640 1 -- 172.21.15.159:0/2546441933 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418035070 con 0x7fc4301036e0 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.295+0000 7fc4349bc640 1 -- 172.21.15.159:0/2546441933 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4301a5160 con 0x7fc4301036e0 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.298+0000 7fc4277fe640 1 -- 172.21.15.159:0/2546441933 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc418042030 con 0x7fc4301036e0 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.298+0000 7fc436d95740 1 Processor -- start 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.298+0000 7fc436d95740 1 -- start start 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.298+0000 7fc436d95740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 0x55b06130ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.298+0000 7fc436d95740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b06131a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.298+0000 7fc4277fe640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc41c0a33b0 0x7fc41c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.298+0000 7fc436d95740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b06131d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc436d95740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b061275280 con 0x55b06131ad40 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc436d95740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b06121cb10 con 0x55b06130fb60 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc436d95740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b061271240 con 0x55b061310480 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b06131d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b06131d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48840/0 (socket says 172.21.15.159:48840) 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 -- 172.21.15.159:0/2914837631 learned_addr learned my addr 172.21.15.159:0/2914837631 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42e59c640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc41c0a33b0 0x7fc41c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/2914837631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 0x55b06130ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc4277fe640 1 -- 172.21.15.159:0/2546441933 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7fc4180f02d0 con 0x7fc4301036e0 2024-09-19T06:49:32.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42dd9b640 1 --2- 172.21.15.159:0/2914837631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b06131a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 -- 172.21.15.159:0/2914837631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 msgr2=0x55b06131a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/2914837631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b06131a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 -- 172.21.15.159:0/2914837631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 msgr2=0x55b06130ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/2914837631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 0x55b06130ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 -- 172.21.15.159:0/2914837631 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0612291f0 con 0x55b06131ad40 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42e59c640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc41c0a33b0 0x7fc41c0a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc428005fd0 tx=0x7fc4280093e0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/2914837631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b06131d130 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc4200137d0 tx=0x7fc42000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d98e9a1cddb321 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc424ff9640 1 -- 172.21.15.159:0/2914837631 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42000e8f0 con 0x55b06131ad40 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc424ff9640 1 -- 172.21.15.159:0/2914837631 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc420013e10 con 0x55b06131ad40 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.299+0000 7fc424ff9640 1 -- 172.21.15.159:0/2914837631 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420011dd0 con 0x55b06131ad40 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.300+0000 7fc436d95740 1 -- 172.21.15.159:0/2914837631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 msgr2=0x55b06131d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.300+0000 7fc436d95740 1 --2- 172.21.15.159:0/2914837631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b06131d130 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc4200137d0 tx=0x7fc42000b3e0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.300+0000 7fc436d95740 1 -- 172.21.15.159:0/2914837631 shutdown_connections 2024-09-19T06:49:32.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.300+0000 7fc436d95740 1 --2- 172.21.15.159:0/2914837631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b06131d130 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.300+0000 7fc436d95740 1 --2- 172.21.15.159:0/2914837631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b06131a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.300+0000 7fc436d95740 1 --2- 172.21.15.159:0/2914837631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 0x55b06130ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.300+0000 7fc436d95740 1 -- 172.21.15.159:0/2914837631 >> 172.21.15.159:0/2914837631 conn(0x55b06130c0f0 msgr2=0x55b06130c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.300+0000 7fc436d95740 1 -- 172.21.15.159:0/2914837631 shutdown_connections 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.300+0000 7fc436d95740 1 -- 172.21.15.159:0/2914837631 wait complete. 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc436d95740 1 -- start start 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc436d95740 1 Processor -- start 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc436d95740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b06130fb60 0x55b061317cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc436d95740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b061310480 0x55b0613181f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc436d95740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b061318730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc436d95740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b06131d910 con 0x55b06131ad40 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc436d95740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b06122ff10 con 0x55b061310480 2024-09-19T06:49:32.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc436d95740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b06131da90 con 0x55b06130fb60 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc436d95740 10 client.0 _ll_register_callbacks cb 0x55b0611f8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b061318730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b061318730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48854/0 (socket says 172.21.15.159:48854) 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42ed9d640 1 -- 172.21.15.159:0/109836071 learned_addr learned my addr 172.21.15.159:0/109836071 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42dd9b640 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b061310480 0x55b0613181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42e59c640 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b06130fb60 0x55b061317cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42ed9d640 1 -- 172.21.15.159:0/109836071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b06130fb60 msgr2=0x55b061317cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b06130fb60 0x55b061317cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42ed9d640 1 -- 172.21.15.159:0/109836071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b061310480 msgr2=0x55b0613181f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b061310480 0x55b0613181f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42ed9d640 1 -- 172.21.15.159:0/109836071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b060fe66a0 con 0x55b06131ad40 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.301+0000 7fc42e59c640 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b06130fb60 0x55b061317cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b061318730 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc420014fd0 tx=0x7fc42000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1fbb0931e605c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc415ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc415ffb640 1 -- 172.21.15.159:0/109836071 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420011d50 con 0x55b06131ad40 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc415ffb640 1 -- 172.21.15.159:0/109836071 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7fc420013070 con 0x55b06131ad40 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc436d95740 1 -- 172.21.15.159:0/109836071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc420013e10 con 0x55b06131ad40 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc415ffb640 1 -- 172.21.15.159:0/109836071 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc420013270 con 0x55b06131ad40 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc436d95740 10 client.15981 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc436d95740 1 -- 172.21.15.159:0/109836071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b0613295a0 con 0x55b06131ad40 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc415ffb640 1 -- 172.21.15.159:0/109836071 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc420013e10 con 0x55b06131ad40 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.302+0000 7fc415ffb640 1 -- 172.21.15.159:0/109836071 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fc420025070 con 0x55b06131ad40 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.303+0000 7fc436d95740 10 client.15981 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.303+0000 7fc436d95740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.303+0000 7fc436d95740 20 client.15981 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.303+0000 7fc436d95740 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b06132a8f0 0x55b06132cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.303+0000 7fc436d95740 4 client.15981 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.303+0000 7fc436d95740 1 -- 172.21.15.159:0/109836071 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0612827f0 con 0x55b06132a8f0 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.303+0000 7fc42e59c640 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b06132a8f0 0x55b06132cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.303+0000 7fc42e59c640 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b06132a8f0 0x55b06132cce0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ab3b939cfbca638 server_cookie=2806a46d78103c82 in_seq=0 out_seq=0 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.303+0000 7fc415ffb640 10 client.15981 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc415ffb640 1 -- 172.21.15.159:0/109836071 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0612827f0 con 0x55b06132a8f0 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc415ffb640 10 client.15981 handle_command_reply: tid=0 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 client.15981 shutdown 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 -- 172.21.15.159:0/109836071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 msgr2=0x55b061318730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b061318730 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc420014fd0 tx=0x7fc42000bc80 comp rx=0 tx=0).stop 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 -- 172.21.15.159:0/109836071 shutdown_connections 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b06132a8f0 0x55b06132cce0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06131ad40 0x55b061318730 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b061310480 0x55b0613181f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc415ffb640 0 client.15981 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 --2- 172.21.15.159:0/109836071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b06130fb60 0x55b061317cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 -- 172.21.15.159:0/109836071 >> 172.21.15.159:0/109836071 conn(0x55b06130c0f0 msgr2=0x55b061311dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 -- 172.21.15.159:0/109836071 shutdown_connections 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 1 -- 172.21.15.159:0/109836071 wait complete. 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.304+0000 7fc436d95740 20 client.15981 trim_cache size 0 max 16384 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.321+0000 7fc436d95740 1 Processor -- start 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.321+0000 7fc436d95740 1 -- start start 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.321+0000 7fc436d95740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130c0f0 0x55b061319b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.321+0000 7fc436d95740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 0x55b0613323d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.321+0000 7fc436d95740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b061332910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc436d95740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301aba40 con 0x55b06130c0f0 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc436d95740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301ae2c0 con 0x55b06130fb60 2024-09-19T06:49:32.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc436d95740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301ac0b0 con 0x55b061310480 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130c0f0 0x55b061319b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130c0f0 0x55b061319b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48856/0 (socket says 172.21.15.159:48856) 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42e59c640 1 -- 172.21.15.159:0/655800506 learned_addr learned my addr 172.21.15.159:0/655800506 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42dd9b640 1 --2- 172.21.15.159:0/655800506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 0x55b0613323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42e59c640 1 -- 172.21.15.159:0/655800506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 msgr2=0x55b061332910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42e59c640 1 --2- 172.21.15.159:0/655800506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b061332910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42e59c640 1 -- 172.21.15.159:0/655800506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 msgr2=0x55b0613323d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42e59c640 1 --2- 172.21.15.159:0/655800506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 0x55b0613323d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42e59c640 1 -- 172.21.15.159:0/655800506 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b06131a580 con 0x55b06130c0f0 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc42e59c640 1 --2- 172.21.15.159:0/655800506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130c0f0 0x55b061319b10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55b06132d370 tx=0x7fc428015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d76e80d5d260dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc417fff640 1 -- 172.21.15.159:0/655800506 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428004b20 con 0x55b06130c0f0 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc417fff640 1 -- 172.21.15.159:0/655800506 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc42801ed50 con 0x55b06130c0f0 2024-09-19T06:49:32.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.322+0000 7fc417fff640 1 -- 172.21.15.159:0/655800506 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428005630 con 0x55b06130c0f0 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 -- 172.21.15.159:0/655800506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130c0f0 msgr2=0x55b061319b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 --2- 172.21.15.159:0/655800506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130c0f0 0x55b061319b10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55b06132d370 tx=0x7fc428015000 comp rx=0 tx=0).stop 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 -- 172.21.15.159:0/655800506 shutdown_connections 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 --2- 172.21.15.159:0/655800506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b061332910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 --2- 172.21.15.159:0/655800506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130fb60 0x55b0613323d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 --2- 172.21.15.159:0/655800506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130c0f0 0x55b061319b10 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 -- 172.21.15.159:0/655800506 >> 172.21.15.159:0/655800506 conn(0x55b0613136a0 msgr2=0x55b061319400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 -- 172.21.15.159:0/655800506 shutdown_connections 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 -- 172.21.15.159:0/655800506 wait complete. 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 -- start start 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.323+0000 7fc436d95740 1 Processor -- start 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130c0f0 0x55b06131f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130fb60 0x55b06131f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b0613943a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301ac780 con 0x55b06130fb60 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301adbf0 con 0x55b06130c0f0 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301ace50 con 0x55b061310480 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 10 client.0 _ll_register_callbacks cb 0x7fc42000bd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130fb60 0x55b06131f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130fb60 0x55b06131f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48860/0 (socket says 172.21.15.159:48860) 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42dd9b640 1 -- 172.21.15.159:0/2786823873 learned_addr learned my addr 172.21.15.159:0/2786823873 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42ed9d640 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b0613943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42e59c640 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130c0f0 0x55b06131f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42dd9b640 1 -- 172.21.15.159:0/2786823873 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 msgr2=0x55b0613943a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42dd9b640 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b0613943a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42dd9b640 1 -- 172.21.15.159:0/2786823873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130c0f0 msgr2=0x55b06131f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42dd9b640 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130c0f0 0x55b06131f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42dd9b640 1 -- 172.21.15.159:0/2786823873 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0613948e0 con 0x55b06130fb60 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc42dd9b640 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130fb60 0x55b06131f6a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc4180edaa0 tx=0x7fc418009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88124953b0d143c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc415ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc415ffb640 1 -- 172.21.15.159:0/2786823873 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418049040 con 0x55b06130fb60 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc415ffb640 1 -- 172.21.15.159:0/2786823873 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7fc4180b8bf0 con 0x55b06130fb60 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 1 -- 172.21.15.159:0/2786823873 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc42801ed50 con 0x55b06130fb60 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc415ffb640 1 -- 172.21.15.159:0/2786823873 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc4180bbee0 con 0x55b06130fb60 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 10 client.15987 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.324+0000 7fc436d95740 1 -- 172.21.15.159:0/2786823873 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b061395bf0 con 0x55b06130fb60 2024-09-19T06:49:32.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc415ffb640 1 -- 172.21.15.159:0/2786823873 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc42801ed50 con 0x55b06130fb60 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc415ffb640 1 -- 172.21.15.159:0/2786823873 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fc4180bc7e0 con 0x55b06130fb60 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc436d95740 10 client.15987 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc436d95740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc436d95740 20 client.15987 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc436d95740 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b06131ad40 0x55b061398400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc436d95740 4 client.15987 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc436d95740 1 -- 172.21.15.159:0/2786823873 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b06127cd00 con 0x55b06131ad40 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc42e59c640 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b06131ad40 0x55b061398400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc415ffb640 10 client.15987 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.325+0000 7fc42e59c640 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b06131ad40 0x55b061398400 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e40bcb1ff45dd34e server_cookie=7d578a860732658c in_seq=0 out_seq=0 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.326+0000 7fc415ffb640 1 -- 172.21.15.159:0/2786823873 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b06127cd00 con 0x55b06131ad40 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.326+0000 7fc415ffb640 10 client.15987 handle_command_reply: tid=0 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.326+0000 7fc436d95740 1 client.15987 shutdown 2024-09-19T06:49:32.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 -- 172.21.15.159:0/2786823873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130fb60 msgr2=0x55b06131f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130fb60 0x55b06131f6a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc4180edaa0 tx=0x7fc418009620 comp rx=0 tx=0).stop 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 -- 172.21.15.159:0/2786823873 shutdown_connections 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b06131ad40 0x55b061398400 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b061310480 0x55b0613943a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b06130fb60 0x55b06131f6a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 --2- 172.21.15.159:0/2786823873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b06130c0f0 0x55b06131f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 -- 172.21.15.159:0/2786823873 >> 172.21.15.159:0/2786823873 conn(0x55b0613136a0 msgr2=0x55b061311dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc415ffb640 0 client.15987 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 -- 172.21.15.159:0/2786823873 shutdown_connections 2024-09-19T06:49:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:49:32.396 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:49:32.396 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "3bcc76d2-211e-483c-b2c5-7d147f533617", 2024-09-19T06:49:32.396 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:49:32.396 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:49:32.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 1 -- 172.21.15.159:0/2786823873 wait complete. 2024-09-19T06:49:32.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc436d95740 20 client.15987 trim_cache size 0 max 16384 2024-09-19T06:49:32.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 -- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc41c0a33b0 msgr2=0x7fc41c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc41c0a33b0 0x7fc41c0a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc428005fd0 tx=0x7fc4280093e0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 -- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 msgr2=0x7fc430198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 0x7fc430198b20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc418005940 tx=0x7fc4180042f0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 -- 172.21.15.159:0/2546441933 shutdown_connections 2024-09-19T06:49:32.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc41c0a33b0 0x7fc41c0a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4301082a0 0x7fc43019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4301036e0 0x7fc430198b20 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 --2- 172.21.15.159:0/2546441933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc430102d30 0x7fc4301985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.327+0000 7fc4349bc640 1 -- 172.21.15.159:0/2546441933 >> 172.21.15.159:0/2546441933 conn(0x7fc4300fc7d0 msgr2=0x7fc430105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.328+0000 7fc4349bc640 1 -- 172.21.15.159:0/2546441933 shutdown_connections 2024-09-19T06:49:32.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:32.328+0000 7fc4349bc640 1 -- 172.21.15.159:0/2546441933 wait complete. 2024-09-19T06:49:32.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:32 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:49:32.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:32 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:32.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:32 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:49:32.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:32 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:49:32.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:32 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:32.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:32 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:49:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:32 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:49:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:32 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:32 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:49:33.537 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:49:33.788 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:33.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:33 smithi203 ceph-mon[35473]: pgmap v80: 97 pgs: 97 active+clean; 38 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 1.87k op/s 2024-09-19T06:49:33.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:33 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:33.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:33 smithi189 ceph-mon[34880]: pgmap v80: 97 pgs: 97 active+clean; 38 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 1.87k op/s 2024-09-19T06:49:33.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:33 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:33.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:33 smithi159 ceph-mon[30935]: pgmap v80: 97 pgs: 97 active+clean; 38 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 1.87k op/s 2024-09-19T06:49:33.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:33 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:34.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 -- 172.21.15.159:0/1022861523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 msgr2=0x7fdb6010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/1022861523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 0x7fdb6010e610 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009ca0 tx=0x7fdb5802a950 comp rx=0 tx=0).stop 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 -- 172.21.15.159:0/1022861523 shutdown_connections 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/1022861523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 0x7fdb6010e610 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/1022861523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb60103700 0x7fdb6010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/1022861523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb60102de0 0x7fdb601031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 -- 172.21.15.159:0/1022861523 >> 172.21.15.159:0/1022861523 conn(0x7fdb600fc7a0 msgr2=0x7fdb600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 -- 172.21.15.159:0/1022861523 shutdown_connections 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 -- 172.21.15.159:0/1022861523 wait complete. 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 Processor -- start 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.329+0000 7fdb67fcc640 1 -- start start 2024-09-19T06:49:34.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb67fcc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb60102de0 0x7fdb60198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb67fcc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb60103700 0x7fdb601989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb67fcc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 0x7fdb6019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb67fcc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60111fd0 con 0x7fdb6010c180 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb67fcc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60111e50 con 0x7fdb60103700 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb67fcc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60112150 con 0x7fdb60102de0 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb66569640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 0x7fdb6019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb66569640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 0x7fdb6019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48872/0 (socket says 172.21.15.159:48872) 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb66569640 1 -- 172.21.15.159:0/3966122044 learned_addr learned my addr 172.21.15.159:0/3966122044 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb65d68640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb60102de0 0x7fdb60198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb65567640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb60103700 0x7fdb601989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb66569640 1 -- 172.21.15.159:0/3966122044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb60102de0 msgr2=0x7fdb60198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb66569640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb60102de0 0x7fdb60198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb66569640 1 -- 172.21.15.159:0/3966122044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb60103700 msgr2=0x7fdb601989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb66569640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb60103700 0x7fdb601989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb66569640 1 -- 172.21.15.159:0/3966122044 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6019d420 con 0x7fdb6010c180 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb65d68640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb60102de0 0x7fdb60198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb66569640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 0x7fdb6019cd40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fdb5802ae70 tx=0x7fdb5802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb56ffd640 1 -- 172.21.15.159:0/3966122044 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58034040 con 0x7fdb6010c180 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb56ffd640 1 -- 172.21.15.159:0/3966122044 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb58030920 con 0x7fdb6010c180 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb67fcc640 1 -- 172.21.15.159:0/3966122044 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6019d6b0 con 0x7fdb6010c180 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb56ffd640 1 -- 172.21.15.159:0/3966122044 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58045480 con 0x7fdb6010c180 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.330+0000 7fdb67fcc640 1 -- 172.21.15.159:0/3966122044 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb601a4ff0 con 0x7fdb6010c180 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.332+0000 7fdb56ffd640 1 -- 172.21.15.159:0/3966122044 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fdb58037020 con 0x7fdb6010c180 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.333+0000 7fdb6a3a5740 1 Processor -- start 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.333+0000 7fdb6a3a5740 1 -- start start 2024-09-19T06:49:34.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.333+0000 7fdb56ffd640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb4c0a33b0 0x7fdb4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.333+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 0x562622bf9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.333+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 0x562622c04140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.333+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622c04680 0x562622c06a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562622b5f2e0 con 0x562622c04680 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562622b06ce0 con 0x562622bf9dc0 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562622b5b2a0 con 0x562622bf94a0 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb56ffd640 1 -- 172.21.15.159:0/3966122044 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7fdb580f0c60 con 0x7fdb6010c180 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb66569640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622c04680 0x562622c06a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb66569640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622c04680 0x562622c06a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48874/0 (socket says 172.21.15.159:48874) 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb66569640 1 -- 172.21.15.159:0/193040976 learned_addr learned my addr 172.21.15.159:0/193040976 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb65d68640 1 --2- 172.21.15.159:0/193040976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 0x562622bf9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb65567640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb4c0a33b0 0x7fdb4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb66569640 1 -- 172.21.15.159:0/193040976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 msgr2=0x562622bf9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb66569640 1 --2- 172.21.15.159:0/193040976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 0x562622bf9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb66569640 1 -- 172.21.15.159:0/193040976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 msgr2=0x562622c04140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb66569640 1 --2- 172.21.15.159:0/193040976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 0x562622c04140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb66569640 1 -- 172.21.15.159:0/193040976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562622aeb440 con 0x562622c04680 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb66569640 1 --2- 172.21.15.159:0/193040976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622c04680 0x562622c06a70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdb580b99f0 tx=0x7fdb580b9380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d26b689bcc3cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb4bfff640 1 -- 172.21.15.159:0/193040976 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5802c040 con 0x562622c04680 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb4bfff640 1 -- 172.21.15.159:0/193040976 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb580098d0 con 0x562622c04680 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb4bfff640 1 -- 172.21.15.159:0/193040976 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb580c13d0 con 0x562622c04680 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.334+0000 7fdb65567640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb4c0a33b0 0x7fdb4c0a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x562622bf6890 tx=0x7fdb5c005f30 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/193040976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622c04680 msgr2=0x562622c06a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/193040976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622c04680 0x562622c06a70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdb580b99f0 tx=0x7fdb580b9380 comp rx=0 tx=0).stop 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/193040976 shutdown_connections 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/193040976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622c04680 0x562622c06a70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/193040976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 0x562622c04140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/193040976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 0x562622bf9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/193040976 >> 172.21.15.159:0/193040976 conn(0x562622bf5a30 msgr2=0x562622bf5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/193040976 shutdown_connections 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/193040976 wait complete. 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.335+0000 7fdb6a3a5740 1 -- start start 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb6a3a5740 1 Processor -- start 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 0x562622c04040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622c04680 0x562622c018e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562622c07010 con 0x562622bf9dc0 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562622b1a050 con 0x562622c04680 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562622c07190 con 0x562622bf94a0 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb6a3a5740 10 client.0 _ll_register_callbacks cb 0x562622b5a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:34.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65567640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65567640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48876/0 (socket says 172.21.15.159:48876) 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65567640 1 -- 172.21.15.159:0/913398640 learned_addr learned my addr 172.21.15.159:0/913398640 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65d68640 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 0x562622c04040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65567640 1 -- 172.21.15.159:0/913398640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 msgr2=0x562622c04040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65567640 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 0x562622c04040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65567640 1 -- 172.21.15.159:0/913398640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622c04680 msgr2=0x562622c018e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65567640 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622c04680 0x562622c018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65567640 1 -- 172.21.15.159:0/913398640 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626228d03c0 con 0x562622bf9dc0 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.336+0000 7fdb65d68640 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 0x562622c04040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb65567640 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c012f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00ffe0 tx=0x7fdb5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebaeb79688aa22a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb497fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:34.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb497fa640 1 -- 172.21.15.159:0/913398640 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c022070 con 0x562622bf9dc0 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb497fa640 1 -- 172.21.15.159:0/913398640 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7fdb5c01e860 con 0x562622bf9dc0 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/913398640 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562622b6c850 con 0x562622bf9dc0 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb497fa640 1 -- 172.21.15.159:0/913398640 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fdb5c02e050 con 0x562622bf9dc0 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb6a3a5740 10 client.15999 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/913398640 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562622c12a00 con 0x562622bf9dc0 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb497fa640 1 -- 172.21.15.159:0/913398640 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562622b6c850 con 0x562622bf9dc0 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb497fa640 1 -- 172.21.15.159:0/913398640 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fdb5c010bd0 con 0x562622bf9dc0 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb6a3a5740 10 client.15999 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb6a3a5740 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb6a3a5740 20 client.15999 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562622c13e60 0x562622c16300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb6a3a5740 4 client.15999 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:34.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.337+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/913398640 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562622b66d60 con 0x562622c13e60 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.338+0000 7fdb65d68640 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562622c13e60 0x562622c16300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.338+0000 7fdb497fa640 10 client.15999 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.338+0000 7fdb65d68640 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562622c13e60 0x562622c16300 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db6d5ccc641cea2e server_cookie=3639d9ef4743217 in_seq=0 out_seq=0 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb497fa640 1 -- 172.21.15.159:0/913398640 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562622b66d60 con 0x562622c13e60 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb497fa640 10 client.15999 handle_command_reply: tid=0 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 client.15999 shutdown 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/913398640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 msgr2=0x562622c012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c012f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00ffe0 tx=0x7fdb5c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/913398640 shutdown_connections 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562622c13e60 0x562622c16300 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622c04680 0x562622c018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c012f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb497fa640 0 client.15999 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:34.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/913398640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622bf94a0 0x562622c04040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/913398640 >> 172.21.15.159:0/913398640 conn(0x562622bf5a30 msgr2=0x562622bfb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/913398640 shutdown_connections 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/913398640 wait complete. 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.339+0000 7fdb6a3a5740 20 client.15999 trim_cache size 0 max 16384 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb6a3a5740 1 Processor -- start 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb6a3a5740 1 -- start start 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf94a0 0x562622c100d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c1bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 0x562622c1c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601ab940 con 0x562622bf9dc0 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601ae1c0 con 0x562622bf94a0 2024-09-19T06:49:34.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601abfb0 con 0x562622c04680 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb65567640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c1bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb65567640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c1bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48888/0 (socket says 172.21.15.159:48888) 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb65567640 1 -- 172.21.15.159:0/340364395 learned_addr learned my addr 172.21.15.159:0/340364395 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb65567640 1 -- 172.21.15.159:0/340364395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 msgr2=0x562622c1c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb66569640 1 --2- 172.21.15.159:0/340364395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 0x562622c1c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb65567640 1 --2- 172.21.15.159:0/340364395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 0x562622c1c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb65567640 1 -- 172.21.15.159:0/340364395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf94a0 msgr2=0x562622c100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb65d68640 1 --2- 172.21.15.159:0/340364395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf94a0 0x562622c100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.356+0000 7fdb65567640 1 --2- 172.21.15.159:0/340364395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf94a0 0x562622c100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.357+0000 7fdb65567640 1 -- 172.21.15.159:0/340364395 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562622c01c50 con 0x562622bf9dc0 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.357+0000 7fdb65567640 1 --2- 172.21.15.159:0/340364395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c1bbd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0263b0 tx=0x7fdb5c011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab7c6d643e05f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.357+0000 7fdb4b7fe640 1 -- 172.21.15.159:0/340364395 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c036030 con 0x562622bf9dc0 2024-09-19T06:49:34.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.357+0000 7fdb4b7fe640 1 -- 172.21.15.159:0/340364395 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5c00b840 con 0x562622bf9dc0 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.357+0000 7fdb4b7fe640 1 -- 172.21.15.159:0/340364395 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c022050 con 0x562622bf9dc0 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.357+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/340364395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 msgr2=0x562622c1bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.357+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/340364395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c1bbd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0263b0 tx=0x7fdb5c011ee0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/340364395 shutdown_connections 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/340364395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 0x562622c1c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/340364395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf9dc0 0x562622c1bbd0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/340364395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf94a0 0x562622c100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/340364395 >> 172.21.15.159:0/340364395 conn(0x562622bf5a30 msgr2=0x562622bfc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/340364395 shutdown_connections 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/340364395 wait complete. 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 -- start start 2024-09-19T06:49:34.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 Processor -- start 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "3bcc76d2-211e-483c-b2c5-7d147f533617": { 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "3bcc76d2-211e-483c-b2c5-7d147f533617", 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:49:34.378 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf94a0 0x562622c083a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 0x562622c088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 0x562622c7dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601ac680 con 0x562622bf94a0 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601adaf0 con 0x562622bf9dc0 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601acd50 con 0x562622c04680 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb6a3a5740 10 client.0 _ll_register_callbacks cb 0x7fdb5c015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb65d68640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf94a0 0x562622c083a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb65d68640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf94a0 0x562622c083a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48894/0 (socket says 172.21.15.159:48894) 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.358+0000 7fdb65d68640 1 -- 172.21.15.159:0/3370831956 learned_addr learned my addr 172.21.15.159:0/3370831956 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:34.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb66569640 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 0x562622c7dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb65567640 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 0x562622c088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb65d68640 1 -- 172.21.15.159:0/3370831956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 msgr2=0x562622c7dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:34.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb65d68640 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 0x562622c7dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb65d68640 1 -- 172.21.15.159:0/3370831956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 msgr2=0x562622c088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:34.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb65d68640 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 0x562622c088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb65d68640 1 -- 172.21.15.159:0/3370831956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562622c7e0e0 con 0x562622bf94a0 2024-09-19T06:49:34.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb65567640 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 0x562622c088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:34.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb65d68640 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf94a0 0x562622c083a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdb50004810 tx=0x7fdb500157f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c231281749cf2a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:34.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb497fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb497fa640 1 -- 172.21.15.159:0/3370831956 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb500145c0 con 0x562622bf94a0 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb497fa640 1 -- 172.21.15.159:0/3370831956 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7fdb50014760 con 0x562622bf94a0 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/3370831956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb5c00b840 con 0x562622bf94a0 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb497fa640 1 -- 172.21.15.159:0/3370831956 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fdb50014960 con 0x562622bf94a0 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb6a3a5740 10 client.16005 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/3370831956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562622c7f320 con 0x562622bf94a0 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.359+0000 7fdb497fa640 1 -- 172.21.15.159:0/3370831956 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5c00b840 con 0x562622bf94a0 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb497fa640 1 -- 172.21.15.159:0/3370831956 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fdb5002b070 con 0x562622bf94a0 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb6a3a5740 10 client.16005 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:34.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb6a3a5740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:34.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb6a3a5740 20 client.16005 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:34.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562622c7fa80 0x562622c81ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:34.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb6a3a5740 4 client.16005 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:49:34.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/3370831956 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562622ae3210 con 0x562622c7fa80 2024-09-19T06:49:34.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb65567640 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562622c7fa80 0x562622c81ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:34.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb497fa640 10 client.16005 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:34.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb65567640 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562622c7fa80 0x562622c81ea0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c854af4d3e45ee9 server_cookie=7998cc3656acb03a in_seq=0 out_seq=0 2024-09-19T06:49:34.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb497fa640 1 -- 172.21.15.159:0/3370831956 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562622ae3210 con 0x562622c7fa80 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb497fa640 10 client.16005 handle_command_reply: tid=0 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.360+0000 7fdb6a3a5740 1 client.16005 shutdown 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/3370831956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf94a0 msgr2=0x562622c083a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf94a0 0x562622c083a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdb50004810 tx=0x7fdb500157f0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/3370831956 shutdown_connections 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562622c7fa80 0x562622c81ea0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562622c04680 0x562622c7dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562622bf9dc0 0x562622c088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 --2- 172.21.15.159:0/3370831956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562622bf94a0 0x562622c083a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb497fa640 0 client.16005 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:34.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/3370831956 >> 172.21.15.159:0/3370831956 conn(0x562622bf5a30 msgr2=0x562622c02b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/3370831956 shutdown_connections 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 1 -- 172.21.15.159:0/3370831956 wait complete. 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb6a3a5740 20 client.16005 trim_cache size 0 max 16384 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 -- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb4c0a33b0 msgr2=0x7fdb4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb4c0a33b0 0x7fdb4c0a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x562622bf6890 tx=0x7fdb5c005f30 comp rx=0 tx=0).stop 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 -- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 msgr2=0x7fdb6019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 0x7fdb6019cd40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fdb5802ae70 tx=0x7fdb5802f5b0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 -- 172.21.15.159:0/3966122044 shutdown_connections 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb4c0a33b0 0x7fdb4c0a5870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6010c180 0x7fdb6019cd40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb60103700 0x7fdb601989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 --2- 172.21.15.159:0/3966122044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb60102de0 0x7fdb60198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 -- 172.21.15.159:0/3966122044 >> 172.21.15.159:0/3966122044 conn(0x7fdb600fc7a0 msgr2=0x7fdb600fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:34.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.361+0000 7fdb67fcc640 1 -- 172.21.15.159:0/3966122044 shutdown_connections 2024-09-19T06:49:34.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:49:34.362+0000 7fdb67fcc640 1 -- 172.21.15.159:0/3966122044 wait complete. 2024-09-19T06:49:34.814 INFO:tasks.workunit.client.0.smithi159.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-09-19T06:49:34.814 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether ln -s works... yes 2024-09-19T06:49:34.837 INFO:tasks.workunit.client.0.smithi159.stdout:checking the maximum length of command line arguments... 1572864 2024-09-19T06:49:34.840 INFO:tasks.workunit.client.0.smithi159.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-19T06:49:34.840 INFO:tasks.workunit.client.0.smithi159.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-19T06:49:34.840 INFO:tasks.workunit.client.0.smithi159.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-09-19T06:49:34.841 INFO:tasks.workunit.client.0.smithi159.stdout:checking for objdump... objdump 2024-09-19T06:49:34.841 INFO:tasks.workunit.client.0.smithi159.stdout:checking how to recognize dependent libraries... pass_all 2024-09-19T06:49:34.841 INFO:tasks.workunit.client.0.smithi159.stdout:checking for dlltool... no 2024-09-19T06:49:34.841 INFO:tasks.workunit.client.0.smithi159.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-19T06:49:34.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:34 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:49:34.842 INFO:tasks.workunit.client.0.smithi159.stdout:checking for ar... ar 2024-09-19T06:49:34.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:34 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:49:34.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:34 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:49:34.951 INFO:tasks.workunit.client.0.smithi159.stdout:checking for archiver @FILE support... @ 2024-09-19T06:49:34.951 INFO:tasks.workunit.client.0.smithi159.stdout:checking for strip... strip 2024-09-19T06:49:34.951 INFO:tasks.workunit.client.0.smithi159.stdout:checking for ranlib... ranlib 2024-09-19T06:49:34.951 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gawk... gawk 2024-09-19T06:49:35.056 INFO:tasks.workunit.client.0.smithi159.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-09-19T06:49:35.057 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sysroot... no 2024-09-19T06:49:35.071 INFO:tasks.workunit.client.0.smithi159.stdout:checking for a working dd... /usr/bin/dd 2024-09-19T06:49:35.086 INFO:tasks.workunit.client.0.smithi159.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-09-19T06:49:35.121 INFO:tasks.workunit.client.0.smithi159.stdout:checking for mt... no 2024-09-19T06:49:35.135 INFO:tasks.workunit.client.0.smithi159.stdout:checking if : is a manifest tool... no 2024-09-19T06:49:35.215 INFO:tasks.cephfs.filesystem:scrub status for tag:3bcc76d2-211e-483c-b2c5-7d147f533617 - {'path': '/', 'tag': '3bcc76d2-211e-483c-b2c5-7d147f533617', 'options': 'recursive,force'} 2024-09-19T06:49:35.261 INFO:tasks.workunit.client.0.smithi159.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T06:49:35.470 INFO:tasks.workunit.client.0.smithi159.stdout:checking for ANSI C header files... yes 2024-09-19T06:49:35.507 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/types.h... yes 2024-09-19T06:49:35.544 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/stat.h... yes 2024-09-19T06:49:35.581 INFO:tasks.workunit.client.0.smithi159.stdout:checking for stdlib.h... yes 2024-09-19T06:49:35.619 INFO:tasks.workunit.client.0.smithi159.stdout:checking for string.h... yes 2024-09-19T06:49:35.658 INFO:tasks.workunit.client.0.smithi159.stdout:checking for memory.h... yes 2024-09-19T06:49:35.697 INFO:tasks.workunit.client.0.smithi159.stdout:checking for strings.h... yes 2024-09-19T06:49:35.735 INFO:tasks.workunit.client.0.smithi159.stdout:checking for inttypes.h... yes 2024-09-19T06:49:35.774 INFO:tasks.workunit.client.0.smithi159.stdout:checking for stdint.h... yes 2024-09-19T06:49:35.815 INFO:tasks.workunit.client.0.smithi159.stdout:checking for unistd.h... yes 2024-09-19T06:49:35.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:35 smithi203 ceph-mon[35473]: pgmap v81: 97 pgs: 97 active+clean; 38 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 1.87k op/s 2024-09-19T06:49:35.858 INFO:tasks.workunit.client.0.smithi159.stdout:checking for dlfcn.h... yes 2024-09-19T06:49:35.863 INFO:tasks.workunit.client.0.smithi159.stdout:checking for objdir... .libs 2024-09-19T06:49:35.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:35 smithi189 ceph-mon[34880]: pgmap v81: 97 pgs: 97 active+clean; 38 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 1.87k op/s 2024-09-19T06:49:35.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:35 smithi159 ceph-mon[30935]: pgmap v81: 97 pgs: 97 active+clean; 38 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 1.87k op/s 2024-09-19T06:49:35.979 INFO:tasks.workunit.client.0.smithi159.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-19T06:49:35.979 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-19T06:49:36.013 INFO:tasks.workunit.client.0.smithi159.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-19T06:49:36.057 INFO:tasks.workunit.client.0.smithi159.stdout:checking if gcc static flag -static works... no 2024-09-19T06:49:36.112 INFO:tasks.workunit.client.0.smithi159.stdout:checking if gcc supports -c -o file.o... yes 2024-09-19T06:49:36.112 INFO:tasks.workunit.client.0.smithi159.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-19T06:49:36.119 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-19T06:49:36.174 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether -lc should be explicitly linked in... no 2024-09-19T06:49:36.229 INFO:tasks.workunit.client.0.smithi159.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-19T06:49:36.229 INFO:tasks.workunit.client.0.smithi159.stdout:checking how to hardcode library paths into programs... immediate 2024-09-19T06:49:36.230 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether stripping libraries is possible... yes 2024-09-19T06:49:36.231 INFO:tasks.workunit.client.0.smithi159.stdout:checking if libtool supports shared libraries... yes 2024-09-19T06:49:36.231 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether to build shared libraries... yes 2024-09-19T06:49:36.231 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether to build static libraries... yes 2024-09-19T06:49:36.237 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gcc... (cached) gcc 2024-09-19T06:49:36.271 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T06:49:36.271 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T06:49:36.271 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T06:49:36.272 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gmake... /usr/bin/gmake 2024-09-19T06:49:36.272 INFO:tasks.workunit.client.0.smithi159.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-19T06:49:36.272 INFO:tasks.workunit.client.0.smithi159.stdout:checking for tar... /bin/tar 2024-09-19T06:49:36.273 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gzip... /bin/gzip 2024-09-19T06:49:36.292 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether gcc -MM is supported... yes 2024-09-19T06:49:36.292 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sort... /bin/sort 2024-09-19T06:49:36.292 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether ln -s works... yes 2024-09-19T06:49:36.292 INFO:tasks.workunit.client.0.smithi159.stdout:checking for rpm... /bin/rpm 2024-09-19T06:49:36.295 INFO:tasks.workunit.client.0.smithi159.stdout:checking for rpmbuild... no 2024-09-19T06:49:36.352 INFO:tasks.workunit.client.0.smithi159.stdout:checking assert.h usability... yes 2024-09-19T06:49:36.368 INFO:tasks.workunit.client.0.smithi159.stdout:checking assert.h presence... yes 2024-09-19T06:49:36.368 INFO:tasks.workunit.client.0.smithi159.stdout:checking for assert.h... yes 2024-09-19T06:49:36.415 INFO:tasks.workunit.client.0.smithi159.stdout:checking bstring.h usability... no 2024-09-19T06:49:36.442 INFO:tasks.workunit.client.0.smithi159.stdout:checking bstring.h presence... no 2024-09-19T06:49:36.442 INFO:tasks.workunit.client.0.smithi159.stdout:checking for bstring.h... no 2024-09-19T06:49:36.480 INFO:tasks.workunit.client.0.smithi159.stdout:checking libgen.h usability... yes 2024-09-19T06:49:36.496 INFO:tasks.workunit.client.0.smithi159.stdout:checking libgen.h presence... yes 2024-09-19T06:49:36.496 INFO:tasks.workunit.client.0.smithi159.stdout:checking for libgen.h... yes 2024-09-19T06:49:36.552 INFO:tasks.workunit.client.0.smithi159.stdout:checking dirent.h usability... yes 2024-09-19T06:49:36.569 INFO:tasks.workunit.client.0.smithi159.stdout:checking dirent.h presence... yes 2024-09-19T06:49:36.569 INFO:tasks.workunit.client.0.smithi159.stdout:checking for dirent.h... yes 2024-09-19T06:49:36.612 INFO:tasks.workunit.client.0.smithi159.stdout:checking errno.h usability... yes 2024-09-19T06:49:36.628 INFO:tasks.workunit.client.0.smithi159.stdout:checking errno.h presence... yes 2024-09-19T06:49:36.628 INFO:tasks.workunit.client.0.smithi159.stdout:checking for errno.h... yes 2024-09-19T06:49:36.671 INFO:tasks.workunit.client.0.smithi159.stdout:checking malloc.h usability... yes 2024-09-19T06:49:36.689 INFO:tasks.workunit.client.0.smithi159.stdout:checking malloc.h presence... yes 2024-09-19T06:49:36.689 INFO:tasks.workunit.client.0.smithi159.stdout:checking for malloc.h... yes 2024-09-19T06:49:36.737 INFO:tasks.workunit.client.0.smithi159.stdout:checking uuid.h usability... no 2024-09-19T06:49:36.764 INFO:tasks.workunit.client.0.smithi159.stdout:checking uuid.h presence... no 2024-09-19T06:49:36.765 INFO:tasks.workunit.client.0.smithi159.stdout:checking for uuid.h... no 2024-09-19T06:49:36.819 INFO:tasks.workunit.client.0.smithi159.stdout:checking uuid/uuid.h usability... yes 2024-09-19T06:49:36.837 INFO:tasks.workunit.client.0.smithi159.stdout:checking uuid/uuid.h presence... yes 2024-09-19T06:49:36.837 INFO:tasks.workunit.client.0.smithi159.stdout:checking for uuid/uuid.h... yes 2024-09-19T06:49:36.886 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/uuid.h usability... no 2024-09-19T06:49:36.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:36 smithi159 ceph-mon[30935]: pgmap v82: 97 pgs: 97 active+clean; 39 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 2.13k op/s 2024-09-19T06:49:36.914 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/uuid.h presence... no 2024-09-19T06:49:36.914 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/uuid.h... no 2024-09-19T06:49:36.962 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/file.h usability... yes 2024-09-19T06:49:36.979 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/file.h presence... yes 2024-09-19T06:49:36.979 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/file.h... yes 2024-09-19T06:49:37.029 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/fcntl.h usability... yes 2024-09-19T06:49:37.046 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/fcntl.h presence... yes 2024-09-19T06:49:37.046 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/fcntl.h... yes 2024-09-19T06:49:37.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:36 smithi203 ceph-mon[35473]: pgmap v82: 97 pgs: 97 active+clean; 39 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 2.13k op/s 2024-09-19T06:49:37.094 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/syssgi.h usability... no 2024-09-19T06:49:37.122 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/syssgi.h presence... no 2024-09-19T06:49:37.122 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/syssgi.h... no 2024-09-19T06:49:37.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:36 smithi189 ceph-mon[34880]: pgmap v82: 97 pgs: 97 active+clean; 39 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 2.13k op/s 2024-09-19T06:49:37.226 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/param.h usability... yes 2024-09-19T06:49:37.245 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/param.h presence... yes 2024-09-19T06:49:37.246 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/param.h... yes 2024-09-19T06:49:37.259 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/stat.h... (cached) yes 2024-09-19T06:49:37.301 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/statvfs.h usability... yes 2024-09-19T06:49:37.318 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/statvfs.h presence... yes 2024-09-19T06:49:37.318 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/statvfs.h... yes 2024-09-19T06:49:37.361 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/time.h usability... yes 2024-09-19T06:49:37.378 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/time.h presence... yes 2024-09-19T06:49:37.378 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/time.h... yes 2024-09-19T06:49:37.422 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/ioctl.h usability... yes 2024-09-19T06:49:37.439 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/ioctl.h presence... yes 2024-09-19T06:49:37.439 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/ioctl.h... yes 2024-09-19T06:49:37.494 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/wait.h usability... yes 2024-09-19T06:49:37.512 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/wait.h presence... yes 2024-09-19T06:49:37.512 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/wait.h... yes 2024-09-19T06:49:37.526 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/types.h... (cached) yes 2024-09-19T06:49:37.531 INFO:tasks.workunit.client.0.smithi159.stdout:checking for strings.h... (cached) yes 2024-09-19T06:49:37.566 INFO:tasks.workunit.client.0.smithi159.stdout:checking err.h usability... yes 2024-09-19T06:49:37.583 INFO:tasks.workunit.client.0.smithi159.stdout:checking err.h presence... yes 2024-09-19T06:49:37.583 INFO:tasks.workunit.client.0.smithi159.stdout:checking for err.h... yes 2024-09-19T06:49:37.627 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/falloc.h usability... yes 2024-09-19T06:49:37.643 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/falloc.h presence... yes 2024-09-19T06:49:37.643 INFO:tasks.workunit.client.0.smithi159.stdout:checking for linux/falloc.h... yes 2024-09-19T06:49:37.690 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-19T06:49:37.717 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-19T06:49:37.717 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-19T06:49:37.758 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-19T06:49:37.786 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-19T06:49:37.786 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-19T06:49:37.829 INFO:tasks.workunit.client.0.smithi159.stdout:checking xfs/platform_defs.h usability... no 2024-09-19T06:49:37.856 INFO:tasks.workunit.client.0.smithi159.stdout:checking xfs/platform_defs.h presence... no 2024-09-19T06:49:37.856 INFO:tasks.workunit.client.0.smithi159.stdout:checking for xfs/platform_defs.h... no 2024-09-19T06:49:38.008 INFO:tasks.workunit.client.0.smithi159.stdout:checking btrfs/ioctl.h usability... no 2024-09-19T06:49:38.036 INFO:tasks.workunit.client.0.smithi159.stdout:checking btrfs/ioctl.h presence... no 2024-09-19T06:49:38.036 INFO:tasks.workunit.client.0.smithi159.stdout:checking for btrfs/ioctl.h... no 2024-09-19T06:49:38.181 INFO:tasks.workunit.client.0.smithi159.stdout:checking cifs/ioctl.h usability... no 2024-09-19T06:49:38.209 INFO:tasks.workunit.client.0.smithi159.stdout:checking cifs/ioctl.h presence... no 2024-09-19T06:49:38.210 INFO:tasks.workunit.client.0.smithi159.stdout:checking for cifs/ioctl.h... no 2024-09-19T06:49:38.710 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/mman.h usability... yes 2024-09-19T06:49:38.730 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/mman.h presence... yes 2024-09-19T06:49:38.730 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/mman.h... yes 2024-09-19T06:49:38.784 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/ext4.h usability... no 2024-09-19T06:49:38.813 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/ext4.h presence... no 2024-09-19T06:49:38.813 INFO:tasks.workunit.client.0.smithi159.stdout:checking for linux/ext4.h... no 2024-09-19T06:49:38.842 INFO:tasks.workunit.client.0.smithi159.stdout:checking for xfs/xfs_log_format.h... no 2024-09-19T06:49:38.901 INFO:tasks.workunit.client.0.smithi159.stdout:checking for uuid_compare... no 2024-09-19T06:49:38.940 INFO:tasks.workunit.client.0.smithi159.stdout:checking for uuid_compare in -luuid... yes 2024-09-19T06:49:39.008 INFO:tasks.workunit.client.0.smithi159.stdout:checking for xfs/xfs.h... yes 2024-09-19T06:49:39.043 INFO:tasks.workunit.client.0.smithi159.stdout:checking for xfs/libxfs.h... no 2024-09-19T06:49:39.071 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-19T06:49:39.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:38 smithi203 ceph-mon[35473]: pgmap v83: 97 pgs: 97 active+clean; 39 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 839 KiB/s wr, 513 op/s 2024-09-19T06:49:39.108 INFO:tasks.workunit.client.0.smithi159.stdout:checking for xfs/xqm.h... yes 2024-09-19T06:49:39.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:38 smithi189 ceph-mon[34880]: pgmap v83: 97 pgs: 97 active+clean; 39 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 839 KiB/s wr, 513 op/s 2024-09-19T06:49:39.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:38 smithi159 ceph-mon[30935]: pgmap v83: 97 pgs: 97 active+clean; 39 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 839 KiB/s wr, 513 op/s 2024-09-19T06:49:39.160 INFO:tasks.workunit.client.0.smithi159.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-19T06:49:39.196 INFO:tasks.workunit.client.0.smithi159.stdout:checking xfs/handle.h usability... yes 2024-09-19T06:49:39.210 INFO:tasks.workunit.client.0.smithi159.stdout:checking xfs/handle.h presence... yes 2024-09-19T06:49:39.210 INFO:tasks.workunit.client.0.smithi159.stdout:checking for xfs/handle.h... yes 2024-09-19T06:49:39.257 INFO:tasks.workunit.client.0.smithi159.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-19T06:49:39.293 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/acl.h usability... yes 2024-09-19T06:49:39.310 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/acl.h presence... yes 2024-09-19T06:49:39.311 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/acl.h... yes 2024-09-19T06:49:39.352 INFO:tasks.workunit.client.0.smithi159.stdout:checking acl/libacl.h usability... yes 2024-09-19T06:49:39.369 INFO:tasks.workunit.client.0.smithi159.stdout:checking acl/libacl.h presence... yes 2024-09-19T06:49:39.369 INFO:tasks.workunit.client.0.smithi159.stdout:checking for acl/libacl.h... yes 2024-09-19T06:49:39.409 INFO:tasks.workunit.client.0.smithi159.stdout:checking for acl_init in -lacl... yes 2024-09-19T06:49:39.475 INFO:tasks.workunit.client.0.smithi159.stdout:checking gdbm-ndbm.h usability... no 2024-09-19T06:49:39.506 INFO:tasks.workunit.client.0.smithi159.stdout:checking gdbm-ndbm.h presence... no 2024-09-19T06:49:39.506 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gdbm-ndbm.h... no 2024-09-19T06:49:39.546 INFO:tasks.workunit.client.0.smithi159.stdout:checking gdbm/ndbm.h usability... no 2024-09-19T06:49:39.573 INFO:tasks.workunit.client.0.smithi159.stdout:checking gdbm/ndbm.h presence... no 2024-09-19T06:49:39.573 INFO:tasks.workunit.client.0.smithi159.stdout:checking for gdbm/ndbm.h... no 2024-09-19T06:49:39.609 INFO:tasks.workunit.client.0.smithi159.stdout:checking ndbm.h usability... no 2024-09-19T06:49:39.635 INFO:tasks.workunit.client.0.smithi159.stdout:checking ndbm.h presence... no 2024-09-19T06:49:39.636 INFO:tasks.workunit.client.0.smithi159.stdout:checking for ndbm.h... no 2024-09-19T06:49:39.667 INFO:tasks.workunit.client.0.smithi159.stdout:checking libaio.h usability... yes 2024-09-19T06:49:39.684 INFO:tasks.workunit.client.0.smithi159.stdout:checking libaio.h presence... yes 2024-09-19T06:49:39.685 INFO:tasks.workunit.client.0.smithi159.stdout:checking for libaio.h... yes 2024-09-19T06:49:39.728 INFO:tasks.workunit.client.0.smithi159.stdout:checking liburing.h usability... no 2024-09-19T06:49:39.757 INFO:tasks.workunit.client.0.smithi159.stdout:checking liburing.h presence... no 2024-09-19T06:49:39.757 INFO:tasks.workunit.client.0.smithi159.stdout:checking for liburing.h... no 2024-09-19T06:49:39.791 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/capability.h usability... no 2024-09-19T06:49:39.818 INFO:tasks.workunit.client.0.smithi159.stdout:checking sys/capability.h presence... no 2024-09-19T06:49:39.819 INFO:tasks.workunit.client.0.smithi159.stdout:checking for sys/capability.h... no 2024-09-19T06:49:39.849 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/fiemap.h usability... yes 2024-09-19T06:49:39.864 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/fiemap.h presence... yes 2024-09-19T06:49:39.864 INFO:tasks.workunit.client.0.smithi159.stdout:checking for linux/fiemap.h... yes 2024-09-19T06:49:39.901 INFO:tasks.workunit.client.0.smithi159.stdout:checking for fallocate... yes 2024-09-19T06:49:39.953 INFO:tasks.workunit.client.0.smithi159.stdout:checking for open_by_handle_at... yes 2024-09-19T06:49:39.991 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/fs.h usability... yes 2024-09-19T06:49:40.007 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/fs.h presence... yes 2024-09-19T06:49:40.007 INFO:tasks.workunit.client.0.smithi159.stdout:checking for linux/fs.h... yes 2024-09-19T06:49:40.061 INFO:tasks.workunit.client.0.smithi159.stdout:checking btrfsutil.h usability... no 2024-09-19T06:49:40.088 INFO:tasks.workunit.client.0.smithi159.stdout:checking btrfsutil.h presence... no 2024-09-19T06:49:40.088 INFO:tasks.workunit.client.0.smithi159.stdout:checking for btrfsutil.h... no 2024-09-19T06:49:40.128 INFO:tasks.workunit.client.0.smithi159.stdout:checking for copy_file_range... yes 2024-09-19T06:49:40.175 INFO:tasks.workunit.client.0.smithi159.stdout:checking for SEEK_DATA... yes 2024-09-19T06:49:40.230 INFO:tasks.workunit.client.0.smithi159.stdout:checking for BMV_OF_SHARED... yes 2024-09-19T06:49:40.274 INFO:tasks.workunit.client.0.smithi159.stdout:checking for nftw... yes 2024-09-19T06:49:40.319 INFO:tasks.workunit.client.0.smithi159.stdout:checking for RLIMIT_NOFILE... yes 2024-09-19T06:49:40.362 INFO:tasks.workunit.client.0.smithi159.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.364+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3695435361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a04102ce0 msgr2=0x7f5a041030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.364+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3695435361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a04102ce0 0x7f5a041030c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009900 tx=0x7f5a0002a480 comp rx=0 tx=0).stop 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.364+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3695435361 shutdown_connections 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.364+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3695435361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a0410c0b0 0x7f5a0410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.364+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3695435361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a04103600 0x7f5a0410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.364+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3695435361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a04102ce0 0x7f5a041030c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.364+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3695435361 >> 172.21.15.159:0/3695435361 conn(0x7f5a04077990 msgr2=0x7f5a040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.364+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3695435361 shutdown_connections 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.364+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3695435361 wait complete. 2024-09-19T06:49:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a0b41e640 1 Processor -- start 2024-09-19T06:49:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a0b41e640 1 -- start start 2024-09-19T06:49:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a0b41e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a04102ce0 0x7f5a04198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a0b41e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a04103600 0x7f5a04198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a0b41e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0410c0b0 0x7f5a0419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a0b41e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5a04111eb0 con 0x7f5a0410c0b0 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a0b41e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a04111d30 con 0x7f5a04102ce0 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a0b41e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5a04112030 con 0x7f5a04103600 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a099bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0410c0b0 0x7f5a0419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a099bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0410c0b0 0x7f5a0419cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47956/0 (socket says 172.21.15.159:47956) 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a099bb640 1 -- 172.21.15.159:0/3290073928 learned_addr learned my addr 172.21.15.159:0/3290073928 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a091ba640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a04102ce0 0x7f5a04198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a089b9640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a04103600 0x7f5a04198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a099bb640 1 -- 172.21.15.159:0/3290073928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a04103600 msgr2=0x7f5a04198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a099bb640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a04103600 0x7f5a04198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a099bb640 1 -- 172.21.15.159:0/3290073928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a04102ce0 msgr2=0x7f5a04198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a099bb640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a04102ce0 0x7f5a04198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.365+0000 7f5a099bb640 1 -- 172.21.15.159:0/3290073928 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0419d2f0 con 0x7f5a0410c0b0 2024-09-19T06:49:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.366+0000 7f5a099bb640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0410c0b0 0x7f5a0419cbc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00eb10 tx=0x7f59fc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.366+0000 7f59fa7fc640 1 -- 172.21.15.159:0/3290073928 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc004b20 con 0x7f5a0410c0b0 2024-09-19T06:49:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.366+0000 7f59fa7fc640 1 -- 172.21.15.159:0/3290073928 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59fc004cc0 con 0x7f5a0410c0b0 2024-09-19T06:49:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.366+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3290073928 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0419d5e0 con 0x7f5a0410c0b0 2024-09-19T06:49:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.366+0000 7f59fa7fc640 1 -- 172.21.15.159:0/3290073928 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc010760 con 0x7f5a0410c0b0 2024-09-19T06:49:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.366+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3290073928 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a04100860 con 0x7f5a0410c0b0 2024-09-19T06:49:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.368+0000 7f59fa7fc640 1 -- 172.21.15.159:0/3290073928 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f59fc005020 con 0x7f5a0410c0b0 2024-09-19T06:49:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.368+0000 7f5a0e291740 1 Processor -- start 2024-09-19T06:49:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.368+0000 7f5a0e291740 1 -- start start 2024-09-19T06:49:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2eaf0 0x561889a2eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a39770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a39cb0 0x561889a3c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a0e291740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5618899932f0 con 0x561889a2f410 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a0e291740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56188993b270 con 0x561889a2eaf0 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a0e291740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56188998f2b0 con 0x561889a39cb0 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a091ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a39770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a091ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a39770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47964/0 (socket says 172.21.15.159:47964) 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a091ba640 1 -- 172.21.15.159:0/2114821512 learned_addr learned my addr 172.21.15.159:0/2114821512 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a089b9640 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a39cb0 0x561889a3c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a089b9640 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2eaf0 0x561889a2eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a091ba640 1 -- 172.21.15.159:0/2114821512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a39cb0 msgr2=0x561889a3c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a091ba640 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a39cb0 0x561889a3c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a091ba640 1 -- 172.21.15.159:0/2114821512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2eaf0 msgr2=0x561889a2eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f59fa7fc640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59f00a3460 0x7f59f00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a091ba640 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2eaf0 0x561889a2eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a091ba640 1 -- 172.21.15.159:0/2114821512 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56188993a340 con 0x561889a2f410 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a089b9640 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2eaf0 0x561889a2eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a099bb640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59f00a3460 0x7f59f00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f5a091ba640 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a39770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009900 tx=0x7f5a00005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568a2d35b91512fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.369+0000 7f59fa7fc640 1 -- 172.21.15.159:0/3290073928 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f59fc0d0390 con 0x7f5a0410c0b0 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f59ef7fe640 1 -- 172.21.15.159:0/2114821512 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00040070 con 0x561889a2f410 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f59ef7fe640 1 -- 172.21.15.159:0/2114821512 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a00004030 con 0x561889a2f410 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f59ef7fe640 1 -- 172.21.15.159:0/2114821512 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00035040 con 0x561889a2f410 2024-09-19T06:49:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a0e291740 1 -- 172.21.15.159:0/2114821512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 msgr2=0x561889a39770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a099bb640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59f00a3460 0x7f59f00a5920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59fc09c5d0 tx=0x7f59fc00efd0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a0e291740 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a39770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009900 tx=0x7f5a00005e00 comp rx=0 tx=0).stop 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a0e291740 1 -- 172.21.15.159:0/2114821512 shutdown_connections 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a0e291740 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a39cb0 0x561889a3c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a0e291740 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a39770 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a0e291740 1 --2- 172.21.15.159:0/2114821512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2eaf0 0x561889a2eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a0e291740 1 -- 172.21.15.159:0/2114821512 >> 172.21.15.159:0/2114821512 conn(0x561889a2b060 msgr2=0x561889a2b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a0e291740 1 -- 172.21.15.159:0/2114821512 shutdown_connections 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.370+0000 7f5a0e291740 1 -- 172.21.15.159:0/2114821512 wait complete. 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a0e291740 1 -- start start 2024-09-19T06:49:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a0e291740 1 Processor -- start 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a36b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a37090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a39cb0 0x561889a375d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a0e291740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561889a3c880 con 0x561889a2f410 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a0e291740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56188991c290 con 0x561889a39cb0 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a0e291740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561889a3ca00 con 0x561889a2eaf0 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a0e291740 10 client.0 _ll_register_callbacks cb 0x56188994d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a091ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a37090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a089b9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a36b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a091ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a37090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47980/0 (socket says 172.21.15.159:47980) 2024-09-19T06:49:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a089b9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a36b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:56390/0 (socket says 172.21.15.159:56390) 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.371+0000 7f5a091ba640 1 -- 172.21.15.159:0/818777150 learned_addr learned my addr 172.21.15.159:0/818777150 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a089b9640 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a39cb0 0x561889a375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a091ba640 1 -- 172.21.15.159:0/818777150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 msgr2=0x561889a36b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a091ba640 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a36b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a091ba640 1 -- 172.21.15.159:0/818777150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a39cb0 msgr2=0x561889a375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a091ba640 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a39cb0 0x561889a375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a091ba640 1 -- 172.21.15.159:0/818777150 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618896a6210 con 0x561889a2f410 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a091ba640 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a37090 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5a0002a9a0 tx=0x7f5a00005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b7e0029ccb6699 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f59ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f59ecff9640 1 -- 172.21.15.159:0/818777150 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00040070 con 0x561889a2f410 2024-09-19T06:49:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f59ecff9640 1 -- 172.21.15.159:0/818777150 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f5a00005500 con 0x561889a2f410 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a0e291740 1 -- 172.21.15.159:0/818777150 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a00004030 con 0x561889a2f410 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f59ecff9640 1 -- 172.21.15.159:0/818777150 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5a00056050 con 0x561889a2f410 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a0e291740 10 client.16017 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f5a0e291740 1 -- 172.21.15.159:0/818777150 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x561889772620 con 0x561889a2f410 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.372+0000 7f59ecff9640 1 -- 172.21.15.159:0/818777150 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a00004030 con 0x561889a2f410 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f59ecff9640 1 -- 172.21.15.159:0/818777150 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f5a000035f0 con 0x561889a2f410 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f5a0e291740 10 client.16017 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f5a0e291740 10 client.16017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f5a0e291740 20 client.16017 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f5a0e291740 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561889a49a50 0x561889a4be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f5a0e291740 4 client.16017 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f5a0e291740 1 -- 172.21.15.159:0/818777150 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618899a0a20 con 0x561889a49a50 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f5a089b9640 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561889a49a50 0x561889a4be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f5a089b9640 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561889a49a50 0x561889a4be40 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=919d45c2122ad0fc server_cookie=f45b7e1c73fed686 in_seq=0 out_seq=0 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.373+0000 7f59ecff9640 10 client.16017 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.374+0000 7f59ecff9640 1 -- 172.21.15.159:0/818777150 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618899a0a20 con 0x561889a49a50 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.374+0000 7f59ecff9640 10 client.16017 handle_command_reply: tid=0 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.374+0000 7f5a0e291740 1 client.16017 shutdown 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 -- 172.21.15.159:0/818777150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 msgr2=0x561889a37090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a37090 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5a0002a9a0 tx=0x7f5a00005020 comp rx=0 tx=0).stop 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 -- 172.21.15.159:0/818777150 shutdown_connections 2024-09-19T06:49:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561889a49a50 0x561889a4be40 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a39cb0 0x561889a375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a2f410 0x561889a37090 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 --2- 172.21.15.159:0/818777150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a36b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f59ecff9640 0 client.16017 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 -- 172.21.15.159:0/818777150 >> 172.21.15.159:0/818777150 conn(0x561889a2b060 msgr2=0x561889a30dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 -- 172.21.15.159:0/818777150 shutdown_connections 2024-09-19T06:49:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 1 -- 172.21.15.159:0/818777150 wait complete. 2024-09-19T06:49:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.375+0000 7f5a0e291740 20 client.16017 trim_cache size 0 max 16384 2024-09-19T06:49:40.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a0e291740 1 Processor -- start 2024-09-19T06:49:40.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a0e291740 1 -- start start 2024-09-19T06:49:40.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a35400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 0x561889a37400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a51440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a0e291740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5a041ada00 con 0x561889a39cb0 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a0e291740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a041b0280 con 0x561889a2f410 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a0e291740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5a041ae070 con 0x561889a2eaf0 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a089b9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a51440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a089b9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a51440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47994/0 (socket says 172.21.15.159:47994) 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a089b9640 1 -- 172.21.15.159:0/926066149 learned_addr learned my addr 172.21.15.159:0/926066149 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a089b9640 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a35400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a091ba640 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 0x561889a37400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a089b9640 1 -- 172.21.15.159:0/926066149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 msgr2=0x561889a35400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.390+0000 7f5a089b9640 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a35400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.391+0000 7f5a089b9640 1 -- 172.21.15.159:0/926066149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 msgr2=0x561889a37400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.391+0000 7f5a089b9640 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 0x561889a37400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.391+0000 7f5a089b9640 1 -- 172.21.15.159:0/926066149 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561889a3c9f0 con 0x561889a39cb0 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.391+0000 7f5a091ba640 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 0x561889a37400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.391+0000 7f5a089b9640 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a51440 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5a040ffe50 tx=0x7f59f400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1f9a99033f58b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.391+0000 7f59eeffd640 1 -- 172.21.15.159:0/926066149 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4011c50 con 0x561889a39cb0 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.391+0000 7f59eeffd640 1 -- 172.21.15.159:0/926066149 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59f4026040 con 0x561889a39cb0 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.391+0000 7f59eeffd640 1 -- 172.21.15.159:0/926066149 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4003c40 con 0x561889a39cb0 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 -- 172.21.15.159:0/926066149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 msgr2=0x561889a51440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:40.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a51440 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5a040ffe50 tx=0x7f59f400b390 comp rx=0 tx=0).stop 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 -- 172.21.15.159:0/926066149 shutdown_connections 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a51440 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 0x561889a37400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 --2- 172.21.15.159:0/926066149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a35400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 -- 172.21.15.159:0/926066149 >> 172.21.15.159:0/926066149 conn(0x561889a2b060 msgr2=0x561889a38bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 -- 172.21.15.159:0/926066149 shutdown_connections 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 -- 172.21.15.159:0/926066149 wait complete. 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 -- start start 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.392+0000 7f5a0e291740 1 Processor -- start 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a41f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 0x561889a42490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a0e291740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a33520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a0e291740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5a041ae740 con 0x561889a39cb0 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a0e291740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a041afbb0 con 0x561889a2f410 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a0e291740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5a041aee10 con 0x561889a2eaf0 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a0e291740 10 client.0 _ll_register_callbacks cb 0x7f59f400ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a33520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a33520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48006/0 (socket says 172.21.15.159:48006) 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 -- 172.21.15.159:0/3387440933 learned_addr learned my addr 172.21.15.159:0/3387440933 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a41f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a091ba640 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 0x561889a42490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 -- 172.21.15.159:0/3387440933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 msgr2=0x561889a42490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 0x561889a42490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 -- 172.21.15.159:0/3387440933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 msgr2=0x561889a33520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a33520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 -- 172.21.15.159:0/3387440933 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561889a33d50 con 0x561889a2eaf0 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a089b9640 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a41f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59f400bc10 tx=0x7f59f4005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93a6d2128bba93d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f59ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f59ecff9640 1 -- 172.21.15.159:0/3387440933 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4011c50 con 0x561889a2eaf0 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f59ecff9640 1 -- 172.21.15.159:0/3387440933 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7f59f4011df0 con 0x561889a2eaf0 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.393+0000 7f5a0e291740 1 -- 172.21.15.159:0/3387440933 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59f4026040 con 0x561889a2eaf0 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f59ecff9640 1 -- 172.21.15.159:0/3387440933 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f59f4041050 con 0x561889a2eaf0 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f5a0e291740 10 client.25453 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:40.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f5a0e291740 1 -- 172.21.15.159:0/3387440933 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x561889ab4020 con 0x561889a2eaf0 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f59ecff9640 1 -- 172.21.15.159:0/3387440933 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59f4026040 con 0x561889a2eaf0 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f59ecff9640 1 -- 172.21.15.159:0/3387440933 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f59f402b030 con 0x561889a2eaf0 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f5a0e291740 10 client.25453 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f5a0e291740 10 client.25453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f5a0e291740 20 client.25453 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f5a0e291740 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561889ab4670 0x561889ab6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f5a0e291740 4 client.25453 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f5a0e291740 1 -- 172.21.15.159:0/3387440933 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56188999ad70 con 0x561889ab4670 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.394+0000 7f5a091ba640 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561889ab4670 0x561889ab6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.395+0000 7f59ecff9640 10 client.25453 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:40.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.395+0000 7f5a091ba640 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561889ab4670 0x561889ab6a90 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d148be12b84dd002 server_cookie=ec51df993519b1c4 in_seq=0 out_seq=0 2024-09-19T06:49:40.664 INFO:tasks.workunit.client.0.smithi159.stdout:checking for FICLONE... yes 2024-09-19T06:49:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.697+0000 7f59ecff9640 1 -- 172.21.15.159:0/3387440933 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56188999ad70 con 0x561889ab4670 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.697+0000 7f59ecff9640 10 client.25453 handle_command_reply: tid=0 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.697+0000 7f5a0e291740 1 client.25453 shutdown 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.697+0000 7f5a0e291740 1 -- 172.21.15.159:0/3387440933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 msgr2=0x561889a41f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.697+0000 7f5a0e291740 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a41f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59f400bc10 tx=0x7f59f4005850 comp rx=0 tx=0).stop 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0e291740 1 -- 172.21.15.159:0/3387440933 shutdown_connections 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0e291740 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561889ab4670 0x561889ab6a90 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0e291740 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561889a39cb0 0x561889a33520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f59ecff9640 0 client.25453 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0e291740 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561889a2f410 0x561889a42490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0e291740 1 --2- 172.21.15.159:0/3387440933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561889a2eaf0 0x561889a41f50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0e291740 1 -- 172.21.15.159:0/3387440933 >> 172.21.15.159:0/3387440933 conn(0x561889a2b060 msgr2=0x561889a30550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0e291740 1 -- 172.21.15.159:0/3387440933 shutdown_connections 2024-09-19T06:49:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0e291740 1 -- 172.21.15.159:0/3387440933 wait complete. 2024-09-19T06:49:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0e291740 20 client.25453 trim_cache size 0 max 16384 2024-09-19T06:49:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:49:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:49:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:49:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:49:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59f00a3460 msgr2=0x7f59f00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59f00a3460 0x7f59f00a5920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59fc09c5d0 tx=0x7f59fc00efd0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0410c0b0 msgr2=0x7f5a0419cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.698+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0410c0b0 0x7f5a0419cbc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00eb10 tx=0x7f59fc00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.699+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3290073928 shutdown_connections 2024-09-19T06:49:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.699+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f59f00a3460 0x7f59f00a5920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.699+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a0410c0b0 0x7f5a0419cbc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.699+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a04103600 0x7f5a04198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.699+0000 7f5a0b41e640 1 --2- 172.21.15.159:0/3290073928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a04102ce0 0x7f5a04198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.699+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3290073928 >> 172.21.15.159:0/3290073928 conn(0x7f5a04077990 msgr2=0x7f5a040fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.699+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3290073928 shutdown_connections 2024-09-19T06:49:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:40.699+0000 7f5a0b41e640 1 -- 172.21.15.159:0/3290073928 wait complete. 2024-09-19T06:49:40.712 INFO:tasks.workunit.client.0.smithi159.stdout:checking for renameat2... yes 2024-09-19T06:49:40.754 INFO:tasks.workunit.client.0.smithi159.stdout:checking for reallocarray... yes 2024-09-19T06:49:40.811 INFO:tasks.workunit.client.0.smithi159.stdout:checking for struct mount_attr... yes 2024-09-19T06:49:40.877 INFO:tasks.workunit.client.0.smithi159.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-19T06:49:40.930 INFO:tasks.workunit.client.0.smithi159.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-19T06:49:40.984 INFO:tasks.workunit.client.0.smithi159.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-19T06:49:41.037 INFO:tasks.workunit.client.0.smithi159.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-19T06:49:41.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:40 smithi203 ceph-mon[35473]: pgmap v84: 97 pgs: 97 active+clean; 39 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 839 KiB/s wr, 513 op/s 2024-09-19T06:49:41.092 INFO:tasks.workunit.client.0.smithi159.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-19T06:49:41.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:40 smithi189 ceph-mon[34880]: pgmap v84: 97 pgs: 97 active+clean; 39 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 839 KiB/s wr, 513 op/s 2024-09-19T06:49:41.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:40 smithi159 ceph-mon[30935]: pgmap v84: 97 pgs: 97 active+clean; 39 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 839 KiB/s wr, 513 op/s 2024-09-19T06:49:41.148 INFO:tasks.workunit.client.0.smithi159.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-19T06:49:41.202 INFO:tasks.workunit.client.0.smithi159.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-19T06:49:41.240 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/btrfs.h usability... yes 2024-09-19T06:49:41.256 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/btrfs.h presence... yes 2024-09-19T06:49:41.257 INFO:tasks.workunit.client.0.smithi159.stdout:checking for linux/btrfs.h... yes 2024-09-19T06:49:41.303 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-19T06:49:41.320 INFO:tasks.workunit.client.0.smithi159.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-19T06:49:41.320 INFO:tasks.workunit.client.0.smithi159.stdout:checking for linux/btrfs_tree.h... yes 2024-09-19T06:49:41.357 INFO:tasks.workunit.client.0.smithi159.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-19T06:49:41.386 INFO:tasks.workunit.client.0.smithi159.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-19T06:49:41.406 INFO:tasks.workunit.client.0.smithi159.stdout:configure: creating ./config.status 2024-09-19T06:49:41.736 INFO:tasks.workunit.client.0.smithi159.stdout:config.status: creating include/builddefs 2024-09-19T06:49:41.750 INFO:tasks.workunit.client.0.smithi159.stdout:config.status: creating include/config.h 2024-09-19T06:49:41.761 INFO:tasks.workunit.client.0.smithi159.stdout:config.status: executing libtool commands 2024-09-19T06:49:41.833 INFO:tasks.workunit.client.0.smithi159.stdout:Building include 2024-09-19T06:49:41.833 INFO:tasks.workunit.client.0.smithi159.stdout:Building lib 2024-09-19T06:49:41.833 INFO:tasks.workunit.client.0.smithi159.stdout:Building tests 2024-09-19T06:49:41.838 INFO:tasks.workunit.client.0.smithi159.stdout: [LTDEP] 2024-09-19T06:49:41.841 INFO:tasks.workunit.client.0.smithi159.stdout:Building btrfs 2024-09-19T06:49:41.841 INFO:tasks.workunit.client.0.smithi159.stdout:Building ceph 2024-09-19T06:49:41.841 INFO:tasks.workunit.client.0.smithi159.stdout:Building cifs 2024-09-19T06:49:41.851 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-09-19T06:49:41.851 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-09-19T06:49:41.864 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-09-19T06:49:41.870 INFO:tasks.workunit.client.0.smithi159.stdout:Building ext4 2024-09-19T06:49:41.871 INFO:tasks.workunit.client.0.smithi159.stdout:Building f2fs 2024-09-19T06:49:41.878 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-09-19T06:49:41.887 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-09-19T06:49:41.899 INFO:tasks.workunit.client.0.smithi159.stdout:Building generic 2024-09-19T06:49:41.932 INFO:tasks.workunit.client.0.smithi159.stdout:Building nfs 2024-09-19T06:49:41.938 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-09-19T06:49:41.939 INFO:tasks.workunit.client.0.smithi159.stdout:Building ocfs2 2024-09-19T06:49:41.946 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-09-19T06:49:41.956 INFO:tasks.workunit.client.0.smithi159.stdout:Building overlay 2024-09-19T06:49:41.963 INFO:tasks.workunit.client.0.smithi159.stdout:Building perf 2024-09-19T06:49:41.971 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-09-19T06:49:41.978 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-09-19T06:49:41.986 INFO:tasks.workunit.client.0.smithi159.stdout:Building selftest 2024-09-19T06:49:41.987 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-09-19T06:49:41.993 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-09-19T06:49:42.013 INFO:tasks.workunit.client.0.smithi159.stdout:Building shared 2024-09-19T06:49:42.016 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-09-19T06:49:42.028 INFO:tasks.workunit.client.0.smithi159.stdout:Building tmpfs 2024-09-19T06:49:42.036 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-09-19T06:49:42.037 INFO:tasks.workunit.client.0.smithi159.stdout:Building udf 2024-09-19T06:49:42.044 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-09-19T06:49:42.049 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] dataascii.lo 2024-09-19T06:49:42.053 INFO:tasks.workunit.client.0.smithi159.stdout:Building xfs 2024-09-19T06:49:42.058 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] databin.lo 2024-09-19T06:49:42.114 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] datapid.lo 2024-09-19T06:49:42.126 INFO:tasks.workunit.client.0.smithi159.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-09-19T06:49:42.201 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] file_lock.lo 2024-09-19T06:49:42.225 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] forker.lo 2024-09-19T06:49:42.312 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] pattern.lo 2024-09-19T06:49:42.313 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] open_flags.lo 2024-09-19T06:49:42.351 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] random_range.lo 2024-09-19T06:49:42.363 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] string_to_tokens.lo 2024-09-19T06:49:42.366 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] str_to_bytes.lo 2024-09-19T06:49:42.407 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] tlibio.lo 2024-09-19T06:49:42.472 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] write_log.lo 2024-09-19T06:49:42.541 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] random.lo 2024-09-19T06:49:42.718 INFO:tasks.workunit.client.0.smithi159.stdout: [LD] 2024-09-19T06:49:42.842 INFO:tasks.workunit.client.0.smithi159.stdout:Building ltp 2024-09-19T06:49:42.842 INFO:tasks.workunit.client.0.smithi159.stdout:Building src 2024-09-19T06:49:42.842 INFO:tasks.workunit.client.0.smithi159.stdout:Building m4 2024-09-19T06:49:42.842 INFO:tasks.workunit.client.0.smithi159.stdout:Building common 2024-09-19T06:49:42.848 INFO:tasks.workunit.client.0.smithi159.stdout: [DEP] 2024-09-19T06:49:42.859 INFO:tasks.workunit.client.0.smithi159.stdout: [DEP] 2024-09-19T06:49:42.939 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:42 smithi189 ceph-mon[34880]: pgmap v85: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 647 op/s 2024-09-19T06:49:43.037 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] doio 2024-09-19T06:49:43.037 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fsstress 2024-09-19T06:49:43.037 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fsx 2024-09-19T06:49:43.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:42 smithi203 ceph-mon[35473]: pgmap v85: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 647 op/s 2024-09-19T06:49:43.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:42 smithi159 ceph-mon[30935]: pgmap v85: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 647 op/s 2024-09-19T06:49:43.716 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] growfiles 2024-09-19T06:49:43.793 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] iogen 2024-09-19T06:49:44.191 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-stress 2024-09-19T06:49:44.868 INFO:tasks.workunit.client.0.smithi159.stdout: [DEP] 2024-09-19T06:49:44.868 INFO:tasks.workunit.client.0.smithi159.stdout: [DEP] 2024-09-19T06:49:44.868 INFO:tasks.workunit.client.0.smithi159.stdout: [DEP] 2024-09-19T06:49:44.872 INFO:tasks.workunit.client.0.smithi159.stdout: [DEP] 2024-09-19T06:49:45.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:44 smithi203 ceph-mon[35473]: pgmap v86: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 596 KiB/s wr, 508 op/s 2024-09-19T06:49:45.106 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] dirstress 2024-09-19T06:49:45.106 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fill 2024-09-19T06:49:45.106 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fill2 2024-09-19T06:49:45.106 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] getpagesize 2024-09-19T06:49:45.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:44 smithi189 ceph-mon[34880]: pgmap v86: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 596 KiB/s wr, 508 op/s 2024-09-19T06:49:45.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:44 smithi159 ceph-mon[30935]: pgmap v86: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 596 KiB/s wr, 508 op/s 2024-09-19T06:49:45.251 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] holes 2024-09-19T06:49:45.270 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] lstat64 2024-09-19T06:49:45.333 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] nametest 2024-09-19T06:49:45.345 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] permname 2024-09-19T06:49:45.451 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] randholes 2024-09-19T06:49:45.457 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] runas 2024-09-19T06:49:45.554 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] truncfile 2024-09-19T06:49:45.574 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] usemem 2024-09-19T06:49:45.647 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] mmapcat 2024-09-19T06:49:45.713 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] append_reader 2024-09-19T06:49:45.729 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] append_writer 2024-09-19T06:49:45.744 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] dirperf 2024-09-19T06:49:45.790 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] metaperf 2024-09-19T06:49:45.871 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] devzero 2024-09-19T06:49:45.874 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] feature 2024-09-19T06:49:45.987 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] alloc 2024-09-19T06:49:46.039 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fault 2024-09-19T06:49:46.073 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fstest 2024-09-19T06:49:46.097 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_access_root 2024-09-19T06:49:46.196 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] godown 2024-09-19T06:49:46.213 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] resvtest 2024-09-19T06:49:46.265 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] writemod 2024-09-19T06:49:46.317 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] writev_on_pagefault 2024-09-19T06:49:46.367 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] makeextents 2024-09-19T06:49:46.410 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] itrash 2024-09-19T06:49:46.412 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] rename 2024-09-19T06:49:46.479 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] multi_open_unlink 2024-09-19T06:49:46.541 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] unwritten_sync 2024-09-19T06:49:46.546 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] genhashnames 2024-09-19T06:49:46.548 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_holes 2024-09-19T06:49:46.643 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mmap_writev 2024-09-19T06:49:46.712 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_truncate_cmtime 2024-09-19T06:49:46.731 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] dirhash_collide 2024-09-19T06:49:46.740 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_rename_overwrite 2024-09-19T06:49:46.805 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] holetest 2024-09-19T06:49:46.874 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_truncate_self 2024-09-19T06:49:46.881 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] af_unix 2024-09-19T06:49:46.926 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mmap_stale_pmd 2024-09-19T06:49:47.014 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mmap_cow_race 2024-09-19T06:49:47.027 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mmap_fallocate 2024-09-19T06:49:47.045 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fsync-err 2024-09-19T06:49:47.085 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mmap_write_ro 2024-09-19T06:49:47.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:46 smithi203 ceph-mon[35473]: pgmap v87: 97 pgs: 97 active+clean; 27 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 638 KiB/s wr, 530 op/s 2024-09-19T06:49:47.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:46 smithi189 ceph-mon[34880]: pgmap v87: 97 pgs: 97 active+clean; 27 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 638 KiB/s wr, 530 op/s 2024-09-19T06:49:47.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:46 smithi159 ceph-mon[30935]: pgmap v87: 97 pgs: 97 active+clean; 27 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 638 KiB/s wr, 530 op/s 2024-09-19T06:49:47.178 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-19T06:49:47.183 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-19T06:49:47.227 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_ofd_locks 2024-09-19T06:49:47.230 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mmap_collision 2024-09-19T06:49:47.333 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] mmap-write-concurrent 2024-09-19T06:49:47.338 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_get_file_time 2024-09-19T06:49:47.419 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_create_short_dirs 2024-09-19T06:49:47.441 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_create_long_dirs 2024-09-19T06:49:47.491 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_enospc 2024-09-19T06:49:47.509 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mmap_writev_overlap 2024-09-19T06:49:47.601 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] checkpoint_journal 2024-09-19T06:49:47.619 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] mmap-rw-fault 2024-09-19T06:49:47.687 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] allocstale 2024-09-19T06:49:47.704 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mmap_cow_memory_failure 2024-09-19T06:49:47.756 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fake-dump-rootino 2024-09-19T06:49:47.819 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] dio-buf-fault 2024-09-19T06:49:47.865 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] rewinddir-test 2024-09-19T06:49:47.880 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] readdir-while-renames 2024-09-19T06:49:47.922 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] xfsctl 2024-09-19T06:49:47.972 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] bstat 2024-09-19T06:49:48.034 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mtab 2024-09-19T06:49:48.039 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] getdevicesize 2024-09-19T06:49:48.114 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] preallo_rw_pattern_reader 2024-09-19T06:49:48.176 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] preallo_rw_pattern_writer 2024-09-19T06:49:48.182 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] ftrunc 2024-09-19T06:49:48.219 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] trunc 2024-09-19T06:49:48.265 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fs_perms 2024-09-19T06:49:48.336 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] testx 2024-09-19T06:49:48.337 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] looptest 2024-09-19T06:49:48.379 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] locktest 2024-09-19T06:49:48.436 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] unwritten_mmap 2024-09-19T06:49:48.485 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] bulkstat_unlink_test 2024-09-19T06:49:48.534 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] deduperace 2024-09-19T06:49:48.591 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] bulkstat_unlink_test_modified 2024-09-19T06:49:48.690 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_dir_offset 2024-09-19T06:49:48.724 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_futimens 2024-09-19T06:49:48.741 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_immutable 2024-09-19T06:49:48.818 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] stale_handle 2024-09-19T06:49:48.841 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] pwrite_mmap_blocked 2024-09-19T06:49:48.869 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_dir_offset2 2024-09-19T06:49:48.985 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] seek_sanity_test 2024-09-19T06:49:49.002 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] seek_copy_test 2024-09-19T06:49:49.057 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_readdir_1 2024-09-19T06:49:49.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:48 smithi203 ceph-mon[35473]: pgmap v88: 97 pgs: 97 active+clean; 27 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 515 KiB/s wr, 155 op/s 2024-09-19T06:49:49.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:48 smithi189 ceph-mon[34880]: pgmap v88: 97 pgs: 97 active+clean; 27 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 515 KiB/s wr, 155 op/s 2024-09-19T06:49:49.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:48 smithi159 ceph-mon[30935]: pgmap v88: 97 pgs: 97 active+clean; 27 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 515 KiB/s wr, 155 op/s 2024-09-19T06:49:49.176 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_readdir_2 2024-09-19T06:49:49.214 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fsync-tester 2024-09-19T06:49:49.344 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] nsexec 2024-09-19T06:49:49.465 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] cloner 2024-09-19T06:49:49.478 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] renameat2 2024-09-19T06:49:49.483 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_getcwd 2024-09-19T06:49:49.548 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] e4compact 2024-09-19T06:49:49.636 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] test-nextquota 2024-09-19T06:49:49.643 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] punch-alternating 2024-09-19T06:49:49.650 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-19T06:49:49.926 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] listxattr 2024-09-19T06:49:49.976 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] dio-interleaved 2024-09-19T06:49:49.980 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_dir_type 2024-09-19T06:49:49.981 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] dio-invalidate-cache 2024-09-19T06:49:50.068 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] stat_test 2024-09-19T06:49:50.123 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_encrypted_d_revalidate 2024-09-19T06:49:50.125 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] attr_replace_test 2024-09-19T06:49:50.196 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] swapon 2024-09-19T06:49:50.282 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] mkswap 2024-09-19T06:49:50.288 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_attr_corruption 2024-09-19T06:49:50.382 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_open_tmpfiles 2024-09-19T06:49:50.389 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fscrypt-crypt-util 2024-09-19T06:49:50.427 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] bulkstat_null_ocount 2024-09-19T06:49:50.453 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] splice-test 2024-09-19T06:49:50.567 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] chprojid_fail 2024-09-19T06:49:50.586 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] detached_mounts_propagation 2024-09-19T06:49:50.637 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] ext4_resize 2024-09-19T06:49:50.724 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_readdir_3 2024-09-19T06:49:50.781 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] splice2pipe 2024-09-19T06:49:50.786 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] uuid_ioctl 2024-09-19T06:49:50.919 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-19T06:49:50.930 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fiemap-fault 2024-09-19T06:49:50.947 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fiemap-tester 2024-09-19T06:49:51.084 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_stripealign 2024-09-19T06:49:51.090 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] open_by_handle 2024-09-19T06:49:51.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:50 smithi203 ceph-mon[35473]: pgmap v89: 97 pgs: 97 active+clean; 27 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 515 KiB/s wr, 155 op/s 2024-09-19T06:49:51.129 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_mmap_dio 2024-09-19T06:49:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:50 smithi189 ceph-mon[34880]: pgmap v89: 97 pgs: 97 active+clean; 27 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 515 KiB/s wr, 155 op/s 2024-09-19T06:49:51.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:50 smithi159 ceph-mon[30935]: pgmap v89: 97 pgs: 97 active+clean; 27 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 515 KiB/s wr, 155 op/s 2024-09-19T06:49:51.236 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] xfsfind 2024-09-19T06:49:51.237 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] t_reflink_read_race 2024-09-19T06:49:51.292 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] fssum 2024-09-19T06:49:51.361 INFO:tasks.workunit.client.0.smithi159.stdout:Building log-writes 2024-09-19T06:49:51.368 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] replay-log 2024-09-19T06:49:51.426 INFO:tasks.workunit.client.0.smithi159.stdout:Building perf 2024-09-19T06:49:51.430 INFO:tasks.workunit.client.0.smithi159.stdout:Building aio-dio-regress 2024-09-19T06:49:51.437 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aiocp 2024-09-19T06:49:51.443 INFO:tasks.workunit.client.0.smithi159.stdout:Building vfs 2024-09-19T06:49:51.448 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] vfstest 2024-09-19T06:49:51.688 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] mount-idmapped 2024-09-19T06:49:51.694 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-19T06:49:51.729 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-append-write-read-race 2024-09-19T06:49:51.863 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-cow-race 2024-09-19T06:49:51.920 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-cycle-write 2024-09-19T06:49:52.010 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-eof-race 2024-09-19T06:49:52.107 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-extend-stat 2024-09-19T06:49:52.120 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-fcntl-race 2024-09-19T06:49:52.207 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-hole-filling-race 2024-09-19T06:49:52.308 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-invalidate-failure 2024-09-19T06:49:52.309 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-invalidate-readahead 2024-09-19T06:49:52.361 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aiodio_sparse2 2024-09-19T06:49:52.473 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-subblock-eof-read 2024-09-19T06:49:52.478 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-dio-write-verify 2024-09-19T06:49:52.592 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-19T06:49:52.631 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-19T06:49:52.666 INFO:tasks.workunit.client.0.smithi159.stdout: [CC] aio-last-ref-held-by-io 2024-09-19T06:49:53.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:52 smithi203 ceph-mon[35473]: pgmap v90: 97 pgs: 97 active+clean; 36 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.3 MiB/s wr, 209 op/s 2024-09-19T06:49:53.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:52 smithi189 ceph-mon[34880]: pgmap v90: 97 pgs: 97 active+clean; 36 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.3 MiB/s wr, 209 op/s 2024-09-19T06:49:53.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:52 smithi159 ceph-mon[30935]: pgmap v90: 97 pgs: 97 active+clean; 36 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.3 MiB/s wr, 209 op/s 2024-09-19T06:49:53.510 INFO:tasks.workunit.client.0.smithi159.stderr:+ cd .. 2024-09-19T06:49:53.511 INFO:tasks.workunit.client.0.smithi159.stderr:+ cp xfstests-dev/ltp/fsx . 2024-09-19T06:49:53.513 INFO:tasks.workunit.client.0.smithi159.stderr:+ OPTIONS=-z 2024-09-19T06:49:53.513 INFO:tasks.workunit.client.0.smithi159.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-09-19T06:49:53.513 INFO:tasks.workunit.client.0.smithi159.stdout:Seed set to 1 2024-09-19T06:49:53.673 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-19T06:49:53.673 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-19T06:49:53.675 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T06:49:53.676 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T06:49:53.676 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T06:49:53.678 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T06:49:53.680 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support exchange range, disabling! 2024-09-19T06:49:53.680 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero size read 2024-09-19T06:49:53.680 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero size read 2024-09-19T06:49:53.680 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0x81d54 2024-09-19T06:49:53.683 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xb86d7 2024-09-19T06:49:53.690 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xe627e 2024-09-19T06:49:53.725 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0xf3194 2024-09-19T06:49:53.745 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xf3ceb 2024-09-19T06:49:53.751 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0xf47e4 2024-09-19T06:49:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 -- 172.21.15.159:0/15297131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc87c1069c0 msgr2=0x7fc87c106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 --2- 172.21.15.159:0/15297131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc87c1069c0 0x7fc87c106da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc878009890 tx=0x7fc87802a380 comp rx=0 tx=0).stop 2024-09-19T06:49:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 -- 172.21.15.159:0/15297131 shutdown_connections 2024-09-19T06:49:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 --2- 172.21.15.159:0/15297131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c101350 0x7fc87c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 --2- 172.21.15.159:0/15297131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c1009b0 0x7fc87c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 --2- 172.21.15.159:0/15297131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc87c1069c0 0x7fc87c106da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 -- 172.21.15.159:0/15297131 >> 172.21.15.159:0/15297131 conn(0x7fc87c077990 msgr2=0x7fc87c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 -- 172.21.15.159:0/15297131 shutdown_connections 2024-09-19T06:49:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 -- 172.21.15.159:0/15297131 wait complete. 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 Processor -- start 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 -- start start 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc87c1009b0 0x7fc87c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.788+0000 7fc883d4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c101350 0x7fc87c197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc883d4b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c1069c0 0x7fc87c19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc883d4b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c110e00 con 0x7fc87c101350 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc883d4b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c110c80 con 0x7fc87c1069c0 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc883d4b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c110f80 con 0x7fc87c1009b0 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc881ae7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc87c1009b0 0x7fc87c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc8812e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c101350 0x7fc87c197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc881ae7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc87c1009b0 0x7fc87c197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:60472/0 (socket says 172.21.15.159:60472) 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc881ae7640 1 -- 172.21.15.159:0/2333679046 learned_addr learned my addr 172.21.15.159:0/2333679046 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc8822e8640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c1069c0 0x7fc87c19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc8812e6640 1 -- 172.21.15.159:0/2333679046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc87c1009b0 msgr2=0x7fc87c197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc8812e6640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc87c1009b0 0x7fc87c197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc8812e6640 1 -- 172.21.15.159:0/2333679046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c1069c0 msgr2=0x7fc87c19baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc8812e6640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c1069c0 0x7fc87c19baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc8812e6640 1 -- 172.21.15.159:0/2333679046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c19c220 con 0x7fc87c101350 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc8812e6640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c101350 0x7fc87c197770 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc86c005fd0 tx=0x7fc86c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc872ffd640 1 -- 172.21.15.159:0/2333679046 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00ccc0 con 0x7fc87c101350 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc883d4b640 1 -- 172.21.15.159:0/2333679046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87c19c510 con 0x7fc87c101350 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc872ffd640 1 -- 172.21.15.159:0/2333679046 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc86c0035f0 con 0x7fc87c101350 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.789+0000 7fc872ffd640 1 -- 172.21.15.159:0/2333679046 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00ce60 con 0x7fc87c101350 2024-09-19T06:49:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.790+0000 7fc883d4b640 1 -- 172.21.15.159:0/2333679046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87c1a3da0 con 0x7fc87c101350 2024-09-19T06:49:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.792+0000 7fc872ffd640 1 -- 172.21.15.159:0/2333679046 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc86c0037a0 con 0x7fc87c101350 2024-09-19T06:49:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.792+0000 7fc886722740 1 Processor -- start 2024-09-19T06:49:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc886722740 1 -- start start 2024-09-19T06:49:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc886722740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c208ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc886722740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c213770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc886722740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c2160a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc886722740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563a7c16d2f0 con 0x563a7c209410 2024-09-19T06:49:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc886722740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a7c115270 con 0x563a7c208af0 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc886722740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563a7c1692b0 con 0x563a7c213cb0 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc872ffd640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc8680a3460 0x7fc8680a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc8812e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c2160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc881ae7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c213770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc881ae7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c213770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53184/0 (socket says 172.21.15.159:53184) 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc8812e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c2160a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:60476/0 (socket says 172.21.15.159:60476) 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc881ae7640 1 -- 172.21.15.159:0/1325528301 learned_addr learned my addr 172.21.15.159:0/1325528301 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc8822e8640 1 --2- 172.21.15.159:0/1325528301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c208ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc8822e8640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc8680a3460 0x7fc8680a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc881ae7640 1 -- 172.21.15.159:0/1325528301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 msgr2=0x563a7c2160a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc881ae7640 1 --2- 172.21.15.159:0/1325528301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c2160a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc881ae7640 1 -- 172.21.15.159:0/1325528301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 msgr2=0x563a7c208ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc881ae7640 1 --2- 172.21.15.159:0/1325528301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c208ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc881ae7640 1 -- 172.21.15.159:0/1325528301 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a7c114340 con 0x563a7c209410 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.793+0000 7fc872ffd640 1 -- 172.21.15.159:0/2333679046 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7fc86c0cfed0 con 0x7fc87c101350 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.794+0000 7fc881ae7640 1 --2- 172.21.15.159:0/1325528301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c213770 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc878009590 tx=0x7fc878030340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c5dd74a3865e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.794+0000 7fc8822e8640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc8680a3460 0x7fc8680a5920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc874005fd0 tx=0x7fc874009500 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.794+0000 7fc867fff640 1 -- 172.21.15.159:0/1325528301 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878037040 con 0x563a7c209410 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.794+0000 7fc867fff640 1 -- 172.21.15.159:0/1325528301 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc878030e50 con 0x563a7c209410 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.794+0000 7fc867fff640 1 -- 172.21.15.159:0/1325528301 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8780038d0 con 0x563a7c209410 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.794+0000 7fc886722740 1 -- 172.21.15.159:0/1325528301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 msgr2=0x563a7c213770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.794+0000 7fc886722740 1 --2- 172.21.15.159:0/1325528301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c213770 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc878009590 tx=0x7fc878030340 comp rx=0 tx=0).stop 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 -- 172.21.15.159:0/1325528301 shutdown_connections 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 --2- 172.21.15.159:0/1325528301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c2160a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 --2- 172.21.15.159:0/1325528301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c213770 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 --2- 172.21.15.159:0/1325528301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c208ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 -- 172.21.15.159:0/1325528301 >> 172.21.15.159:0/1325528301 conn(0x563a7c205060 msgr2=0x563a7c205440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 -- 172.21.15.159:0/1325528301 shutdown_connections 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 -- 172.21.15.159:0/1325528301 wait complete. 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 -- start start 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 Processor -- start 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c210b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c209410 0x563a7c2110a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c213cb0 0x563a7c2115e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563a7c216880 con 0x563a7c213cb0 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a7c0f6290 con 0x563a7c208af0 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.795+0000 7fc886722740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563a7c216a00 con 0x563a7c209410 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc886722740 10 client.0 _ll_register_callbacks cb 0x563a7c127140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8822e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c213cb0 0x563a7c2115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8822e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c213cb0 0x563a7c2115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53192/0 (socket says 172.21.15.159:53192) 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8822e8640 1 -- 172.21.15.159:0/1519868518 learned_addr learned my addr 172.21.15.159:0/1519868518 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8812e6640 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c209410 0x563a7c2110a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc881ae7640 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c210b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8812e6640 1 -- 172.21.15.159:0/1519868518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 msgr2=0x563a7c210b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8812e6640 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c210b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8812e6640 1 -- 172.21.15.159:0/1519868518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c213cb0 msgr2=0x563a7c2115e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8812e6640 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c213cb0 0x563a7c2115e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8812e6640 1 -- 172.21.15.159:0/1519868518 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a7be80210 con 0x563a7c209410 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8812e6640 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c209410 0x563a7c2110a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0cd5f0 tx=0x7fc86c0092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b89ffffebe424748 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8657fa640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8657fa640 1 -- 172.21.15.159:0/1519868518 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0b5060 con 0x563a7c209410 2024-09-19T06:49:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8657fa640 1 -- 172.21.15.159:0/1519868518 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7fc86c0a0180 con 0x563a7c209410 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc886722740 1 -- 172.21.15.159:0/1519868518 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc878030e50 con 0x563a7c209410 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc8657fa640 1 -- 172.21.15.159:0/1519868518 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc86c0a4df0 con 0x563a7c209410 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc886722740 10 client.25465 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.796+0000 7fc886722740 1 -- 172.21.15.159:0/1519868518 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563a7bf4c620 con 0x563a7c209410 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc8657fa640 1 -- 172.21.15.159:0/1519868518 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc878030e50 con 0x563a7c209410 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc8657fa640 1 -- 172.21.15.159:0/1519868518 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fc86c09b5d0 con 0x563a7c209410 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc886722740 10 client.25465 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc886722740 10 client.25465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc886722740 20 client.25465 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc886722740 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563a7c223c20 0x563a7c226010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc886722740 4 client.25465 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc886722740 1 -- 172.21.15.159:0/1519868518 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a7c17aa20 con 0x563a7c223c20 2024-09-19T06:49:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc881ae7640 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563a7c223c20 0x563a7c226010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc8657fa640 10 client.25465 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.797+0000 7fc881ae7640 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563a7c223c20 0x563a7c226010 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ca70b8cc360c3e server_cookie=2daba4ed8903e74c in_seq=0 out_seq=0 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.798+0000 7fc8657fa640 1 -- 172.21.15.159:0/1519868518 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a7c17aa20 con 0x563a7c223c20 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.798+0000 7fc8657fa640 10 client.25465 handle_command_reply: tid=0 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.798+0000 7fc886722740 1 client.25465 shutdown 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.798+0000 7fc886722740 1 -- 172.21.15.159:0/1519868518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c209410 msgr2=0x563a7c2110a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.798+0000 7fc886722740 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c209410 0x563a7c2110a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0cd5f0 tx=0x7fc86c0092d0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc886722740 1 -- 172.21.15.159:0/1519868518 shutdown_connections 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc886722740 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563a7c223c20 0x563a7c226010 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc886722740 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c213cb0 0x563a7c2115e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc886722740 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c209410 0x563a7c2110a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc886722740 1 --2- 172.21.15.159:0/1519868518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c210b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc886722740 1 -- 172.21.15.159:0/1519868518 >> 172.21.15.159:0/1519868518 conn(0x563a7c205060 msgr2=0x563a7c20adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc8657fa640 0 client.25465 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc886722740 1 -- 172.21.15.159:0/1519868518 shutdown_connections 2024-09-19T06:49:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc886722740 1 -- 172.21.15.159:0/1519868518 wait complete. 2024-09-19T06:49:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.799+0000 7fc886722740 20 client.25465 trim_cache size 0 max 16384 2024-09-19T06:49:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc886722740 1 Processor -- start 2024-09-19T06:49:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc886722740 1 -- start start 2024-09-19T06:49:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc886722740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c211410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc886722740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c212ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc886722740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c22b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc886722740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c1aa760 con 0x563a7c209410 2024-09-19T06:49:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc886722740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c1acfe0 con 0x563a7c208af0 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc886722740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c1aadd0 con 0x563a7c213cb0 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc8812e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c212ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc8812e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c212ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53200/0 (socket says 172.21.15.159:53200) 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc881ae7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c211410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc8812e6640 1 -- 172.21.15.159:0/2075083561 learned_addr learned my addr 172.21.15.159:0/2075083561 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc8822e8640 1 --2- 172.21.15.159:0/2075083561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c22b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc8812e6640 1 -- 172.21.15.159:0/2075083561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 msgr2=0x563a7c22b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc8812e6640 1 --2- 172.21.15.159:0/2075083561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c22b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc8812e6640 1 -- 172.21.15.159:0/2075083561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 msgr2=0x563a7c211410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc8812e6640 1 --2- 172.21.15.159:0/2075083561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c211410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.813+0000 7fc8812e6640 1 -- 172.21.15.159:0/2075083561 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a7c2002d0 con 0x563a7c209410 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc8812e6640 1 --2- 172.21.15.159:0/2075083561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c212ad0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc86c09c110 tx=0x7fc86c0d0280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798173665d7a9402 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc8677fe640 1 -- 172.21.15.159:0/2075083561 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c09bae0 con 0x563a7c209410 2024-09-19T06:49:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc8677fe640 1 -- 172.21.15.159:0/2075083561 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc86c09c180 con 0x563a7c209410 2024-09-19T06:49:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc8677fe640 1 -- 172.21.15.159:0/2075083561 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0a0180 con 0x563a7c209410 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc886722740 1 -- 172.21.15.159:0/2075083561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 msgr2=0x563a7c212ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc886722740 1 --2- 172.21.15.159:0/2075083561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c212ad0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc86c09c110 tx=0x7fc86c0d0280 comp rx=0 tx=0).stop 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc886722740 1 -- 172.21.15.159:0/2075083561 shutdown_connections 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc886722740 1 --2- 172.21.15.159:0/2075083561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c22b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc886722740 1 --2- 172.21.15.159:0/2075083561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c209410 0x563a7c212ad0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc886722740 1 --2- 172.21.15.159:0/2075083561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c208af0 0x563a7c211410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.814+0000 7fc886722740 1 -- 172.21.15.159:0/2075083561 >> 172.21.15.159:0/2075083561 conn(0x563a7c205060 msgr2=0x563a7c2123c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 -- 172.21.15.159:0/2075083561 shutdown_connections 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 -- 172.21.15.159:0/2075083561 wait complete. 2024-09-19T06:49:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 -- start start 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 Processor -- start 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c208af0 0x563a7c21c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c209410 0x563a7c20d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c20da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c1ab4a0 con 0x563a7c208af0 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c1ac910 con 0x563a7c209410 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c1abb70 con 0x563a7c213cb0 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc886722740 10 client.0 _ll_register_callbacks cb 0x7fc86c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc881ae7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c208af0 0x563a7c21c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc881ae7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c208af0 0x563a7c21c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53210/0 (socket says 172.21.15.159:53210) 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc881ae7640 1 -- 172.21.15.159:0/1577617105 learned_addr learned my addr 172.21.15.159:0/1577617105 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.815+0000 7fc8812e6640 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c209410 0x563a7c20d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc8822e8640 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c20da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc881ae7640 1 -- 172.21.15.159:0/1577617105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 msgr2=0x563a7c20da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc881ae7640 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c20da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc881ae7640 1 -- 172.21.15.159:0/1577617105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c209410 msgr2=0x563a7c20d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc881ae7640 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c209410 0x563a7c20d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc881ae7640 1 -- 172.21.15.159:0/1577617105 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a7c20e000 con 0x563a7c208af0 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc881ae7640 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c208af0 0x563a7c21c100 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc878030ac0 tx=0x7fc878030af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67aeaeb85be85bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc8657fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc8657fa640 1 -- 172.21.15.159:0/1577617105 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878037040 con 0x563a7c208af0 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc886722740 1 -- 172.21.15.159:0/1577617105 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563a7c174d70 con 0x563a7c208af0 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc8657fa640 1 -- 172.21.15.159:0/1577617105 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8570+0+0 (secure 0 0 0) 0x7fc878030650 con 0x563a7c208af0 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc8657fa640 1 -- 172.21.15.159:0/1577617105 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc878030850 con 0x563a7c208af0 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc886722740 10 client.16041 fetch_fsmap learned FSMap version 22 2024-09-19T06:49:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc886722740 1 -- 172.21.15.159:0/1577617105 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563a7c2929e0 con 0x563a7c208af0 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.816+0000 7fc8657fa640 1 -- 172.21.15.159:0/1577617105 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563a7c174d70 con 0x563a7c208af0 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc8657fa640 1 -- 172.21.15.159:0/1577617105 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fc878057560 con 0x563a7c208af0 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc886722740 10 client.16041 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc886722740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc886722740 20 client.16041 populate_metadata read hostname 'smithi159' 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc886722740 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563a7c292d40 0x563a7c295130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc886722740 4 client.16041 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc886722740 1 -- 172.21.15.159:0/1577617105 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a7c0f1900 con 0x563a7c292d40 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc8812e6640 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563a7c292d40 0x563a7c295130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc8657fa640 10 client.16041 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.817+0000 7fc8812e6640 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563a7c292d40 0x563a7c295130 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70e897caa8ea3c18 server_cookie=c24ed0e8ffb2f627 in_seq=0 out_seq=0 2024-09-19T06:49:53.899 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc8657fa640 1 -- 172.21.15.159:0/1577617105 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a7c0f1900 con 0x563a7c292d40 2024-09-19T06:49:53.899 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc8657fa640 10 client.16041 handle_command_reply: tid=0 2024-09-19T06:49:53.899 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 client.16041 shutdown 2024-09-19T06:49:53.899 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 -- 172.21.15.159:0/1577617105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c208af0 msgr2=0x563a7c21c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:53.899 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c208af0 0x563a7c21c100 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc878030ac0 tx=0x7fc878030af0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 -- 172.21.15.159:0/1577617105 shutdown_connections 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563a7c292d40 0x563a7c295130 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563a7c213cb0 0x563a7c20da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a7c209410 0x563a7c20d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 --2- 172.21.15.159:0/1577617105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a7c208af0 0x563a7c21c100 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 -- 172.21.15.159:0/1577617105 >> 172.21.15.159:0/1577617105 conn(0x563a7c205060 msgr2=0x563a7c212be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc8657fa640 0 client.16041 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 -- 172.21.15.159:0/1577617105 shutdown_connections 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.896+0000 7fc886722740 1 -- 172.21.15.159:0/1577617105 wait complete. 2024-09-19T06:49:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc886722740 20 client.16041 trim_cache size 0 max 16384 2024-09-19T06:49:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:49:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:49:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:49:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 -- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc8680a3460 msgr2=0x7fc8680a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc8680a3460 0x7fc8680a5920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc874005fd0 tx=0x7fc874009500 comp rx=0 tx=0).stop 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 -- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c101350 msgr2=0x7fc87c197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c101350 0x7fc87c197770 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc86c005fd0 tx=0x7fc86c00ed90 comp rx=0 tx=0).stop 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 -- 172.21.15.159:0/2333679046 shutdown_connections 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc8680a3460 0x7fc8680a5920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c1069c0 0x7fc87c19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c101350 0x7fc87c197770 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 --2- 172.21.15.159:0/2333679046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc87c1009b0 0x7fc87c197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 -- 172.21.15.159:0/2333679046 >> 172.21.15.159:0/2333679046 conn(0x7fc87c077990 msgr2=0x7fc87c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 -- 172.21.15.159:0/2333679046 shutdown_connections 2024-09-19T06:49:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:49:53.897+0000 7fc883d4b640 1 -- 172.21.15.159:0/2333679046 wait complete. 2024-09-19T06:49:53.903 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xfaccc 2024-09-19T06:49:54.327 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xfe423 2024-09-19T06:49:54.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:54 smithi203 ceph-mon[35473]: daemon mds.b restarted 2024-09-19T06:49:54.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:54 smithi189 ceph-mon[34880]: daemon mds.b restarted 2024-09-19T06:49:54.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:54 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[68480]: ignoring --setuser ceph since I am not root 2024-09-19T06:49:54.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:54 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[68480]: ignoring --setgroup ceph since I am not root 2024-09-19T06:49:54.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:54 smithi189 ceph-mds[68484]: -- 172.21.15.189:0/2270235613 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cb213f9c20 con 0x55cb213d6800 2024-09-19T06:49:54.638 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:49:54 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[68480]: starting mds.b at 2024-09-19T06:49:54.647 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:54 smithi159 ceph-mon[30935]: daemon mds.b restarted 2024-09-19T06:49:55.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:55 smithi203 ceph-mon[35473]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:49:55.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:55 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.189:6838/2326501898,v1:172.21.15.189:6839/2326501898] up:boot 2024-09-19T06:49:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:55 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:49:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:55 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:49:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:55 smithi203 ceph-mon[35473]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:49:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:55 smithi203 ceph-mon[35473]: pgmap v92: 97 pgs: 97 active+clean; 36 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 1003 KiB/s wr, 90 op/s 2024-09-19T06:49:55.637 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:55 smithi189 ceph-mon[34880]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:49:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:55 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.189:6838/2326501898,v1:172.21.15.189:6839/2326501898] up:boot 2024-09-19T06:49:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:55 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:49:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:55 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:49:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:55 smithi189 ceph-mon[34880]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:49:55.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:55 smithi189 ceph-mon[34880]: pgmap v92: 97 pgs: 97 active+clean; 36 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 1003 KiB/s wr, 90 op/s 2024-09-19T06:49:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:55 smithi159 ceph-mon[30935]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:49:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:55 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.189:6838/2326501898,v1:172.21.15.189:6839/2326501898] up:boot 2024-09-19T06:49:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:55 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T06:49:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:55 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:49:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:55 smithi159 ceph-mon[30935]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:49:55.648 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:55 smithi159 ceph-mon[30935]: pgmap v92: 97 pgs: 97 active+clean; 36 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 1003 KiB/s wr, 90 op/s 2024-09-19T06:49:56.312 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xfe492 2024-09-19T06:49:56.982 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:56 smithi159 ceph-mon[30935]: pgmap v93: 97 pgs: 97 active+clean; 34 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 445 op/s 2024-09-19T06:49:57.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:56 smithi203 ceph-mon[35473]: pgmap v93: 97 pgs: 97 active+clean; 34 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 445 op/s 2024-09-19T06:49:57.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:56 smithi189 ceph-mon[34880]: pgmap v93: 97 pgs: 97 active+clean; 34 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 445 op/s 2024-09-19T06:49:58.022 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xff038 2024-09-19T06:49:58.787 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0xffcac 2024-09-19T06:49:58.895 INFO:tasks.workunit.client.0.smithi159.stdout:10000 copy from 0x2d237 to 0x30552, (0x331b bytes) at 0x82aed 2024-09-19T06:49:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:49:58 smithi203 ceph-mon[35473]: pgmap v94: 97 pgs: 97 active+clean; 34 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 445 op/s 2024-09-19T06:49:59.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:49:58 smithi189 ceph-mon[34880]: pgmap v94: 97 pgs: 97 active+clean; 34 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 445 op/s 2024-09-19T06:49:59.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:49:58 smithi159 ceph-mon[30935]: pgmap v94: 97 pgs: 97 active+clean; 34 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 445 op/s 2024-09-19T06:50:00.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:00 smithi203 ceph-mon[35473]: overall HEALTH_OK 2024-09-19T06:50:00.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:00 smithi189 ceph-mon[34880]: overall HEALTH_OK 2024-09-19T06:50:00.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:00 smithi159 ceph-mon[30935]: overall HEALTH_OK 2024-09-19T06:50:01.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:01 smithi203 ceph-mon[35473]: pgmap v95: 97 pgs: 97 active+clean; 34 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 445 op/s 2024-09-19T06:50:01.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:01 smithi189 ceph-mon[34880]: pgmap v95: 97 pgs: 97 active+clean; 34 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 445 op/s 2024-09-19T06:50:01.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:01 smithi159 ceph-mon[30935]: pgmap v95: 97 pgs: 97 active+clean; 34 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 445 op/s 2024-09-19T06:50:03.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:02 smithi203 ceph-mon[35473]: pgmap v96: 97 pgs: 97 active+clean; 40 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 826 op/s 2024-09-19T06:50:03.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:02 smithi189 ceph-mon[34880]: pgmap v96: 97 pgs: 97 active+clean; 40 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 826 op/s 2024-09-19T06:50:03.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:02 smithi159 ceph-mon[30935]: pgmap v96: 97 pgs: 97 active+clean; 40 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 826 op/s 2024-09-19T06:50:05.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:04 smithi203 ceph-mon[35473]: pgmap v97: 97 pgs: 97 active+clean; 40 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.5 MiB/s wr, 802 op/s 2024-09-19T06:50:05.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:04 smithi189 ceph-mon[34880]: pgmap v97: 97 pgs: 97 active+clean; 40 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.5 MiB/s wr, 802 op/s 2024-09-19T06:50:05.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:04 smithi159 ceph-mon[30935]: pgmap v97: 97 pgs: 97 active+clean; 40 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.5 MiB/s wr, 802 op/s 2024-09-19T06:50:05.216 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:50:05.484 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:06.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 -- 172.21.15.159:0/1206982999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440102ef0 msgr2=0x7f544010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 --2- 172.21.15.159:0/1206982999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440102ef0 0x7f544010da40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5438009ca0 tx=0x7f543802a950 comp rx=0 tx=0).stop 2024-09-19T06:50:06.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 -- 172.21.15.159:0/1206982999 shutdown_connections 2024-09-19T06:50:06.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 --2- 172.21.15.159:0/1206982999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440102ef0 0x7f544010da40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 --2- 172.21.15.159:0/1206982999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5440102570 0x7f54401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 --2- 172.21.15.159:0/1206982999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5440100e20 0x7f5440101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 -- 172.21.15.159:0/1206982999 >> 172.21.15.159:0/1206982999 conn(0x7f54400fc7d0 msgr2=0x7f54400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 -- 172.21.15.159:0/1206982999 shutdown_connections 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 -- 172.21.15.159:0/1206982999 wait complete. 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.980+0000 7f54460d4640 1 Processor -- start 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f54460d4640 1 -- start start 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f54460d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440100e20 0x7f544010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f54460d4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5440102570 0x7f544010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f54460d4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5440102ef0 0x7f544010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f54460d4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f54401120a0 con 0x7f5440100e20 2024-09-19T06:50:06.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f54460d4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5440111f20 con 0x7f5440102570 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f54460d4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5440112220 con 0x7f5440102ef0 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440100e20 0x7f544010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5440102570 0x7f544010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5440102ef0 0x7f544010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440100e20 0x7f544010e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57074/0 (socket says 172.21.15.159:57074) 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543f7fe640 1 -- 172.21.15.159:0/1238038286 learned_addr learned my addr 172.21.15.159:0/1238038286 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543f7fe640 1 -- 172.21.15.159:0/1238038286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5440102ef0 msgr2=0x7f544010ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543f7fe640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5440102ef0 0x7f544010ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543f7fe640 1 -- 172.21.15.159:0/1238038286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5440102570 msgr2=0x7f544010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543f7fe640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5440102570 0x7f544010ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543f7fe640 1 -- 172.21.15.159:0/1238038286 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54401a6960 con 0x7f5440100e20 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.981+0000 7f543effd640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5440102570 0x7f544010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:06.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.982+0000 7f543f7fe640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440100e20 0x7f544010e4d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f543000e9f0 tx=0x7f543000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.982+0000 7f543cff9640 1 -- 172.21.15.159:0/1238038286 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543000cd80 con 0x7f5440100e20 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.982+0000 7f54460d4640 1 -- 172.21.15.159:0/1238038286 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54401a6c50 con 0x7f5440100e20 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.982+0000 7f543cff9640 1 -- 172.21.15.159:0/1238038286 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5430010910 con 0x7f5440100e20 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.982+0000 7f543cff9640 1 -- 172.21.15.159:0/1238038286 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430018990 con 0x7f5440100e20 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.982+0000 7f54460d4640 1 -- 172.21.15.159:0/1238038286 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54401a7190 con 0x7f5440100e20 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.984+0000 7f543cff9640 1 -- 172.21.15.159:0/1238038286 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5430010ac0 con 0x7f5440100e20 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f54484ad740 1 Processor -- start 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f54484ad740 1 -- start start 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f54484ad740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc65254a0 0x558cc6525880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f54484ad740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc6530140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f54484ad740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc6532a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f54484ad740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558cc648b2e0 con 0x558cc65254a0 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f54484ad740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558cc6432ce0 con 0x558cc6525dc0 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f54484ad740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558cc64872a0 con 0x558cc6530680 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543cff9640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54280a33b0 0x7f54280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc65254a0 0x558cc6525880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc65254a0 0x558cc6525880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57080/0 (socket says 172.21.15.159:57080) 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc6530140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543ffff640 1 -- 172.21.15.159:0/2983260187 learned_addr learned my addr 172.21.15.159:0/2983260187 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543effd640 1 --2- 172.21.15.159:0/2983260187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc6532a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543ffff640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54280a33b0 0x7f54280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543cff9640 1 -- 172.21.15.159:0/1238038286 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f54300d0040 con 0x7f5440100e20 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543f7fe640 1 -- 172.21.15.159:0/2983260187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 msgr2=0x558cc6532a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543f7fe640 1 --2- 172.21.15.159:0/2983260187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc6532a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543f7fe640 1 -- 172.21.15.159:0/2983260187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc65254a0 msgr2=0x558cc6525880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543f7fe640 1 --2- 172.21.15.159:0/2983260187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc65254a0 0x558cc6525880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.985+0000 7f543f7fe640 1 -- 172.21.15.159:0/2983260187 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc6417440 con 0x558cc6525dc0 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.986+0000 7f543f7fe640 1 --2- 172.21.15.159:0/2983260187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc6530140 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54300cd760 tx=0x7f5430013700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=641c5356eed7096f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.986+0000 7f543ffff640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54280a33b0 0x7f54280a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5438030040 tx=0x7f5438005c50 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.986+0000 7f5425ffb640 1 -- 172.21.15.159:0/2983260187 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543009c3a0 con 0x558cc6525dc0 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.986+0000 7f5425ffb640 1 -- 172.21.15.159:0/2983260187 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54300a06a0 con 0x558cc6525dc0 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.986+0000 7f5425ffb640 1 -- 172.21.15.159:0/2983260187 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430098b90 con 0x558cc6525dc0 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.986+0000 7f54484ad740 1 -- 172.21.15.159:0/2983260187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 msgr2=0x558cc6530140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.986+0000 7f54484ad740 1 --2- 172.21.15.159:0/2983260187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc6530140 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54300cd760 tx=0x7f5430013700 comp rx=0 tx=0).stop 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.987+0000 7f54484ad740 1 -- 172.21.15.159:0/2983260187 shutdown_connections 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.987+0000 7f54484ad740 1 --2- 172.21.15.159:0/2983260187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc6532a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.987+0000 7f54484ad740 1 --2- 172.21.15.159:0/2983260187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc6530140 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.987+0000 7f54484ad740 1 --2- 172.21.15.159:0/2983260187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc65254a0 0x558cc6525880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.987+0000 7f54484ad740 1 -- 172.21.15.159:0/2983260187 >> 172.21.15.159:0/2983260187 conn(0x558cc6521a30 msgr2=0x558cc6521e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.987+0000 7f54484ad740 1 -- 172.21.15.159:0/2983260187 shutdown_connections 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.987+0000 7f54484ad740 1 -- 172.21.15.159:0/2983260187 wait complete. 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.987+0000 7f54484ad740 1 -- start start 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.987+0000 7f54484ad740 1 Processor -- start 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f54484ad740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc6530060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f54484ad740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc652d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f54484ad740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc652d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f54484ad740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558cc65331f0 con 0x558cc6525dc0 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f54484ad740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558cc6446050 con 0x558cc65254a0 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f54484ad740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558cc6533370 con 0x558cc6530680 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f54484ad740 10 client.0 _ll_register_callbacks cb 0x558cc6486160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:06.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc652d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc6530060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc6530060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:57226/0 (socket says 172.21.15.159:57226) 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc652d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc652d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57096/0 (socket says 172.21.15.159:57096) 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543f7fe640 1 -- 172.21.15.159:0/453710831 learned_addr learned my addr 172.21.15.159:0/453710831 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543f7fe640 1 -- 172.21.15.159:0/453710831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 msgr2=0x558cc652d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543f7fe640 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc652d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543f7fe640 1 -- 172.21.15.159:0/453710831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 msgr2=0x558cc652d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543f7fe640 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc652d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543f7fe640 1 -- 172.21.15.159:0/453710831 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc61fc3c0 con 0x558cc65254a0 2024-09-19T06:50:06.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543ffff640 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc652d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543effd640 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc652d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f543f7fe640 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc6530060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f54300cd810 tx=0x7f5430018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1c762f66b6e2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f541effd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.988+0000 7f541effd640 1 -- 172.21.15.159:0/453710831 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300a4f60 con 0x558cc65254a0 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f541effd640 1 -- 172.21.15.159:0/453710831 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f54300a4ce0 con 0x558cc65254a0 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f54484ad740 1 -- 172.21.15.159:0/453710831 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54300a06a0 con 0x558cc65254a0 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f541effd640 1 -- 172.21.15.159:0/453710831 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f54300b5140 con 0x558cc65254a0 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f54484ad740 10 client.25436 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f54484ad740 1 -- 172.21.15.159:0/453710831 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558cc6547440 con 0x558cc65254a0 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f541effd640 1 -- 172.21.15.159:0/453710831 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54300a06a0 con 0x558cc65254a0 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f541effd640 1 -- 172.21.15.159:0/453710831 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f543009b7f0 con 0x558cc65254a0 2024-09-19T06:50:06.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f54484ad740 10 client.25436 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f54484ad740 10 client.25436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f54484ad740 20 client.25436 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f54484ad740 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558cc6548790 0x558cc654ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f54484ad740 4 client.25436 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f54484ad740 1 -- 172.21.15.159:0/453710831 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cc6498850 con 0x558cc6548790 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.989+0000 7f543effd640 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558cc6548790 0x558cc654ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.990+0000 7f543effd640 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558cc6548790 0x558cc654ab80 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=374246ebe3740033 server_cookie=d622f17cc7b03146 in_seq=0 out_seq=0 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.990+0000 7f541effd640 10 client.25436 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.990+0000 7f541effd640 1 -- 172.21.15.159:0/453710831 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558cc6498850 con 0x558cc6548790 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.990+0000 7f541effd640 10 client.25436 handle_command_reply: tid=0 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 client.25436 shutdown 2024-09-19T06:50:06.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 -- 172.21.15.159:0/453710831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 msgr2=0x558cc6530060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc6530060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f54300cd810 tx=0x7f5430018420 comp rx=0 tx=0).stop 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 -- 172.21.15.159:0/453710831 shutdown_connections 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558cc6548790 0x558cc654ab80 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc652d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc652d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 --2- 172.21.15.159:0/453710831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc6530060 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f541effd640 0 client.25436 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 -- 172.21.15.159:0/453710831 >> 172.21.15.159:0/453710831 conn(0x558cc6521a30 msgr2=0x558cc6527760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 -- 172.21.15.159:0/453710831 shutdown_connections 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 1 -- 172.21.15.159:0/453710831 wait complete. 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:05.991+0000 7f54484ad740 20 client.25436 trim_cache size 0 max 16384 2024-09-19T06:50:06.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f54484ad740 1 Processor -- start 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f54484ad740 1 -- start start 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f54484ad740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc65254a0 0x558cc654ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f54484ad740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc652cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f54484ad740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6530680 0x558cc652f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f54484ad740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f54401a9730 con 0x558cc6530680 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f54484ad740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f54401abf90 con 0x558cc6525dc0 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f54484ad740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f54401a9d80 con 0x558cc65254a0 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f543ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6530680 0x558cc652f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f543ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6530680 0x558cc652f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57110/0 (socket says 172.21.15.159:57110) 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f543effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc652cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f543ffff640 1 -- 172.21.15.159:0/182703717 learned_addr learned my addr 172.21.15.159:0/182703717 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f543f7fe640 1 --2- 172.21.15.159:0/182703717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc65254a0 0x558cc654ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.009+0000 7f543ffff640 1 -- 172.21.15.159:0/182703717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc65254a0 msgr2=0x558cc654ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.010+0000 7f543ffff640 1 --2- 172.21.15.159:0/182703717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc65254a0 0x558cc654ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.010+0000 7f543ffff640 1 -- 172.21.15.159:0/182703717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 msgr2=0x558cc652cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.010+0000 7f543ffff640 1 --2- 172.21.15.159:0/182703717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc652cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.010+0000 7f543ffff640 1 -- 172.21.15.159:0/182703717 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc6525bf0 con 0x558cc6530680 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.010+0000 7f543effd640 1 --2- 172.21.15.159:0/182703717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc652cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.010+0000 7f543ffff640 1 --2- 172.21.15.159:0/182703717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6530680 0x558cc652f390 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5438009ca0 tx=0x7f5438009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5535ff01437666 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.010+0000 7f54257fa640 1 -- 172.21.15.159:0/182703717 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438034040 con 0x558cc6530680 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.010+0000 7f54257fa640 1 -- 172.21.15.159:0/182703717 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5438004720 con 0x558cc6530680 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.010+0000 7f54257fa640 1 -- 172.21.15.159:0/182703717 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438030d90 con 0x558cc6530680 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 -- 172.21.15.159:0/182703717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6530680 msgr2=0x558cc652f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 --2- 172.21.15.159:0/182703717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6530680 0x558cc652f390 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5438009ca0 tx=0x7f5438009360 comp rx=0 tx=0).stop 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 -- 172.21.15.159:0/182703717 shutdown_connections 2024-09-19T06:50:06.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 --2- 172.21.15.159:0/182703717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6530680 0x558cc652f390 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 --2- 172.21.15.159:0/182703717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc6525dc0 0x558cc652cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 --2- 172.21.15.159:0/182703717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc65254a0 0x558cc654ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 -- 172.21.15.159:0/182703717 >> 172.21.15.159:0/182703717 conn(0x558cc6521a30 msgr2=0x558cc6521e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 -- 172.21.15.159:0/182703717 shutdown_connections 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 -- 172.21.15.159:0/182703717 wait complete. 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 -- start start 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.011+0000 7f54484ad740 1 Processor -- start 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f54484ad740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc65aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f54484ad740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc65aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f54484ad740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc653e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f54484ad740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f54401aa450 con 0x558cc6525dc0 2024-09-19T06:50:06.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f54484ad740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f54401ab8c0 con 0x558cc65254a0 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f54484ad740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f54401aab20 con 0x558cc6530680 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f54484ad740 10 client.0 _ll_register_callbacks cb 0x7f5434005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc65aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc653e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc65aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57122/0 (socket says 172.21.15.159:57122) 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543effd640 1 -- 172.21.15.159:0/2564975626 learned_addr learned my addr 172.21.15.159:0/2564975626 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543f7fe640 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc65aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543f7fe640 1 -- 172.21.15.159:0/2564975626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 msgr2=0x558cc653e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543f7fe640 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc653e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543f7fe640 1 -- 172.21.15.159:0/2564975626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 msgr2=0x558cc65aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543f7fe640 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc65aaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543f7fe640 1 -- 172.21.15.159:0/2564975626 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc65303d0 con 0x558cc65254a0 2024-09-19T06:50:06.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543ffff640 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc653e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543effd640 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc65aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f543f7fe640 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc65aa4d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f543009b260 tx=0x7f543009c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfed1d0b706aad98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.012+0000 7f541effd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f541effd640 1 -- 172.21.15.159:0/2564975626 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430095060 con 0x558cc65254a0 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f541effd640 1 -- 172.21.15.159:0/2564975626 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f5430018b30 con 0x558cc65254a0 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f54484ad740 1 -- 172.21.15.159:0/2564975626 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5438004720 con 0x558cc65254a0 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f541effd640 1 -- 172.21.15.159:0/2564975626 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f54300b52e0 con 0x558cc65254a0 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f54484ad740 10 client.25442 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f54484ad740 1 -- 172.21.15.159:0/2564975626 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558cc6533600 con 0x558cc65254a0 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f541effd640 1 -- 172.21.15.159:0/2564975626 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5438004720 con 0x558cc65254a0 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f541effd640 1 -- 172.21.15.159:0/2564975626 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f543009b400 con 0x558cc65254a0 2024-09-19T06:50:06.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f54484ad740 10 client.25442 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f54484ad740 10 client.25442 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f54484ad740 20 client.25442 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f54484ad740 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558cc6533b90 0x558cc6535f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f54484ad740 4 client.25442 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f54484ad740 1 -- 172.21.15.159:0/2564975626 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558cc6492d60 con 0x558cc6533b90 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.013+0000 7f543effd640 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558cc6533b90 0x558cc6535f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f543effd640 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558cc6533b90 0x558cc6535f80 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7de96e30d909069 server_cookie=839d8b6fa9e6af47 in_seq=0 out_seq=0 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f541effd640 10 client.25442 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f541effd640 1 -- 172.21.15.159:0/2564975626 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558cc6492d60 con 0x558cc6533b90 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f541effd640 10 client.25442 handle_command_reply: tid=0 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 client.25442 shutdown 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 -- 172.21.15.159:0/2564975626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 msgr2=0x558cc65aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc65aa4d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f543009b260 tx=0x7f543009c420 comp rx=0 tx=0).stop 2024-09-19T06:50:06.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 -- 172.21.15.159:0/2564975626 shutdown_connections 2024-09-19T06:50:06.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558cc6533b90 0x558cc6535f80 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558cc6530680 0x558cc653e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558cc6525dc0 0x558cc65aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f541effd640 0 client.25442 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:06.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 --2- 172.21.15.159:0/2564975626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558cc65254a0 0x558cc65aa4d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 -- 172.21.15.159:0/2564975626 >> 172.21.15.159:0/2564975626 conn(0x558cc6521a30 msgr2=0x558cc6520350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 -- 172.21.15.159:0/2564975626 shutdown_connections 2024-09-19T06:50:06.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 1 -- 172.21.15.159:0/2564975626 wait complete. 2024-09-19T06:50:06.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.014+0000 7f54484ad740 20 client.25442 trim_cache size 0 max 16384 2024-09-19T06:50:06.034 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:50:06.034 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:50:06.034 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:50:06.034 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:50:06.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 -- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54280a33b0 msgr2=0x7f54280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54280a33b0 0x7f54280a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5438030040 tx=0x7f5438005c50 comp rx=0 tx=0).stop 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 -- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440100e20 msgr2=0x7f544010e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440100e20 0x7f544010e4d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f543000e9f0 tx=0x7f543000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 -- 172.21.15.159:0/1238038286 shutdown_connections 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54280a33b0 0x7f54280a5870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5440102ef0 0x7f544010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5440102570 0x7f544010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 --2- 172.21.15.159:0/1238038286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5440100e20 0x7f544010e4d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 -- 172.21.15.159:0/1238038286 >> 172.21.15.159:0/1238038286 conn(0x7f54400fc7d0 msgr2=0x7f5440106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 -- 172.21.15.159:0/1238038286 shutdown_connections 2024-09-19T06:50:06.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:06.015+0000 7f54460d4640 1 -- 172.21.15.159:0/1238038286 wait complete. 2024-09-19T06:50:06.856 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:50:06.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:50:06.880 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:06 smithi159 ceph-mon[30935]: pgmap v98: 97 pgs: 97 active+clean; 43 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 995 op/s 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.993+0000 7fbd40b3b640 1 -- 172.21.15.159:0/949537669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c10c0c0 msgr2=0x7fbd3c10e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.993+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/949537669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c10c0c0 0x7fbd3c10e580 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009ca0 tx=0x7fbd3402a950 comp rx=0 tx=0).stop 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.994+0000 7fbd40b3b640 1 -- 172.21.15.159:0/949537669 shutdown_connections 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.994+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/949537669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c10c0c0 0x7fbd3c10e580 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.994+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/949537669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd3c1035c0 0x7fbd3c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.994+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/949537669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd3c102ca0 0x7fbd3c103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.994+0000 7fbd40b3b640 1 -- 172.21.15.159:0/949537669 >> 172.21.15.159:0/949537669 conn(0x7fbd3c0fc6f0 msgr2=0x7fbd3c0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.994+0000 7fbd40b3b640 1 -- 172.21.15.159:0/949537669 shutdown_connections 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.994+0000 7fbd40b3b640 1 -- 172.21.15.159:0/949537669 wait complete. 2024-09-19T06:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.994+0000 7fbd40b3b640 1 Processor -- start 2024-09-19T06:50:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.994+0000 7fbd40b3b640 1 -- start start 2024-09-19T06:50:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd40b3b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c102ca0 0x7fbd3c1008f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd40b3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd3c1035c0 0x7fbd3c100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd40b3b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd3c10c0c0 0x7fbd3c101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd40b3b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c111ee0 con 0x7fbd3c102ca0 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd40b3b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c111d60 con 0x7fbd3c1035c0 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd40b3b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c112060 con 0x7fbd3c10c0c0 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd3a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c102ca0 0x7fbd3c1008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd39d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd3c1035c0 0x7fbd3c100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd3a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c102ca0 0x7fbd3c1008f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57146/0 (socket says 172.21.15.159:57146) 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd3a59c640 1 -- 172.21.15.159:0/1739150736 learned_addr learned my addr 172.21.15.159:0/1739150736 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd3c10c0c0 0x7fbd3c101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd39d9b640 1 -- 172.21.15.159:0/1739150736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd3c10c0c0 msgr2=0x7fbd3c101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd3c10c0c0 0x7fbd3c101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd39d9b640 1 -- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c102ca0 msgr2=0x7fbd3c1008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c102ca0 0x7fbd3c1008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd39d9b640 1 -- 172.21.15.159:0/1739150736 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c1a67b0 con 0x7fbd3c1035c0 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c102ca0 0x7fbd3c1008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd3c1035c0 0x7fbd3c100e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000e9f0 tx=0x7fbd3000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd2b7fe640 1 -- 172.21.15.159:0/1739150736 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3000ccc0 con 0x7fbd3c1035c0 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd40b3b640 1 -- 172.21.15.159:0/1739150736 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c1a6aa0 con 0x7fbd3c1035c0 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.995+0000 7fbd2b7fe640 1 -- 172.21.15.159:0/1739150736 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd30005020 con 0x7fbd3c1035c0 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.996+0000 7fbd2b7fe640 1 -- 172.21.15.159:0/1739150736 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd300049e0 con 0x7fbd3c1035c0 2024-09-19T06:50:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.996+0000 7fbd40b3b640 1 -- 172.21.15.159:0/1739150736 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c1a6fa0 con 0x7fbd3c1035c0 2024-09-19T06:50:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.998+0000 7fbd438d7740 1 Processor -- start 2024-09-19T06:50:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.998+0000 7fbd438d7740 1 -- start start 2024-09-19T06:50:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.998+0000 7fbd2b7fe640 1 -- 172.21.15.159:0/1739150736 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fbd30004c00 con 0x7fbd3c1035c0 2024-09-19T06:50:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.998+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.998+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6ff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.998+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a7020a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.998+0000 7fbd438d7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a6592f0 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.998+0000 7fbd438d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a601270 con 0x55ed8a6f4af0 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.998+0000 7fbd438d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a6552b0 con 0x55ed8a6f5410 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3ad9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd39d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a7020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3ad9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6f4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:57258/0 (socket says 172.21.15.159:57258) 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3ad9d640 1 -- 172.21.15.159:0/602437242 learned_addr learned my addr 172.21.15.159:0/602437242 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3ad9d640 1 -- 172.21.15.159:0/602437242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 msgr2=0x55ed8a6ff770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6ff770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3ad9d640 1 -- 172.21.15.159:0/602437242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 msgr2=0x55ed8a7020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a7020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3ad9d640 1 -- 172.21.15.159:0/602437242 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed8a600340 con 0x55ed8a6f4af0 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a7020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd2b7fe640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbd240a3460 0x7fbd240a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6f4ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd34035000 tx=0x7fbd340093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3235a68577b929e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbd240a3460 0x7fbd240a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:06.999+0000 7fbd2b7fe640 1 -- 172.21.15.159:0/1739150736 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fbd300cfc50 con 0x7fbd3c1035c0 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd28ff9640 1 -- 172.21.15.159:0/602437242 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34048070 con 0x55ed8a6f4af0 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd28ff9640 1 -- 172.21.15.159:0/602437242 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd3402f940 con 0x55ed8a6f4af0 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd28ff9640 1 -- 172.21.15.159:0/602437242 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34034040 con 0x55ed8a6f4af0 2024-09-19T06:50:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd438d7740 1 -- 172.21.15.159:0/602437242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 msgr2=0x55ed8a6f4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbd240a3460 0x7fbd240a5920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009620 tx=0x7fbd2c005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd438d7740 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6f4ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd34035000 tx=0x7fbd340093e0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd438d7740 1 -- 172.21.15.159:0/602437242 shutdown_connections 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd438d7740 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a7020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd438d7740 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd438d7740 1 --2- 172.21.15.159:0/602437242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6f4ed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.000+0000 7fbd438d7740 1 -- 172.21.15.159:0/602437242 >> 172.21.15.159:0/602437242 conn(0x55ed8a6f1060 msgr2=0x55ed8a6f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 -- 172.21.15.159:0/602437242 shutdown_connections 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 -- 172.21.15.159:0/602437242 wait complete. 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 -- start start 2024-09-19T06:50:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 Processor -- start 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a6fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6fd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a702880 con 0x55ed8a6f4af0 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a5e2290 con 0x55ed8a6f5410 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ed8a702a00 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd438d7740 10 client.0 _ll_register_callbacks cb 0x55ed8a613140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd39d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a6fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd3a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.001+0000 7fbd39d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a6fd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:57266/0 (socket says 172.21.15.159:57266) 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd39d9b640 1 -- 172.21.15.159:0/20653147 learned_addr learned my addr 172.21.15.159:0/20653147 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd39d9b640 1 -- 172.21.15.159:0/20653147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 msgr2=0x55ed8a6fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd39d9b640 1 -- 172.21.15.159:0/20653147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 msgr2=0x55ed8a6fcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6fcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd39d9b640 1 -- 172.21.15.159:0/20653147 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed8a36c210 con 0x55ed8a6f5410 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a6fd0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c6a0 tx=0x7fbd30009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7930560fc404d52e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd21ffb640 1 -- 172.21.15.159:0/20653147 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3001c070 con 0x55ed8a6f5410 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd438d7740 1 -- 172.21.15.159:0/20653147 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd3402f940 con 0x55ed8a6f5410 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd21ffb640 1 -- 172.21.15.159:0/20653147 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fbd300a46e0 con 0x55ed8a6f5410 2024-09-19T06:50:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd21ffb640 1 -- 172.21.15.159:0/20653147 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd3009bcd0 con 0x55ed8a6f5410 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd438d7740 10 client.25454 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.002+0000 7fbd438d7740 1 -- 172.21.15.159:0/20653147 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ed8a438620 con 0x55ed8a6f5410 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd21ffb640 1 -- 172.21.15.159:0/20653147 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd3402f940 con 0x55ed8a6f5410 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd21ffb640 1 -- 172.21.15.159:0/20653147 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fbd300bab40 con 0x55ed8a6f5410 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd438d7740 10 client.25454 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd438d7740 10 client.25454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd438d7740 20 client.25454 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd438d7740 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ed8a70fca0 0x55ed8a712090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd438d7740 4 client.25454 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd438d7740 1 -- 172.21.15.159:0/20653147 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed8a666a20 con 0x55ed8a70fca0 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ed8a70fca0 0x55ed8a712090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ed8a70fca0 0x55ed8a712090 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca9c23be779e9c server_cookie=dce47e03468baa95 in_seq=0 out_seq=0 2024-09-19T06:50:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.003+0000 7fbd21ffb640 10 client.25454 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd21ffb640 1 -- 172.21.15.159:0/20653147 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed8a666a20 con 0x55ed8a70fca0 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd21ffb640 10 client.25454 handle_command_reply: tid=0 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 client.25454 shutdown 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 -- 172.21.15.159:0/20653147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 msgr2=0x55ed8a6fd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a6fd0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c6a0 tx=0x7fbd30009f60 comp rx=0 tx=0).stop 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 -- 172.21.15.159:0/20653147 shutdown_connections 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ed8a70fca0 0x55ed8a712090 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a6fd0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd21ffb640 0 client.25454 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 --2- 172.21.15.159:0/20653147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 -- 172.21.15.159:0/20653147 >> 172.21.15.159:0/20653147 conn(0x55ed8a6f1060 msgr2=0x55ed8a6f01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 -- 172.21.15.159:0/20653147 shutdown_connections 2024-09-19T06:50:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 1 -- 172.21.15.159:0/20653147 wait complete. 2024-09-19T06:50:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.004+0000 7fbd438d7740 20 client.25454 trim_cache size 0 max 16384 2024-09-19T06:50:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd438d7740 1 Processor -- start 2024-09-19T06:50:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd438d7740 1 -- start start 2024-09-19T06:50:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6fd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a717960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a717ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd438d7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1ad9a0 con 0x55ed8a6f4af0 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd438d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1b0220 con 0x55ed8a6f5410 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd438d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1ae010 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd39d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a717960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd3a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd39d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a717960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:57282/0 (socket says 172.21.15.159:57282) 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd39d9b640 1 -- 172.21.15.159:0/80897990 learned_addr learned my addr 172.21.15.159:0/80897990 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/80897990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a717ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd39d9b640 1 -- 172.21.15.159:0/80897990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 msgr2=0x55ed8a717ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/80897990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a717ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd39d9b640 1 -- 172.21.15.159:0/80897990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 msgr2=0x55ed8a6fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/80897990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.020+0000 7fbd39d9b640 1 -- 172.21.15.159:0/80897990 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed8a702410 con 0x55ed8a6f5410 2024-09-19T06:50:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.021+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/80897990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a717960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd300988d0 tx=0x7fbd300096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63826793feb45b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.021+0000 7fbd23fff640 1 -- 172.21.15.159:0/80897990 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3007e070 con 0x55ed8a6f5410 2024-09-19T06:50:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.021+0000 7fbd23fff640 1 -- 172.21.15.159:0/80897990 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd300051d0 con 0x55ed8a6f5410 2024-09-19T06:50:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.021+0000 7fbd23fff640 1 -- 172.21.15.159:0/80897990 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3001c070 con 0x55ed8a6f5410 2024-09-19T06:50:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 -- 172.21.15.159:0/80897990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 msgr2=0x55ed8a717960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 --2- 172.21.15.159:0/80897990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a717960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd300988d0 tx=0x7fbd300096e0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 -- 172.21.15.159:0/80897990 shutdown_connections 2024-09-19T06:50:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 --2- 172.21.15.159:0/80897990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a717ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 --2- 172.21.15.159:0/80897990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f5410 0x55ed8a717960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 --2- 172.21.15.159:0/80897990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6f4af0 0x55ed8a6fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 -- 172.21.15.159:0/80897990 >> 172.21.15.159:0/80897990 conn(0x55ed8a6f1060 msgr2=0x55ed8a6fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 -- 172.21.15.159:0/80897990 shutdown_connections 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 -- 172.21.15.159:0/80897990 wait complete. 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 -- start start 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 Processor -- start 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a708190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6f9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1ae6e0 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1afb50 con 0x55ed8a6f4af0 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1aedb0 con 0x55ed8a6f5410 2024-09-19T06:50:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd438d7740 10 client.0 _ll_register_callbacks cb 0x7fbd300d3490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd3a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a708190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.022+0000 7fbd3ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd3a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a708190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:57284/0 (socket says 172.21.15.159:57284) 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd3a59c640 1 -- 172.21.15.159:0/2387422121 learned_addr learned my addr 172.21.15.159:0/2387422121 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd3ad9d640 1 -- 172.21.15.159:0/2387422121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 msgr2=0x55ed8a6f9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6f9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd3ad9d640 1 -- 172.21.15.159:0/2387422121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 msgr2=0x55ed8a708190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a708190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd3ad9d640 1 -- 172.21.15.159:0/2387422121 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed8a6f6000 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd39d9b640 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a708190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd3ad9d640 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6f9b70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbd3402ae70 tx=0x7fbd34005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554c72f346ed32fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd21ffb640 1 -- 172.21.15.159:0/2387422121 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34053020 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd21ffb640 1 -- 172.21.15.159:0/2387422121 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fbd34003970 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd438d7740 1 -- 172.21.15.159:0/2387422121 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd300051d0 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd21ffb640 1 -- 172.21.15.159:0/2387422121 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd3405e050 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd438d7740 10 client.16083 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.023+0000 7fbd438d7740 1 -- 172.21.15.159:0/2387422121 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ed8a77a5a0 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd21ffb640 1 -- 172.21.15.159:0/2387422121 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd300051d0 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd21ffb640 1 -- 172.21.15.159:0/2387422121 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fbd34030440 con 0x55ed8a6ffcb0 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd438d7740 10 client.16083 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd438d7740 10 client.16083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd438d7740 20 client.16083 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd438d7740 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ed8a77a8d0 0x55ed8a77ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd438d7740 4 client.16083 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:50:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd438d7740 1 -- 172.21.15.159:0/2387422121 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ed8a660d70 con 0x55ed8a77a8d0 2024-09-19T06:50:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ed8a77a8d0 0x55ed8a77ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd21ffb640 10 client.16083 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.024+0000 7fbd3a59c640 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ed8a77a8d0 0x55ed8a77ccc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d979aca4209d50c server_cookie=996fc2e90b0dfb48 in_seq=0 out_seq=0 2024-09-19T06:50:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.045+0000 7fbd21ffb640 1 -- 172.21.15.159:0/2387422121 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ed8a660d70 con 0x55ed8a77a8d0 2024-09-19T06:50:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.045+0000 7fbd21ffb640 10 client.16083 handle_command_reply: tid=0 2024-09-19T06:50:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.045+0000 7fbd438d7740 1 client.16083 shutdown 2024-09-19T06:50:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.045+0000 7fbd438d7740 1 -- 172.21.15.159:0/2387422121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 msgr2=0x55ed8a6f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.045+0000 7fbd438d7740 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6f9b70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbd3402ae70 tx=0x7fbd34005cf0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd438d7740 1 -- 172.21.15.159:0/2387422121 shutdown_connections 2024-09-19T06:50:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd438d7740 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ed8a77a8d0 0x55ed8a77ccc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd438d7740 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ed8a6ffcb0 0x55ed8a6f9b70 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd438d7740 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed8a6f5410 0x55ed8a6f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd21ffb640 0 client.16083 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd438d7740 1 --2- 172.21.15.159:0/2387422121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ed8a6f4af0 0x55ed8a708190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd438d7740 1 -- 172.21.15.159:0/2387422121 >> 172.21.15.159:0/2387422121 conn(0x55ed8a6f1060 msgr2=0x55ed8a6ef9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd438d7740 1 -- 172.21.15.159:0/2387422121 shutdown_connections 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd438d7740 1 -- 172.21.15.159:0/2387422121 wait complete. 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd438d7740 20 client.16083 trim_cache size 0 max 16384 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:50:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:50:07.049 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:50:07.049 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:50:07.049 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd40b3b640 1 -- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbd240a3460 msgr2=0x7fbd240a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.049 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbd240a3460 0x7fbd240a5920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009620 tx=0x7fbd2c005f90 comp rx=0 tx=0).stop 2024-09-19T06:50:07.049 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd40b3b640 1 -- 172.21.15.159:0/1739150736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd3c1035c0 msgr2=0x7fbd3c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.050 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.046+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd3c1035c0 0x7fbd3c100e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000e9f0 tx=0x7fbd3000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.050 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.047+0000 7fbd40b3b640 1 -- 172.21.15.159:0/1739150736 shutdown_connections 2024-09-19T06:50:07.050 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.047+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbd240a3460 0x7fbd240a5920 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.050 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.047+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd3c10c0c0 0x7fbd3c101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.050 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.047+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd3c1035c0 0x7fbd3c100e30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.050 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.047+0000 7fbd40b3b640 1 --2- 172.21.15.159:0/1739150736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd3c102ca0 0x7fbd3c1008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.050 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.047+0000 7fbd40b3b640 1 -- 172.21.15.159:0/1739150736 >> 172.21.15.159:0/1739150736 conn(0x7fbd3c0fc6f0 msgr2=0x7fbd3c0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:07.050 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.047+0000 7fbd40b3b640 1 -- 172.21.15.159:0/1739150736 shutdown_connections 2024-09-19T06:50:07.050 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:07.047+0000 7fbd40b3b640 1 -- 172.21.15.159:0/1739150736 wait complete. 2024-09-19T06:50:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:06 smithi203 ceph-mon[35473]: pgmap v98: 97 pgs: 97 active+clean; 43 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 995 op/s 2024-09-19T06:50:07.128 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:07.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:06 smithi189 ceph-mon[34880]: pgmap v98: 97 pgs: 97 active+clean; 43 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 995 op/s 2024-09-19T06:50:07.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.628+0000 7f9f75e96640 1 -- 172.21.15.159:0/1294940260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 msgr2=0x7f9f70101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.628+0000 7f9f75e96640 1 --2- 172.21.15.159:0/1294940260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 0x7f9f70101200 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009900 tx=0x7f9f6002a480 comp rx=0 tx=0).stop 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.628+0000 7f9f75e96640 1 -- 172.21.15.159:0/1294940260 shutdown_connections 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.628+0000 7f9f75e96640 1 --2- 172.21.15.159:0/1294940260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f70102ef0 0x7f9f7010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.628+0000 7f9f75e96640 1 --2- 172.21.15.159:0/1294940260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f70102570 0x7f9f701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.628+0000 7f9f75e96640 1 --2- 172.21.15.159:0/1294940260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 0x7f9f70101200 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.628+0000 7f9f75e96640 1 -- 172.21.15.159:0/1294940260 >> 172.21.15.159:0/1294940260 conn(0x7f9f700fc7d0 msgr2=0x7f9f700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.628+0000 7f9f75e96640 1 -- 172.21.15.159:0/1294940260 shutdown_connections 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.628+0000 7f9f75e96640 1 -- 172.21.15.159:0/1294940260 wait complete. 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f75e96640 1 Processor -- start 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f75e96640 1 -- start start 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f75e96640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 0x7f9f70198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f75e96640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f70102570 0x7f9f70198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f75e96640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f70102ef0 0x7f9f7019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f75e96640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7006a980 con 0x7f9f70100e20 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f75e96640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7006a800 con 0x7f9f70102ef0 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f75e96640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7006ab00 con 0x7f9f70102570 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f6f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 0x7f9f70198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f6effd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f70102570 0x7f9f70198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f6f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 0x7f9f70198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57208/0 (socket says 172.21.15.159:57208) 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f6f7fe640 1 -- 172.21.15.159:0/3345244614 learned_addr learned my addr 172.21.15.159:0/3345244614 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.629+0000 7f9f6ffff640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f70102ef0 0x7f9f7019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6f7fe640 1 -- 172.21.15.159:0/3345244614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f70102570 msgr2=0x7f9f70198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6f7fe640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f70102570 0x7f9f70198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6f7fe640 1 -- 172.21.15.159:0/3345244614 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f70102ef0 msgr2=0x7f9f7019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6f7fe640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f70102ef0 0x7f9f7019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6f7fe640 1 -- 172.21.15.159:0/3345244614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7019d510 con 0x7f9f70100e20 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6effd640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f70102570 0x7f9f70198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6f7fe640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 0x7f9f70198560 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9f60006010 tx=0x7f9f60003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6cff9640 1 -- 172.21.15.159:0/3345244614 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6003f070 con 0x7f9f70100e20 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7019d7a0 con 0x7f9f70100e20 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6cff9640 1 -- 172.21.15.159:0/3345244614 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f60031c30 con 0x7f9f70100e20 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f6cff9640 1 -- 172.21.15.159:0/3345244614 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60035030 con 0x7f9f70100e20 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.630+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f701a50e0 con 0x7f9f70100e20 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.631+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f701021b0 con 0x7f9f70100e20 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.632+0000 7f9f6cff9640 1 -- 172.21.15.159:0/3345244614 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9f60042070 con 0x7f9f70100e20 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.633+0000 7f9f6cff9640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f580a33b0 0x7f9f580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:07.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.633+0000 7f9f6cff9640 1 -- 172.21.15.159:0/3345244614 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f9f600f03b0 con 0x7f9f70100e20 2024-09-19T06:50:07.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.633+0000 7f9f6effd640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f580a33b0 0x7f9f580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:07.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.634+0000 7f9f6effd640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f580a33b0 0x7f9f580a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f700ffde0 tx=0x7f9f64005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:07.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.637+0000 7f9f6cff9640 1 -- 172.21.15.159:0/3345244614 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9f60031de0 con 0x7f9f70100e20 2024-09-19T06:50:07.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.866+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f70109090 con 0x7f9f70100e20 2024-09-19T06:50:07.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.867+0000 7f9f6cff9640 1 -- 172.21.15.159:0/3345244614 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f9f600bc710 con 0x7f9f70100e20 2024-09-19T06:50:07.868 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:50:07.868 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:50:07.869 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:50:07.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f580a33b0 msgr2=0x7f9f580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f580a33b0 0x7f9f580a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f700ffde0 tx=0x7f9f64005f90 comp rx=0 tx=0).stop 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 msgr2=0x7f9f70198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 0x7f9f70198560 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9f60006010 tx=0x7f9f60003c10 comp rx=0 tx=0).stop 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 shutdown_connections 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9f580a33b0 0x7f9f580a5870 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f70102ef0 0x7f9f7019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f70102570 0x7f9f70198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 --2- 172.21.15.159:0/3345244614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f70100e20 0x7f9f70198560 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 >> 172.21.15.159:0/3345244614 conn(0x7f9f700fc7d0 msgr2=0x7f9f700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 shutdown_connections 2024-09-19T06:50:07.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:07.869+0000 7f9f75e96640 1 -- 172.21.15.159:0/3345244614 wait complete. 2024-09-19T06:50:08.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:07 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3345244614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:08.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:07 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3345244614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:08.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:07 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3345244614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:08.617 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:50:08.918 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:09.187 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:08 smithi159 ceph-mon[30935]: pgmap v99: 97 pgs: 97 active+clean; 43 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 678 op/s 2024-09-19T06:50:09.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:08 smithi203 ceph-mon[35473]: pgmap v99: 97 pgs: 97 active+clean; 43 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 678 op/s 2024-09-19T06:50:09.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:08 smithi189 ceph-mon[34880]: pgmap v99: 97 pgs: 97 active+clean; 43 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 678 op/s 2024-09-19T06:50:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.428+0000 7fd41ab3c640 1 -- 172.21.15.159:0/1014980390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 msgr2=0x7fd414107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.428+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/1014980390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 0x7fd414107b80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd400009930 tx=0x7fd40002a420 comp rx=0 tx=0).stop 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.428+0000 7fd41ab3c640 1 -- 172.21.15.159:0/1014980390 shutdown_connections 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.428+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/1014980390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd414108290 0x7fd41410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/1014980390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 0x7fd414107b80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/1014980390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd414102d90 0x7fd414103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 -- 172.21.15.159:0/1014980390 >> 172.21.15.159:0/1014980390 conn(0x7fd4140fc7d0 msgr2=0x7fd4140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 -- 172.21.15.159:0/1014980390 shutdown_connections 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 -- 172.21.15.159:0/1014980390 wait complete. 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 Processor -- start 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 -- start start 2024-09-19T06:50:09.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd414102d90 0x7fd4141985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 0x7fd414198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd414108290 0x7fd41419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd414112050 con 0x7fd414103740 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd414111ed0 con 0x7fd414108290 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd41ab3c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141121d0 con 0x7fd414102d90 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd413fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 0x7fd414198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd413fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 0x7fd414198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34400/0 (socket says 172.21.15.159:34400) 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.429+0000 7fd413fff640 1 -- 172.21.15.159:0/110675427 learned_addr learned my addr 172.21.15.159:0/110675427 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd4188d8640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd414102d90 0x7fd4141985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd4190d9640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd414108290 0x7fd41419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd413fff640 1 -- 172.21.15.159:0/110675427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd414102d90 msgr2=0x7fd4141985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd413fff640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd414102d90 0x7fd4141985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd413fff640 1 -- 172.21.15.159:0/110675427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd414108290 msgr2=0x7fd41419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd413fff640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd414108290 0x7fd41419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd413fff640 1 -- 172.21.15.159:0/110675427 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41419d560 con 0x7fd414103740 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd4190d9640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd414108290 0x7fd41419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd4188d8640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd414102d90 0x7fd4141985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd413fff640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 0x7fd414198af0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd400005940 tx=0x7fd4000040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd411ffb640 1 -- 172.21.15.159:0/110675427 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40003f030 con 0x7fd414103740 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd41ab3c640 1 -- 172.21.15.159:0/110675427 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41419d7f0 con 0x7fd414103740 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd411ffb640 1 -- 172.21.15.159:0/110675427 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4000044c0 con 0x7fd414103740 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.430+0000 7fd411ffb640 1 -- 172.21.15.159:0/110675427 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400035070 con 0x7fd414103740 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.431+0000 7fd41ab3c640 1 -- 172.21.15.159:0/110675427 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4141a5130 con 0x7fd414103740 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.433+0000 7fd411ffb640 1 -- 172.21.15.159:0/110675427 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd400042030 con 0x7fd414103740 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.433+0000 7fd41cf15740 1 Processor -- start 2024-09-19T06:50:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd41cf15740 1 -- start start 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676df5d0 0x55a4676dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd411ffb640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd4040a33b0 0x7fd4040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676ec760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd41cf15740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a4676452f0 con 0x55a4676ea370 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd41cf15740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a4675eccf0 con 0x55a4676df5d0 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd41cf15740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a4676412b0 con 0x55a4676e0b40 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4188d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676df5d0 0x55a4676dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4190d9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd413fff640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd4040a33b0 0x7fd4040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4188d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676df5d0 0x55a4676dfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:34868/0 (socket says 172.21.15.159:34868) 2024-09-19T06:50:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4188d8640 1 -- 172.21.15.159:0/904432957 learned_addr learned my addr 172.21.15.159:0/904432957 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4190d9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676df090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:34088/0 (socket says 172.21.15.159:34088) 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4190d9640 1 --2- 172.21.15.159:0/904432957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676ec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd411ffb640 1 -- 172.21.15.159:0/110675427 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fd4000f0130 con 0x7fd414103740 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4188d8640 1 -- 172.21.15.159:0/904432957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 msgr2=0x55a4676df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4188d8640 1 --2- 172.21.15.159:0/904432957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676df090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4188d8640 1 -- 172.21.15.159:0/904432957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 msgr2=0x55a4676ec760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4188d8640 1 --2- 172.21.15.159:0/904432957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676ec760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4188d8640 1 -- 172.21.15.159:0/904432957 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4675d13a0 con 0x55a4676df5d0 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.434+0000 7fd4190d9640 1 --2- 172.21.15.159:0/904432957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.435+0000 7fd413fff640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd4040a33b0 0x7fd4040a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4000c4ac0 tx=0x7fd4000b7fb0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.435+0000 7fd4188d8640 1 --2- 172.21.15.159:0/904432957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676df5d0 0x55a4676dfa10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd4080115f0 tx=0x7fd408011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd0293ad746d6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.435+0000 7fd3feffd640 1 -- 172.21.15.159:0/904432957 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40801e070 con 0x55a4676df5d0 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.435+0000 7fd3feffd640 1 -- 172.21.15.159:0/904432957 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd40800fb20 con 0x55a4676df5d0 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.435+0000 7fd3feffd640 1 -- 172.21.15.159:0/904432957 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408019bd0 con 0x55a4676df5d0 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 -- 172.21.15.159:0/904432957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676df5d0 msgr2=0x55a4676dfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 --2- 172.21.15.159:0/904432957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676df5d0 0x55a4676dfa10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd4080115f0 tx=0x7fd408011ab0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 -- 172.21.15.159:0/904432957 shutdown_connections 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 --2- 172.21.15.159:0/904432957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676ec760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 --2- 172.21.15.159:0/904432957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676df5d0 0x55a4676dfa10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 --2- 172.21.15.159:0/904432957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 -- 172.21.15.159:0/904432957 >> 172.21.15.159:0/904432957 conn(0x55a4676a8310 msgr2=0x55a4676dbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 -- 172.21.15.159:0/904432957 shutdown_connections 2024-09-19T06:50:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 -- 172.21.15.159:0/904432957 wait complete. 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 -- start start 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.436+0000 7fd41cf15740 1 Processor -- start 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 0x55a4676e9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd41cf15740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a4676ed070 con 0x55a4676ea370 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd41cf15740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a467600060 con 0x55a4676e0b40 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd41cf15740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a4676ed1f0 con 0x55a4676df5d0 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd41cf15740 10 client.0 _ll_register_callbacks cb 0x55a4673538c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4188d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4190d9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 0x55a4676e9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4188d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:34880/0 (socket says 172.21.15.159:34880) 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4188d8640 1 -- 172.21.15.159:0/2838411637 learned_addr learned my addr 172.21.15.159:0/2838411637 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4190d9640 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4188d8640 1 -- 172.21.15.159:0/2838411637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 msgr2=0x55a4676e9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4188d8640 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 0x55a4676e9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4188d8640 1 -- 172.21.15.159:0/2838411637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 msgr2=0x55a4676e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4188d8640 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4188d8640 1 -- 172.21.15.159:0/2838411637 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4673b63c0 con 0x55a4676e0b40 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4190d9640 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd4188d8640 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e7000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd40801c040 tx=0x7fd40800f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ab1cef874597b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.437+0000 7fd3f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd3f3fff640 1 -- 172.21.15.159:0/2838411637 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408029060 con 0x55a4676e0b40 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd3f3fff640 1 -- 172.21.15.159:0/2838411637 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fd408004040 con 0x55a4676e0b40 2024-09-19T06:50:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd41cf15740 1 -- 172.21.15.159:0/2838411637 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd40800fb20 con 0x55a4676e0b40 2024-09-19T06:50:09.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd3f3fff640 1 -- 172.21.15.159:0/2838411637 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd40801e040 con 0x55a4676e0b40 2024-09-19T06:50:09.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd41cf15740 10 client.25478 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:09.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd41cf15740 1 -- 172.21.15.159:0/2838411637 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a4676f8af0 con 0x55a4676e0b40 2024-09-19T06:50:09.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd3f3fff640 1 -- 172.21.15.159:0/2838411637 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd40800fb20 con 0x55a4676e0b40 2024-09-19T06:50:09.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd3f3fff640 1 -- 172.21.15.159:0/2838411637 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd4080035f0 con 0x55a4676e0b40 2024-09-19T06:50:09.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd41cf15740 10 client.25478 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:09.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd41cf15740 10 client.25478 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:09.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd41cf15740 20 client.25478 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:09.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd41cf15740 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a4676f9ef0 0x55a4676fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd41cf15740 4 client.25478 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:09.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd41cf15740 1 -- 172.21.15.159:0/2838411637 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a467652860 con 0x55a4676f9ef0 2024-09-19T06:50:09.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.438+0000 7fd4190d9640 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a4676f9ef0 0x55a4676fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.439+0000 7fd3f3fff640 10 client.25478 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:09.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.439+0000 7fd4190d9640 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a4676f9ef0 0x55a4676fc2e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d81aeae1bdfcf97d server_cookie=61b29fa2a553f8ee in_seq=0 out_seq=0 2024-09-19T06:50:09.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.439+0000 7fd3f3fff640 1 -- 172.21.15.159:0/2838411637 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a467652860 con 0x55a4676f9ef0 2024-09-19T06:50:09.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.439+0000 7fd3f3fff640 10 client.25478 handle_command_reply: tid=0 2024-09-19T06:50:09.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.439+0000 7fd41cf15740 1 client.25478 shutdown 2024-09-19T06:50:09.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 -- 172.21.15.159:0/2838411637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 msgr2=0x55a4676e7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:09.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e7000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd40801c040 tx=0x7fd40800f8d0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 -- 172.21.15.159:0/2838411637 shutdown_connections 2024-09-19T06:50:09.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a4676f9ef0 0x55a4676fc2e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e7000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd3f3fff640 0 client.25478 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:09.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 --2- 172.21.15.159:0/2838411637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 0x55a4676e9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 -- 172.21.15.159:0/2838411637 >> 172.21.15.159:0/2838411637 conn(0x55a4676a8310 msgr2=0x55a4676e1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:09.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 -- 172.21.15.159:0/2838411637 shutdown_connections 2024-09-19T06:50:09.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 1 -- 172.21.15.159:0/2838411637 wait complete. 2024-09-19T06:50:09.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.440+0000 7fd41cf15740 20 client.25478 trim_cache size 0 max 16384 2024-09-19T06:50:09.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.454+0000 7fd41cf15740 1 Processor -- start 2024-09-19T06:50:09.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.454+0000 7fd41cf15740 1 -- start start 2024-09-19T06:50:09.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676df5d0 0x55a4676e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676e2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676ea370 0x55a4676e2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd41cf15740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141ab9c0 con 0x55a4676df5d0 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd41cf15740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141ae240 con 0x55a4676ea370 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd41cf15740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141ac030 con 0x55a4676e0b40 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4190d9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676df5d0 0x55a4676e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4190d9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676df5d0 0x55a4676e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34436/0 (socket says 172.21.15.159:34436) 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4188d8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4190d9640 1 -- 172.21.15.159:0/350977992 learned_addr learned my addr 172.21.15.159:0/350977992 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4190d9640 1 --2- 172.21.15.159:0/350977992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676ea370 0x55a4676e2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4188d8640 1 -- 172.21.15.159:0/350977992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676ea370 msgr2=0x55a4676e2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4188d8640 1 --2- 172.21.15.159:0/350977992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676ea370 0x55a4676e2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4188d8640 1 -- 172.21.15.159:0/350977992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676df5d0 msgr2=0x55a4676e8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4188d8640 1 --2- 172.21.15.159:0/350977992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676df5d0 0x55a4676e8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4188d8640 1 -- 172.21.15.159:0/350977992 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4676dc950 con 0x55a4676e0b40 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4190d9640 1 --2- 172.21.15.159:0/350977992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676ea370 0x55a4676e2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.455+0000 7fd4188d8640 1 --2- 172.21.15.159:0/350977992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676e2120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd408003a40 tx=0x7fd4080059b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68db9dc8313aa79d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd3fe7fc640 1 -- 172.21.15.159:0/350977992 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408029070 con 0x55a4676e0b40 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd3fe7fc640 1 -- 172.21.15.159:0/350977992 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd408015030 con 0x55a4676e0b40 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd3fe7fc640 1 -- 172.21.15.159:0/350977992 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408005020 con 0x55a4676e0b40 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd41cf15740 1 -- 172.21.15.159:0/350977992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 msgr2=0x55a4676e2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd41cf15740 1 --2- 172.21.15.159:0/350977992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676e2120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd408003a40 tx=0x7fd4080059b0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd41cf15740 1 -- 172.21.15.159:0/350977992 shutdown_connections 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd41cf15740 1 --2- 172.21.15.159:0/350977992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676ea370 0x55a4676e2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd41cf15740 1 --2- 172.21.15.159:0/350977992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676e0b40 0x55a4676e2120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd41cf15740 1 --2- 172.21.15.159:0/350977992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676df5d0 0x55a4676e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd41cf15740 1 -- 172.21.15.159:0/350977992 >> 172.21.15.159:0/350977992 conn(0x55a4676a8310 msgr2=0x55a4676e8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd41cf15740 1 -- 172.21.15.159:0/350977992 shutdown_connections 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.456+0000 7fd41cf15740 1 -- 172.21.15.159:0/350977992 wait complete. 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.457+0000 7fd41cf15740 1 -- start start 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.457+0000 7fd41cf15740 1 Processor -- start 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.457+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 0x55a4676f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.457+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.457+0000 7fd41cf15740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.457+0000 7fd41cf15740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141ac700 con 0x55a4676ea370 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.457+0000 7fd41cf15740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141adb70 con 0x55a4676e0b40 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.457+0000 7fd41cf15740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141acdd0 con 0x55a4676df5d0 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.457+0000 7fd41cf15740 10 client.0 _ll_register_callbacks cb 0x7fd40801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:09.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4188d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4190d9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4188d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:34902/0 (socket says 172.21.15.159:34902) 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4188d8640 1 -- 172.21.15.159:0/466680736 learned_addr learned my addr 172.21.15.159:0/466680736 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4190d9640 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 0x55a4676f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4188d8640 1 -- 172.21.15.159:0/466680736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 msgr2=0x55a4676f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4188d8640 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 0x55a4676f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4188d8640 1 -- 172.21.15.159:0/466680736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 msgr2=0x55a4676e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4188d8640 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4188d8640 1 -- 172.21.15.159:0/466680736 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4676e44b0 con 0x55a4676e0b40 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4190d9640 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:09.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd4188d8640 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e3a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55a4676d7730 tx=0x7fd408009d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfa65f36c8d420cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd3f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd3f3fff640 1 -- 172.21.15.159:0/466680736 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40803b060 con 0x55a4676e0b40 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd41cf15740 1 -- 172.21.15.159:0/466680736 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd408015030 con 0x55a4676e0b40 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd3f3fff640 1 -- 172.21.15.159:0/466680736 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fd4080050d0 con 0x55a4676e0b40 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.458+0000 7fd3f3fff640 1 -- 172.21.15.159:0/466680736 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd408029070 con 0x55a4676e0b40 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd41cf15740 10 client.25481 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd41cf15740 1 -- 172.21.15.159:0/466680736 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a467764630 con 0x55a4676e0b40 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd3f3fff640 1 -- 172.21.15.159:0/466680736 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd408015030 con 0x55a4676e0b40 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd3f3fff640 1 -- 172.21.15.159:0/466680736 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd408036470 con 0x55a4676e0b40 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd41cf15740 10 client.25481 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd41cf15740 10 client.25481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:09.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd41cf15740 20 client.25481 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd41cf15740 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a467764cf0 0x55a467767110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd41cf15740 4 client.25481 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd41cf15740 1 -- 172.21.15.159:0/466680736 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a46764cd70 con 0x55a467764cf0 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.459+0000 7fd4190d9640 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a467764cf0 0x55a467767110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd4190d9640 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a467764cf0 0x55a467767110 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba39e369741ecd8 server_cookie=1c7157e638bebaf5 in_seq=0 out_seq=0 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd3f3fff640 10 client.25481 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd3f3fff640 1 -- 172.21.15.159:0/466680736 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a46764cd70 con 0x55a467764cf0 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd3f3fff640 10 client.25481 handle_command_reply: tid=0 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 client.25481 shutdown 2024-09-19T06:50:09.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 -- 172.21.15.159:0/466680736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 msgr2=0x55a4676e3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:09.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e3a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55a4676d7730 tx=0x7fd408009d40 comp rx=0 tx=0).stop 2024-09-19T06:50:09.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 -- 172.21.15.159:0/466680736 shutdown_connections 2024-09-19T06:50:09.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a467764cf0 0x55a467767110 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a4676ea370 0x55a4676e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4676e0b40 0x55a4676e3a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd3f3fff640 0 client.25481 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:09.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 --2- 172.21.15.159:0/466680736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4676df5d0 0x55a4676f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 -- 172.21.15.159:0/466680736 >> 172.21.15.159:0/466680736 conn(0x55a4676a8310 msgr2=0x55a4676dad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:09.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 -- 172.21.15.159:0/466680736 shutdown_connections 2024-09-19T06:50:09.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 1 -- 172.21.15.159:0/466680736 wait complete. 2024-09-19T06:50:09.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.460+0000 7fd41cf15740 20 client.25481 trim_cache size 0 max 16384 2024-09-19T06:50:09.473 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:50:09.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 -- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd4040a33b0 msgr2=0x7fd4040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:09.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd4040a33b0 0x7fd4040a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4000c4ac0 tx=0x7fd4000b7fb0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 -- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 msgr2=0x7fd414198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:09.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 0x7fd414198af0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd400005940 tx=0x7fd4000040c0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 -- 172.21.15.159:0/110675427 shutdown_connections 2024-09-19T06:50:09.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd4040a33b0 0x7fd4040a5870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd414108290 0x7fd41419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd414103740 0x7fd414198af0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 --2- 172.21.15.159:0/110675427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd414102d90 0x7fd4141985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:09.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 -- 172.21.15.159:0/110675427 >> 172.21.15.159:0/110675427 conn(0x7fd4140fc7d0 msgr2=0x7fd414105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:09.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 -- 172.21.15.159:0/110675427 shutdown_connections 2024-09-19T06:50:09.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:09.461+0000 7fd41ab3c640 1 -- 172.21.15.159:0/110675427 wait complete. 2024-09-19T06:50:11.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:10 smithi203 ceph-mon[35473]: pgmap v100: 97 pgs: 97 active+clean; 43 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 678 op/s 2024-09-19T06:50:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:10 smithi189 ceph-mon[34880]: pgmap v100: 97 pgs: 97 active+clean; 43 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 678 op/s 2024-09-19T06:50:11.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:10 smithi159 ceph-mon[30935]: pgmap v100: 97 pgs: 97 active+clean; 43 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 678 op/s 2024-09-19T06:50:11.331 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:50:11.331 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:50:11.607 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:11.922 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:50:12.039 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:50:12.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:50:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 -- 172.21.15.159:0/3216325457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c102570 msgr2=0x7f1f5c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 --2- 172.21.15.159:0/3216325457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c102570 0x7f1f5c1029b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009900 tx=0x7f1f5002a480 comp rx=0 tx=0).stop 2024-09-19T06:50:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 -- 172.21.15.159:0/3216325457 shutdown_connections 2024-09-19T06:50:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 --2- 172.21.15.159:0/3216325457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c102ef0 0x7f1f5c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 --2- 172.21.15.159:0/3216325457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c102570 0x7f1f5c1029b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 --2- 172.21.15.159:0/3216325457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f5c100e20 0x7f1f5c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 -- 172.21.15.159:0/3216325457 >> 172.21.15.159:0/3216325457 conn(0x7f1f5c0fc7d0 msgr2=0x7f1f5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 -- 172.21.15.159:0/3216325457 shutdown_connections 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 -- 172.21.15.159:0/3216325457 wait complete. 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 Processor -- start 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.152+0000 7f1f63f51640 1 -- start start 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f63f51640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c100e20 0x7f1f5c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f63f51640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f5c102570 0x7f1f5c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f63f51640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c102ef0 0x7f1f5c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f63f51640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c110f80 con 0x7f1f5c100e20 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f63f51640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c110e00 con 0x7f1f5c102ef0 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f63f51640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c111100 con 0x7f1f5c102570 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f61ced640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c100e20 0x7f1f5c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f61ced640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c100e20 0x7f1f5c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34464/0 (socket says 172.21.15.159:34464) 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f61ced640 1 -- 172.21.15.159:0/2905146175 learned_addr learned my addr 172.21.15.159:0/2905146175 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f624ee640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c102ef0 0x7f1f5c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f614ec640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f5c102570 0x7f1f5c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f61ced640 1 -- 172.21.15.159:0/2905146175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f5c102570 msgr2=0x7f1f5c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f61ced640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f5c102570 0x7f1f5c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f61ced640 1 -- 172.21.15.159:0/2905146175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c102ef0 msgr2=0x7f1f5c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f61ced640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c102ef0 0x7f1f5c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f61ced640 1 -- 172.21.15.159:0/2905146175 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c1a6a30 con 0x7f1f5c100e20 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f61ced640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c100e20 0x7f1f5c0fcc80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e9f0 tx=0x7f1f5400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f5affd640 1 -- 172.21.15.159:0/2905146175 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5400cd80 con 0x7f1f5c100e20 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f5affd640 1 -- 172.21.15.159:0/2905146175 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f54005500 con 0x7f1f5c100e20 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.153+0000 7f1f63f51640 1 -- 172.21.15.159:0/2905146175 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c1a6d20 con 0x7f1f5c100e20 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.154+0000 7f1f5affd640 1 -- 172.21.15.159:0/2905146175 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54010690 con 0x7f1f5c100e20 2024-09-19T06:50:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.154+0000 7f1f63f51640 1 -- 172.21.15.159:0/2905146175 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c1a71d0 con 0x7f1f5c100e20 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.156+0000 7f1f5affd640 1 -- 172.21.15.159:0/2905146175 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1f540046c0 con 0x7f1f5c100e20 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.156+0000 7f1f6632a740 1 Processor -- start 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f6632a740 1 -- start start 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f5affd640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1f440a3430 0x7f1f440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e40fb60 0x55b79e40ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e41a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f624ee640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1f440a3430 0x7f1f440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f6632a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b79e375280 con 0x55b79e41ad40 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f6632a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b79e31cb10 con 0x55b79e40fb60 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f6632a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b79e371240 con 0x55b79e410480 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f5affd640 1 -- 172.21.15.159:0/2905146175 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1f540d00d0 con 0x7f1f5c100e20 2024-09-19T06:50:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f61ced640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e40fb60 0x55b79e40ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f61ced640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e40fb60 0x55b79e40ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:34936/0 (socket says 172.21.15.159:34936) 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f61ced640 1 -- 172.21.15.159:0/684146388 learned_addr learned my addr 172.21.15.159:0/684146388 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f624ee640 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f614ec640 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e41a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f61ced640 1 -- 172.21.15.159:0/684146388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 msgr2=0x55b79e41a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f61ced640 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e41a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f61ced640 1 -- 172.21.15.159:0/684146388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 msgr2=0x55b79e41d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f61ced640 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f61ced640 1 -- 172.21.15.159:0/684146388 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b79e3291f0 con 0x55b79e40fb60 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.157+0000 7f1f614ec640 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e41a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.158+0000 7f1f624ee640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1f440a3430 0x7f1f440a58f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c005fd0 tx=0x7f1f4c013ae0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.158+0000 7f1f61ced640 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e40fb60 0x55b79e40ff40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1f540a4ac0 tx=0x7f1f5409bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49eb307eb7f9ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.158+0000 7f1f43fff640 1 -- 172.21.15.159:0/684146388 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5409ca80 con 0x55b79e40fb60 2024-09-19T06:50:12.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.158+0000 7f1f43fff640 1 -- 172.21.15.159:0/684146388 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f5409c380 con 0x55b79e40fb60 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.158+0000 7f1f43fff640 1 -- 172.21.15.159:0/684146388 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54080000 con 0x55b79e40fb60 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 -- 172.21.15.159:0/684146388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e40fb60 msgr2=0x55b79e40ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e40fb60 0x55b79e40ff40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1f540a4ac0 tx=0x7f1f5409bf80 comp rx=0 tx=0).stop 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 -- 172.21.15.159:0/684146388 shutdown_connections 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e41a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 --2- 172.21.15.159:0/684146388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e40fb60 0x55b79e40ff40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 -- 172.21.15.159:0/684146388 >> 172.21.15.159:0/684146388 conn(0x55b79e40c0f0 msgr2=0x55b79e40c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 -- 172.21.15.159:0/684146388 shutdown_connections 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 -- 172.21.15.159:0/684146388 wait complete. 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 -- start start 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.159+0000 7f1f6632a740 1 Processor -- start 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 0x55b79e417c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e410480 0x55b79e418160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 0x55b79e4186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f6632a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b79e41d910 con 0x55b79e410480 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f6632a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b79e32ff10 con 0x55b79e41ad40 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f6632a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b79e41da90 con 0x55b79e40fb60 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f6632a740 10 client.0 _ll_register_callbacks cb 0x55b79e2f8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f614ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e410480 0x55b79e418160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f614ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e410480 0x55b79e418160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34480/0 (socket says 172.21.15.159:34480) 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f614ec640 1 -- 172.21.15.159:0/2265035982 learned_addr learned my addr 172.21.15.159:0/2265035982 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f624ee640 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 0x55b79e4186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f61ced640 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 0x55b79e417c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f624ee640 1 -- 172.21.15.159:0/2265035982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 msgr2=0x55b79e417c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f624ee640 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 0x55b79e417c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f624ee640 1 -- 172.21.15.159:0/2265035982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e410480 msgr2=0x55b79e418160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f624ee640 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e410480 0x55b79e418160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f624ee640 1 -- 172.21.15.159:0/2265035982 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b79e0e66a0 con 0x55b79e41ad40 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f614ec640 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e410480 0x55b79e418160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f624ee640 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 0x55b79e4186a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00f3c0 tx=0x7f1f4c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4e14e8f9480342 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.160+0000 7f1f417fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f417fa640 1 -- 172.21.15.159:0/2265035982 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c024020 con 0x55b79e41ad40 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f417fa640 1 -- 172.21.15.159:0/2265035982 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1f4c004250 con 0x55b79e41ad40 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f6632a740 1 -- 172.21.15.159:0/2265035982 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f5409c380 con 0x55b79e41ad40 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f417fa640 1 -- 172.21.15.159:0/2265035982 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1f4c02f050 con 0x55b79e41ad40 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f6632a740 10 client.25493 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f6632a740 1 -- 172.21.15.159:0/2265035982 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b79e429560 con 0x55b79e41ad40 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f417fa640 1 -- 172.21.15.159:0/2265035982 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f5409c380 con 0x55b79e41ad40 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f417fa640 1 -- 172.21.15.159:0/2265035982 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f1f4c010c90 con 0x55b79e41ad40 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f6632a740 10 client.25493 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f6632a740 10 client.25493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f6632a740 20 client.25493 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f6632a740 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b79e42aa70 0x55b79e42cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f6632a740 4 client.25493 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.161+0000 7f1f6632a740 1 -- 172.21.15.159:0/2265035982 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b79e3827f0 con 0x55b79e42aa70 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.162+0000 7f1f61ced640 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b79e42aa70 0x55b79e42cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.162+0000 7f1f417fa640 10 client.25493 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.162+0000 7f1f61ced640 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b79e42aa70 0x55b79e42cef0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a487cb2d0c411c4 server_cookie=8ec1892bcd2588b2 in_seq=0 out_seq=0 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f417fa640 1 -- 172.21.15.159:0/2265035982 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b79e3827f0 con 0x55b79e42aa70 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f417fa640 10 client.25493 handle_command_reply: tid=0 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 client.25493 shutdown 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 -- 172.21.15.159:0/2265035982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 msgr2=0x55b79e4186a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 0x55b79e4186a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00f3c0 tx=0x7f1f4c004ab0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 -- 172.21.15.159:0/2265035982 shutdown_connections 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b79e42aa70 0x55b79e42cef0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 0x55b79e4186a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e410480 0x55b79e418160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 --2- 172.21.15.159:0/2265035982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 0x55b79e417c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f417fa640 0 client.25493 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 -- 172.21.15.159:0/2265035982 >> 172.21.15.159:0/2265035982 conn(0x55b79e40c0f0 msgr2=0x55b79e411e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 -- 172.21.15.159:0/2265035982 shutdown_connections 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 1 -- 172.21.15.159:0/2265035982 wait complete. 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.163+0000 7f1f6632a740 20 client.25493 trim_cache size 0 max 16384 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.181+0000 7f1f6632a740 1 Processor -- start 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.181+0000 7f1f6632a740 1 -- start start 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e40fb60 0x55b79e4125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e4327c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 0x55b79e432d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f6632a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1adaf0 con 0x55b79e40fb60 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f6632a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b0370 con 0x55b79e41ad40 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f6632a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1ae160 con 0x55b79e410480 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f61ced640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e40fb60 0x55b79e4125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f61ced640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e40fb60 0x55b79e4125c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34490/0 (socket says 172.21.15.159:34490) 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f61ced640 1 -- 172.21.15.159:0/1349422136 learned_addr learned my addr 172.21.15.159:0/1349422136 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f614ec640 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e4327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f624ee640 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 0x55b79e432d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f614ec640 1 -- 172.21.15.159:0/1349422136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 msgr2=0x55b79e432d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f614ec640 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 0x55b79e432d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f614ec640 1 -- 172.21.15.159:0/1349422136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e40fb60 msgr2=0x55b79e4125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f614ec640 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e40fb60 0x55b79e4125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f614ec640 1 -- 172.21.15.159:0/1349422136 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b79e40bf20 con 0x55b79e410480 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f61ced640 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e40fb60 0x55b79e4125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.182+0000 7f1f614ec640 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e4327c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f50000c00 tx=0x7f1f50005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87cb93266d279377 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f437fe640 1 -- 172.21.15.159:0/1349422136 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50035040 con 0x55b79e410480 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f437fe640 1 -- 172.21.15.159:0/1349422136 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f50004400 con 0x55b79e410480 2024-09-19T06:50:12.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f437fe640 1 -- 172.21.15.159:0/1349422136 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f500035f0 con 0x55b79e410480 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f6632a740 1 -- 172.21.15.159:0/1349422136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 msgr2=0x55b79e4327c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f6632a740 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e4327c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f50000c00 tx=0x7f1f50005e00 comp rx=0 tx=0).stop 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f6632a740 1 -- 172.21.15.159:0/1349422136 shutdown_connections 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f6632a740 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e41ad40 0x55b79e432d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f6632a740 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e410480 0x55b79e4327c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f6632a740 1 --2- 172.21.15.159:0/1349422136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e40fb60 0x55b79e4125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f6632a740 1 -- 172.21.15.159:0/1349422136 >> 172.21.15.159:0/1349422136 conn(0x55b79e40c0f0 msgr2=0x55b79e416d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.183+0000 7f1f6632a740 1 -- 172.21.15.159:0/1349422136 shutdown_connections 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.184+0000 7f1f6632a740 1 -- 172.21.15.159:0/1349422136 wait complete. 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.184+0000 7f1f6632a740 1 -- start start 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.184+0000 7f1f6632a740 1 Processor -- start 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.184+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 0x55b79e423150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e410480 0x55b79e41e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f6632a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f6632a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1ae830 con 0x55b79e41ad40 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f6632a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1afca0 con 0x55b79e410480 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f6632a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1aef00 con 0x55b79e40fb60 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f6632a740 10 client.0 _ll_register_callbacks cb 0x7f1f4c012070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f624ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f61ced640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 0x55b79e423150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f614ec640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e410480 0x55b79e41e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f624ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34504/0 (socket says 172.21.15.159:34504) 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f624ee640 1 -- 172.21.15.159:0/3079521675 learned_addr learned my addr 172.21.15.159:0/3079521675 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f614ec640 1 -- 172.21.15.159:0/3079521675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 msgr2=0x55b79e423150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f614ec640 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 0x55b79e423150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f614ec640 1 -- 172.21.15.159:0/3079521675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 msgr2=0x55b79e41e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f614ec640 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f614ec640 1 -- 172.21.15.159:0/3079521675 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b79e41ef00 con 0x55b79e410480 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f624ee640 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f61ced640 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 0x55b79e423150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f614ec640 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e410480 0x55b79e41e480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55b79e407c90 tx=0x7f1f50004a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b148aa456e3a513 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f417fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f417fa640 1 -- 172.21.15.159:0/3079521675 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50051060 con 0x55b79e410480 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f6632a740 1 -- 172.21.15.159:0/3079521675 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f50004400 con 0x55b79e410480 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.185+0000 7f1f417fa640 1 -- 172.21.15.159:0/3079521675 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1f50004200 con 0x55b79e410480 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f417fa640 1 -- 172.21.15.159:0/3079521675 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1f50035040 con 0x55b79e410480 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f6632a740 10 client.25499 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f6632a740 1 -- 172.21.15.159:0/3079521675 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b79e4954e0 con 0x55b79e410480 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f417fa640 1 -- 172.21.15.159:0/3079521675 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f50004400 con 0x55b79e410480 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f417fa640 1 -- 172.21.15.159:0/3079521675 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f1f50043070 con 0x55b79e410480 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f6632a740 10 client.25499 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f6632a740 10 client.25499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f6632a740 20 client.25499 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f6632a740 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b79e495c40 0x55b79e498060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f6632a740 4 client.25499 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.186+0000 7f1f6632a740 1 -- 172.21.15.159:0/3079521675 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b79e37cd00 con 0x55b79e495c40 2024-09-19T06:50:12.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.187+0000 7f1f61ced640 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b79e495c40 0x55b79e498060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.187+0000 7f1f417fa640 10 client.25499 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:12.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.187+0000 7f1f61ced640 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b79e495c40 0x55b79e498060 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bc1173814b3606d server_cookie=37e6240aecfad61 in_seq=0 out_seq=0 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.188+0000 7f1f417fa640 1 -- 172.21.15.159:0/3079521675 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b79e37cd00 con 0x55b79e495c40 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.188+0000 7f1f417fa640 10 client.25499 handle_command_reply: tid=0 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.188+0000 7f1f6632a740 1 client.25499 shutdown 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.188+0000 7f1f6632a740 1 -- 172.21.15.159:0/3079521675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e410480 msgr2=0x55b79e41e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.188+0000 7f1f6632a740 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e410480 0x55b79e41e480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55b79e407c90 tx=0x7f1f50004a00 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f6632a740 1 -- 172.21.15.159:0/3079521675 shutdown_connections 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f6632a740 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b79e495c40 0x55b79e498060 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f6632a740 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b79e41ad40 0x55b79e41e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f6632a740 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b79e410480 0x55b79e41e480 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f417fa640 0 client.25499 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f6632a740 1 --2- 172.21.15.159:0/3079521675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b79e40fb60 0x55b79e423150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f6632a740 1 -- 172.21.15.159:0/3079521675 >> 172.21.15.159:0/3079521675 conn(0x55b79e40c0f0 msgr2=0x55b79e40aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f6632a740 1 -- 172.21.15.159:0/3079521675 shutdown_connections 2024-09-19T06:50:12.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f6632a740 1 -- 172.21.15.159:0/3079521675 wait complete. 2024-09-19T06:50:12.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f6632a740 20 client.25499 trim_cache size 0 max 16384 2024-09-19T06:50:12.194 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:50:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:50:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "5388605e-e8bc-49da-9b3b-3bc8b53c64c4", 2024-09-19T06:50:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:50:12.194 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f63f51640 1 -- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1f440a3430 msgr2=0x7f1f440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f63f51640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1f440a3430 0x7f1f440a58f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c005fd0 tx=0x7f1f4c013ae0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f63f51640 1 -- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c100e20 msgr2=0x7f1f5c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.189+0000 7f1f63f51640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c100e20 0x7f1f5c0fcc80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e9f0 tx=0x7f1f5400edf0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.190+0000 7f1f63f51640 1 -- 172.21.15.159:0/2905146175 shutdown_connections 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.190+0000 7f1f63f51640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1f440a3430 0x7f1f440a58f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.190+0000 7f1f63f51640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f5c102ef0 0x7f1f5c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.190+0000 7f1f63f51640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f5c102570 0x7f1f5c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.190+0000 7f1f63f51640 1 --2- 172.21.15.159:0/2905146175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f5c100e20 0x7f1f5c0fcc80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.190+0000 7f1f63f51640 1 -- 172.21.15.159:0/2905146175 >> 172.21.15.159:0/2905146175 conn(0x7f1f5c0fc7d0 msgr2=0x7f1f5c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.190+0000 7f1f63f51640 1 -- 172.21.15.159:0/2905146175 shutdown_connections 2024-09-19T06:50:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:12.190+0000 7f1f63f51640 1 -- 172.21.15.159:0/2905146175 wait complete. 2024-09-19T06:50:12.209 INFO:tasks.workunit.client.0.smithi159.stdout:30000 trunc from 0x7bb2f to 0xcdf83 2024-09-19T06:50:12.694 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xffcdd 2024-09-19T06:50:12.971 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:12 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:50:13.028 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:12 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:50:13.028 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:12 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:50:13.028 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:12 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:50:13.028 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:12 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:13.028 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:12 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:50:13.028 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:12 smithi159 ceph-mon[30935]: pgmap v101: 97 pgs: 97 active+clean; 38 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.2 MiB/s wr, 955 op/s 2024-09-19T06:50:13.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:12 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:50:13.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:12 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:50:13.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:12 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:50:13.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:12 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:50:13.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:12 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:13.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:12 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:50:13.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:12 smithi203 ceph-mon[35473]: pgmap v101: 97 pgs: 97 active+clean; 38 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.2 MiB/s wr, 955 op/s 2024-09-19T06:50:13.030 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:50:13.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:12 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:50:13.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:12 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:50:13.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:12 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:50:13.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:12 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:50:13.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:12 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:13.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:12 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:50:13.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:12 smithi189 ceph-mon[34880]: pgmap v101: 97 pgs: 97 active+clean; 38 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.2 MiB/s wr, 955 op/s 2024-09-19T06:50:13.290 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:13.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.812+0000 7f5a25994640 1 -- 172.21.15.159:0/1319354866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20102d90 msgr2=0x7f5a20103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:13.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.812+0000 7f5a25994640 1 --2- 172.21.15.159:0/1319354866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20102d90 0x7f5a20103170 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009930 tx=0x7f5a1002a420 comp rx=0 tx=0).stop 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.812+0000 7f5a25994640 1 -- 172.21.15.159:0/1319354866 shutdown_connections 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.812+0000 7f5a25994640 1 --2- 172.21.15.159:0/1319354866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a20108290 0x7f5a2010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.812+0000 7f5a25994640 1 --2- 172.21.15.159:0/1319354866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a20103740 0x7f5a20107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.812+0000 7f5a25994640 1 --2- 172.21.15.159:0/1319354866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20102d90 0x7f5a20103170 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.812+0000 7f5a25994640 1 -- 172.21.15.159:0/1319354866 >> 172.21.15.159:0/1319354866 conn(0x7f5a200fc7d0 msgr2=0x7f5a200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.812+0000 7f5a25994640 1 -- 172.21.15.159:0/1319354866 shutdown_connections 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.812+0000 7f5a25994640 1 -- 172.21.15.159:0/1319354866 wait complete. 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.813+0000 7f5a25994640 1 Processor -- start 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.813+0000 7f5a25994640 1 -- start start 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.813+0000 7f5a25994640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a20102d90 0x7f5a201009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.813+0000 7f5a25994640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a20103740 0x7f5a20100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.813+0000 7f5a25994640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20108290 0x7f5a20101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.813+0000 7f5a25994640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5a20112090 con 0x7f5a20108290 2024-09-19T06:50:13.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.813+0000 7f5a25994640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a20111f10 con 0x7f5a20102d90 2024-09-19T06:50:13.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.813+0000 7f5a25994640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5a20112210 con 0x7f5a20103740 2024-09-19T06:50:13.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20108290 0x7f5a20101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a20102d90 0x7f5a201009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20108290 0x7f5a20101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34534/0 (socket says 172.21.15.159:34534) 2024-09-19T06:50:13.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a20102d90 0x7f5a201009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:34980/0 (socket says 172.21.15.159:34980) 2024-09-19T06:50:13.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1f7fe640 1 -- 172.21.15.159:0/219696702 learned_addr learned my addr 172.21.15.159:0/219696702 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:13.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1e7fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a20103740 0x7f5a20100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1f7fe640 1 -- 172.21.15.159:0/219696702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a20103740 msgr2=0x7f5a20100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:13.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a20103740 0x7f5a20100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1f7fe640 1 -- 172.21.15.159:0/219696702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a20102d90 msgr2=0x7f5a201009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:13.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a20102d90 0x7f5a201009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1f7fe640 1 -- 172.21.15.159:0/219696702 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a201a6a60 con 0x7f5a20108290 2024-09-19T06:50:13.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1effd640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a20102d90 0x7f5a201009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20108290 0x7f5a20101470 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800eb10 tx=0x7f5a1800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a24992640 1 -- 172.21.15.159:0/219696702 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18004b20 con 0x7f5a20108290 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a25994640 1 -- 172.21.15.159:0/219696702 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a201a6d50 con 0x7f5a20108290 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a24992640 1 -- 172.21.15.159:0/219696702 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a18004cc0 con 0x7f5a20108290 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a24992640 1 -- 172.21.15.159:0/219696702 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18010760 con 0x7f5a20108290 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.814+0000 7f5a25994640 1 -- 172.21.15.159:0/219696702 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a201a7240 con 0x7f5a20108290 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.816+0000 7f5a24992640 1 -- 172.21.15.159:0/219696702 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5a18005020 con 0x7f5a20108290 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a27d6d740 1 Processor -- start 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a27d6d740 1 -- start start 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a24992640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a080a33b0 0x7f5a080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edecc4a0 0x55d7edecc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edeccdc0 0x55d7eded7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7eded9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d7ede322e0 con 0x55d7edecc4a0 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d7eddd9ce0 con 0x55d7edeccdc0 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d7ede2e2a0 con 0x55d7eded7680 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a1e7fc640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a080a33b0 0x7f5a080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a24992640 1 -- 172.21.15.159:0/219696702 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f5a180d0240 con 0x7f5a20108290 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edecc4a0 0x55d7edecc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edecc4a0 0x55d7edecc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34544/0 (socket says 172.21.15.159:34544) 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a1effd640 1 -- 172.21.15.159:0/133845477 learned_addr learned my addr 172.21.15.159:0/133845477 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a1e7fc640 1 --2- 172.21.15.159:0/133845477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edeccdc0 0x55d7eded7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.817+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/133845477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7eded9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a1effd640 1 -- 172.21.15.159:0/133845477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 msgr2=0x55d7eded9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a1effd640 1 --2- 172.21.15.159:0/133845477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7eded9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a1effd640 1 -- 172.21.15.159:0/133845477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edeccdc0 msgr2=0x55d7eded7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a1effd640 1 --2- 172.21.15.159:0/133845477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edeccdc0 0x55d7eded7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a1effd640 1 -- 172.21.15.159:0/133845477 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7eddbe440 con 0x55d7edecc4a0 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a1e7fc640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a080a33b0 0x7f5a080a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009710 tx=0x7f5a14013880 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a1effd640 1 --2- 172.21.15.159:0/133845477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edecc4a0 0x55d7edecc880 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5a10000c00 tx=0x7f5a10005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188d55476b7e981 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a05ffb640 1 -- 172.21.15.159:0/133845477 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a10035040 con 0x55d7edecc4a0 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a05ffb640 1 -- 172.21.15.159:0/133845477 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a10031830 con 0x55d7edecc4a0 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.818+0000 7f5a05ffb640 1 -- 172.21.15.159:0/133845477 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a10003d20 con 0x55d7edecc4a0 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 -- 172.21.15.159:0/133845477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edecc4a0 msgr2=0x55d7edecc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/133845477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edecc4a0 0x55d7edecc880 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5a10000c00 tx=0x7f5a10005d50 comp rx=0 tx=0).stop 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 -- 172.21.15.159:0/133845477 shutdown_connections 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/133845477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7eded9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/133845477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edeccdc0 0x55d7eded7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/133845477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edecc4a0 0x55d7edecc880 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 -- 172.21.15.159:0/133845477 >> 172.21.15.159:0/133845477 conn(0x55d7edec8a30 msgr2=0x55d7edec8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 -- 172.21.15.159:0/133845477 shutdown_connections 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 -- 172.21.15.159:0/133845477 wait complete. 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 -- start start 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.819+0000 7f5a27d6d740 1 Processor -- start 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7eded6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7eded41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7eded4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d7ededa250 con 0x55d7edeccdc0 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d7edded050 con 0x55d7edecc4a0 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d7ededa3d0 con 0x55d7eded7680 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7eded6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7eded41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7eded6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:34998/0 (socket says 172.21.15.159:34998) 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1effd640 1 -- 172.21.15.159:0/37210720 learned_addr learned my addr 172.21.15.159:0/37210720 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7eded41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34546/0 (socket says 172.21.15.159:34546) 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a27d6d740 10 client.0 _ll_register_callbacks cb 0x55d7ede2d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7eded4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1effd640 1 -- 172.21.15.159:0/37210720 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 msgr2=0x55d7eded4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1effd640 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7eded4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1effd640 1 -- 172.21.15.159:0/37210720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 msgr2=0x55d7eded41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1effd640 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7eded41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1effd640 1 -- 172.21.15.159:0/37210720 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7edba33c0 con 0x55d7edecc4a0 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7eded4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f5a1effd640 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7eded6f30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009900 tx=0x7f5a10003880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6e1a2b2537d27e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.820+0000 7f59feffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f59feffd640 1 -- 172.21.15.159:0/37210720 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1004e020 con 0x55d7edecc4a0 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f59feffd640 1 -- 172.21.15.159:0/37210720 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f5a10005250 con 0x55d7edecc4a0 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a27d6d740 1 -- 172.21.15.159:0/37210720 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a10031830 con 0x55d7edecc4a0 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f59feffd640 1 -- 172.21.15.159:0/37210720 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5a10059050 con 0x55d7edecc4a0 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a27d6d740 10 client.25511 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a27d6d740 1 -- 172.21.15.159:0/37210720 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d7edee5b50 con 0x55d7edecc4a0 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f59feffd640 1 -- 172.21.15.159:0/37210720 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a10031830 con 0x55d7edecc4a0 2024-09-19T06:50:13.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f59feffd640 1 -- 172.21.15.159:0/37210720 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f5a10003c20 con 0x55d7edecc4a0 2024-09-19T06:50:13.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a27d6d740 10 client.25511 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:13.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a27d6d740 10 client.25511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:13.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a27d6d740 20 client.25511 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:13.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d7edee6ea0 0x55d7edee9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a27d6d740 4 client.25511 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:13.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a27d6d740 1 -- 172.21.15.159:0/37210720 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7ede3f850 con 0x55d7edee6ea0 2024-09-19T06:50:13.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.821+0000 7f5a1e7fc640 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d7edee6ea0 0x55d7edee9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.822+0000 7f59feffd640 10 client.25511 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:13.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.822+0000 7f5a1e7fc640 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d7edee6ea0 0x55d7edee9290 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=686545957fe3510b server_cookie=bf3fc22c68cdb7ba in_seq=0 out_seq=0 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f59feffd640 1 -- 172.21.15.159:0/37210720 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7ede3f850 con 0x55d7edee6ea0 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f59feffd640 10 client.25511 handle_command_reply: tid=0 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 client.25511 shutdown 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 -- 172.21.15.159:0/37210720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 msgr2=0x55d7eded6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7eded6f30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009900 tx=0x7f5a10003880 comp rx=0 tx=0).stop 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 -- 172.21.15.159:0/37210720 shutdown_connections 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d7edee6ea0 0x55d7edee9290 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7eded4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7eded41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/37210720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7eded6f30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f59feffd640 0 client.25511 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:13.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 -- 172.21.15.159:0/37210720 >> 172.21.15.159:0/37210720 conn(0x55d7edec8a30 msgr2=0x55d7edece760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:13.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 -- 172.21.15.159:0/37210720 shutdown_connections 2024-09-19T06:50:13.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 1 -- 172.21.15.159:0/37210720 wait complete. 2024-09-19T06:50:13.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.823+0000 7f5a27d6d740 20 client.25511 trim_cache size 0 max 16384 2024-09-19T06:50:13.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.841+0000 7f5a27d6d740 1 Processor -- start 2024-09-19T06:50:13.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.841+0000 7f5a27d6d740 1 -- start start 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7edee34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7edeccdc0 0x55d7edeee940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7eded7680 0x55d7edeeee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201adbb0 con 0x55d7eded7680 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201b0430 con 0x55d7edecc4a0 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201ae220 con 0x55d7edeccdc0 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7eded7680 0x55d7edeeee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7eded7680 0x55d7edeeee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34550/0 (socket says 172.21.15.159:34550) 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1f7fe640 1 -- 172.21.15.159:0/2510076349 learned_addr learned my addr 172.21.15.159:0/2510076349 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1e7fc640 1 --2- 172.21.15.159:0/2510076349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7edeccdc0 0x55d7edeee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1effd640 1 --2- 172.21.15.159:0/2510076349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7edee34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1f7fe640 1 -- 172.21.15.159:0/2510076349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7edeccdc0 msgr2=0x55d7edeee940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:13.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/2510076349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7edeccdc0 0x55d7edeee940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1f7fe640 1 -- 172.21.15.159:0/2510076349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 msgr2=0x55d7edee34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:13.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/2510076349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7edee34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1f7fe640 1 -- 172.21.15.159:0/2510076349 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7edec8860 con 0x55d7eded7680 2024-09-19T06:50:13.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/2510076349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7eded7680 0x55d7edeeee80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5a1809c1f0 tx=0x7f5a180057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd946d97c10880f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:13.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a057fa640 1 -- 172.21.15.159:0/2510076349 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1809be50 con 0x55d7eded7680 2024-09-19T06:50:13.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a057fa640 1 -- 172.21.15.159:0/2510076349 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a1809cbf0 con 0x55d7eded7680 2024-09-19T06:50:13.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.842+0000 7f5a057fa640 1 -- 172.21.15.159:0/2510076349 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a180b52a0 con 0x55d7eded7680 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.843+0000 7f5a27d6d740 1 -- 172.21.15.159:0/2510076349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7eded7680 msgr2=0x55d7edeeee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.843+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/2510076349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7eded7680 0x55d7edeeee80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5a1809c1f0 tx=0x7f5a180057d0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.843+0000 7f5a27d6d740 1 -- 172.21.15.159:0/2510076349 shutdown_connections 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.843+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/2510076349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7eded7680 0x55d7edeeee80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.843+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/2510076349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7edeccdc0 0x55d7edeee940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.843+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/2510076349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7edee34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.843+0000 7f5a27d6d740 1 -- 172.21.15.159:0/2510076349 >> 172.21.15.159:0/2510076349 conn(0x55d7edec8a30 msgr2=0x55d7edecf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 -- 172.21.15.159:0/2510076349 shutdown_connections 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 -- 172.21.15.159:0/2510076349 wait complete. 2024-09-19T06:50:13.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 -- start start 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 Processor -- start 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7ededb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7ededb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7ededbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201ae8f0 con 0x55d7edeccdc0 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201afd60 con 0x55d7edecc4a0 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201aefc0 con 0x55d7eded7680 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a27d6d740 10 client.0 _ll_register_callbacks cb 0x7f5a10040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7ededb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.844+0000 7f5a1e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7ededb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7ededb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34558/0 (socket says 172.21.15.159:34558) 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7ededb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:35022/0 (socket says 172.21.15.159:35022) 2024-09-19T06:50:13.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1e7fc640 1 -- 172.21.15.159:0/233257808 learned_addr learned my addr 172.21.15.159:0/233257808 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1f7fe640 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7ededbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1e7fc640 1 -- 172.21.15.159:0/233257808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 msgr2=0x55d7ededbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1e7fc640 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7ededbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1e7fc640 1 -- 172.21.15.159:0/233257808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 msgr2=0x55d7ededb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1e7fc640 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7ededb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1e7fc640 1 -- 172.21.15.159:0/233257808 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7edf509c0 con 0x55d7edeccdc0 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1effd640 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7ededb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a1e7fc640 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7ededb960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5a1401d000 tx=0x7f5a1401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e8577025ec06e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f59feffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:13.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f59feffd640 1 -- 172.21.15.159:0/233257808 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a140120d0 con 0x55d7edeccdc0 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a27d6d740 1 -- 172.21.15.159:0/233257808 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a1809cbf0 con 0x55d7edeccdc0 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f59feffd640 1 -- 172.21.15.159:0/233257808 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f5a14027040 con 0x55d7edeccdc0 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f59feffd640 1 -- 172.21.15.159:0/233257808 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5a14012270 con 0x55d7edeccdc0 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a27d6d740 10 client.16143 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.845+0000 7f5a27d6d740 1 -- 172.21.15.159:0/233257808 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d7edf51ce0 con 0x55d7edeccdc0 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f59feffd640 1 -- 172.21.15.159:0/233257808 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a1809cbf0 con 0x55d7edeccdc0 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f59feffd640 1 -- 172.21.15.159:0/233257808 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f5a1403b070 con 0x55d7edeccdc0 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f5a27d6d740 10 client.16143 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f5a27d6d740 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f5a27d6d740 20 client.16143 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d7edf52440 0x55d7edf54860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:13.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f5a27d6d740 4 client.16143 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f5a27d6d740 1 -- 172.21.15.159:0/233257808 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d7ede39d60 con 0x55d7edf52440 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f5a1effd640 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d7edf52440 0x55d7edf54860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f59feffd640 10 client.16143 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f5a1effd640 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d7edf52440 0x55d7edf54860 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ee6a171b348c4c6 server_cookie=c4b1f2256a5c47f1 in_seq=0 out_seq=0 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f59feffd640 1 -- 172.21.15.159:0/233257808 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d7ede39d60 con 0x55d7edf52440 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f59feffd640 10 client.16143 handle_command_reply: tid=0 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.846+0000 7f5a27d6d740 1 client.16143 shutdown 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 -- 172.21.15.159:0/233257808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 msgr2=0x55d7ededb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7ededb960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5a1401d000 tx=0x7f5a1401b000 comp rx=0 tx=0).stop 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 -- 172.21.15.159:0/233257808 shutdown_connections 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d7edf52440 0x55d7edf54860 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d7eded7680 0x55d7ededbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d7edeccdc0 0x55d7ededb960 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f59feffd640 0 client.16143 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 --2- 172.21.15.159:0/233257808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7edecc4a0 0x55d7ededb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 -- 172.21.15.159:0/233257808 >> 172.21.15.159:0/233257808 conn(0x55d7edec8a30 msgr2=0x55d7eded5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 -- 172.21.15.159:0/233257808 shutdown_connections 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 1 -- 172.21.15.159:0/233257808 wait complete. 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a27d6d740 20 client.16143 trim_cache size 0 max 16384 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:50:13.859 INFO:teuthology.orchestra.run.smithi159.stdout: "5388605e-e8bc-49da-9b3b-3bc8b53c64c4": { 2024-09-19T06:50:13.860 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:50:13.860 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "5388605e-e8bc-49da-9b3b-3bc8b53c64c4", 2024-09-19T06:50:13.860 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:50:13.860 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:13.860 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:13.860 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a25994640 1 -- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a080a33b0 msgr2=0x7f5a080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.847+0000 7f5a25994640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a080a33b0 0x7f5a080a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009710 tx=0x7f5a14013880 comp rx=0 tx=0).stop 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 -- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20108290 msgr2=0x7f5a20101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20108290 0x7f5a20101470 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800eb10 tx=0x7f5a1800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 -- 172.21.15.159:0/219696702 shutdown_connections 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5a080a33b0 0x7f5a080a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a20108290 0x7f5a20101470 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a20103740 0x7f5a20100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 --2- 172.21.15.159:0/219696702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a20102d90 0x7f5a201009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 -- 172.21.15.159:0/219696702 >> 172.21.15.159:0/219696702 conn(0x7f5a200fc7d0 msgr2=0x7f5a20105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 -- 172.21.15.159:0/219696702 shutdown_connections 2024-09-19T06:50:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:13.848+0000 7f5a25994640 1 -- 172.21.15.159:0/219696702 wait complete. 2024-09-19T06:50:14.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:13 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:14.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:13 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:14.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:13 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:14.410 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xffd97 2024-09-19T06:50:14.636 INFO:tasks.cephfs.filesystem:scrub status for tag:5388605e-e8bc-49da-9b3b-3bc8b53c64c4 - {'path': '/', 'tag': '5388605e-e8bc-49da-9b3b-3bc8b53c64c4', 'options': 'recursive,force'} 2024-09-19T06:50:14.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:14 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:50:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:14 smithi159 ceph-mon[30935]: pgmap v102: 97 pgs: 97 active+clean; 38 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 584 op/s 2024-09-19T06:50:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:14 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:50:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:14 smithi203 ceph-mon[35473]: pgmap v102: 97 pgs: 97 active+clean; 38 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 584 op/s 2024-09-19T06:50:15.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:14 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:50:15.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:14 smithi189 ceph-mon[34880]: pgmap v102: 97 pgs: 97 active+clean; 38 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 584 op/s 2024-09-19T06:50:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:16 smithi203 ceph-mon[35473]: pgmap v103: 97 pgs: 97 active+clean; 42 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.5 MiB/s wr, 1.20k op/s 2024-09-19T06:50:17.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:16 smithi189 ceph-mon[34880]: pgmap v103: 97 pgs: 97 active+clean; 42 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.5 MiB/s wr, 1.20k op/s 2024-09-19T06:50:17.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:16 smithi159 ceph-mon[30935]: pgmap v103: 97 pgs: 97 active+clean; 42 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.5 MiB/s wr, 1.20k op/s 2024-09-19T06:50:19.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:18 smithi203 ceph-mon[35473]: pgmap v104: 97 pgs: 97 active+clean; 42 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 895 op/s 2024-09-19T06:50:19.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:18 smithi189 ceph-mon[34880]: pgmap v104: 97 pgs: 97 active+clean; 42 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 895 op/s 2024-09-19T06:50:19.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:18 smithi159 ceph-mon[30935]: pgmap v104: 97 pgs: 97 active+clean; 42 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 895 op/s 2024-09-19T06:50:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.137+0000 7f343b34b640 1 -- 172.21.15.159:0/470396986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 msgr2=0x7f343410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.137+0000 7f343b34b640 1 --2- 172.21.15.159:0/470396986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 0x7f343410d8a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f342c009cd0 tx=0x7f342c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.137+0000 7f343b34b640 1 -- 172.21.15.159:0/470396986 shutdown_connections 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.137+0000 7f343b34b640 1 --2- 172.21.15.159:0/470396986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 0x7f343410d8a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.137+0000 7f343b34b640 1 --2- 172.21.15.159:0/470396986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34341009d0 0x7f3434100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.137+0000 7f343b34b640 1 --2- 172.21.15.159:0/470396986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34341069e0 0x7f3434106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.137+0000 7f343b34b640 1 -- 172.21.15.159:0/470396986 >> 172.21.15.159:0/470396986 conn(0x7f34340fc6b0 msgr2=0x7f34340fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 -- 172.21.15.159:0/470396986 shutdown_connections 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 -- 172.21.15.159:0/470396986 wait complete. 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 Processor -- start 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 -- start start 2024-09-19T06:50:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34341009d0 0x7f3434199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 0x7f34341996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34341069e0 0x7f34341a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3434110e20 con 0x7f3434101370 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3434110ca0 con 0x7f34341069e0 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f343b34b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3434110fa0 con 0x7f34341009d0 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f34388e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 0x7f34341996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f34388e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 0x7f34341996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40052/0 (socket says 172.21.15.159:40052) 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f34398e8640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34341069e0 0x7f34341a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f34388e6640 1 -- 172.21.15.159:0/1310070935 learned_addr learned my addr 172.21.15.159:0/1310070935 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.138+0000 7f34390e7640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34341009d0 0x7f3434199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f34388e6640 1 -- 172.21.15.159:0/1310070935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34341009d0 msgr2=0x7f3434199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f34388e6640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34341009d0 0x7f3434199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f34388e6640 1 -- 172.21.15.159:0/1310070935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34341069e0 msgr2=0x7f34341a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f34388e6640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34341069e0 0x7f34341a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f34388e6640 1 -- 172.21.15.159:0/1310070935 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34341a4750 con 0x7f3434101370 2024-09-19T06:50:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f34388e6640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 0x7f34341996d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f342400e9f0 tx=0x7f342400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f342a7fc640 1 -- 172.21.15.159:0/1310070935 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342400cd80 con 0x7f3434101370 2024-09-19T06:50:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f342a7fc640 1 -- 172.21.15.159:0/1310070935 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3424005500 con 0x7f3434101370 2024-09-19T06:50:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f343b34b640 1 -- 172.21.15.159:0/1310070935 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34341a4920 con 0x7f3434101370 2024-09-19T06:50:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f342a7fc640 1 -- 172.21.15.159:0/1310070935 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424010690 con 0x7f3434101370 2024-09-19T06:50:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.139+0000 7f343b34b640 1 -- 172.21.15.159:0/1310070935 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34341a4df0 con 0x7f3434101370 2024-09-19T06:50:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.142+0000 7f343e1c1740 1 Processor -- start 2024-09-19T06:50:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.142+0000 7f343e1c1740 1 -- start start 2024-09-19T06:50:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.142+0000 7f342a7fc640 1 -- 172.21.15.159:0/1310070935 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f34240046c0 con 0x7f3434101370 2024-09-19T06:50:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.142+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.142+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b9410 0x5606ef8c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.142+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 0x5606ef8c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f343e1c1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5606ef81d2f0 con 0x5606ef8b9410 2024-09-19T06:50:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f343e1c1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5606ef7c5270 con 0x5606ef8b8af0 2024-09-19T06:50:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f343e1c1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5606ef8192b0 con 0x5606ef8c3cb0 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34390e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b9410 0x5606ef8c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34398e8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34390e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b9410 0x5606ef8c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40066/0 (socket says 172.21.15.159:40066) 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34390e7640 1 -- 172.21.15.159:0/1207070432 learned_addr learned my addr 172.21.15.159:0/1207070432 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34388e6640 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 0x5606ef8c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34398e8640 1 -- 172.21.15.159:0/1207070432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 msgr2=0x5606ef8c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34398e8640 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 0x5606ef8c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34398e8640 1 -- 172.21.15.159:0/1207070432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b9410 msgr2=0x5606ef8c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34398e8640 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b9410 0x5606ef8c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34398e8640 1 -- 172.21.15.159:0/1207070432 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ef7c4340 con 0x5606ef8b8af0 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34390e7640 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b9410 0x5606ef8c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34388e6640 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 0x5606ef8c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34398e8640 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8b8ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f342c009ca0 tx=0x7f342c009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9abd2a0b8734f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f342a7fc640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f34200a3460 0x7f34200a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f34390e7640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f34200a3460 0x7f34200a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f341f7fe640 1 -- 172.21.15.159:0/1207070432 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c048070 con 0x5606ef8b8af0 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f342a7fc640 1 -- 172.21.15.159:0/1310070935 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f34240d0170 con 0x7f3434101370 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f341f7fe640 1 -- 172.21.15.159:0/1207070432 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f342c036070 con 0x5606ef8b8af0 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.143+0000 7f341f7fe640 1 -- 172.21.15.159:0/1207070432 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0043b0 con 0x5606ef8b8af0 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.144+0000 7f343e1c1740 1 -- 172.21.15.159:0/1207070432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 msgr2=0x5606ef8b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.144+0000 7f34390e7640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f34200a3460 0x7f34200a5920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5606ef8b5ec0 tx=0x7f3430005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.144+0000 7f343e1c1740 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8b8ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f342c009ca0 tx=0x7f342c009a20 comp rx=0 tx=0).stop 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.144+0000 7f343e1c1740 1 -- 172.21.15.159:0/1207070432 shutdown_connections 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.144+0000 7f343e1c1740 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 0x5606ef8c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.144+0000 7f343e1c1740 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b9410 0x5606ef8c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.144+0000 7f343e1c1740 1 --2- 172.21.15.159:0/1207070432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8b8ed0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.144+0000 7f343e1c1740 1 -- 172.21.15.159:0/1207070432 >> 172.21.15.159:0/1207070432 conn(0x5606ef8b5060 msgr2=0x5606ef8b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 -- 172.21.15.159:0/1207070432 shutdown_connections 2024-09-19T06:50:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 -- 172.21.15.159:0/1207070432 wait complete. 2024-09-19T06:50:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 -- start start 2024-09-19T06:50:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 Processor -- start 2024-09-19T06:50:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b8af0 0x5606ef8c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b9410 0x5606ef8c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 0x5606ef8c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5606ef8cac90 con 0x5606ef8b8af0 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5606ef7a6290 con 0x5606ef8b9410 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5606ef8cae10 con 0x5606ef8c3cb0 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.145+0000 7f343e1c1740 10 client.0 _ll_register_callbacks cb 0x5606ef7d7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34390e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b8af0 0x5606ef8c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34388e6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b9410 0x5606ef8c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34398e8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 0x5606ef8c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34388e6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b9410 0x5606ef8c1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:39222/0 (socket says 172.21.15.159:39222) 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34388e6640 1 -- 172.21.15.159:0/3995583942 learned_addr learned my addr 172.21.15.159:0/3995583942 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34390e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b8af0 0x5606ef8c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40070/0 (socket says 172.21.15.159:40070) 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34388e6640 1 -- 172.21.15.159:0/3995583942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 msgr2=0x5606ef8c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34388e6640 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 0x5606ef8c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34388e6640 1 -- 172.21.15.159:0/3995583942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b8af0 msgr2=0x5606ef8c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34388e6640 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b8af0 0x5606ef8c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34388e6640 1 -- 172.21.15.159:0/3995583942 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606ef530210 con 0x5606ef8b9410 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f34388e6640 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b9410 0x5606ef8c1130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f342400c6a0 tx=0x7f3424098780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22cda25b4986264d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f341cff9640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f341cff9640 1 -- 172.21.15.159:0/3995583942 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34240a4e00 con 0x5606ef8b9410 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f343e1c1740 1 -- 172.21.15.159:0/3995583942 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f342c036070 con 0x5606ef8b9410 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f341cff9640 1 -- 172.21.15.159:0/3995583942 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f342409b870 con 0x5606ef8b9410 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f341cff9640 1 -- 172.21.15.159:0/3995583942 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f342409cb20 con 0x5606ef8b9410 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f343e1c1740 10 client.25529 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.146+0000 7f343e1c1740 1 -- 172.21.15.159:0/3995583942 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5606ef5fc620 con 0x5606ef8b9410 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f341cff9640 1 -- 172.21.15.159:0/3995583942 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f342c036070 con 0x5606ef8b9410 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f341cff9640 1 -- 172.21.15.159:0/3995583942 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f34240b5120 con 0x5606ef8b9410 2024-09-19T06:50:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f343e1c1740 10 client.25529 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f343e1c1740 10 client.25529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f343e1c1740 20 client.25529 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5606ef8d80c0 0x5606ef8da4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f343e1c1740 4 client.25529 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f343e1c1740 1 -- 172.21.15.159:0/3995583942 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606ef82aa20 con 0x5606ef8d80c0 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f34390e7640 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5606ef8d80c0 0x5606ef8da4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f34390e7640 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5606ef8d80c0 0x5606ef8da4b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6514418495900c9 server_cookie=ba303339fc2848f0 in_seq=0 out_seq=0 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.147+0000 7f341cff9640 10 client.25529 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f341cff9640 1 -- 172.21.15.159:0/3995583942 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606ef82aa20 con 0x5606ef8d80c0 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f341cff9640 10 client.25529 handle_command_reply: tid=0 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f343e1c1740 1 client.25529 shutdown 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f343e1c1740 1 -- 172.21.15.159:0/3995583942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b9410 msgr2=0x5606ef8c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b9410 0x5606ef8c1130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f342400c6a0 tx=0x7f3424098780 comp rx=0 tx=0).stop 2024-09-19T06:50:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f343e1c1740 1 -- 172.21.15.159:0/3995583942 shutdown_connections 2024-09-19T06:50:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5606ef8d80c0 0x5606ef8da4b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8c3cb0 0x5606ef8c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f341cff9640 0 client.25529 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.148+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b9410 0x5606ef8c1130 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.149+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3995583942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8b8af0 0x5606ef8c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.149+0000 7f343e1c1740 1 -- 172.21.15.159:0/3995583942 >> 172.21.15.159:0/3995583942 conn(0x5606ef8b5060 msgr2=0x5606ef8badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.149+0000 7f343e1c1740 1 -- 172.21.15.159:0/3995583942 shutdown_connections 2024-09-19T06:50:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.149+0000 7f343e1c1740 1 -- 172.21.15.159:0/3995583942 wait complete. 2024-09-19T06:50:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.149+0000 7f343e1c1740 20 client.25529 trim_cache size 0 max 16384 2024-09-19T06:50:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f343e1c1740 1 Processor -- start 2024-09-19T06:50:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f343e1c1740 1 -- start start 2024-09-19T06:50:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8bb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 0x5606ef8c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8dfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f343e1c1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f34341a9580 con 0x5606ef8c3cb0 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f343e1c1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f34341abe00 con 0x5606ef8b8af0 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f343e1c1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f34341a9bf0 con 0x5606ef8b9410 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34398e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8dfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34388e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 0x5606ef8c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34390e7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8bb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34398e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8dfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40086/0 (socket says 172.21.15.159:40086) 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34398e8640 1 -- 172.21.15.159:0/3833144694 learned_addr learned my addr 172.21.15.159:0/3833144694 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34388e6640 1 -- 172.21.15.159:0/3833144694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 msgr2=0x5606ef8bb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34388e6640 1 --2- 172.21.15.159:0/3833144694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8bb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34388e6640 1 -- 172.21.15.159:0/3833144694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 msgr2=0x5606ef8dfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34388e6640 1 --2- 172.21.15.159:0/3833144694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8dfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34388e6640 1 -- 172.21.15.159:0/3833144694 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ef8b8920 con 0x5606ef8b9410 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.164+0000 7f34398e8640 1 --2- 172.21.15.159:0/3833144694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8dfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f34388e6640 1 --2- 172.21.15.159:0/3833144694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 0x5606ef8c2b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f342409c120 tx=0x7f34240987f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b00882bb3e3629 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f341effd640 1 -- 172.21.15.159:0/3833144694 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342409bf60 con 0x5606ef8b9410 2024-09-19T06:50:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f341effd640 1 -- 172.21.15.159:0/3833144694 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f342409bb60 con 0x5606ef8b9410 2024-09-19T06:50:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f341effd640 1 -- 172.21.15.159:0/3833144694 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34240a4e60 con 0x5606ef8b9410 2024-09-19T06:50:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f343e1c1740 1 -- 172.21.15.159:0/3833144694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 msgr2=0x5606ef8c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3833144694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 0x5606ef8c2b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f342409c120 tx=0x7f34240987f0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f343e1c1740 1 -- 172.21.15.159:0/3833144694 shutdown_connections 2024-09-19T06:50:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3833144694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8dfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3833144694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 0x5606ef8c2b60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f343e1c1740 1 --2- 172.21.15.159:0/3833144694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8bb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.165+0000 7f343e1c1740 1 -- 172.21.15.159:0/3833144694 >> 172.21.15.159:0/3833144694 conn(0x5606ef8b5060 msgr2=0x5606ef8c2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 -- 172.21.15.159:0/3833144694 shutdown_connections 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 -- 172.21.15.159:0/3833144694 wait complete. 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 -- start start 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 Processor -- start 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 0x5606ef8bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f34341aa2c0 con 0x5606ef8c3cb0 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f34341ab730 con 0x5606ef8b8af0 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f34341aa990 con 0x5606ef8b9410 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f343e1c1740 10 client.0 _ll_register_callbacks cb 0x7f342400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f34398e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f34390e7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f34388e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 0x5606ef8bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f34398e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8be090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40102/0 (socket says 172.21.15.159:40102) 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f34390e7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:39236/0 (socket says 172.21.15.159:39236) 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.166+0000 7f34398e8640 1 -- 172.21.15.159:0/2616480140 learned_addr learned my addr 172.21.15.159:0/2616480140 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f34398e8640 1 -- 172.21.15.159:0/2616480140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 msgr2=0x5606ef8bdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f34398e8640 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 0x5606ef8bdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f34398e8640 1 -- 172.21.15.159:0/2616480140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 msgr2=0x5606ef8d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f34398e8640 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f34398e8640 1 -- 172.21.15.159:0/2616480140 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606ef8b5cf0 con 0x5606ef8c3cb0 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f34398e8640 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8be090 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f342c004ab0 tx=0x7f342c02b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86ca70c88e70d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f341cff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f341cff9640 1 -- 172.21.15.159:0/2616480140 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c054070 con 0x5606ef8c3cb0 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f343e1c1740 1 -- 172.21.15.159:0/2616480140 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f342409bb60 con 0x5606ef8c3cb0 2024-09-19T06:50:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f341cff9640 1 -- 172.21.15.159:0/2616480140 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f342c031ac0 con 0x5606ef8c3cb0 2024-09-19T06:50:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f341cff9640 1 -- 172.21.15.159:0/2616480140 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f342c048040 con 0x5606ef8c3cb0 2024-09-19T06:50:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f343e1c1740 10 client.16161 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f343e1c1740 1 -- 172.21.15.159:0/2616480140 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5606ef942c20 con 0x5606ef8c3cb0 2024-09-19T06:50:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f341cff9640 1 -- 172.21.15.159:0/2616480140 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f342409bb60 con 0x5606ef8c3cb0 2024-09-19T06:50:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.167+0000 7f341cff9640 1 -- 172.21.15.159:0/2616480140 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f342c042030 con 0x5606ef8c3cb0 2024-09-19T06:50:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.168+0000 7f343e1c1740 10 client.16161 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.168+0000 7f343e1c1740 10 client.16161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.168+0000 7f343e1c1740 20 client.16161 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.168+0000 7f343e1c1740 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5606ef8d80c0 0x5606ef944f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.168+0000 7f343e1c1740 4 client.16161 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:50:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.168+0000 7f343e1c1740 1 -- 172.21.15.159:0/2616480140 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5606ef824d70 con 0x5606ef8d80c0 2024-09-19T06:50:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.168+0000 7f34390e7640 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5606ef8d80c0 0x5606ef944f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.168+0000 7f34390e7640 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5606ef8d80c0 0x5606ef944f70 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d58fa8493ea7ad4c server_cookie=234a6a5247eb5933 in_seq=0 out_seq=0 2024-09-19T06:50:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.168+0000 7f341cff9640 10 client.16161 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f341cff9640 1 -- 172.21.15.159:0/2616480140 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5606ef824d70 con 0x5606ef8d80c0 2024-09-19T06:50:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f341cff9640 10 client.16161 handle_command_reply: tid=0 2024-09-19T06:50:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f343e1c1740 1 client.16161 shutdown 2024-09-19T06:50:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f343e1c1740 1 -- 172.21.15.159:0/2616480140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 msgr2=0x5606ef8be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f343e1c1740 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8be090 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f342c004ab0 tx=0x7f342c02b020 comp rx=0 tx=0).stop 2024-09-19T06:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f343e1c1740 1 -- 172.21.15.159:0/2616480140 shutdown_connections 2024-09-19T06:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f343e1c1740 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5606ef8d80c0 0x5606ef944f70 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f343e1c1740 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5606ef8c3cb0 0x5606ef8be090 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f343e1c1740 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5606ef8b9410 0x5606ef8bdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f343e1c1740 1 --2- 172.21.15.159:0/2616480140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5606ef8b8af0 0x5606ef8d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f341cff9640 0 client.16161 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.182+0000 7f343e1c1740 1 -- 172.21.15.159:0/2616480140 >> 172.21.15.159:0/2616480140 conn(0x5606ef8b5060 msgr2=0x5606ef8b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.183+0000 7f343e1c1740 1 -- 172.21.15.159:0/2616480140 shutdown_connections 2024-09-19T06:50:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.183+0000 7f343e1c1740 1 -- 172.21.15.159:0/2616480140 wait complete. 2024-09-19T06:50:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.183+0000 7f343e1c1740 20 client.16161 trim_cache size 0 max 16384 2024-09-19T06:50:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:50:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:50:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:50:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.183+0000 7f343b34b640 1 -- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f34200a3460 msgr2=0x7f34200a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.183+0000 7f343b34b640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f34200a3460 0x7f34200a5920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5606ef8b5ec0 tx=0x7f3430005f90 comp rx=0 tx=0).stop 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.183+0000 7f343b34b640 1 -- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 msgr2=0x7f34341996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.183+0000 7f343b34b640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 0x7f34341996d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f342400e9f0 tx=0x7f342400edf0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.184+0000 7f343b34b640 1 -- 172.21.15.159:0/1310070935 shutdown_connections 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.184+0000 7f343b34b640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f34200a3460 0x7f34200a5920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.184+0000 7f343b34b640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34341069e0 0x7f34341a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.184+0000 7f343b34b640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3434101370 0x7f34341996d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.184+0000 7f343b34b640 1 --2- 172.21.15.159:0/1310070935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34341009d0 0x7f3434199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.184+0000 7f343b34b640 1 -- 172.21.15.159:0/1310070935 >> 172.21.15.159:0/1310070935 conn(0x7f34340fc6b0 msgr2=0x7f34340fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.184+0000 7f343b34b640 1 -- 172.21.15.159:0/1310070935 shutdown_connections 2024-09-19T06:50:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:20.184+0000 7f343b34b640 1 -- 172.21.15.159:0/1310070935 wait complete. 2024-09-19T06:50:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:20 smithi203 ceph-mon[35473]: pgmap v105: 97 pgs: 97 active+clean; 42 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 895 op/s 2024-09-19T06:50:21.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:20 smithi189 ceph-mon[34880]: pgmap v105: 97 pgs: 97 active+clean; 42 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 895 op/s 2024-09-19T06:50:21.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:20 smithi159 ceph-mon[30935]: pgmap v105: 97 pgs: 97 active+clean; 42 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 895 op/s 2024-09-19T06:50:22.282 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0xffdb8 2024-09-19T06:50:22.466 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T06:50:22.467 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:50:22.719 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:22.841 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:22 smithi159 ceph-mon[30935]: pgmap v106: 97 pgs: 97 active+clean; 38 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.9 MiB/s wr, 1.13k op/s 2024-09-19T06:50:23.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:22 smithi203 ceph-mon[35473]: pgmap v106: 97 pgs: 97 active+clean; 38 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.9 MiB/s wr, 1.13k op/s 2024-09-19T06:50:23.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:22 smithi189 ceph-mon[34880]: pgmap v106: 97 pgs: 97 active+clean; 38 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.9 MiB/s wr, 1.13k op/s 2024-09-19T06:50:23.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.365+0000 7f48cf837640 1 -- 172.21.15.159:0/311675895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8100e20 msgr2=0x7f48c8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.365+0000 7f48cf837640 1 --2- 172.21.15.159:0/311675895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8100e20 0x7f48c8101200 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009900 tx=0x7f48c402a480 comp rx=0 tx=0).stop 2024-09-19T06:50:23.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.365+0000 7f48cf837640 1 -- 172.21.15.159:0/311675895 shutdown_connections 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.365+0000 7f48cf837640 1 --2- 172.21.15.159:0/311675895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48c8102ef0 0x7f48c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.365+0000 7f48cf837640 1 --2- 172.21.15.159:0/311675895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48c8102570 0x7f48c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.365+0000 7f48cf837640 1 --2- 172.21.15.159:0/311675895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8100e20 0x7f48c8101200 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.365+0000 7f48cf837640 1 -- 172.21.15.159:0/311675895 >> 172.21.15.159:0/311675895 conn(0x7f48c80fc7d0 msgr2=0x7f48c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.365+0000 7f48cf837640 1 -- 172.21.15.159:0/311675895 shutdown_connections 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.365+0000 7f48cf837640 1 -- 172.21.15.159:0/311675895 wait complete. 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cf837640 1 Processor -- start 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cf837640 1 -- start start 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cf837640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48c8100e20 0x7f48c8103c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cf837640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48c8102570 0x7f48c81041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cf837640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8102ef0 0x7f48c81046f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cf837640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f48c8110f80 con 0x7f48c8102ef0 2024-09-19T06:50:23.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cf837640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48c8110e00 con 0x7f48c8102570 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cf837640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48c8111100 con 0x7f48c8100e20 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cddd4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8102ef0 0x7f48c81046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cddd4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8102ef0 0x7f48c81046f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40112/0 (socket says 172.21.15.159:40112) 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cd5d3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48c8100e20 0x7f48c8103c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48cddd4640 1 -- 172.21.15.159:0/3710466308 learned_addr learned my addr 172.21.15.159:0/3710466308 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.366+0000 7f48ccdd2640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48c8102570 0x7f48c81041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48cddd4640 1 -- 172.21.15.159:0/3710466308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48c8100e20 msgr2=0x7f48c8103c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48cddd4640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48c8100e20 0x7f48c8103c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48cddd4640 1 -- 172.21.15.159:0/3710466308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48c8102570 msgr2=0x7f48c81041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48cddd4640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48c8102570 0x7f48c81041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48cddd4640 1 -- 172.21.15.159:0/3710466308 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c81a69c0 con 0x7f48c8102ef0 2024-09-19T06:50:23.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48cddd4640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8102ef0 0x7f48c81046f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f48c000eaa0 tx=0x7f48c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48be7fc640 1 -- 172.21.15.159:0/3710466308 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c000cdb0 con 0x7f48c8102ef0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c81a6cb0 con 0x7f48c8102ef0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48be7fc640 1 -- 172.21.15.159:0/3710466308 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48c0005020 con 0x7f48c8102ef0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48be7fc640 1 -- 172.21.15.159:0/3710466308 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c00116b0 con 0x7f48c8102ef0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.367+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c81a71f0 con 0x7f48c8102ef0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.368+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c8101200 con 0x7f48c8102ef0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.369+0000 7f48be7fc640 1 -- 172.21.15.159:0/3710466308 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f48c0005560 con 0x7f48c8102ef0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.370+0000 7f48be7fc640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48b40a33b0 0x7f48b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.370+0000 7f48cd5d3640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48b40a33b0 0x7f48b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.371+0000 7f48be7fc640 1 -- 172.21.15.159:0/3710466308 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f48c00d0240 con 0x7f48c8102ef0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.371+0000 7f48cd5d3640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48b40a33b0 0x7f48b40a5870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009230 tx=0x7f48c40058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.374+0000 7f48be7fc640 1 -- 172.21.15.159:0/3710466308 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48c0016030 con 0x7f48c8102ef0 2024-09-19T06:50:23.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.582+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48c81a7480 con 0x7f48c8102ef0 2024-09-19T06:50:23.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.583+0000 7f48be7fc640 1 -- 172.21.15.159:0/3710466308 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f48c009c5a0 con 0x7f48c8102ef0 2024-09-19T06:50:23.586 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:50:23.586 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:50:23.586 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:50:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.585+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48b40a33b0 msgr2=0x7f48b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.585+0000 7f48cf837640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48b40a33b0 0x7f48b40a5870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009230 tx=0x7f48c40058d0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.585+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8102ef0 msgr2=0x7f48c81046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.585+0000 7f48cf837640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8102ef0 0x7f48c81046f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f48c000eaa0 tx=0x7f48c000ef60 comp rx=0 tx=0).stop 2024-09-19T06:50:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.586+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 shutdown_connections 2024-09-19T06:50:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.586+0000 7f48cf837640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48b40a33b0 0x7f48b40a5870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.586+0000 7f48cf837640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48c8102ef0 0x7f48c81046f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.586+0000 7f48cf837640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48c8102570 0x7f48c81041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.586+0000 7f48cf837640 1 --2- 172.21.15.159:0/3710466308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48c8100e20 0x7f48c8103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.586+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 >> 172.21.15.159:0/3710466308 conn(0x7f48c80fc7d0 msgr2=0x7f48c8105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:23.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.586+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 shutdown_connections 2024-09-19T06:50:23.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:23.586+0000 7f48cf837640 1 -- 172.21.15.159:0/3710466308 wait complete. 2024-09-19T06:50:23.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:23 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3710466308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:24.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:23 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3710466308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:24.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:23 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3710466308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:24.346 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T06:50:24.346 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T06:50:24.598 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:25.057 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:24 smithi159 ceph-mon[30935]: pgmap v107: 97 pgs: 97 active+clean; 38 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 848 op/s 2024-09-19T06:50:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:24 smithi203 ceph-mon[35473]: pgmap v107: 97 pgs: 97 active+clean; 38 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 848 op/s 2024-09-19T06:50:25.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:24 smithi189 ceph-mon[34880]: pgmap v107: 97 pgs: 97 active+clean; 38 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 848 op/s 2024-09-19T06:50:25.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 -- 172.21.15.159:0/1476628308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 msgr2=0x7fb9c81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 --2- 172.21.15.159:0/1476628308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 0x7fb9c81029b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009900 tx=0x7fb9c402a480 comp rx=0 tx=0).stop 2024-09-19T06:50:25.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 -- 172.21.15.159:0/1476628308 shutdown_connections 2024-09-19T06:50:25.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 --2- 172.21.15.159:0/1476628308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb9c8102ef0 0x7fb9c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 --2- 172.21.15.159:0/1476628308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 0x7fb9c81029b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 --2- 172.21.15.159:0/1476628308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9c8100e20 0x7fb9c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 -- 172.21.15.159:0/1476628308 >> 172.21.15.159:0/1476628308 conn(0x7fb9c80fc7d0 msgr2=0x7fb9c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 -- 172.21.15.159:0/1476628308 shutdown_connections 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 -- 172.21.15.159:0/1476628308 wait complete. 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.147+0000 7fb9d0109640 1 Processor -- start 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9d0109640 1 -- start start 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9d0109640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb9c8100e20 0x7fb9c81973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9d0109640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 0x7fb9c8197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9d0109640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9c8102ef0 0x7fb9c819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9d0109640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8110f80 con 0x7fb9c8102570 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9d0109640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8110e00 con 0x7fb9c8102ef0 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9d0109640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8111100 con 0x7fb9c8100e20 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cd6a4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 0x7fb9c8197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cd6a4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 0x7fb9c8197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40118/0 (socket says 172.21.15.159:40118) 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/203080932 learned_addr learned my addr 172.21.15.159:0/203080932 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:25.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cdea5640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb9c8100e20 0x7fb9c81973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9ce6a6640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9c8102ef0 0x7fb9c819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/203080932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb9c8100e20 msgr2=0x7fb9c81973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb9c8100e20 0x7fb9c81973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/203080932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9c8102ef0 msgr2=0x7fb9c819bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9c8102ef0 0x7fb9c819bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/203080932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c819c390 con 0x7fb9c8102570 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.148+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 0x7fb9c8197920 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4006010 tx=0x7fb9c4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.149+0000 7fb9baffd640 1 -- 172.21.15.159:0/203080932 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c403f070 con 0x7fb9c8102570 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.149+0000 7fb9baffd640 1 -- 172.21.15.159:0/203080932 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c4031c30 con 0x7fb9c8102570 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.149+0000 7fb9d0109640 1 -- 172.21.15.159:0/203080932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c819c620 con 0x7fb9c8102570 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.149+0000 7fb9baffd640 1 -- 172.21.15.159:0/203080932 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4035030 con 0x7fb9c8102570 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.149+0000 7fb9d0109640 1 -- 172.21.15.159:0/203080932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c81a3f60 con 0x7fb9c8102570 2024-09-19T06:50:25.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.151+0000 7fb9baffd640 1 -- 172.21.15.159:0/203080932 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb9c4042070 con 0x7fb9c8102570 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.151+0000 7fb9d24e2740 1 Processor -- start 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.151+0000 7fb9d24e2740 1 -- start start 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 0x557d550c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d550c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557d5501f2a0 con 0x557d550b95e0 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d54fc6b10 con 0x557d550c6b50 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557d5501b260 con 0x557d550b9f00 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9ce6a6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9ce6a6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40132/0 (socket says 172.21.15.159:40132) 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9ce6a6640 1 -- 172.21.15.159:0/446605273 learned_addr learned my addr 172.21.15.159:0/446605273 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9cdea5640 1 --2- 172.21.15.159:0/446605273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 0x557d550c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/446605273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d550c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9ce6a6640 1 -- 172.21.15.159:0/446605273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 msgr2=0x557d550c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9ce6a6640 1 --2- 172.21.15.159:0/446605273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 0x557d550c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9ce6a6640 1 -- 172.21.15.159:0/446605273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 msgr2=0x557d550c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9ce6a6640 1 --2- 172.21.15.159:0/446605273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d550c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9baffd640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb9b40a33b0 0x7fb9b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9ce6a6640 1 -- 172.21.15.159:0/446605273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d54d90b90 con 0x557d550b95e0 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9cdea5640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb9b40a33b0 0x7fb9b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9ce6a6640 1 --2- 172.21.15.159:0/446605273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550b99c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009fd0 tx=0x7fb9c00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc0b0ddd438802f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9baffd640 1 -- 172.21.15.159:0/203080932 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb9c40f0410 con 0x7fb9c8102570 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.152+0000 7fb9b3fff640 1 -- 172.21.15.159:0/446605273 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0004d20 con 0x557d550b95e0 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9b3fff640 1 -- 172.21.15.159:0/446605273 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c0004050 con 0x557d550b95e0 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9b3fff640 1 -- 172.21.15.159:0/446605273 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0005280 con 0x557d550b95e0 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9d24e2740 1 -- 172.21.15.159:0/446605273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 msgr2=0x557d550b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/446605273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550b99c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009fd0 tx=0x7fb9c00118d0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9cdea5640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb9b40a33b0 0x7fb9b40a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x557d550ba6b0 tx=0x7fb9bc005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9d24e2740 1 -- 172.21.15.159:0/446605273 shutdown_connections 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/446605273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d550c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/446605273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 0x557d550c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/446605273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550b99c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.153+0000 7fb9d24e2740 1 -- 172.21.15.159:0/446605273 >> 172.21.15.159:0/446605273 conn(0x557d550b5cf0 msgr2=0x557d550b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 -- 172.21.15.159:0/446605273 shutdown_connections 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 -- 172.21.15.159:0/446605273 wait complete. 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 -- start start 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 Processor -- start 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 0x557d550ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d550ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557d550c9780 con 0x557d550b95e0 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d54fa76e0 con 0x557d550c6b50 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557d550c9900 con 0x557d550b9f00 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9d24e2740 10 client.0 _ll_register_callbacks cb 0x557d54fcba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9cdea5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.154+0000 7fb9cdea5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40142/0 (socket says 172.21.15.159:40142) 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9cdea5640 1 -- 172.21.15.159:0/4101540267 learned_addr learned my addr 172.21.15.159:0/4101540267 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9ce6a6640 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d550ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 0x557d550ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9cdea5640 1 -- 172.21.15.159:0/4101540267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 msgr2=0x557d550ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9cdea5640 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 0x557d550ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9cdea5640 1 -- 172.21.15.159:0/4101540267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 msgr2=0x557d550ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9cdea5640 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d550ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9cdea5640 1 -- 172.21.15.159:0/4101540267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d550d4f40 con 0x557d550b95e0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9cdea5640 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550c9bd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009730 tx=0x7fb9bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc06c1090ee5d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9b17fa640 1 -- 172.21.15.159:0/4101540267 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc009e60 con 0x557d550b95e0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9b17fa640 1 -- 172.21.15.159:0/4101540267 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb9bc01f640 con 0x557d550b95e0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9d24e2740 1 -- 172.21.15.159:0/4101540267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c0004050 con 0x557d550b95e0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9b17fa640 1 -- 172.21.15.159:0/4101540267 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb9bc01f840 con 0x557d550b95e0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9d24e2740 10 client.16179 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9d24e2740 1 -- 172.21.15.159:0/4101540267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557d550d7940 con 0x557d550b95e0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.155+0000 7fb9b17fa640 1 -- 172.21.15.159:0/4101540267 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c0004050 con 0x557d550b95e0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9b17fa640 1 -- 172.21.15.159:0/4101540267 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb9bc027070 con 0x557d550b95e0 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9d24e2740 10 client.16179 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:25.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9d24e2740 10 client.16179 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9d24e2740 20 client.16179 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557d550d9270 0x557d550db6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9d24e2740 4 client.16179 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9d24e2740 1 -- 172.21.15.159:0/4101540267 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d5502c9d0 con 0x557d550d9270 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557d550d9270 0x557d550db6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9b17fa640 10 client.16179 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.156+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557d550d9270 0x557d550db6d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92c9d99bb8b61d35 server_cookie=e583581e0e12903b in_seq=0 out_seq=0 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9b17fa640 1 -- 172.21.15.159:0/4101540267 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d5502c9d0 con 0x557d550d9270 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9b17fa640 10 client.16179 handle_command_reply: tid=0 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 client.16179 shutdown 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 -- 172.21.15.159:0/4101540267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 msgr2=0x557d550c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550c9bd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009730 tx=0x7fb9bc004730 comp rx=0 tx=0).stop 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 -- 172.21.15.159:0/4101540267 shutdown_connections 2024-09-19T06:50:25.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557d550d9270 0x557d550db6d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d550ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9b17fa640 0 client.16179 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b9f00 0x557d550ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/4101540267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b95e0 0x557d550c9bd0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 -- 172.21.15.159:0/4101540267 >> 172.21.15.159:0/4101540267 conn(0x557d550b5cf0 msgr2=0x557d550bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 -- 172.21.15.159:0/4101540267 shutdown_connections 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 1 -- 172.21.15.159:0/4101540267 wait complete. 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.157+0000 7fb9d24e2740 20 client.16179 trim_cache size 0 max 16384 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.174+0000 7fb9d24e2740 1 Processor -- start 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.174+0000 7fb9d24e2740 1 -- start start 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.174+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550b95e0 0x557d550bd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550e0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550c6b50 0x557d550e1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81a9610 con 0x557d550b9f00 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81abe90 con 0x557d550b95e0 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81a9c80 con 0x557d550c6b50 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cd6a4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550e0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cd6a4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550e0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40156/0 (socket says 172.21.15.159:40156) 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cdea5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550b95e0 0x557d550bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/1402737080 learned_addr learned my addr 172.21.15.159:0/1402737080 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9ce6a6640 1 --2- 172.21.15.159:0/1402737080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550c6b50 0x557d550e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/1402737080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550c6b50 msgr2=0x557d550e1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/1402737080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550c6b50 0x557d550e1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/1402737080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550b95e0 msgr2=0x557d550bd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/1402737080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550b95e0 0x557d550bd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/1402737080 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d550c4c80 con 0x557d550b9f00 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/1402737080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550e0fe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40bc410 tx=0x7fb9c40f2860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce4db8ab6836cb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9b37fe640 1 -- 172.21.15.159:0/1402737080 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4049040 con 0x557d550b9f00 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9b37fe640 1 -- 172.21.15.159:0/1402737080 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c4031de0 con 0x557d550b9f00 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.175+0000 7fb9b37fe640 1 -- 172.21.15.159:0/1402737080 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c40f3d10 con 0x557d550b9f00 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 -- 172.21.15.159:0/1402737080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 msgr2=0x557d550e0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/1402737080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550e0fe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40bc410 tx=0x7fb9c40f2860 comp rx=0 tx=0).stop 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 -- 172.21.15.159:0/1402737080 shutdown_connections 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/1402737080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550c6b50 0x557d550e1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/1402737080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550e0fe0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/1402737080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550b95e0 0x557d550bd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 -- 172.21.15.159:0/1402737080 >> 172.21.15.159:0/1402737080 conn(0x557d550b5cf0 msgr2=0x557d550bd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 -- 172.21.15.159:0/1402737080 shutdown_connections 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 -- 172.21.15.159:0/1402737080 wait complete. 2024-09-19T06:50:25.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 -- start start 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.176+0000 7fb9d24e2740 1 Processor -- start 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b95e0 0x557d550ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9d24e2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d55142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81aa350 con 0x557d550b9f00 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81ab7c0 con 0x557d550c6b50 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9d24e2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81aaa20 con 0x557d550b95e0 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9d24e2740 10 client.0 _ll_register_callbacks cb 0x7fb9bc0044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cdea5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b95e0 0x557d550ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cd6a4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cdea5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b95e0 0x557d550ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:49798/0 (socket says 172.21.15.159:49798) 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cdea5640 1 -- 172.21.15.159:0/46179788 learned_addr learned my addr 172.21.15.159:0/46179788 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9ce6a6640 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d55142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/46179788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b95e0 msgr2=0x557d550ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b95e0 0x557d550ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/46179788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 msgr2=0x557d55142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d55142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cd6a4640 1 -- 172.21.15.159:0/46179788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d55143500 con 0x557d550b9f00 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9cd6a4640 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550cd290 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x557d550b6df0 tx=0x7fb9c40eda40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bab69353669914 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9b17fa640 1 -- 172.21.15.159:0/46179788 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4049070 con 0x557d550b9f00 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9b17fa640 1 -- 172.21.15.159:0/46179788 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb9c403b460 con 0x557d550b9f00 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.177+0000 7fb9d24e2740 1 -- 172.21.15.159:0/46179788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c4031de0 con 0x557d550b9f00 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9b17fa640 1 -- 172.21.15.159:0/46179788 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb9c40bc710 con 0x557d550b9f00 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9d24e2740 10 client.16185 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9d24e2740 1 -- 172.21.15.159:0/46179788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557d55144670 con 0x557d550b9f00 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9b17fa640 1 -- 172.21.15.159:0/46179788 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c4031de0 con 0x557d550b9f00 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9b17fa640 1 -- 172.21.15.159:0/46179788 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb9c409c050 con 0x557d550b9f00 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9d24e2740 10 client.16185 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9d24e2740 10 client.16185 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9d24e2740 20 client.16185 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557d55144b60 0x557d55146f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9d24e2740 4 client.16185 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T06:50:25.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9d24e2740 1 -- 172.21.15.159:0/46179788 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x557d55026d20 con 0x557d55144b60 2024-09-19T06:50:25.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9cdea5640 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557d55144b60 0x557d55146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9cdea5640 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557d55144b60 0x557d55146f50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d28b080e018cdc server_cookie=4a59e9e680afe2fe in_seq=0 out_seq=0 2024-09-19T06:50:25.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:25.178+0000 7fb9b17fa640 10 client.16185 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:26 smithi203 ceph-mon[35473]: pgmap v108: 97 pgs: 97 active+clean; 42 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 1.03k op/s 2024-09-19T06:50:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:26 smithi189 ceph-mon[34880]: pgmap v108: 97 pgs: 97 active+clean; 42 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 1.03k op/s 2024-09-19T06:50:27.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:26 smithi159 ceph-mon[30935]: pgmap v108: 97 pgs: 97 active+clean; 42 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 1.03k op/s 2024-09-19T06:50:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9b17fa640 1 -- 172.21.15.159:0/46179788 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557d55026d20 con 0x557d55144b60 2024-09-19T06:50:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9b17fa640 10 client.16185 handle_command_reply: tid=0 2024-09-19T06:50:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9d24e2740 1 client.16185 shutdown 2024-09-19T06:50:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9d24e2740 1 -- 172.21.15.159:0/46179788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 msgr2=0x557d550cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550cd290 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x557d550b6df0 tx=0x7fb9c40eda40 comp rx=0 tx=0).stop 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9d24e2740 1 -- 172.21.15.159:0/46179788 shutdown_connections 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557d55144b60 0x557d55146f50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d550c6b50 0x557d55142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557d550b9f00 0x557d550cd290 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9d24e2740 1 --2- 172.21.15.159:0/46179788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d550b95e0 0x557d550ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.418+0000 7fb9d24e2740 1 -- 172.21.15.159:0/46179788 >> 172.21.15.159:0/46179788 conn(0x557d550b5cf0 msgr2=0x557d550b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9b17fa640 0 client.16185 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d24e2740 1 -- 172.21.15.159:0/46179788 shutdown_connections 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d24e2740 1 -- 172.21.15.159:0/46179788 wait complete. 2024-09-19T06:50:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d24e2740 20 client.16185 trim_cache size 0 max 16384 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 24, 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 14, 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "a2b991a9": { 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 14, 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:50:28.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 136.6, 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:28.423 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:28.424 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:50:28.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 -- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb9b40a33b0 msgr2=0x7fb9b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:28.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb9b40a33b0 0x7fb9b40a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x557d550ba6b0 tx=0x7fb9bc005f90 comp rx=0 tx=0).stop 2024-09-19T06:50:28.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 -- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 msgr2=0x7fb9c8197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:28.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 0x7fb9c8197920 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4006010 tx=0x7fb9c4003c10 comp rx=0 tx=0).stop 2024-09-19T06:50:28.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 -- 172.21.15.159:0/203080932 shutdown_connections 2024-09-19T06:50:28.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb9b40a33b0 0x7fb9b40a5870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:28.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9c8102ef0 0x7fb9c819bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:28.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c8102570 0x7fb9c8197920 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:28.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 --2- 172.21.15.159:0/203080932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb9c8100e20 0x7fb9c81973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:28.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 -- 172.21.15.159:0/203080932 >> 172.21.15.159:0/203080932 conn(0x7fb9c80fc7d0 msgr2=0x7fb9c81068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:28.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 -- 172.21.15.159:0/203080932 shutdown_connections 2024-09-19T06:50:28.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:28.419+0000 7fb9d0109640 1 -- 172.21.15.159:0/203080932 wait complete. 2024-09-19T06:50:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:28 smithi203 ceph-mon[35473]: pgmap v109: 97 pgs: 97 active+clean; 42 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 413 op/s 2024-09-19T06:50:29.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:28 smithi189 ceph-mon[34880]: pgmap v109: 97 pgs: 97 active+clean; 42 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 413 op/s 2024-09-19T06:50:29.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:28 smithi159 ceph-mon[30935]: pgmap v109: 97 pgs: 97 active+clean; 42 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 413 op/s 2024-09-19T06:50:29.215 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a2b991a9', quiesce took 6.7 seconds. Will release after: 9.900000000000002 2024-09-19T06:50:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:30 smithi203 ceph-mon[35473]: pgmap v110: 97 pgs: 97 active+clean; 42 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 413 op/s 2024-09-19T06:50:31.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:30 smithi189 ceph-mon[34880]: pgmap v110: 97 pgs: 97 active+clean; 42 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 413 op/s 2024-09-19T06:50:31.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:30 smithi159 ceph-mon[30935]: pgmap v110: 97 pgs: 97 active+clean; 42 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 413 op/s 2024-09-19T06:50:32.950 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:32 smithi159 ceph-mon[30935]: pgmap v111: 97 pgs: 97 active+clean; 45 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 503 op/s 2024-09-19T06:50:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:32 smithi203 ceph-mon[35473]: pgmap v111: 97 pgs: 97 active+clean; 45 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 503 op/s 2024-09-19T06:50:33.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:32 smithi189 ceph-mon[34880]: pgmap v111: 97 pgs: 97 active+clean; 45 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 503 op/s 2024-09-19T06:50:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.275+0000 7f54d0711640 1 -- 172.21.15.159:0/3869440930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c8101370 msgr2=0x7f54c810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.275+0000 7f54d0711640 1 --2- 172.21.15.159:0/3869440930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c8101370 0x7f54c810d8a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009cd0 tx=0x7f54c002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.275+0000 7f54d0711640 1 -- 172.21.15.159:0/3869440930 shutdown_connections 2024-09-19T06:50:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.275+0000 7f54d0711640 1 --2- 172.21.15.159:0/3869440930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c8101370 0x7f54c810d8a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.275+0000 7f54d0711640 1 --2- 172.21.15.159:0/3869440930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54c81009d0 0x7f54c8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.275+0000 7f54d0711640 1 --2- 172.21.15.159:0/3869440930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54c81069e0 0x7f54c8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.275+0000 7f54d0711640 1 -- 172.21.15.159:0/3869440930 >> 172.21.15.159:0/3869440930 conn(0x7f54c80fc6b0 msgr2=0x7f54c80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.275+0000 7f54d0711640 1 -- 172.21.15.159:0/3869440930 shutdown_connections 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.275+0000 7f54d0711640 1 -- 172.21.15.159:0/3869440930 wait complete. 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54d0711640 1 Processor -- start 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54d0711640 1 -- start start 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54d0711640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54c81009d0 0x7f54c8197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54d0711640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54c8101370 0x7f54c81976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54d0711640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c81069e0 0x7f54c819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54d0711640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8110e20 con 0x7f54c81069e0 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54d0711640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8110ca0 con 0x7f54c81009d0 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54d0711640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8110fa0 con 0x7f54c8101370 2024-09-19T06:50:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54cecae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c81069e0 0x7f54c819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54cecae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c81069e0 0x7f54c819ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34122/0 (socket says 172.21.15.159:34122) 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54cecae640 1 -- 172.21.15.159:0/3398299323 learned_addr learned my addr 172.21.15.159:0/3398299323 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54cdcac640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54c8101370 0x7f54c81976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.276+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54c81009d0 0x7f54c8197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54cecae640 1 -- 172.21.15.159:0/3398299323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54c8101370 msgr2=0x7f54c81976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54cecae640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54c8101370 0x7f54c81976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54cecae640 1 -- 172.21.15.159:0/3398299323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54c81009d0 msgr2=0x7f54c8197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54cecae640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54c81009d0 0x7f54c8197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54cecae640 1 -- 172.21.15.159:0/3398299323 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c819c160 con 0x7f54c81069e0 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54c81009d0 0x7f54c8197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54cecae640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c81069e0 0x7f54c819ba30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f54c0005cc0 tx=0x7f54c0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54bf7fe640 1 -- 172.21.15.159:0/3398299323 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0004040 con 0x7f54c81069e0 2024-09-19T06:50:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54bf7fe640 1 -- 172.21.15.159:0/3398299323 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54c00046c0 con 0x7f54c81069e0 2024-09-19T06:50:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54d0711640 1 -- 172.21.15.159:0/3398299323 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c819c3f0 con 0x7f54c81069e0 2024-09-19T06:50:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54bf7fe640 1 -- 172.21.15.159:0/3398299323 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0046480 con 0x7f54c81069e0 2024-09-19T06:50:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.277+0000 7f54d0711640 1 -- 172.21.15.159:0/3398299323 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c806a0c0 con 0x7f54c81069e0 2024-09-19T06:50:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54d34a8740 1 Processor -- start 2024-09-19T06:50:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54bf7fe640 1 -- 172.21.15.159:0/3398299323 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f54c00305a0 con 0x7f54c81069e0 2024-09-19T06:50:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54d34a8740 1 -- start start 2024-09-19T06:50:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e829394af0 0x55e829394ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e82939f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e8293a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54d34a8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55e8292f92f0 con 0x55e82939fcb0 2024-09-19T06:50:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54d34a8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e8292a1270 con 0x55e829395410 2024-09-19T06:50:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54d34a8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e8292f52b0 con 0x55e829394af0 2024-09-19T06:50:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54cdcac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e8293a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54cdcac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e8293a20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34136/0 (socket says 172.21.15.159:34136) 2024-09-19T06:50:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54cdcac640 1 -- 172.21.15.159:0/2138744754 learned_addr learned my addr 172.21.15.159:0/2138744754 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e82939f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.280+0000 7f54cdcac640 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e829394af0 0x55e829394ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54bf7fe640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54b40a3460 0x7f54b40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54cecae640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54b40a3460 0x7f54b40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54cdcac640 1 -- 172.21.15.159:0/2138744754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e829394af0 msgr2=0x55e829394ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54cdcac640 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e829394af0 0x55e829394ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54cdcac640 1 -- 172.21.15.159:0/2138744754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 msgr2=0x55e82939f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54cdcac640 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e82939f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54cdcac640 1 -- 172.21.15.159:0/2138744754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8292a0340 con 0x55e82939fcb0 2024-09-19T06:50:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e82939f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54bf7fe640 1 -- 172.21.15.159:0/3398299323 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f54c002e030 con 0x7f54c81069e0 2024-09-19T06:50:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54cdcac640 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e8293a20a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f54b8013930 tx=0x7f54b800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9b94e34c2b2cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54bcff9640 1 -- 172.21.15.159:0/2138744754 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b800e950 con 0x55e82939fcb0 2024-09-19T06:50:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54bcff9640 1 -- 172.21.15.159:0/2138744754 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b8011440 con 0x55e82939fcb0 2024-09-19T06:50:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54cecae640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54b40a3460 0x7f54b40a5920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54c00eedf0 tx=0x7f54c00a81c0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.281+0000 7f54bcff9640 1 -- 172.21.15.159:0/2138744754 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8010690 con 0x55e82939fcb0 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 -- 172.21.15.159:0/2138744754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 msgr2=0x55e8293a20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e8293a20a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f54b8013930 tx=0x7f54b800b460 comp rx=0 tx=0).stop 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 -- 172.21.15.159:0/2138744754 shutdown_connections 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e8293a20a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e82939f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 --2- 172.21.15.159:0/2138744754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e829394af0 0x55e829394ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 -- 172.21.15.159:0/2138744754 >> 172.21.15.159:0/2138744754 conn(0x55e829391060 msgr2=0x55e829391440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 -- 172.21.15.159:0/2138744754 shutdown_connections 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 -- 172.21.15.159:0/2138744754 wait complete. 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 -- start start 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.282+0000 7f54d34a8740 1 Processor -- start 2024-09-19T06:50:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829394af0 0x55e82939cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e82939d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e82939fcb0 0x55e82939d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54d34a8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55e8293a2880 con 0x55e829394af0 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54d34a8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e829282290 con 0x55e829395410 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54d34a8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e8293a2a00 con 0x55e82939fcb0 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54d34a8740 10 client.0 _ll_register_callbacks cb 0x55e8292b3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54cdcac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829394af0 0x55e82939cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54cdcac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829394af0 0x55e82939cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34140/0 (socket says 172.21.15.159:34140) 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54cdcac640 1 -- 172.21.15.159:0/3543068478 learned_addr learned my addr 172.21.15.159:0/3543068478 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54cdcac640 1 -- 172.21.15.159:0/3543068478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e82939fcb0 msgr2=0x55e82939d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54cdcac640 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e82939fcb0 0x55e82939d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54cdcac640 1 -- 172.21.15.159:0/3543068478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 msgr2=0x55e82939d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54cdcac640 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e82939d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54cdcac640 1 -- 172.21.15.159:0/3543068478 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e82900c210 con 0x55e829394af0 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54cdcac640 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829394af0 0x55e82939cc10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f54b8011e90 tx=0x7f54b8011820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbc16dec4162b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54b1ffb640 1 -- 172.21.15.159:0/3543068478 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8024070 con 0x55e829394af0 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54b1ffb640 1 -- 172.21.15.159:0/3543068478 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f54b800eb30 con 0x55e829394af0 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.283+0000 7f54d34a8740 1 -- 172.21.15.159:0/3543068478 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b8011440 con 0x55e829394af0 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54b1ffb640 1 -- 172.21.15.159:0/3543068478 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f54b800ed30 con 0x55e829394af0 2024-09-19T06:50:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54d34a8740 10 client.16197 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54d34a8740 1 -- 172.21.15.159:0/3543068478 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e8290d8620 con 0x55e829394af0 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54b1ffb640 1 -- 172.21.15.159:0/3543068478 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b8011440 con 0x55e829394af0 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54b1ffb640 1 -- 172.21.15.159:0/3543068478 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f54b8029a60 con 0x55e829394af0 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54d34a8740 10 client.16197 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54d34a8740 10 client.16197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54d34a8740 20 client.16197 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54d34a8740 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e8293afb60 0x55e8293b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54d34a8740 4 client.16197 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54d34a8740 1 -- 172.21.15.159:0/3543068478 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e829306a20 con 0x55e8293afb60 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.284+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e8293afb60 0x55e8293b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e8293afb60 0x55e8293b1f50 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c932b78e9c9a598f server_cookie=b6fb20d2e6663ee0 in_seq=0 out_seq=0 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54b1ffb640 10 client.16197 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54b1ffb640 1 -- 172.21.15.159:0/3543068478 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e829306a20 con 0x55e8293afb60 2024-09-19T06:50:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54b1ffb640 10 client.16197 handle_command_reply: tid=0 2024-09-19T06:50:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54d34a8740 1 client.16197 shutdown 2024-09-19T06:50:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54d34a8740 1 -- 172.21.15.159:0/3543068478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829394af0 msgr2=0x55e82939cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54d34a8740 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829394af0 0x55e82939cc10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f54b8011e90 tx=0x7f54b8011820 comp rx=0 tx=0).stop 2024-09-19T06:50:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54d34a8740 1 -- 172.21.15.159:0/3543068478 shutdown_connections 2024-09-19T06:50:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54d34a8740 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e8293afb60 0x55e8293b1f50 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54d34a8740 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e82939fcb0 0x55e82939d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54b1ffb640 0 client.16197 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54d34a8740 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e82939d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54d34a8740 1 --2- 172.21.15.159:0/3543068478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829394af0 0x55e82939cc10 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.285+0000 7f54d34a8740 1 -- 172.21.15.159:0/3543068478 >> 172.21.15.159:0/3543068478 conn(0x55e829391060 msgr2=0x55e829396d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.286+0000 7f54d34a8740 1 -- 172.21.15.159:0/3543068478 shutdown_connections 2024-09-19T06:50:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.286+0000 7f54d34a8740 1 -- 172.21.15.159:0/3543068478 wait complete. 2024-09-19T06:50:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.286+0000 7f54d34a8740 20 client.16197 trim_cache size 0 max 16384 2024-09-19T06:50:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54d34a8740 1 Processor -- start 2024-09-19T06:50:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54d34a8740 1 -- start start 2024-09-19T06:50:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829394af0 0x55e829397530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829395410 0x55e82939d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e82939fcb0 0x55e8293b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54d34a8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81ab7a0 con 0x55e829395410 2024-09-19T06:50:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54d34a8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81ae020 con 0x55e829394af0 2024-09-19T06:50:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54d34a8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81abe10 con 0x55e82939fcb0 2024-09-19T06:50:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54ce4ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829395410 0x55e82939d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54ce4ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829395410 0x55e82939d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34152/0 (socket says 172.21.15.159:34152) 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54ce4ad640 1 -- 172.21.15.159:0/540441541 learned_addr learned my addr 172.21.15.159:0/540441541 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54cdcac640 1 --2- 172.21.15.159:0/540441541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829394af0 0x55e829397530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54ce4ad640 1 -- 172.21.15.159:0/540441541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e82939fcb0 msgr2=0x55e8293b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/540441541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e82939fcb0 0x55e8293b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54ce4ad640 1 -- 172.21.15.159:0/540441541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829394af0 msgr2=0x55e829397530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/540441541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829394af0 0x55e829397530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54ce4ad640 1 -- 172.21.15.159:0/540441541 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82938c270 con 0x55e829395410 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54cdcac640 1 --2- 172.21.15.159:0/540441541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829394af0 0x55e829397530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/540441541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829395410 0x55e82939d4c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f54c4005d80 tx=0x7f54c4009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb75e4a28417128b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.300+0000 7f54b3fff640 1 -- 172.21.15.159:0/540441541 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c401b3b0 con 0x55e829395410 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54b3fff640 1 -- 172.21.15.159:0/540441541 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54c401ba30 con 0x55e829395410 2024-09-19T06:50:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54b3fff640 1 -- 172.21.15.159:0/540441541 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4011d70 con 0x55e829395410 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 -- 172.21.15.159:0/540441541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829395410 msgr2=0x55e82939d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 --2- 172.21.15.159:0/540441541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829395410 0x55e82939d4c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f54c4005d80 tx=0x7f54c4009820 comp rx=0 tx=0).stop 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 -- 172.21.15.159:0/540441541 shutdown_connections 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 --2- 172.21.15.159:0/540441541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e82939fcb0 0x55e8293b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 --2- 172.21.15.159:0/540441541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e829395410 0x55e82939d4c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 --2- 172.21.15.159:0/540441541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829394af0 0x55e829397530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 -- 172.21.15.159:0/540441541 >> 172.21.15.159:0/540441541 conn(0x55e829391060 msgr2=0x55e82939ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 -- 172.21.15.159:0/540441541 shutdown_connections 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 -- 172.21.15.159:0/540441541 wait complete. 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 -- start start 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.301+0000 7f54d34a8740 1 Processor -- start 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e829394af0 0x55e8293a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e8293a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54d34a8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e829399630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54d34a8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81ac4e0 con 0x55e82939fcb0 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54d34a8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81ad950 con 0x55e829395410 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54d34a8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f54c81acbb0 con 0x55e829394af0 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54d34a8740 10 client.0 _ll_register_callbacks cb 0x7f54c4009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54cdcac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e829399630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54cdcac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e829399630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34156/0 (socket says 172.21.15.159:34156) 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54cdcac640 1 -- 172.21.15.159:0/252349525 learned_addr learned my addr 172.21.15.159:0/252349525 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e8293a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54cdcac640 1 -- 172.21.15.159:0/252349525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e829394af0 msgr2=0x55e8293a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54cdcac640 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e829394af0 0x55e8293a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54cdcac640 1 -- 172.21.15.159:0/252349525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 msgr2=0x55e8293a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54cdcac640 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e8293a8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54cdcac640 1 -- 172.21.15.159:0/252349525 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e829399e60 con 0x55e82939fcb0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54cdcac640 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e829399630 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f54b800b970 tx=0x7f54b80138a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488c4940420a3d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54b1ffb640 1 -- 172.21.15.159:0/252349525 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b803e060 con 0x55e82939fcb0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54d34a8740 1 -- 172.21.15.159:0/252349525 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54c401ba30 con 0x55e82939fcb0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.302+0000 7f54b1ffb640 1 -- 172.21.15.159:0/252349525 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f54b800eb30 con 0x55e82939fcb0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54b1ffb640 1 -- 172.21.15.159:0/252349525 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f54b8035050 con 0x55e82939fcb0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54d34a8740 10 client.16203 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54d34a8740 1 -- 172.21.15.159:0/252349525 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e82941a070 con 0x55e82939fcb0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54b1ffb640 1 -- 172.21.15.159:0/252349525 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54c401ba30 con 0x55e82939fcb0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54b1ffb640 1 -- 172.21.15.159:0/252349525 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f54b8029460 con 0x55e82939fcb0 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54d34a8740 10 client.16203 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54d34a8740 10 client.16203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54d34a8740 20 client.16203 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54d34a8740 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e82941a7c0 0x55e82941cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54d34a8740 4 client.16203 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:50:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54d34a8740 1 -- 172.21.15.159:0/252349525 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e829300d70 con 0x55e82941a7c0 2024-09-19T06:50:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.303+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e82941a7c0 0x55e82941cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.304+0000 7f54b1ffb640 10 client.16203 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.304+0000 7f54ce4ad640 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e82941a7c0 0x55e82941cbe0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36a8fb18455a2f7 server_cookie=b8e334fc35cd5154 in_seq=0 out_seq=0 2024-09-19T06:50:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54b1ffb640 1 -- 172.21.15.159:0/252349525 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e829300d70 con 0x55e82941a7c0 2024-09-19T06:50:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54b1ffb640 10 client.16203 handle_command_reply: tid=0 2024-09-19T06:50:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54d34a8740 1 client.16203 shutdown 2024-09-19T06:50:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54d34a8740 1 -- 172.21.15.159:0/252349525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 msgr2=0x55e829399630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54d34a8740 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e829399630 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f54b800b970 tx=0x7f54b80138a0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54d34a8740 1 -- 172.21.15.159:0/252349525 shutdown_connections 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54d34a8740 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55e82941a7c0 0x55e82941cbe0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54d34a8740 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55e82939fcb0 0x55e829399630 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54d34a8740 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e829395410 0x55e8293a8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54b1ffb640 0 client.16203 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54d34a8740 1 --2- 172.21.15.159:0/252349525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e829394af0 0x55e8293a7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.399+0000 7f54d34a8740 1 -- 172.21.15.159:0/252349525 >> 172.21.15.159:0/252349525 conn(0x55e829391060 msgr2=0x55e8293aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d34a8740 1 -- 172.21.15.159:0/252349525 shutdown_connections 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d34a8740 1 -- 172.21.15.159:0/252349525 wait complete. 2024-09-19T06:50:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d34a8740 20 client.16203 trim_cache size 0 max 16384 2024-09-19T06:50:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:50:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:50:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:50:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:50:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 -- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54b40a3460 msgr2=0x7f54b40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54b40a3460 0x7f54b40a5920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54c00eedf0 tx=0x7f54c00a81c0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 -- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c81069e0 msgr2=0x7f54c819ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c81069e0 0x7f54c819ba30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f54c0005cc0 tx=0x7f54c0003970 comp rx=0 tx=0).stop 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 -- 172.21.15.159:0/3398299323 shutdown_connections 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f54b40a3460 0x7f54b40a5920 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c81069e0 0x7f54c819ba30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54c8101370 0x7f54c81976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 --2- 172.21.15.159:0/3398299323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54c81009d0 0x7f54c8197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 -- 172.21.15.159:0/3398299323 >> 172.21.15.159:0/3398299323 conn(0x7f54c80fc6b0 msgr2=0x7f54c80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.400+0000 7f54d0711640 1 -- 172.21.15.159:0/3398299323 shutdown_connections 2024-09-19T06:50:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:33.401+0000 7f54d0711640 1 -- 172.21.15.159:0/3398299323 wait complete. 2024-09-19T06:50:35.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:34 smithi203 ceph-mon[35473]: pgmap v112: 97 pgs: 97 active+clean; 45 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 1.5 MiB/s wr, 272 op/s 2024-09-19T06:50:35.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:34 smithi189 ceph-mon[34880]: pgmap v112: 97 pgs: 97 active+clean; 45 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 1.5 MiB/s wr, 272 op/s 2024-09-19T06:50:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:34 smithi159 ceph-mon[30935]: pgmap v112: 97 pgs: 97 active+clean; 45 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 1.5 MiB/s wr, 272 op/s 2024-09-19T06:50:37.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:36 smithi203 ceph-mon[35473]: pgmap v113: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-09-19T06:50:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:36 smithi189 ceph-mon[34880]: pgmap v113: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-09-19T06:50:37.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:36 smithi159 ceph-mon[30935]: pgmap v113: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-09-19T06:50:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:38 smithi203 ceph-mon[35473]: pgmap v114: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 136 op/s 2024-09-19T06:50:39.117 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:50:39.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:38 smithi189 ceph-mon[34880]: pgmap v114: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 136 op/s 2024-09-19T06:50:39.146 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:38 smithi159 ceph-mon[30935]: pgmap v114: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 136 op/s 2024-09-19T06:50:39.391 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 -- 172.21.15.159:0/163624458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39101036c0 msgr2=0x7f391010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 --2- 172.21.15.159:0/163624458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39101036c0 0x7f391010bbb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009900 tx=0x7f38f802a480 comp rx=0 tx=0).stop 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 -- 172.21.15.159:0/163624458 shutdown_connections 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 --2- 172.21.15.159:0/163624458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f391010c180 0x7f391010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 --2- 172.21.15.159:0/163624458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39101036c0 0x7f391010bbb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 --2- 172.21.15.159:0/163624458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3910102da0 0x7f3910103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 -- 172.21.15.159:0/163624458 >> 172.21.15.159:0/163624458 conn(0x7f39100fc7a0 msgr2=0x7f39100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 -- 172.21.15.159:0/163624458 shutdown_connections 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 -- 172.21.15.159:0/163624458 wait complete. 2024-09-19T06:50:39.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.970+0000 7f3915384640 1 Processor -- start 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f3915384640 1 -- start start 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f3915384640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3910102da0 0x7f39101984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f3915384640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39101036c0 0x7f39101989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f3915384640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391010c180 0x7f391019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f3915384640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3910111fa0 con 0x7f391010c180 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f3915384640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3910111e20 con 0x7f39101036c0 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f3915384640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3910112120 con 0x7f3910102da0 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391010c180 0x7f391019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391010c180 0x7f391019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37484/0 (socket says 172.21.15.159:37484) 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390f7fe640 1 -- 172.21.15.159:0/1085831699 learned_addr learned my addr 172.21.15.159:0/1085831699 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390effd640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3910102da0 0x7f39101984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:39.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390e7fc640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39101036c0 0x7f39101989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390f7fe640 1 -- 172.21.15.159:0/1085831699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3910102da0 msgr2=0x7f39101984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390f7fe640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3910102da0 0x7f39101984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390f7fe640 1 -- 172.21.15.159:0/1085831699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39101036c0 msgr2=0x7f39101989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390f7fe640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39101036c0 0x7f39101989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.971+0000 7f390f7fe640 1 -- 172.21.15.159:0/1085831699 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391019d460 con 0x7f391010c180 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.972+0000 7f390f7fe640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391010c180 0x7f391019cd80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f390800b970 tx=0x7f390800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.972+0000 7f3907fff640 1 -- 172.21.15.159:0/1085831699 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908019070 con 0x7f391010c180 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.972+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391019d750 con 0x7f391010c180 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.972+0000 7f3907fff640 1 -- 172.21.15.159:0/1085831699 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f390800cb40 con 0x7f391010c180 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.972+0000 7f3907fff640 1 -- 172.21.15.159:0/1085831699 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908007610 con 0x7f391010c180 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.972+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39101a5030 con 0x7f391010c180 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.973+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3910103180 con 0x7f391010c180 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.975+0000 7f3907fff640 1 -- 172.21.15.159:0/1085831699 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f390801c070 con 0x7f391010c180 2024-09-19T06:50:39.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.975+0000 7f3907fff640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38fc0a33b0 0x7f38fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:39.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.976+0000 7f390effd640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38fc0a33b0 0x7f38fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:39.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.976+0000 7f3907fff640 1 -- 172.21.15.159:0/1085831699 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f39080cf680 con 0x7f391010c180 2024-09-19T06:50:39.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.976+0000 7f390effd640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38fc0a33b0 0x7f38fc0a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f390000bbe0 tx=0x7f390000b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:39.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:39.979+0000 7f3907fff640 1 -- 172.21.15.159:0/1085831699 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f390809baf0 con 0x7f391010c180 2024-09-19T06:50:40.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.181+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3910199810 con 0x7f391010c180 2024-09-19T06:50:40.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.181+0000 7f3907fff640 1 -- 172.21.15.159:0/1085831699 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f3910199810 con 0x7f391010c180 2024-09-19T06:50:40.183 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:50:40.183 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:50:40.183 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:50:40.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38fc0a33b0 msgr2=0x7f38fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:40.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38fc0a33b0 0x7f38fc0a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f390000bbe0 tx=0x7f390000b390 comp rx=0 tx=0).stop 2024-09-19T06:50:40.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391010c180 msgr2=0x7f391019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:40.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391010c180 0x7f391019cd80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f390800b970 tx=0x7f390800be30 comp rx=0 tx=0).stop 2024-09-19T06:50:40.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 shutdown_connections 2024-09-19T06:50:40.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38fc0a33b0 0x7f38fc0a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:40.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391010c180 0x7f391019cd80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:40.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39101036c0 0x7f39101989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:40.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 --2- 172.21.15.159:0/1085831699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3910102da0 0x7f39101984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:40.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 >> 172.21.15.159:0/1085831699 conn(0x7f39100fc7a0 msgr2=0x7f39100fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:40.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 shutdown_connections 2024-09-19T06:50:40.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:40.184+0000 7f3915384640 1 -- 172.21.15.159:0/1085831699 wait complete. 2024-09-19T06:50:40.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:40 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1085831699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:40.633 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:40 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1085831699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:40.637 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:40 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1085831699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:40.995 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id a2b991a9 --release --await' 2024-09-19T06:50:40.995 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id a2b991a9 --release --await 2024-09-19T06:50:41.289 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:41.546 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:41 smithi159 ceph-mon[30935]: pgmap v115: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 136 op/s 2024-09-19T06:50:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:41 smithi203 ceph-mon[35473]: pgmap v115: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 136 op/s 2024-09-19T06:50:41.638 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:41 smithi189 ceph-mon[34880]: pgmap v115: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 136 op/s 2024-09-19T06:50:41.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.771+0000 7fe16b619640 1 -- 172.21.15.159:0/730927170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 msgr2=0x7fe164106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:41.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.771+0000 7fe16b619640 1 --2- 172.21.15.159:0/730927170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 0x7fe164106e60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe154009930 tx=0x7fe15402a420 comp rx=0 tx=0).stop 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.771+0000 7fe16b619640 1 -- 172.21.15.159:0/730927170 shutdown_connections 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.771+0000 7fe16b619640 1 --2- 172.21.15.159:0/730927170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe164101420 0x7fe16410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.771+0000 7fe16b619640 1 --2- 172.21.15.159:0/730927170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe164100a80 0x7fe164100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.771+0000 7fe16b619640 1 --2- 172.21.15.159:0/730927170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 0x7fe164106e60 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.771+0000 7fe16b619640 1 -- 172.21.15.159:0/730927170 >> 172.21.15.159:0/730927170 conn(0x7fe1640fc7a0 msgr2=0x7fe1640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.771+0000 7fe16b619640 1 -- 172.21.15.159:0/730927170 shutdown_connections 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.771+0000 7fe16b619640 1 -- 172.21.15.159:0/730927170 wait complete. 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.772+0000 7fe16b619640 1 Processor -- start 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.772+0000 7fe16b619640 1 -- start start 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.772+0000 7fe16b619640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe164100a80 0x7fe164197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.772+0000 7fe16b619640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe164101420 0x7fe164197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.772+0000 7fe16b619640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 0x7fe16419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.772+0000 7fe16b619640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe164110f20 con 0x7fe164106a80 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.772+0000 7fe16b619640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe164110da0 con 0x7fe164101420 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.772+0000 7fe16b619640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641110a0 con 0x7fe164100a80 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe169bb6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 0x7fe16419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe169bb6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 0x7fe16419bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37500/0 (socket says 172.21.15.159:37500) 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe169bb6640 1 -- 172.21.15.159:0/2122800319 learned_addr learned my addr 172.21.15.159:0/2122800319 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe168bb4640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe164101420 0x7fe164197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe1693b5640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe164100a80 0x7fe164197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe169bb6640 1 -- 172.21.15.159:0/2122800319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe164100a80 msgr2=0x7fe164197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:41.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe169bb6640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe164100a80 0x7fe164197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe169bb6640 1 -- 172.21.15.159:0/2122800319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe164101420 msgr2=0x7fe164197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe169bb6640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe164101420 0x7fe164197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe169bb6640 1 -- 172.21.15.159:0/2122800319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16419c4b0 con 0x7fe164106a80 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe1693b5640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe164100a80 0x7fe164197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe169bb6640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 0x7fe16419bdd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00b970 tx=0x7fe15c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe15a7fc640 1 -- 172.21.15.159:0/2122800319 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c019070 con 0x7fe164106a80 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe15a7fc640 1 -- 172.21.15.159:0/2122800319 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe15c00cb40 con 0x7fe164106a80 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe16b619640 1 -- 172.21.15.159:0/2122800319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16419c7a0 con 0x7fe164106a80 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe15a7fc640 1 -- 172.21.15.159:0/2122800319 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c007650 con 0x7fe164106a80 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.773+0000 7fe16b619640 1 -- 172.21.15.159:0/2122800319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1641a4080 con 0x7fe164106a80 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.775+0000 7fe15a7fc640 1 -- 172.21.15.159:0/2122800319 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe15c01c070 con 0x7fe164106a80 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe16d9f2740 1 Processor -- start 2024-09-19T06:50:41.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe16d9f2740 1 -- start start 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfff9d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 0x55dcfffa7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 0x55dcfffaa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55dcfff00620 con 0x55dcfff9d270 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dcffea7e50 con 0x55dcfffa8450 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dcffefc5e0 con 0x55dcfff9db90 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe168bb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfff9d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe168bb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfff9d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37514/0 (socket says 172.21.15.159:37514) 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe168bb4640 1 -- 172.21.15.159:0/143410486 learned_addr learned my addr 172.21.15.159:0/143410486 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe15a7fc640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe1500a33b0 0x7fe1500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.776+0000 7fe1693b5640 1 --2- 172.21.15.159:0/143410486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 0x55dcfffa7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe168bb4640 1 --2- 172.21.15.159:0/143410486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 0x55dcfffaa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe169bb6640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe1500a33b0 0x7fe1500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe168bb4640 1 -- 172.21.15.159:0/143410486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 msgr2=0x55dcfffa7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe168bb4640 1 --2- 172.21.15.159:0/143410486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 0x55dcfffa7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe168bb4640 1 -- 172.21.15.159:0/143410486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 msgr2=0x55dcfffaa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe168bb4640 1 --2- 172.21.15.159:0/143410486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 0x55dcfffaa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe168bb4640 1 -- 172.21.15.159:0/143410486 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcffe98d40 con 0x55dcfff9d270 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe15a7fc640 1 -- 172.21.15.159:0/2122800319 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe15c0cf2e0 con 0x7fe164106a80 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe168bb4640 1 --2- 172.21.15.159:0/143410486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfff9d650 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe160006e10 tx=0x7fe160009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86ef180f5aa92d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe169bb6640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe1500a33b0 0x7fe1500a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0ccbc0 tx=0x7fe15c09f040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe14f7fe640 1 -- 172.21.15.159:0/143410486 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16001c070 con 0x55dcfff9d270 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe14f7fe640 1 -- 172.21.15.159:0/143410486 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe160010040 con 0x55dcfff9d270 2024-09-19T06:50:41.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.777+0000 7fe14f7fe640 1 -- 172.21.15.159:0/143410486 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1600146f0 con 0x55dcfff9d270 2024-09-19T06:50:41.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 -- 172.21.15.159:0/143410486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 msgr2=0x55dcfff9d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:41.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/143410486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfff9d650 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe160006e10 tx=0x7fe160009420 comp rx=0 tx=0).stop 2024-09-19T06:50:41.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 -- 172.21.15.159:0/143410486 shutdown_connections 2024-09-19T06:50:41.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/143410486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 0x55dcfffaa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/143410486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 0x55dcfffa7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/143410486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfff9d650 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 -- 172.21.15.159:0/143410486 >> 172.21.15.159:0/143410486 conn(0x55dcfff99800 msgr2=0x55dcfff99be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:41.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 -- 172.21.15.159:0/143410486 shutdown_connections 2024-09-19T06:50:41.790 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 -- 172.21.15.159:0/143410486 wait complete. 2024-09-19T06:50:41.790 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 -- start start 2024-09-19T06:50:41.790 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.778+0000 7fe16d9f2740 1 Processor -- start 2024-09-19T06:50:41.790 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfffa5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.790 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 0x55dcfffa5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.790 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 0x55dcfffa5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.790 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55dcfffab020 con 0x55dcfff9d270 2024-09-19T06:50:41.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dcffe88f10 con 0x55dcfffa8450 2024-09-19T06:50:41.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dcfffab1a0 con 0x55dcfff9db90 2024-09-19T06:50:41.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe16d9f2740 10 client.0 _ll_register_callbacks cb 0x55dcffeacdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:41.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfffa5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfffa5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37524/0 (socket says 172.21.15.159:37524) 2024-09-19T06:50:41.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 -- 172.21.15.159:0/388509220 learned_addr learned my addr 172.21.15.159:0/388509220 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:41.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe1693b5640 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 0x55dcfffa5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 0x55dcfffa5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 -- 172.21.15.159:0/388509220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 msgr2=0x55dcfffa5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:41.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 0x55dcfffa5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 -- 172.21.15.159:0/388509220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 msgr2=0x55dcfffa5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:41.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 0x55dcfffa5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 -- 172.21.15.159:0/388509220 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcffc0f580 con 0x55dcfff9d270 2024-09-19T06:50:41.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe168bb4640 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfffa5400 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe160017fd0 tx=0x7fe1600143b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2264f16418b4997c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:41.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.779+0000 7fe14cff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:41.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe14cff9640 1 -- 172.21.15.159:0/388509220 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16002b060 con 0x55dcfff9d270 2024-09-19T06:50:41.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe14cff9640 1 -- 172.21.15.159:0/388509220 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe160014490 con 0x55dcfff9d270 2024-09-19T06:50:41.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe16d9f2740 1 -- 172.21.15.159:0/388509220 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe160010040 con 0x55dcfff9d270 2024-09-19T06:50:41.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe14cff9640 1 -- 172.21.15.159:0/388509220 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe16001c040 con 0x55dcfff9d270 2024-09-19T06:50:41.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe16d9f2740 10 client.16221 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:41.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe16d9f2740 1 -- 172.21.15.159:0/388509220 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dcffcd9960 con 0x55dcfff9d270 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe14cff9640 1 -- 172.21.15.159:0/388509220 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe160010040 con 0x55dcfff9d270 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe14cff9640 1 -- 172.21.15.159:0/388509220 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe160024440 con 0x55dcfff9d270 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe16d9f2740 10 client.16221 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe16d9f2740 10 client.16221 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe16d9f2740 20 client.16221 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dcfffb8160 0x55dcfffba550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe16d9f2740 4 client.16221 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.780+0000 7fe16d9f2740 1 -- 172.21.15.159:0/388509220 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcfff0db90 con 0x55dcfffb8160 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.781+0000 7fe1693b5640 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dcfffb8160 0x55dcfffba550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.781+0000 7fe1693b5640 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dcfffb8160 0x55dcfffba550 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bfdc02690aef5a5 server_cookie=f7dd49ed62cfb789 in_seq=0 out_seq=0 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.781+0000 7fe14cff9640 10 client.16221 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe14cff9640 1 -- 172.21.15.159:0/388509220 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dcfff0db90 con 0x55dcfffb8160 2024-09-19T06:50:41.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe14cff9640 10 client.16221 handle_command_reply: tid=0 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 client.16221 shutdown 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 -- 172.21.15.159:0/388509220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 msgr2=0x55dcfffa5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfffa5400 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe160017fd0 tx=0x7fe1600143b0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 -- 172.21.15.159:0/388509220 shutdown_connections 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dcfffb8160 0x55dcfffba550 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa8450 0x55dcfffa5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe14cff9640 0 client.16221 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfff9db90 0x55dcfffa5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/388509220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9d270 0x55dcfffa5400 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 -- 172.21.15.159:0/388509220 >> 172.21.15.159:0/388509220 conn(0x55dcfff99800 msgr2=0x55dcfff96750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 -- 172.21.15.159:0/388509220 shutdown_connections 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 1 -- 172.21.15.159:0/388509220 wait complete. 2024-09-19T06:50:41.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.782+0000 7fe16d9f2740 20 client.16221 trim_cache size 0 max 16384 2024-09-19T06:50:41.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe16d9f2740 1 Processor -- start 2024-09-19T06:50:41.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe16d9f2740 1 -- start start 2024-09-19T06:50:41.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9db90 0x55dcfffa72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 0x55dcfffa2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa2ba0 0x55dcfffa3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641a98a0 con 0x55dcfff9db90 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641ac120 con 0x55dcfffa2ba0 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641a9f10 con 0x55dcfffa8450 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe168bb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9db90 0x55dcfffa72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe168bb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9db90 0x55dcfffa72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37534/0 (socket says 172.21.15.159:37534) 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe168bb4640 1 -- 172.21.15.159:0/3432185091 learned_addr learned my addr 172.21.15.159:0/3432185091 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe1693b5640 1 --2- 172.21.15.159:0/3432185091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 0x55dcfffa2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe168bb4640 1 -- 172.21.15.159:0/3432185091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 msgr2=0x55dcfffa2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe168bb4640 1 --2- 172.21.15.159:0/3432185091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 0x55dcfffa2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe168bb4640 1 -- 172.21.15.159:0/3432185091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa2ba0 msgr2=0x55dcfffa3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.799+0000 7fe168bb4640 1 --2- 172.21.15.159:0/3432185091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa2ba0 0x55dcfffa3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.800+0000 7fe168bb4640 1 -- 172.21.15.159:0/3432185091 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfff9a490 con 0x55dcfff9db90 2024-09-19T06:50:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.800+0000 7fe1693b5640 1 --2- 172.21.15.159:0/3432185091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 0x55dcfffa2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.800+0000 7fe168bb4640 1 --2- 172.21.15.159:0/3432185091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9db90 0x55dcfffa72d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe160004810 tx=0x7fe16000f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1566ca85c98133e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.800+0000 7fe14effd640 1 -- 172.21.15.159:0/3432185091 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160006ca0 con 0x55dcfff9db90 2024-09-19T06:50:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.800+0000 7fe14effd640 1 -- 172.21.15.159:0/3432185091 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe160009380 con 0x55dcfff9db90 2024-09-19T06:50:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.800+0000 7fe14effd640 1 -- 172.21.15.159:0/3432185091 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16002f920 con 0x55dcfff9db90 2024-09-19T06:50:41.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3432185091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9db90 msgr2=0x55dcfffa72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3432185091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9db90 0x55dcfffa72d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe160004810 tx=0x7fe16000f9e0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3432185091 shutdown_connections 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3432185091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa2ba0 0x55dcfffa3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3432185091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 0x55dcfffa2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3432185091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfff9db90 0x55dcfffa72d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3432185091 >> 172.21.15.159:0/3432185091 conn(0x55dcfff99800 msgr2=0x55dcfff96750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3432185091 shutdown_connections 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3432185091 wait complete. 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 -- start start 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 Processor -- start 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.801+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa2ba0 0x55dcfffba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 0x55dcfffba740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe16d9f2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfffbac80 0x55dd0001ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641aa5e0 con 0x55dcfffbac80 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641aba50 con 0x55dcfffa2ba0 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe16d9f2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641aacb0 con 0x55dcfffa8450 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe16d9f2740 10 client.0 _ll_register_callbacks cb 0x7fe160009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfffbac80 0x55dd0001ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfffbac80 0x55dd0001ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37550/0 (socket says 172.21.15.159:37550) 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 -- 172.21.15.159:0/3163676904 learned_addr learned my addr 172.21.15.159:0/3163676904 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe1693b5640 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 0x55dcfffba740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa2ba0 0x55dcfffba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 -- 172.21.15.159:0/3163676904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 msgr2=0x55dcfffba740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 0x55dcfffba740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 -- 172.21.15.159:0/3163676904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa2ba0 msgr2=0x55dcfffba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa2ba0 0x55dcfffba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 -- 172.21.15.159:0/3163676904 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfffbe220 con 0x55dcfffbac80 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe168bb4640 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfffbac80 0x55dd0001ca70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe1600249b0 tx=0x7fe160008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236ae9f4f2a0a773 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe14cff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe14cff9640 1 -- 172.21.15.159:0/3163676904 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16003d070 con 0x55dcfffbac80 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe14cff9640 1 -- 172.21.15.159:0/3163676904 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe16002fb40 con 0x55dcfffbac80 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.802+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3163676904 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe160009380 con 0x55dcfffbac80 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe14cff9640 1 -- 172.21.15.159:0/3163676904 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe160024c30 con 0x55dcfffbac80 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe16d9f2740 10 client.16227 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:41.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3163676904 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dd0001e0c0 con 0x55dcfffbac80 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe14cff9640 1 -- 172.21.15.159:0/3163676904 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe160009380 con 0x55dcfffbac80 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe14cff9640 1 -- 172.21.15.159:0/3163676904 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe16004a4c0 con 0x55dcfffbac80 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe16d9f2740 10 client.16227 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe16d9f2740 10 client.16227 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe16d9f2740 20 client.16227 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dd00026ea0 0x55dd00029290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe16d9f2740 4 client.16227 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a2b991a9", "release": true, "await": true}] 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3163676904 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a2b991a9", "release": true, "await": true}) -- 0x55dcfff92950 con 0x55dd00026ea0 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.803+0000 7fe1693b5640 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dd00026ea0 0x55dd00029290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.804+0000 7fe14cff9640 10 client.16227 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.804+0000 7fe1693b5640 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dd00026ea0 0x55dd00029290 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=887c5486933399ec server_cookie=80419783a380659d in_seq=0 out_seq=0 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe14cff9640 1 -- 172.21.15.159:0/3163676904 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55dcfff92950 con 0x55dd00026ea0 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe14cff9640 10 client.16227 handle_command_reply: tid=0 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 client.16227 shutdown 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3163676904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfffbac80 msgr2=0x55dd0001ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfffbac80 0x55dd0001ca70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe1600249b0 tx=0x7fe160008040 comp rx=0 tx=0).stop 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3163676904 shutdown_connections 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55dd00026ea0 0x55dd00029290 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dcfffbac80 0x55dd0001ca70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcfffa8450 0x55dcfffba740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe14cff9640 0 client.16227 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:41.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 --2- 172.21.15.159:0/3163676904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dcfffa2ba0 0x55dcfffba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3163676904 >> 172.21.15.159:0/3163676904 conn(0x55dcfff99800 msgr2=0x55dcfffb33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:41.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3163676904 shutdown_connections 2024-09-19T06:50:41.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 1 -- 172.21.15.159:0/3163676904 wait complete. 2024-09-19T06:50:41.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.989+0000 7fe16d9f2740 20 client.16227 trim_cache size 0 max 16384 2024-09-19T06:50:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 24, 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 16, 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "a2b991a9": { 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 16, 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:50:41.993 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 136.6, 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:50:41.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 -- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe1500a33b0 msgr2=0x7fe1500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:41.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe1500a33b0 0x7fe1500a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0ccbc0 tx=0x7fe15c09f040 comp rx=0 tx=0).stop 2024-09-19T06:50:41.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 -- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 msgr2=0x7fe16419bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:41.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 0x7fe16419bdd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00b970 tx=0x7fe15c00be30 comp rx=0 tx=0).stop 2024-09-19T06:50:41.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 -- 172.21.15.159:0/2122800319 shutdown_connections 2024-09-19T06:50:41.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe1500a33b0 0x7fe1500a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe164106a80 0x7fe16419bdd0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe164101420 0x7fe164197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 --2- 172.21.15.159:0/2122800319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe164100a80 0x7fe164197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:41.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 -- 172.21.15.159:0/2122800319 >> 172.21.15.159:0/2122800319 conn(0x7fe1640fc7a0 msgr2=0x7fe1640fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:41.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 -- 172.21.15.159:0/2122800319 shutdown_connections 2024-09-19T06:50:41.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:41.990+0000 7fe16b619640 1 -- 172.21.15.159:0/2122800319 wait complete. 2024-09-19T06:50:42.843 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a2b991a9', total seconds elapsed: 20.4 2024-09-19T06:50:43.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:42 smithi203 ceph-mon[35473]: pgmap v116: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 353 KiB/s wr, 137 op/s 2024-09-19T06:50:43.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:42 smithi189 ceph-mon[34880]: pgmap v116: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 353 KiB/s wr, 137 op/s 2024-09-19T06:50:43.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:42 smithi159 ceph-mon[30935]: pgmap v116: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 353 KiB/s wr, 137 op/s 2024-09-19T06:50:44.638 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:50:44.907 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:45.029 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:44 smithi159 ceph-mon[30935]: pgmap v117: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 88 KiB/s wr, 48 op/s 2024-09-19T06:50:45.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:44 smithi203 ceph-mon[35473]: pgmap v117: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 88 KiB/s wr, 48 op/s 2024-09-19T06:50:45.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:44 smithi189 ceph-mon[34880]: pgmap v117: 97 pgs: 97 active+clean; 37 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 88 KiB/s wr, 48 op/s 2024-09-19T06:50:45.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.558+0000 7fab122e6640 1 -- 172.21.15.159:0/284292238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab0c102d90 msgr2=0x7fab0c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.558+0000 7fab122e6640 1 --2- 172.21.15.159:0/284292238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab0c102d90 0x7fab0c103170 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faafc009930 tx=0x7faafc02a420 comp rx=0 tx=0).stop 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.558+0000 7fab122e6640 1 -- 172.21.15.159:0/284292238 shutdown_connections 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.558+0000 7fab122e6640 1 --2- 172.21.15.159:0/284292238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab0c108290 0x7fab0c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.558+0000 7fab122e6640 1 --2- 172.21.15.159:0/284292238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab0c103740 0x7fab0c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.558+0000 7fab122e6640 1 --2- 172.21.15.159:0/284292238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab0c102d90 0x7fab0c103170 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.558+0000 7fab122e6640 1 -- 172.21.15.159:0/284292238 >> 172.21.15.159:0/284292238 conn(0x7fab0c0fc7d0 msgr2=0x7fab0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.558+0000 7fab122e6640 1 -- 172.21.15.159:0/284292238 shutdown_connections 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.558+0000 7fab122e6640 1 -- 172.21.15.159:0/284292238 wait complete. 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.559+0000 7fab122e6640 1 Processor -- start 2024-09-19T06:50:45.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.559+0000 7fab122e6640 1 -- start start 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab122e6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab0c102d90 0x7fab0c1a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab122e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab0c103740 0x7fab0c1a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab122e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab0c108290 0x7fab0c10de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab122e6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c112090 con 0x7fab0c108290 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab122e6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c111f10 con 0x7fab0c102d90 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab122e6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c112210 con 0x7fab0c103740 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab0c102d90 0x7fab0c1a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab0c103740 0x7fab0c1a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab0c102d90 0x7fab0c1a4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:44158/0 (socket says 172.21.15.159:44158) 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0bfff640 1 -- 172.21.15.159:0/2724443542 learned_addr learned my addr 172.21.15.159:0/2724443542 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab10883640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab0c108290 0x7fab0c10de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0b7fe640 1 -- 172.21.15.159:0/2724443542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab0c102d90 msgr2=0x7fab0c1a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:45.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab0c102d90 0x7fab0c1a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0b7fe640 1 -- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab0c108290 msgr2=0x7fab0c10de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab0c108290 0x7fab0c10de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0b7fe640 1 -- 172.21.15.159:0/2724443542 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c10e700 con 0x7fab0c103740 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0bfff640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab0c102d90 0x7fab0c1a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab10883640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab0c108290 0x7fab0c10de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.560+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab0c103740 0x7fab0c1a4e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab0000d6a0 tx=0x7fab0000daa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.561+0000 7fab097fa640 1 -- 172.21.15.159:0/2724443542 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00017070 con 0x7fab0c103740 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.561+0000 7fab097fa640 1 -- 172.21.15.159:0/2724443542 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab000047a0 con 0x7fab0c103740 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.561+0000 7fab122e6640 1 -- 172.21.15.159:0/2724443542 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab0c10e9f0 con 0x7fab0c103740 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.561+0000 7fab097fa640 1 -- 172.21.15.159:0/2724443542 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00009c10 con 0x7fab0c103740 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.561+0000 7fab122e6640 1 -- 172.21.15.159:0/2724443542 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab0c1ab880 con 0x7fab0c103740 2024-09-19T06:50:45.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.563+0000 7fab146bf740 1 Processor -- start 2024-09-19T06:50:45.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.563+0000 7fab146bf740 1 -- start start 2024-09-19T06:50:45.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.563+0000 7fab097fa640 1 -- 172.21.15.159:0/2724443542 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fab00004cc0 con 0x7fab0c103740 2024-09-19T06:50:45.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.563+0000 7fab146bf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 0x55a55775e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.563+0000 7fab146bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557769140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab146bf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55776ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab146bf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a5576c42e0 con 0x55a557769680 2024-09-19T06:50:45.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab146bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a55766bce0 con 0x55a55775edc0 2024-09-19T06:50:45.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab146bf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a5576c02a0 con 0x55a55775e4a0 2024-09-19T06:50:45.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab10883640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 0x55a55775e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557769140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55776ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557769140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:44172/0 (socket says 172.21.15.159:44172) 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab10883640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 0x55a55775e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:58916/0 (socket says 172.21.15.159:58916) 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0bfff640 1 -- 172.21.15.159:0/159332112 learned_addr learned my addr 172.21.15.159:0/159332112 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0bfff640 1 -- 172.21.15.159:0/159332112 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 msgr2=0x55a55775e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0bfff640 1 --2- 172.21.15.159:0/159332112 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 0x55a55775e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0bfff640 1 -- 172.21.15.159:0/159332112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 msgr2=0x55a55776ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0bfff640 1 --2- 172.21.15.159:0/159332112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55776ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0bfff640 1 -- 172.21.15.159:0/159332112 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a557650440 con 0x55a55775edc0 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab097fa640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7faaf40a33b0 0x7faaf40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab0bfff640 1 --2- 172.21.15.159:0/159332112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557769140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faafc006010 tx=0x7faafc005e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6630b9a4794e6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:45.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab10883640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7faaf40a33b0 0x7faaf40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7fab097fa640 1 -- 172.21.15.159:0/2724443542 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fab000cf8d0 con 0x7fab0c103740 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7faaf27fc640 1 -- 172.21.15.159:0/159332112 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc035040 con 0x55a55775edc0 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.564+0000 7faaf27fc640 1 -- 172.21.15.159:0/159332112 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faafc0318e0 con 0x55a55775edc0 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7faaf27fc640 1 -- 172.21.15.159:0/159332112 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc004a00 con 0x55a55775edc0 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab146bf740 1 -- 172.21.15.159:0/159332112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 msgr2=0x55a557769140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab146bf740 1 --2- 172.21.15.159:0/159332112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557769140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faafc006010 tx=0x7faafc005e70 comp rx=0 tx=0).stop 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab10883640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7faaf40a33b0 0x7faaf40a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab04005fd0 tx=0x7fab04009500 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab146bf740 1 -- 172.21.15.159:0/159332112 shutdown_connections 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab146bf740 1 --2- 172.21.15.159:0/159332112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55776ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab146bf740 1 --2- 172.21.15.159:0/159332112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557769140 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab146bf740 1 --2- 172.21.15.159:0/159332112 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 0x55a55775e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab146bf740 1 -- 172.21.15.159:0/159332112 >> 172.21.15.159:0/159332112 conn(0x55a55775aa30 msgr2=0x55a55775ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab146bf740 1 -- 172.21.15.159:0/159332112 shutdown_connections 2024-09-19T06:50:45.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.565+0000 7fab146bf740 1 -- 172.21.15.159:0/159332112 wait complete. 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab146bf740 1 -- start start 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab146bf740 1 Processor -- start 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab146bf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a557768fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab146bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557766280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab146bf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a557769680 0x55a5577667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab146bf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a55776c250 con 0x55a55775e4a0 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab146bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a55767f050 con 0x55a55775edc0 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab146bf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a55776c3d0 con 0x55a557769680 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab146bf740 10 client.0 _ll_register_callbacks cb 0x55a5576bf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a557768fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a557768fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37608/0 (socket says 172.21.15.159:37608) 2024-09-19T06:50:45.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab0bfff640 1 -- 172.21.15.159:0/526779057 learned_addr learned my addr 172.21.15.159:0/526779057 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557766280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.566+0000 7fab10883640 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a557769680 0x55a5577667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab0bfff640 1 -- 172.21.15.159:0/526779057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a557769680 msgr2=0x55a5577667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab0bfff640 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a557769680 0x55a5577667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab0bfff640 1 -- 172.21.15.159:0/526779057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 msgr2=0x55a557766280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab0bfff640 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557766280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab0bfff640 1 -- 172.21.15.159:0/526779057 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5574353c0 con 0x55a55775e4a0 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557766280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab0bfff640 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a557768fd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7faafc0315b0 tx=0x7faafc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf75e88eae1937eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7faaeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:45.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7faaeb7fe640 1 -- 172.21.15.159:0/526779057 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc04e070 con 0x55a55775e4a0 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7faaeb7fe640 1 -- 172.21.15.159:0/526779057 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7faafc0035f0 con 0x55a55775e4a0 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab146bf740 1 -- 172.21.15.159:0/526779057 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faafc0318e0 con 0x55a55775e4a0 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7faaeb7fe640 1 -- 172.21.15.159:0/526779057 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faafc05a050 con 0x55a55775e4a0 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab146bf740 10 client.16239 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7fab146bf740 1 -- 172.21.15.159:0/526779057 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a557777c20 con 0x55a55775e4a0 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.567+0000 7faaeb7fe640 1 -- 172.21.15.159:0/526779057 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faafc0318e0 con 0x55a55775e4a0 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7faaeb7fe640 1 -- 172.21.15.159:0/526779057 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7faafc004870 con 0x55a55775e4a0 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7fab146bf740 10 client.16239 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7fab146bf740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7fab146bf740 20 client.16239 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7fab146bf740 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a557778f70 0x55a55777b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7fab146bf740 4 client.16239 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:45.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7fab146bf740 1 -- 172.21.15.159:0/526779057 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5576d1850 con 0x55a557778f70 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a557778f70 0x55a55777b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7faaeb7fe640 10 client.16239 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.568+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a557778f70 0x55a55777b360 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63fbc3f53c0eb29f server_cookie=1bd2620c32fd1b4e in_seq=0 out_seq=0 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7faaeb7fe640 1 -- 172.21.15.159:0/526779057 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5576d1850 con 0x55a557778f70 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7faaeb7fe640 10 client.16239 handle_command_reply: tid=0 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 client.16239 shutdown 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 -- 172.21.15.159:0/526779057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 msgr2=0x55a557768fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a557768fd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7faafc0315b0 tx=0x7faafc004270 comp rx=0 tx=0).stop 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 -- 172.21.15.159:0/526779057 shutdown_connections 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a557778f70 0x55a55777b360 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a557769680 0x55a5577667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557766280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 --2- 172.21.15.159:0/526779057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a557768fd0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7faaeb7fe640 0 client.16239 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:45.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 -- 172.21.15.159:0/526779057 >> 172.21.15.159:0/526779057 conn(0x55a55775aa30 msgr2=0x55a557760710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:45.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 -- 172.21.15.159:0/526779057 shutdown_connections 2024-09-19T06:50:45.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 1 -- 172.21.15.159:0/526779057 wait complete. 2024-09-19T06:50:45.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.569+0000 7fab146bf740 20 client.16239 trim_cache size 0 max 16384 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab146bf740 1 Processor -- start 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab146bf740 1 -- start start 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab146bf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 0x55a5577754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab146bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557765b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab146bf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55775ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab146bf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c1b1eb0 con 0x55a557769680 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab146bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c1b4730 con 0x55a55775edc0 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab146bf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c1b2520 con 0x55a55775e4a0 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab10883640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55775ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab0b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557765b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab10883640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55775ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37622/0 (socket says 172.21.15.159:37622) 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab10883640 1 -- 172.21.15.159:0/1146815437 learned_addr learned my addr 172.21.15.159:0/1146815437 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab10883640 1 -- 172.21.15.159:0/1146815437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 msgr2=0x55a5577754b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab10883640 1 --2- 172.21.15.159:0/1146815437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 0x55a5577754b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab10883640 1 -- 172.21.15.159:0/1146815437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 msgr2=0x55a557765b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab10883640 1 --2- 172.21.15.159:0/1146815437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557765b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab10883640 1 -- 172.21.15.159:0/1146815437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a557766b50 con 0x55a557769680 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.589+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/1146815437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557765b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.590+0000 7fab10883640 1 --2- 172.21.15.159:0/1146815437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55775ae10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fab0400fc90 tx=0x7fab04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5209bf4633b376fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.590+0000 7faaf1ffb640 1 -- 172.21.15.159:0/1146815437 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0401d890 con 0x55a557769680 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.590+0000 7faaf1ffb640 1 -- 172.21.15.159:0/1146815437 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab0402e070 con 0x55a557769680 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.590+0000 7faaf1ffb640 1 -- 172.21.15.159:0/1146815437 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04029e60 con 0x55a557769680 2024-09-19T06:50:45.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 -- 172.21.15.159:0/1146815437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 msgr2=0x55a55775ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 --2- 172.21.15.159:0/1146815437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55775ae10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fab0400fc90 tx=0x7fab04017000 comp rx=0 tx=0).stop 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 -- 172.21.15.159:0/1146815437 shutdown_connections 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 --2- 172.21.15.159:0/1146815437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a557769680 0x55a55775ae10 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 --2- 172.21.15.159:0/1146815437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a55775edc0 0x55a557765b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 --2- 172.21.15.159:0/1146815437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775e4a0 0x55a5577754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 -- 172.21.15.159:0/1146815437 >> 172.21.15.159:0/1146815437 conn(0x55a55775aa30 msgr2=0x55a557760710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 -- 172.21.15.159:0/1146815437 shutdown_connections 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 -- 172.21.15.159:0/1146815437 wait complete. 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.591+0000 7fab146bf740 1 -- start start 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab146bf740 1 Processor -- start 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab146bf740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a55776cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab146bf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775edc0 0x55a55776d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab146bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a557769680 0x55a557771440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab146bf740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c1b2bf0 con 0x55a55775e4a0 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab146bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c1b4060 con 0x55a557769680 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab146bf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c1b32c0 con 0x55a55775edc0 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab146bf740 10 client.0 _ll_register_callbacks cb 0x7faafc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a55776cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a55776cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37636/0 (socket says 172.21.15.159:37636) 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab0bfff640 1 -- 172.21.15.159:0/1086211977 learned_addr learned my addr 172.21.15.159:0/1086211977 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775edc0 0x55a55776d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab10883640 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a557769680 0x55a557771440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab0bfff640 1 -- 172.21.15.159:0/1086211977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775edc0 msgr2=0x55a55776d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab0bfff640 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775edc0 0x55a55776d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab0bfff640 1 -- 172.21.15.159:0/1086211977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a557769680 msgr2=0x55a557771440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:45.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab0bfff640 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a557769680 0x55a557771440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab0bfff640 1 -- 172.21.15.159:0/1086211977 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a557771b30 con 0x55a55775e4a0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.592+0000 7fab10883640 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a557769680 0x55a557771440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab0bfff640 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a55776cdc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7faafc006010 tx=0x7faafc0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43a33ea6167cdf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7faaeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7faaeb7fe640 1 -- 172.21.15.159:0/1086211977 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc04e040 con 0x55a55775e4a0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7faaeb7fe640 1 -- 172.21.15.159:0/1086211977 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7faafc0046e0 con 0x55a55775e4a0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab146bf740 1 -- 172.21.15.159:0/1086211977 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab0402e070 con 0x55a55775e4a0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7faaeb7fe640 1 -- 172.21.15.159:0/1086211977 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faafc065050 con 0x55a55775e4a0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab146bf740 10 client.16245 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab146bf740 1 -- 172.21.15.159:0/1086211977 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5577e3510 con 0x55a55775e4a0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7faaeb7fe640 1 -- 172.21.15.159:0/1086211977 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab0402e070 con 0x55a55775e4a0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7faaeb7fe640 1 -- 172.21.15.159:0/1086211977 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7faafc0035f0 con 0x55a55775e4a0 2024-09-19T06:50:45.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab146bf740 10 client.16245 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab146bf740 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab146bf740 20 client.16245 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab146bf740 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a5577e3c60 0x55a5577e6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab146bf740 4 client.16245 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.593+0000 7fab146bf740 1 -- 172.21.15.159:0/1086211977 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5576cbd60 con 0x55a5577e3c60 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.594+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a5577e3c60 0x55a5577e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.594+0000 7faaeb7fe640 10 client.16245 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.594+0000 7fab0b7fe640 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a5577e3c60 0x55a5577e6080 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0754407e3b83272 server_cookie=bb868ee3900685ce in_seq=0 out_seq=0 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.594+0000 7faaeb7fe640 1 -- 172.21.15.159:0/1086211977 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a5576cbd60 con 0x55a5577e3c60 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.594+0000 7faaeb7fe640 10 client.16245 handle_command_reply: tid=0 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.594+0000 7fab146bf740 1 client.16245 shutdown 2024-09-19T06:50:45.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 -- 172.21.15.159:0/1086211977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 msgr2=0x55a55776cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a55776cdc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7faafc006010 tx=0x7faafc0042e0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 -- 172.21.15.159:0/1086211977 shutdown_connections 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a5577e3c60 0x55a5577e6080 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a557769680 0x55a557771440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a55775edc0 0x55a55776d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 --2- 172.21.15.159:0/1086211977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a55775e4a0 0x55a55776cdc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 -- 172.21.15.159:0/1086211977 >> 172.21.15.159:0/1086211977 conn(0x55a55775aa30 msgr2=0x55a55775fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7faaeb7fe640 0 client.16245 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 -- 172.21.15.159:0/1086211977 shutdown_connections 2024-09-19T06:50:45.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 1 -- 172.21.15.159:0/1086211977 wait complete. 2024-09-19T06:50:45.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.595+0000 7fab146bf740 20 client.16245 trim_cache size 0 max 16384 2024-09-19T06:50:45.604 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:50:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:50:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:50:45.604 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:50:45.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 -- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7faaf40a33b0 msgr2=0x7faaf40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:45.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7faaf40a33b0 0x7faaf40a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab04005fd0 tx=0x7fab04009500 comp rx=0 tx=0).stop 2024-09-19T06:50:45.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 -- 172.21.15.159:0/2724443542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab0c103740 msgr2=0x7fab0c1a4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:45.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab0c103740 0x7fab0c1a4e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab0000d6a0 tx=0x7fab0000daa0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 -- 172.21.15.159:0/2724443542 shutdown_connections 2024-09-19T06:50:45.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7faaf40a33b0 0x7faaf40a5870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab0c108290 0x7fab0c10de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab0c103740 0x7fab0c1a4e90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 --2- 172.21.15.159:0/2724443542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab0c102d90 0x7fab0c1a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:45.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 -- 172.21.15.159:0/2724443542 >> 172.21.15.159:0/2724443542 conn(0x7fab0c0fc7d0 msgr2=0x7fab0c1009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:45.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 -- 172.21.15.159:0/2724443542 shutdown_connections 2024-09-19T06:50:45.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:45.596+0000 7fab122e6640 1 -- 172.21.15.159:0/2724443542 wait complete. 2024-09-19T06:50:46.410 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:50:46.410 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:50:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.494+0000 7f990de65640 1 -- 172.21.15.159:0/2386127702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9908101d70 msgr2=0x7f99081021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.494+0000 7f990de65640 1 --2- 172.21.15.159:0/2386127702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9908101d70 0x7f99081021b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009930 tx=0x7f98fc02a420 comp rx=0 tx=0).stop 2024-09-19T06:50:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.494+0000 7f990de65640 1 -- 172.21.15.159:0/2386127702 shutdown_connections 2024-09-19T06:50:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.494+0000 7f990de65640 1 --2- 172.21.15.159:0/2386127702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99081026f0 0x7f990810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.494+0000 7f990de65640 1 --2- 172.21.15.159:0/2386127702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9908101d70 0x7f99081021b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.494+0000 7f990de65640 1 --2- 172.21.15.159:0/2386127702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9908100490 0x7f9908100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.494+0000 7f990de65640 1 -- 172.21.15.159:0/2386127702 >> 172.21.15.159:0/2386127702 conn(0x7f99080770f0 msgr2=0x7f99080fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.494+0000 7f990de65640 1 -- 172.21.15.159:0/2386127702 shutdown_connections 2024-09-19T06:50:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.494+0000 7f990de65640 1 -- 172.21.15.159:0/2386127702 wait complete. 2024-09-19T06:50:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f990de65640 1 Processor -- start 2024-09-19T06:50:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f990de65640 1 -- start start 2024-09-19T06:50:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f990de65640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9908100490 0x7f9908198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f990de65640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9908101d70 0x7f9908198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f990de65640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99081026f0 0x7f990819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.500 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f990de65640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f990810fe20 con 0x7f9908100490 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f990de65640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f990810fca0 con 0x7f99081026f0 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f990de65640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f990810ffa0 con 0x7f9908101d70 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f9906ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9908101d70 0x7f9908198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f99077fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9908100490 0x7f9908198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f9906ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9908101d70 0x7f9908198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:58950/0 (socket says 172.21.15.159:58950) 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f9906ffd640 1 -- 172.21.15.159:0/3295468916 learned_addr learned my addr 172.21.15.159:0/3295468916 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.495+0000 7f9907fff640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99081026f0 0x7f990819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f9906ffd640 1 -- 172.21.15.159:0/3295468916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99081026f0 msgr2=0x7f990819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f9906ffd640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99081026f0 0x7f990819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.501 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f9906ffd640 1 -- 172.21.15.159:0/3295468916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9908100490 msgr2=0x7f9908198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f9906ffd640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9908100490 0x7f9908198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f9906ffd640 1 -- 172.21.15.159:0/3295468916 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990819d410 con 0x7f9908101d70 2024-09-19T06:50:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f9906ffd640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9908101d70 0x7f9908198960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f98fc02a940 tx=0x7f98fc003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f9904ff9640 1 -- 172.21.15.159:0/3295468916 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc03f070 con 0x7f9908101d70 2024-09-19T06:50:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f990de65640 1 -- 172.21.15.159:0/3295468916 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990819d6a0 con 0x7f9908101d70 2024-09-19T06:50:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f9904ff9640 1 -- 172.21.15.159:0/3295468916 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98fc031c90 con 0x7f9908101d70 2024-09-19T06:50:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f990de65640 1 -- 172.21.15.159:0/3295468916 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99081a4f90 con 0x7f9908101d70 2024-09-19T06:50:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.496+0000 7f9904ff9640 1 -- 172.21.15.159:0/3295468916 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc035030 con 0x7f9908101d70 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9904ff9640 1 -- 172.21.15.159:0/3295468916 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f98fc042070 con 0x7f9908101d70 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9910c03740 1 Processor -- start 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9910c03740 1 -- start start 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9910c03740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee08951ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9910c03740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9910c03740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee0895ccb0 0x55ee0895f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9910c03740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ee088b62f0 con 0x55ee08951af0 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9910c03740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ee0885e270 con 0x55ee08952410 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9910c03740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ee088b22b0 con 0x55ee0895ccb0 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9904ff9640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f98f00a3460 0x7f98f00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.508 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9907fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee08951ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9907fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee08951ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37666/0 (socket says 172.21.15.159:37666) 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9907fff640 1 -- 172.21.15.159:0/4107604431 learned_addr learned my addr 172.21.15.159:0/4107604431 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f99077fe640 1 --2- 172.21.15.159:0/4107604431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.499+0000 7f9907fff640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f98f00a3460 0x7f98f00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f9904ff9640 1 -- 172.21.15.159:0/3295468916 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f98fc0f0350 con 0x7f9908101d70 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f9906ffd640 1 --2- 172.21.15.159:0/4107604431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee0895ccb0 0x55ee0895f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f9907fff640 1 -- 172.21.15.159:0/4107604431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee0895ccb0 msgr2=0x55ee0895f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f9907fff640 1 --2- 172.21.15.159:0/4107604431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee0895ccb0 0x55ee0895f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f9907fff640 1 -- 172.21.15.159:0/4107604431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 msgr2=0x55ee0895c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:46.509 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f9907fff640 1 --2- 172.21.15.159:0/4107604431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f9907fff640 1 -- 172.21.15.159:0/4107604431 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee0885d340 con 0x55ee08951af0 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f9907fff640 1 --2- 172.21.15.159:0/4107604431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee08951ed0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f990000efb0 tx=0x7f990000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969bc5debf4ab57e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f9907fff640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f98f00a3460 0x7f98f00a5920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f990000cd60 tx=0x7f9900008000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f98edffb640 1 -- 172.21.15.159:0/4107604431 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900017040 con 0x55ee08951af0 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f98edffb640 1 -- 172.21.15.159:0/4107604431 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f990000e930 con 0x55ee08951af0 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.500+0000 7f98edffb640 1 -- 172.21.15.159:0/4107604431 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900005220 con 0x55ee08951af0 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 -- 172.21.15.159:0/4107604431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 msgr2=0x55ee08951ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 --2- 172.21.15.159:0/4107604431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee08951ed0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f990000efb0 tx=0x7f990000c860 comp rx=0 tx=0).stop 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 -- 172.21.15.159:0/4107604431 shutdown_connections 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 --2- 172.21.15.159:0/4107604431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee0895ccb0 0x55ee0895f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 --2- 172.21.15.159:0/4107604431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 --2- 172.21.15.159:0/4107604431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee08951ed0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.510 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 -- 172.21.15.159:0/4107604431 >> 172.21.15.159:0/4107604431 conn(0x55ee0894e060 msgr2=0x55ee0894e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 -- 172.21.15.159:0/4107604431 shutdown_connections 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 -- 172.21.15.159:0/4107604431 wait complete. 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.501+0000 7f9910c03740 1 -- start start 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9910c03740 1 Processor -- start 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9910c03740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08951af0 0x55ee08959b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9910c03740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9910c03740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee0895a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9910c03740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ee0895f880 con 0x55ee0895ccb0 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9910c03740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ee0883f290 con 0x55ee08952410 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9910c03740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ee0895fa00 con 0x55ee08951af0 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9910c03740 10 client.0 _ll_register_callbacks cb 0x55ee08870140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9906ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.511 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f99077fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08951af0 0x55ee08959b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9906ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:44276/0 (socket says 172.21.15.159:44276) 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f99077fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08951af0 0x55ee08959b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:58974/0 (socket says 172.21.15.159:58974) 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9906ffd640 1 -- 172.21.15.159:0/3201164868 learned_addr learned my addr 172.21.15.159:0/3201164868 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9907fff640 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee0895a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9906ffd640 1 -- 172.21.15.159:0/3201164868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08951af0 msgr2=0x55ee08959b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9906ffd640 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08951af0 0x55ee08959b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9906ffd640 1 -- 172.21.15.159:0/3201164868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 msgr2=0x55ee0895a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9906ffd640 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee0895a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.502+0000 7f9906ffd640 1 -- 172.21.15.159:0/3201164868 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee085c9210 con 0x55ee08952410 2024-09-19T06:50:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.503+0000 7f9906ffd640 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895a0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0b8ac0 tx=0x7f98fc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62423967ca863b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.503+0000 7f98e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.503+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3201164868 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0da060 con 0x55ee08952410 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.503+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3201164868 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f98fc0b8d20 con 0x55ee08952410 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.503+0000 7f9910c03740 1 -- 172.21.15.159:0/3201164868 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f990000e930 con 0x55ee08952410 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.503+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3201164868 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f98fc0a2050 con 0x55ee08952410 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.503+0000 7f9910c03740 10 client.25613 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.503+0000 7f9910c03740 1 -- 172.21.15.159:0/3201164868 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ee08695620 con 0x55ee08952410 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3201164868 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f990000e930 con 0x55ee08952410 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3201164868 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f98fc0c4de0 con 0x55ee08952410 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f9910c03740 10 client.25613 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f9910c03740 10 client.25613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f9910c03740 20 client.25613 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f9910c03740 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee0896cbe0 0x55ee0896efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f9910c03740 4 client.25613 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f9910c03740 1 -- 172.21.15.159:0/3201164868 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee088c3a20 con 0x55ee0896cbe0 2024-09-19T06:50:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f99077fe640 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee0896cbe0 0x55ee0896efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f99077fe640 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee0896cbe0 0x55ee0896efd0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d870f6d1def83d35 server_cookie=22412f0441e74997 in_seq=0 out_seq=0 2024-09-19T06:50:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.504+0000 7f98e6ffd640 10 client.25613 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:46.514 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3201164868 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee088c3a20 con 0x55ee0896cbe0 2024-09-19T06:50:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f98e6ffd640 10 client.25613 handle_command_reply: tid=0 2024-09-19T06:50:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 client.25613 shutdown 2024-09-19T06:50:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 -- 172.21.15.159:0/3201164868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 msgr2=0x55ee0895a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895a0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0b8ac0 tx=0x7f98fc009260 comp rx=0 tx=0).stop 2024-09-19T06:50:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 -- 172.21.15.159:0/3201164868 shutdown_connections 2024-09-19T06:50:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee0896cbe0 0x55ee0896efd0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.515 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee0895a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f98e6ffd640 0 client.25613 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:46.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08952410 0x55ee0895a0d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 --2- 172.21.15.159:0/3201164868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08951af0 0x55ee08959b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 -- 172.21.15.159:0/3201164868 >> 172.21.15.159:0/3201164868 conn(0x55ee0894e060 msgr2=0x55ee08953dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:46.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 -- 172.21.15.159:0/3201164868 shutdown_connections 2024-09-19T06:50:46.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.505+0000 7f9910c03740 1 -- 172.21.15.159:0/3201164868 wait complete. 2024-09-19T06:50:46.516 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.506+0000 7f9910c03740 20 client.25613 trim_cache size 0 max 16384 2024-09-19T06:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.531+0000 7f9910c03740 1 Processor -- start 2024-09-19T06:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.531+0000 7f9910c03740 1 -- start start 2024-09-19T06:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9910c03740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee0895a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9910c03740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 0x55ee089748a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9910c03740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee0895ccb0 0x55ee08974de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9910c03740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f99081a9690 con 0x55ee08951af0 2024-09-19T06:50:46.535 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9910c03740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99081abef0 con 0x55ee0895ccb0 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9910c03740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99081a9ce0 con 0x55ee08952410 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f99077fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee0895a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9907fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee0895ccb0 0x55ee08974de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9906ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 0x55ee089748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f99077fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee0895a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37682/0 (socket says 172.21.15.159:37682) 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f99077fe640 1 -- 172.21.15.159:0/467603933 learned_addr learned my addr 172.21.15.159:0/467603933 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9907fff640 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee0895ccb0 0x55ee08974de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:44278/0 (socket says 172.21.15.159:44278) 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f99077fe640 1 -- 172.21.15.159:0/467603933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 msgr2=0x55ee089748a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f99077fe640 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 0x55ee089748a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f99077fe640 1 -- 172.21.15.159:0/467603933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee0895ccb0 msgr2=0x55ee08974de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f99077fe640 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee0895ccb0 0x55ee08974de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f99077fe640 1 -- 172.21.15.159:0/467603933 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee08952240 con 0x55ee08951af0 2024-09-19T06:50:46.536 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9907fff640 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee0895ccb0 0x55ee08974de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f9906ffd640 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 0x55ee089748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.532+0000 7f99077fe640 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee0895a440 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x55ee0896f810 tx=0x7f98f8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d404a9242be9ba5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f98ed7fa640 1 -- 172.21.15.159:0/467603933 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8003e20 con 0x55ee08951af0 2024-09-19T06:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f98ed7fa640 1 -- 172.21.15.159:0/467603933 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f8010910 con 0x55ee08951af0 2024-09-19T06:50:46.537 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f98ed7fa640 1 -- 172.21.15.159:0/467603933 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f801eac0 con 0x55ee08951af0 2024-09-19T06:50:46.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f9910c03740 1 -- 172.21.15.159:0/467603933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 msgr2=0x55ee0895a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:46.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f9910c03740 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee0895a440 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x55ee0896f810 tx=0x7f98f8005f90 comp rx=0 tx=0).stop 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f9910c03740 1 -- 172.21.15.159:0/467603933 shutdown_connections 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f9910c03740 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee0895ccb0 0x55ee08974de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f9910c03740 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 0x55ee089748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f9910c03740 1 --2- 172.21.15.159:0/467603933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee08951af0 0x55ee0895a440 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f9910c03740 1 -- 172.21.15.159:0/467603933 >> 172.21.15.159:0/467603933 conn(0x55ee0894e060 msgr2=0x55ee0895bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f9910c03740 1 -- 172.21.15.159:0/467603933 shutdown_connections 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.533+0000 7f9910c03740 1 -- 172.21.15.159:0/467603933 wait complete. 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9910c03740 1 -- start start 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9910c03740 1 Processor -- start 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9910c03740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08951af0 0x55ee08965480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9910c03740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 0x55ee089607a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9910c03740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee08960d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9910c03740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f99081aa3b0 con 0x55ee0895ccb0 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9910c03740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99081ab820 con 0x55ee08951af0 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9910c03740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99081aaa80 con 0x55ee08952410 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9910c03740 10 client.0 _ll_register_callbacks cb 0x7f98fc009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9907fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee08960d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f99077fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08951af0 0x55ee08965480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9907fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee08960d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37686/0 (socket says 172.21.15.159:37686) 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f99077fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08951af0 0x55ee08965480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:44282/0 (socket says 172.21.15.159:44282) 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9907fff640 1 -- 172.21.15.159:0/3370912707 learned_addr learned my addr 172.21.15.159:0/3370912707 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.534+0000 7f9906ffd640 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 0x55ee089607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f9907fff640 1 -- 172.21.15.159:0/3370912707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 msgr2=0x55ee089607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f9907fff640 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 0x55ee089607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f9907fff640 1 -- 172.21.15.159:0/3370912707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08951af0 msgr2=0x55ee08965480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f9907fff640 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08951af0 0x55ee08965480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f9907fff640 1 -- 172.21.15.159:0/3370912707 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee08961550 con 0x55ee0895ccb0 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f99077fe640 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08951af0 0x55ee08965480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f9907fff640 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee08960d20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f990000e240 tx=0x7f990000e1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5f0b69a2519be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f98e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3370912707 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900033060 con 0x55ee0895ccb0 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f9910c03740 1 -- 172.21.15.159:0/3370912707 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f8010910 con 0x55ee0895ccb0 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3370912707 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f9900004a00 con 0x55ee0895ccb0 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3370912707 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f990000eb30 con 0x55ee0895ccb0 2024-09-19T06:50:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f9910c03740 10 client.16263 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f9910c03740 1 -- 172.21.15.159:0/3370912707 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ee089d7970 con 0x55ee0895ccb0 2024-09-19T06:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.535+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3370912707 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f8010910 con 0x55ee0895ccb0 2024-09-19T06:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3370912707 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f990000b040 con 0x55ee0895ccb0 2024-09-19T06:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f9910c03740 10 client.16263 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f9910c03740 10 client.16263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f9910c03740 20 client.16263 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f9910c03740 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee089d7f00 0x55ee089da2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f9910c03740 4 client.16263 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:50:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f9910c03740 1 -- 172.21.15.159:0/3370912707 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee088bdd70 con 0x55ee089d7f00 2024-09-19T06:50:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f99077fe640 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee089d7f00 0x55ee089da2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f98e6ffd640 10 client.16263 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.536+0000 7f99077fe640 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee089d7f00 0x55ee089da2f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e2dca38c7b85225 server_cookie=eb4d41ec8d14d75c in_seq=0 out_seq=0 2024-09-19T06:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f98e6ffd640 1 -- 172.21.15.159:0/3370912707 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee088bdd70 con 0x55ee089d7f00 2024-09-19T06:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f98e6ffd640 10 client.16263 handle_command_reply: tid=0 2024-09-19T06:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 client.16263 shutdown 2024-09-19T06:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 -- 172.21.15.159:0/3370912707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 msgr2=0x55ee08960d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee08960d20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f990000e240 tx=0x7f990000e1d0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 -- 172.21.15.159:0/3370912707 shutdown_connections 2024-09-19T06:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee089d7f00 0x55ee089da2f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f98e6ffd640 0 client.16263 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee0895ccb0 0x55ee08960d20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee08952410 0x55ee089607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 --2- 172.21.15.159:0/3370912707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee08951af0 0x55ee08965480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 -- 172.21.15.159:0/3370912707 >> 172.21.15.159:0/3370912707 conn(0x55ee0894e060 msgr2=0x55ee0895b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 -- 172.21.15.159:0/3370912707 shutdown_connections 2024-09-19T06:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 1 -- 172.21.15.159:0/3370912707 wait complete. 2024-09-19T06:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.553+0000 7f9910c03740 20 client.16263 trim_cache size 0 max 16384 2024-09-19T06:50:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:50:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 -- 172.21.15.159:0/3295468916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f98f00a3460 msgr2=0x7f98f00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f98f00a3460 0x7f98f00a5920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f990000cd60 tx=0x7f9900008000 comp rx=0 tx=0).stop 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 -- 172.21.15.159:0/3295468916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9908101d70 msgr2=0x7f9908198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9908101d70 0x7f9908198960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f98fc02a940 tx=0x7f98fc003b20 comp rx=0 tx=0).stop 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 -- 172.21.15.159:0/3295468916 shutdown_connections 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f98f00a3460 0x7f98f00a5920 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99081026f0 0x7f990819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9908101d70 0x7f9908198960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 --2- 172.21.15.159:0/3295468916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9908100490 0x7f9908198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 -- 172.21.15.159:0/3295468916 >> 172.21.15.159:0/3295468916 conn(0x7f99080770f0 msgr2=0x7f9908103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 -- 172.21.15.159:0/3295468916 shutdown_connections 2024-09-19T06:50:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:46.554+0000 7f990de65640 1 -- 172.21.15.159:0/3295468916 wait complete. 2024-09-19T06:50:46.695 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:46.952 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:46 smithi159 ceph-mon[30935]: pgmap v118: 97 pgs: 97 active+clean; 39 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.2 MiB/s wr, 228 op/s 2024-09-19T06:50:47.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:46 smithi203 ceph-mon[35473]: pgmap v118: 97 pgs: 97 active+clean; 39 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.2 MiB/s wr, 228 op/s 2024-09-19T06:50:47.141 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:46 smithi189 ceph-mon[34880]: pgmap v118: 97 pgs: 97 active+clean; 39 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.2 MiB/s wr, 228 op/s 2024-09-19T06:50:47.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 -- 172.21.15.159:0/1086515668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c10c170 msgr2=0x7f976c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:47.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 --2- 172.21.15.159:0/1086515668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c10c170 0x7f976c10e610 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9764009ca0 tx=0x7f976402a950 comp rx=0 tx=0).stop 2024-09-19T06:50:47.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 -- 172.21.15.159:0/1086515668 shutdown_connections 2024-09-19T06:50:47.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 --2- 172.21.15.159:0/1086515668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c10c170 0x7f976c10e610 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 --2- 172.21.15.159:0/1086515668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f976c103660 0x7f976c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 --2- 172.21.15.159:0/1086515668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f976c102d40 0x7f976c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 -- 172.21.15.159:0/1086515668 >> 172.21.15.159:0/1086515668 conn(0x7f976c0fc7a0 msgr2=0x7f976c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:47.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 -- 172.21.15.159:0/1086515668 shutdown_connections 2024-09-19T06:50:47.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 -- 172.21.15.159:0/1086515668 wait complete. 2024-09-19T06:50:47.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.156+0000 7f97725ce640 1 Processor -- start 2024-09-19T06:50:47.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f97725ce640 1 -- start start 2024-09-19T06:50:47.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f97725ce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c102d40 0x7f976c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:47.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f97725ce640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f976c103660 0x7f976c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:47.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f97725ce640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f976c10c170 0x7f976c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:47.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f97725ce640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f976c111f70 con 0x7f976c102d40 2024-09-19T06:50:47.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f97725ce640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f976c111df0 con 0x7f976c10c170 2024-09-19T06:50:47.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f97725ce640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f976c1120f0 con 0x7f976c103660 2024-09-19T06:50:47.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f976bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c102d40 0x7f976c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:47.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f976bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c102d40 0x7f976c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37708/0 (socket says 172.21.15.159:37708) 2024-09-19T06:50:47.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f976bfff640 1 -- 172.21.15.159:0/1837085984 learned_addr learned my addr 172.21.15.159:0/1837085984 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:47.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f9770b6b640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f976c10c170 0x7f976c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:47.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f976b7fe640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f976c103660 0x7f976c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:47.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f9770b6b640 1 -- 172.21.15.159:0/1837085984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f976c103660 msgr2=0x7f976c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:47.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f9770b6b640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f976c103660 0x7f976c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f9770b6b640 1 -- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c102d40 msgr2=0x7f976c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:47.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f9770b6b640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c102d40 0x7f976c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f9770b6b640 1 -- 172.21.15.159:0/1837085984 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976c1a68d0 con 0x7f976c10c170 2024-09-19T06:50:47.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.157+0000 7f976bfff640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c102d40 0x7f976c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:47.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.158+0000 7f9770b6b640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f976c10c170 0x7f976c101420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9764005cc0 tx=0x7f976402f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:47.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.158+0000 7f97697fa640 1 -- 172.21.15.159:0/1837085984 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9764034040 con 0x7f976c10c170 2024-09-19T06:50:47.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.158+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976c1a6b60 con 0x7f976c10c170 2024-09-19T06:50:47.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.158+0000 7f97697fa640 1 -- 172.21.15.159:0/1837085984 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9764030920 con 0x7f976c10c170 2024-09-19T06:50:47.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.158+0000 7f97697fa640 1 -- 172.21.15.159:0/1837085984 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97640045b0 con 0x7f976c10c170 2024-09-19T06:50:47.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.158+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f976c1a7040 con 0x7f976c10c170 2024-09-19T06:50:47.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.159+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976c103120 con 0x7f976c10c170 2024-09-19T06:50:47.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.160+0000 7f97697fa640 1 -- 172.21.15.159:0/1837085984 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9764037020 con 0x7f976c10c170 2024-09-19T06:50:47.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.161+0000 7f97697fa640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f97540a33b0 0x7f97540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:47.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.161+0000 7f976bfff640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f97540a33b0 0x7f97540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:47.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.161+0000 7f97697fa640 1 -- 172.21.15.159:0/1837085984 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f97640f0ac0 con 0x7f976c10c170 2024-09-19T06:50:47.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.161+0000 7f976bfff640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f97540a33b0 0x7f97540a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f975c011590 tx=0x7f975c005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:47.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.164+0000 7f97697fa640 1 -- 172.21.15.159:0/1837085984 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f97640bd580 con 0x7f976c10c170 2024-09-19T06:50:47.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.372+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f976c101ed0 con 0x7f976c10c170 2024-09-19T06:50:47.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.373+0000 7f97697fa640 1 -- 172.21.15.159:0/1837085984 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f97640098b0 con 0x7f976c10c170 2024-09-19T06:50:47.375 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:50:47.376 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:50:47.376 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:50:47.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f97540a33b0 msgr2=0x7f97540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:47.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f97540a33b0 0x7f97540a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f975c011590 tx=0x7f975c005f90 comp rx=0 tx=0).stop 2024-09-19T06:50:47.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f976c10c170 msgr2=0x7f976c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f976c10c170 0x7f976c101420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9764005cc0 tx=0x7f976402f3a0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 shutdown_connections 2024-09-19T06:50:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f97540a33b0 0x7f97540a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f976c10c170 0x7f976c101420 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f976c103660 0x7f976c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 --2- 172.21.15.159:0/1837085984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c102d40 0x7f976c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 >> 172.21.15.159:0/1837085984 conn(0x7f976c0fc7a0 msgr2=0x7f976c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 shutdown_connections 2024-09-19T06:50:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:47.375+0000 7f97725ce640 1 -- 172.21.15.159:0/1837085984 wait complete. 2024-09-19T06:50:47.669 INFO:tasks.workunit.client.0.smithi159.stdout:50000 copy from 0x898b8 to 0x92015, (0x875d bytes) at 0xb142c 2024-09-19T06:50:47.669 INFO:tasks.workunit.client.0.smithi159.stdout:All 50000 operations completed A-OK! 2024-09-19T06:50:47.669 INFO:tasks.workunit.client.0.smithi159.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-09-19T06:50:47.672 INFO:tasks.workunit.client.0.smithi159.stdout:Seed set to 1 2024-09-19T06:50:47.790 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-19T06:50:47.791 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-19T06:50:47.792 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T06:50:47.792 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T06:50:47.792 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T06:50:47.793 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T06:50:47.796 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support exchange range, disabling! 2024-09-19T06:50:47.796 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero length punch hole 2024-09-19T06:50:47.797 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero length punch hole 2024-09-19T06:50:47.797 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero length punch hole 2024-09-19T06:50:47.797 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero size read 2024-09-19T06:50:47.797 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero length punch hole 2024-09-19T06:50:47.797 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero size read 2024-09-19T06:50:47.797 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero length punch hole 2024-09-19T06:50:47.797 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0x4310e9 2024-09-19T06:50:47.801 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0x954a45 2024-09-19T06:50:47.827 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0x9bc582 2024-09-19T06:50:47.845 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0x9eecbc 2024-09-19T06:50:48.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:47 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1837085984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:48.099 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:47 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1837085984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:48.129 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:50:48.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:47 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1837085984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:48.406 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:48.820 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:48 smithi159 ceph-mon[30935]: pgmap v119: 97 pgs: 97 active+clean; 39 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.1 MiB/s wr, 180 op/s 2024-09-19T06:50:48.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 -- 172.21.15.159:0/3714943661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101df0 msgr2=0x7fda041021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 --2- 172.21.15.159:0/3714943661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101df0 0x7fda041021d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009900 tx=0x7fd9f402a410 comp rx=0 tx=0).stop 2024-09-19T06:50:48.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 -- 172.21.15.159:0/3714943661 shutdown_connections 2024-09-19T06:50:48.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 --2- 172.21.15.159:0/3714943661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda04106f20 0x7fda0410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 --2- 172.21.15.159:0/3714943661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda041027a0 0x7fda041067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 --2- 172.21.15.159:0/3714943661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101df0 0x7fda041021d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 -- 172.21.15.159:0/3714943661 >> 172.21.15.159:0/3714943661 conn(0x7fda040fd8f0 msgr2=0x7fda040ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 -- 172.21.15.159:0/3714943661 shutdown_connections 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 -- 172.21.15.159:0/3714943661 wait complete. 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.911+0000 7fda098a7640 1 Processor -- start 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda098a7640 1 -- start start 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda098a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101df0 0x7fda040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda098a7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda041027a0 0x7fda04074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda098a7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda04106f20 0x7fda04074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda098a7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fda04111f80 con 0x7fda04101df0 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda098a7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda04111e00 con 0x7fda04106f20 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda098a7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fda04112100 con 0x7fda041027a0 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101df0 0x7fda040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda027fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda041027a0 0x7fda04074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101df0 0x7fda040744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37722/0 (socket says 172.21.15.159:37722) 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda02ffd640 1 -- 172.21.15.159:0/3949302815 learned_addr learned my addr 172.21.15.159:0/3949302815 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda037fe640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda04106f20 0x7fda04074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda027fc640 1 -- 172.21.15.159:0/3949302815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda04106f20 msgr2=0x7fda04074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda027fc640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda04106f20 0x7fda04074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda027fc640 1 -- 172.21.15.159:0/3949302815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101df0 msgr2=0x7fda040744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda027fc640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101df0 0x7fda040744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.912+0000 7fda027fc640 1 -- 172.21.15.159:0/3949302815 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda041a6910 con 0x7fda041027a0 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.913+0000 7fda027fc640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda041027a0 0x7fda04074a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800e9f0 tx=0x7fd9f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.913+0000 7fda088a5640 1 -- 172.21.15.159:0/3949302815 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f800ccc0 con 0x7fda041027a0 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.913+0000 7fda098a7640 1 -- 172.21.15.159:0/3949302815 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda041a6c00 con 0x7fda041027a0 2024-09-19T06:50:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.913+0000 7fda088a5640 1 -- 172.21.15.159:0/3949302815 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f8010910 con 0x7fda041027a0 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.913+0000 7fda088a5640 1 -- 172.21.15.159:0/3949302815 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8018960 con 0x7fda041027a0 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.913+0000 7fda098a7640 1 -- 172.21.15.159:0/3949302815 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda041a7190 con 0x7fda041027a0 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.915+0000 7fda088a5640 1 -- 172.21.15.159:0/3949302815 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd9f8010ac0 con 0x7fda041027a0 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda0bc80740 1 Processor -- start 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda0bc80740 1 -- start start 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 0x561b47cf3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cf3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d00760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda0bc80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561b47c592f0 con 0x561b47cf35d0 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda0bc80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561b47c00cf0 con 0x561b47cf4b40 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda0bc80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561b47c552b0 con 0x561b47cfe370 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda088a5640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd9ec0a33b0 0x7fd9ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cf3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda037fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 0x561b47cf3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cf3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37724/0 (socket says 172.21.15.159:37724) 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda02ffd640 1 -- 172.21.15.159:0/3722812754 learned_addr learned my addr 172.21.15.159:0/3722812754 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda037fe640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd9ec0a33b0 0x7fd9ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda027fc640 1 --2- 172.21.15.159:0/3722812754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d00760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda088a5640 1 -- 172.21.15.159:0/3949302815 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fd9f80d0120 con 0x7fda041027a0 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda02ffd640 1 -- 172.21.15.159:0/3722812754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 msgr2=0x561b47d00760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda02ffd640 1 --2- 172.21.15.159:0/3722812754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d00760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda02ffd640 1 -- 172.21.15.159:0/3722812754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 msgr2=0x561b47cf3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda02ffd640 1 --2- 172.21.15.159:0/3722812754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 0x561b47cf3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda02ffd640 1 -- 172.21.15.159:0/3722812754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b47be53a0 con 0x561b47cf35d0 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.916+0000 7fda037fe640 1 --2- 172.21.15.159:0/3722812754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 0x561b47cf3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:48.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.917+0000 7fda02ffd640 1 --2- 172.21.15.159:0/3722812754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cf3a10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009a20 tx=0x7fd9f4005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8541ff57cabfea06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.917+0000 7fda037fe640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd9ec0a33b0 0x7fd9ec0a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc005fd0 tx=0x7fd9fc009500 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.917+0000 7fd9e9ffb640 1 -- 172.21.15.159:0/3722812754 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4040070 con 0x561b47cf35d0 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.917+0000 7fd9e9ffb640 1 -- 172.21.15.159:0/3722812754 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f4004030 con 0x561b47cf35d0 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.917+0000 7fd9e9ffb640 1 -- 172.21.15.159:0/3722812754 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4035040 con 0x561b47cf35d0 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 -- 172.21.15.159:0/3722812754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 msgr2=0x561b47cf3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 --2- 172.21.15.159:0/3722812754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cf3a10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009a20 tx=0x7fd9f4005dd0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 -- 172.21.15.159:0/3722812754 shutdown_connections 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 --2- 172.21.15.159:0/3722812754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d00760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 --2- 172.21.15.159:0/3722812754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cf3a10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 --2- 172.21.15.159:0/3722812754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 0x561b47cf3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 -- 172.21.15.159:0/3722812754 >> 172.21.15.159:0/3722812754 conn(0x561b47cbc310 msgr2=0x561b47cefc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 -- 172.21.15.159:0/3722812754 shutdown_connections 2024-09-19T06:50:48.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 -- 172.21.15.159:0/3722812754 wait complete. 2024-09-19T06:50:48.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 -- start start 2024-09-19T06:50:48.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.918+0000 7fda0bc80740 1 Processor -- start 2024-09-19T06:50:48.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cfdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cf4b40 0x561b47cfafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cfe370 0x561b47cfb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda0bc80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561b47d01010 con 0x561b47cf35d0 2024-09-19T06:50:48.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda0bc80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561b47c14060 con 0x561b47cfe370 2024-09-19T06:50:48.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda0bc80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561b47d01190 con 0x561b47cf4b40 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda0bc80740 10 client.0 _ll_register_callbacks cb 0x561b479678c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cfdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cfdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37730/0 (socket says 172.21.15.159:37730) 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda02ffd640 1 -- 172.21.15.159:0/2339107120 learned_addr learned my addr 172.21.15.159:0/2339107120 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda027fc640 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cf4b40 0x561b47cfafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda037fe640 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cfe370 0x561b47cfb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda027fc640 1 -- 172.21.15.159:0/2339107120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cfe370 msgr2=0x561b47cfb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda027fc640 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cfe370 0x561b47cfb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda027fc640 1 -- 172.21.15.159:0/2339107120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 msgr2=0x561b47cfdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda027fc640 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cfdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.919+0000 7fda027fc640 1 -- 172.21.15.159:0/2339107120 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b479ca3c0 con 0x561b47cf4b40 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fda02ffd640 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cfdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:48.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fda027fc640 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cf4b40 0x561b47cfafe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80cd7e0 tx=0x7fd9f800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b39568535d9b0ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fd9e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/2339107120 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80cdc70 con 0x561b47cf4b40 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/2339107120 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fd9f809ba70 con 0x561b47cf4b40 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fda0bc80740 1 -- 172.21.15.159:0/2339107120 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9f4004030 con 0x561b47cf4b40 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/2339107120 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd9f80a4fe0 con 0x561b47cf4b40 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fda0bc80740 10 client.25687 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fda0bc80740 1 -- 172.21.15.159:0/2339107120 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561b47d0ca70 con 0x561b47cf4b40 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.920+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/2339107120 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f4004030 con 0x561b47cf4b40 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/2339107120 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd9f80b51f0 con 0x561b47cf4b40 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fda0bc80740 10 client.25687 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fda0bc80740 10 client.25687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:48.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fda0bc80740 20 client.25687 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fda0bc80740 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561b47d0e160 0x561b47d10550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fda0bc80740 4 client.25687 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fda0bc80740 1 -- 172.21.15.159:0/2339107120 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b47c66860 con 0x561b47d0e160 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fda02ffd640 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561b47d0e160 0x561b47d10550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fda02ffd640 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561b47d0e160 0x561b47d10550 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc528fc9ef7560e0 server_cookie=b29515c6693fa340 in_seq=0 out_seq=0 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.921+0000 7fd9e2ffd640 10 client.25687 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/2339107120 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b47c66860 con 0x561b47d0e160 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fd9e2ffd640 10 client.25687 handle_command_reply: tid=0 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 client.25687 shutdown 2024-09-19T06:50:48.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 -- 172.21.15.159:0/2339107120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cf4b40 msgr2=0x561b47cfafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cf4b40 0x561b47cfafe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80cd7e0 tx=0x7fd9f800cf60 comp rx=0 tx=0).stop 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 -- 172.21.15.159:0/2339107120 shutdown_connections 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561b47d0e160 0x561b47d10550 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cfe370 0x561b47cfb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cf4b40 0x561b47cfafe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 --2- 172.21.15.159:0/2339107120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47cfdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 -- 172.21.15.159:0/2339107120 >> 172.21.15.159:0/2339107120 conn(0x561b47cbc310 msgr2=0x561b47cf5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fd9e2ffd640 0 client.25687 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.922+0000 7fda0bc80740 1 -- 172.21.15.159:0/2339107120 shutdown_connections 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.923+0000 7fda0bc80740 1 -- 172.21.15.159:0/2339107120 wait complete. 2024-09-19T06:50:48.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.923+0000 7fda0bc80740 20 client.25687 trim_cache size 0 max 16384 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.936+0000 7fda0bc80740 1 Processor -- start 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.936+0000 7fda0bc80740 1 -- start start 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.936+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf35d0 0x561b47cfafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf4b40 0x561b47d0a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d15be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda0bc80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fda041a9790 con 0x561b47cf4b40 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda0bc80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda041abff0 con 0x561b47cf35d0 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda0bc80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fda041a9de0 con 0x561b47cfe370 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda027fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf4b40 0x561b47d0a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda027fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf4b40 0x561b47d0a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37736/0 (socket says 172.21.15.159:37736) 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda027fc640 1 -- 172.21.15.159:0/1297433894 learned_addr learned my addr 172.21.15.159:0/1297433894 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda02ffd640 1 --2- 172.21.15.159:0/1297433894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf35d0 0x561b47cfafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda037fe640 1 --2- 172.21.15.159:0/1297433894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d15be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda027fc640 1 -- 172.21.15.159:0/1297433894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 msgr2=0x561b47d15be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda027fc640 1 --2- 172.21.15.159:0/1297433894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d15be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda027fc640 1 -- 172.21.15.159:0/1297433894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf35d0 msgr2=0x561b47cfafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda027fc640 1 --2- 172.21.15.159:0/1297433894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf35d0 0x561b47cfafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda027fc640 1 -- 172.21.15.159:0/1297433894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b47cef4f0 con 0x561b47cf4b40 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fda027fc640 1 --2- 172.21.15.159:0/1297433894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf4b40 0x561b47d0a2b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd9f809c3b0 tx=0x7fd9f8009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93b4d5023b9426 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fd9e97fa640 1 -- 172.21.15.159:0/1297433894 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f809c1f0 con 0x561b47cf4b40 2024-09-19T06:50:48.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fd9e97fa640 1 -- 172.21.15.159:0/1297433894 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f80b5250 con 0x561b47cf4b40 2024-09-19T06:50:48.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.937+0000 7fd9e97fa640 1 -- 172.21.15.159:0/1297433894 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8018b00 con 0x561b47cf4b40 2024-09-19T06:50:48.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 -- 172.21.15.159:0/1297433894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf4b40 msgr2=0x561b47d0a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 --2- 172.21.15.159:0/1297433894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf4b40 0x561b47d0a2b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd9f809c3b0 tx=0x7fd9f8009700 comp rx=0 tx=0).stop 2024-09-19T06:50:48.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 -- 172.21.15.159:0/1297433894 shutdown_connections 2024-09-19T06:50:48.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 --2- 172.21.15.159:0/1297433894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d15be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 --2- 172.21.15.159:0/1297433894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf4b40 0x561b47d0a2b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 --2- 172.21.15.159:0/1297433894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf35d0 0x561b47cfafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 -- 172.21.15.159:0/1297433894 >> 172.21.15.159:0/1297433894 conn(0x561b47cbc310 msgr2=0x561b47cfa8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 -- 172.21.15.159:0/1297433894 shutdown_connections 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 -- 172.21.15.159:0/1297433894 wait complete. 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.938+0000 7fda0bc80740 1 -- start start 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda0bc80740 1 Processor -- start 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47d06bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 0x561b47d01ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda0bc80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d02420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda0bc80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fda041aa4b0 con 0x561b47cf35d0 2024-09-19T06:50:48.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda0bc80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda041ab920 con 0x561b47cf4b40 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda0bc80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fda041aab80 con 0x561b47cfe370 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47d06bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47d06bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37744/0 (socket says 172.21.15.159:37744) 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda02ffd640 1 -- 172.21.15.159:0/4276533179 learned_addr learned my addr 172.21.15.159:0/4276533179 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda0bc80740 10 client.0 _ll_register_callbacks cb 0x7fd9f800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda027fc640 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 0x561b47d01ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda037fe640 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d02420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.939+0000 7fda02ffd640 1 -- 172.21.15.159:0/4276533179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 msgr2=0x561b47d02420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fda02ffd640 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d02420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fda02ffd640 1 -- 172.21.15.159:0/4276533179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 msgr2=0x561b47d01ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fda02ffd640 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 0x561b47d01ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fda02ffd640 1 -- 172.21.15.159:0/4276533179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b47d02c20 con 0x561b47cf35d0 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fda037fe640 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d02420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fda02ffd640 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47d06bb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4031550 tx=0x7fd9f4005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3329b2e2a09854c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fd9e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/4276533179 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4040040 con 0x561b47cf35d0 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/4276533179 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fd9f40054b0 con 0x561b47cf35d0 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.940+0000 7fda0bc80740 1 -- 172.21.15.159:0/4276533179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9f80b5250 con 0x561b47cf35d0 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/4276533179 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd9f4060050 con 0x561b47cf35d0 2024-09-19T06:50:48.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda0bc80740 10 client.16287 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:48.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda0bc80740 1 -- 172.21.15.159:0/4276533179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561b47d78bc0 con 0x561b47cf35d0 2024-09-19T06:50:48.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/4276533179 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f80b5250 con 0x561b47cf35d0 2024-09-19T06:50:48.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/4276533179 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd9f4050900 con 0x561b47cf35d0 2024-09-19T06:50:48.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda0bc80740 10 client.16287 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:48.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda0bc80740 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:48.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda0bc80740 20 client.16287 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:48.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda0bc80740 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561b47d78f00 0x561b47d7b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda0bc80740 4 client.16287 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:48.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda0bc80740 1 -- 172.21.15.159:0/4276533179 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b47c60d70 con 0x561b47d78f00 2024-09-19T06:50:48.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda027fc640 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561b47d78f00 0x561b47d7b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fd9e2ffd640 10 client.16287 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda027fc640 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561b47d78f00 0x561b47d7b2f0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d5d1f7864078b2b server_cookie=95b51946f24b08a1 in_seq=0 out_seq=0 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fd9e2ffd640 1 -- 172.21.15.159:0/4276533179 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b47c60d70 con 0x561b47d78f00 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fd9e2ffd640 10 client.16287 handle_command_reply: tid=0 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.942+0000 7fda0bc80740 1 client.16287 shutdown 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 -- 172.21.15.159:0/4276533179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 msgr2=0x561b47d06bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47d06bb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4031550 tx=0x7fd9f4005e60 comp rx=0 tx=0).stop 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 -- 172.21.15.159:0/4276533179 shutdown_connections 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561b47d78f00 0x561b47d7b2f0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b47cfe370 0x561b47d02420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561b47cf4b40 0x561b47d01ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 --2- 172.21.15.159:0/4276533179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b47cf35d0 0x561b47d06bb0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fd9e2ffd640 0 client.16287 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:48.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 -- 172.21.15.159:0/4276533179 >> 172.21.15.159:0/4276533179 conn(0x561b47cbc310 msgr2=0x561b47cf5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 -- 172.21.15.159:0/4276533179 shutdown_connections 2024-09-19T06:50:48.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 1 -- 172.21.15.159:0/4276533179 wait complete. 2024-09-19T06:50:48.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda0bc80740 20 client.16287 trim_cache size 0 max 16384 2024-09-19T06:50:48.953 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 -- 172.21.15.159:0/3949302815 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd9ec0a33b0 msgr2=0x7fd9ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd9ec0a33b0 0x7fd9ec0a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc005fd0 tx=0x7fd9fc009500 comp rx=0 tx=0).stop 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 -- 172.21.15.159:0/3949302815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda041027a0 msgr2=0x7fda04074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda041027a0 0x7fda04074a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800e9f0 tx=0x7fd9f800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 -- 172.21.15.159:0/3949302815 shutdown_connections 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd9ec0a33b0 0x7fd9ec0a5870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda04106f20 0x7fda04074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda041027a0 0x7fda04074a30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 --2- 172.21.15.159:0/3949302815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101df0 0x7fda040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.943+0000 7fda098a7640 1 -- 172.21.15.159:0/3949302815 >> 172.21.15.159:0/3949302815 conn(0x7fda040fd8f0 msgr2=0x7fda040fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.944+0000 7fda098a7640 1 -- 172.21.15.159:0/3949302815 shutdown_connections 2024-09-19T06:50:48.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:48.944+0000 7fda098a7640 1 -- 172.21.15.159:0/3949302815 wait complete. 2024-09-19T06:50:49.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:48 smithi203 ceph-mon[35473]: pgmap v119: 97 pgs: 97 active+clean; 39 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.1 MiB/s wr, 180 op/s 2024-09-19T06:50:49.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:48 smithi189 ceph-mon[34880]: pgmap v119: 97 pgs: 97 active+clean; 39 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.1 MiB/s wr, 180 op/s 2024-09-19T06:50:49.522 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0x9fdd84 2024-09-19T06:50:50.784 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:50:50.785 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:50:51.066 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:51.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:50 smithi203 ceph-mon[35473]: pgmap v120: 97 pgs: 97 active+clean; 39 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.1 MiB/s wr, 180 op/s 2024-09-19T06:50:51.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:50 smithi189 ceph-mon[34880]: pgmap v120: 97 pgs: 97 active+clean; 39 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.1 MiB/s wr, 180 op/s 2024-09-19T06:50:51.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:50 smithi159 ceph-mon[30935]: pgmap v120: 97 pgs: 97 active+clean; 39 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.1 MiB/s wr, 180 op/s 2024-09-19T06:50:51.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.633+0000 7f1ab9196640 1 -- 172.21.15.159:0/3987171947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab4106f20 msgr2=0x7f1ab410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.633+0000 7f1ab9196640 1 --2- 172.21.15.159:0/3987171947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab4106f20 0x7f1ab410eaa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009ca0 tx=0x7f1aac02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.633+0000 7f1ab9196640 1 -- 172.21.15.159:0/3987171947 shutdown_connections 2024-09-19T06:50:51.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.633+0000 7f1ab9196640 1 --2- 172.21.15.159:0/3987171947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab4106f20 0x7f1ab410eaa0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.633+0000 7f1ab9196640 1 --2- 172.21.15.159:0/3987171947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab41027a0 0x7f1ab41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.633+0000 7f1ab9196640 1 --2- 172.21.15.159:0/3987171947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ab4101df0 0x7f1ab41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.633+0000 7f1ab9196640 1 -- 172.21.15.159:0/3987171947 >> 172.21.15.159:0/3987171947 conn(0x7f1ab40fd8b0 msgr2=0x7f1ab40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.633+0000 7f1ab9196640 1 -- 172.21.15.159:0/3987171947 shutdown_connections 2024-09-19T06:50:51.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.633+0000 7f1ab9196640 1 -- 172.21.15.159:0/3987171947 wait complete. 2024-09-19T06:50:51.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.634+0000 7f1ab9196640 1 Processor -- start 2024-09-19T06:50:51.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.634+0000 7f1ab9196640 1 -- start start 2024-09-19T06:50:51.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.634+0000 7f1ab9196640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ab4101df0 0x7f1ab41a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.634+0000 7f1ab9196640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab41027a0 0x7f1ab41a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.634+0000 7f1ab9196640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab4106f20 0x7f1ab410db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.634+0000 7f1ab9196640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4111f80 con 0x7f1ab41027a0 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.634+0000 7f1ab9196640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4111e00 con 0x7f1ab4101df0 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.634+0000 7f1ab9196640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4112100 con 0x7f1ab4106f20 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab41027a0 0x7f1ab41a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab2d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ab4101df0 0x7f1ab41a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab41027a0 0x7f1ab41a4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52214/0 (socket says 172.21.15.159:52214) 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab259c640 1 -- 172.21.15.159:0/1272747159 learned_addr learned my addr 172.21.15.159:0/1272747159 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:51.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab359e640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab4106f20 0x7f1ab410db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab2d9d640 1 -- 172.21.15.159:0/1272747159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab4106f20 msgr2=0x7f1ab410db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab2d9d640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab4106f20 0x7f1ab410db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab2d9d640 1 -- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab41027a0 msgr2=0x7f1ab41a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab2d9d640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab41027a0 0x7f1ab41a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab2d9d640 1 -- 172.21.15.159:0/1272747159 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab410e310 con 0x7f1ab4101df0 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab259c640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab41027a0 0x7f1ab41a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab2d9d640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ab4101df0 0x7f1ab41a4630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400e9f0 tx=0x7f1aa400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1a9bfff640 1 -- 172.21.15.159:0/1272747159 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400ccc0 con 0x7f1ab4101df0 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab9196640 1 -- 172.21.15.159:0/1272747159 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab410e600 con 0x7f1ab4101df0 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1a9bfff640 1 -- 172.21.15.159:0/1272747159 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa4010910 con 0x7f1ab4101df0 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1a9bfff640 1 -- 172.21.15.159:0/1272747159 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4018960 con 0x7f1ab4101df0 2024-09-19T06:50:51.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.635+0000 7f1ab9196640 1 -- 172.21.15.159:0/1272747159 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab41ab490 con 0x7f1ab4101df0 2024-09-19T06:50:51.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1a9bfff640 1 -- 172.21.15.159:0/1272747159 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1aa4018b00 con 0x7f1ab4101df0 2024-09-19T06:50:51.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1abb56f740 1 Processor -- start 2024-09-19T06:50:51.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1abb56f740 1 -- start start 2024-09-19T06:50:51.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a04f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1a9bfff640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a9c0a33b0 0x7f1a9c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a0fd40 0x55ee70a12130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1abb56f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ee7096a280 con 0x55ee70a0fd40 2024-09-19T06:50:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1abb56f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ee70911b10 con 0x55ee70a04b60 2024-09-19T06:50:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1abb56f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ee70966240 con 0x55ee70a05480 2024-09-19T06:50:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.638+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a04f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab259c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a04f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:33726/0 (socket says 172.21.15.159:33726) 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1a9bfff640 1 -- 172.21.15.159:0/1272747159 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1aa40d0150 con 0x7f1ab4101df0 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab359e640 1 -- 172.21.15.159:0/2927821581 learned_addr learned my addr 172.21.15.159:0/2927821581 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab2d9d640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a9c0a33b0 0x7f1a9c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab359e640 1 --2- 172.21.15.159:0/2927821581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a0fd40 0x55ee70a12130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab259c640 1 -- 172.21.15.159:0/2927821581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 msgr2=0x55ee70a04f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab259c640 1 --2- 172.21.15.159:0/2927821581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a04f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab259c640 1 -- 172.21.15.159:0/2927821581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a0fd40 msgr2=0x55ee70a12130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab259c640 1 --2- 172.21.15.159:0/2927821581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a0fd40 0x55ee70a12130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab259c640 1 -- 172.21.15.159:0/2927821581 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7091e1f0 con 0x55ee70a05480 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab359e640 1 --2- 172.21.15.159:0/2927821581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a04f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab2d9d640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a9c0a33b0 0x7f1a9c0a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40a4b40 tx=0x7f1aa40bc040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1ab259c640 1 --2- 172.21.15.159:0/2927821581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0f800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ab410eec0 tx=0x7f1aa8011950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a66aaa84b019cfb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1a997fa640 1 -- 172.21.15.159:0/2927821581 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa801e070 con 0x55ee70a05480 2024-09-19T06:50:51.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1a997fa640 1 -- 172.21.15.159:0/2927821581 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa80110f0 con 0x55ee70a05480 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.639+0000 7f1a997fa640 1 -- 172.21.15.159:0/2927821581 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8010810 con 0x55ee70a05480 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 -- 172.21.15.159:0/2927821581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 msgr2=0x55ee70a0f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2927821581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0f800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ab410eec0 tx=0x7f1aa8011950 comp rx=0 tx=0).stop 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 -- 172.21.15.159:0/2927821581 shutdown_connections 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2927821581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a0fd40 0x55ee70a12130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2927821581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0f800 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2927821581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a04f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 -- 172.21.15.159:0/2927821581 >> 172.21.15.159:0/2927821581 conn(0x55ee70a010f0 msgr2=0x55ee70a014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 -- 172.21.15.159:0/2927821581 shutdown_connections 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 -- 172.21.15.159:0/2927821581 wait complete. 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.640+0000 7f1abb56f740 1 -- start start 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1abb56f740 1 Processor -- start 2024-09-19T06:50:51.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a0cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a0fd40 0x55ee70a0d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1abb56f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ee70a12910 con 0x55ee70a04b60 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1abb56f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ee70924f10 con 0x55ee70a0fd40 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1abb56f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ee70a12a90 con 0x55ee70a05480 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1abb56f740 10 client.0 _ll_register_callbacks cb 0x55ee708eda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a0cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab259c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab259c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:53576/0 (socket says 172.21.15.159:53576) 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab259c640 1 -- 172.21.15.159:0/3140914014 learned_addr learned my addr 172.21.15.159:0/3140914014 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab359e640 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a0fd40 0x55ee70a0d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab259c640 1 -- 172.21.15.159:0/3140914014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a0fd40 msgr2=0x55ee70a0d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab259c640 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a0fd40 0x55ee70a0d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab259c640 1 -- 172.21.15.159:0/3140914014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 msgr2=0x55ee70a0cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab259c640 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a0cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab259c640 1 -- 172.21.15.159:0/3140914014 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee706db6a0 con 0x55ee70a05480 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.641+0000 7f1ab359e640 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a0cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1ab259c640 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0d110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800fef0 tx=0x7f1aa80056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a30b6629f69ce8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1a96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1a96ff5640 1 -- 172.21.15.159:0/3140914014 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8027020 con 0x55ee70a05480 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1a96ff5640 1 -- 172.21.15.159:0/3140914014 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1aa80046c0 con 0x55ee70a05480 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1abb56f740 1 -- 172.21.15.159:0/3140914014 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aa80110f0 con 0x55ee70a05480 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1a96ff5640 1 -- 172.21.15.159:0/3140914014 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1aa8032050 con 0x55ee70a05480 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1abb56f740 10 client.25705 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1abb56f740 1 -- 172.21.15.159:0/3140914014 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ee70a1e4c0 con 0x55ee70a05480 2024-09-19T06:50:51.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1a96ff5640 1 -- 172.21.15.159:0/3140914014 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa80110f0 con 0x55ee70a05480 2024-09-19T06:50:51.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.642+0000 7f1a96ff5640 1 -- 172.21.15.159:0/3140914014 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f1aa8010510 con 0x55ee70a05480 2024-09-19T06:50:51.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.643+0000 7f1abb56f740 10 client.25705 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:51.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.643+0000 7f1abb56f740 10 client.25705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:51.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.643+0000 7f1abb56f740 20 client.25705 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:51.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.643+0000 7f1abb56f740 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee70a1f980 0x55ee70a21d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.643+0000 7f1abb56f740 4 client.25705 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.643+0000 7f1abb56f740 1 -- 172.21.15.159:0/3140914014 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee709777f0 con 0x55ee70a1f980 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.643+0000 7f1ab359e640 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee70a1f980 0x55ee70a21d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.644+0000 7f1a96ff5640 10 client.25705 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.644+0000 7f1ab359e640 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee70a1f980 0x55ee70a21d70 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4a29d694d91f802 server_cookie=48e0a43004f5573a in_seq=0 out_seq=0 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.644+0000 7f1a96ff5640 1 -- 172.21.15.159:0/3140914014 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee709777f0 con 0x55ee70a1f980 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.644+0000 7f1a96ff5640 10 client.25705 handle_command_reply: tid=0 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.644+0000 7f1abb56f740 1 client.25705 shutdown 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 -- 172.21.15.159:0/3140914014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 msgr2=0x55ee70a0d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0d110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800fef0 tx=0x7f1aa80056d0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 -- 172.21.15.159:0/3140914014 shutdown_connections 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee70a1f980 0x55ee70a21d70 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a0fd40 0x55ee70a0d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a05480 0x55ee70a0d110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 --2- 172.21.15.159:0/3140914014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a0cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 -- 172.21.15.159:0/3140914014 >> 172.21.15.159:0/3140914014 conn(0x55ee70a010f0 msgr2=0x55ee70a00270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1a96ff5640 0 client.25705 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:51.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 -- 172.21.15.159:0/3140914014 shutdown_connections 2024-09-19T06:50:51.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 1 -- 172.21.15.159:0/3140914014 wait complete. 2024-09-19T06:50:51.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.645+0000 7f1abb56f740 20 client.25705 trim_cache size 0 max 16384 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.663+0000 7f1abb56f740 1 Processor -- start 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1abb56f740 1 -- start start 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a05480 0x55ee70a0ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 0x55ee70a274b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1abb56f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab41b1f10 con 0x55ee70a04b60 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1abb56f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab41b4790 con 0x55ee70a05480 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1abb56f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab41b2580 con 0x55ee70a0fd40 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a05480 0x55ee70a0ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52238/0 (socket says 172.21.15.159:52238) 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab359e640 1 -- 172.21.15.159:0/2199354961 learned_addr learned my addr 172.21.15.159:0/2199354961 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab359e640 1 --2- 172.21.15.159:0/2199354961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 0x55ee70a274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab259c640 1 -- 172.21.15.159:0/2199354961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 msgr2=0x55ee70a274b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab259c640 1 --2- 172.21.15.159:0/2199354961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 0x55ee70a274b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab259c640 1 -- 172.21.15.159:0/2199354961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 msgr2=0x55ee70a075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab259c640 1 --2- 172.21.15.159:0/2199354961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a075c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.664+0000 7f1ab259c640 1 -- 172.21.15.159:0/2199354961 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee70a02260 con 0x55ee70a05480 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.665+0000 7f1ab259c640 1 --2- 172.21.15.159:0/2199354961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a05480 0x55ee70a0ea30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8011e50 tx=0x7f1aa8005990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3642f353f1e0973 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.665+0000 7f1a98ff9640 1 -- 172.21.15.159:0/2199354961 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8027050 con 0x55ee70a05480 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.665+0000 7f1a98ff9640 1 -- 172.21.15.159:0/2199354961 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa801f040 con 0x55ee70a05480 2024-09-19T06:50:51.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.665+0000 7f1a98ff9640 1 -- 172.21.15.159:0/2199354961 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa801e070 con 0x55ee70a05480 2024-09-19T06:50:51.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 -- 172.21.15.159:0/2199354961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a05480 msgr2=0x55ee70a0ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2199354961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a05480 0x55ee70a0ea30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8011e50 tx=0x7f1aa8005990 comp rx=0 tx=0).stop 2024-09-19T06:50:51.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 -- 172.21.15.159:0/2199354961 shutdown_connections 2024-09-19T06:50:51.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2199354961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 0x55ee70a274b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2199354961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a05480 0x55ee70a0ea30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2199354961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a04b60 0x55ee70a075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 -- 172.21.15.159:0/2199354961 >> 172.21.15.159:0/2199354961 conn(0x55ee70a010f0 msgr2=0x55ee70a0e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 -- 172.21.15.159:0/2199354961 shutdown_connections 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 -- 172.21.15.159:0/2199354961 wait complete. 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 -- start start 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 Processor -- start 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a18100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a05480 0x55ee70a13430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 0x55ee70a13970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab41b2c50 con 0x55ee70a05480 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab41b40c0 con 0x55ee70a04b60 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab41b3320 con 0x55ee70a0fd40 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.666+0000 7f1abb56f740 10 client.0 _ll_register_callbacks cb 0x7f1aa801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a05480 0x55ee70a13430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a18100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a18100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:33750/0 (socket says 172.21.15.159:33750) 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab359e640 1 -- 172.21.15.159:0/2993630449 learned_addr learned my addr 172.21.15.159:0/2993630449 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab359e640 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 0x55ee70a13970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab259c640 1 -- 172.21.15.159:0/2993630449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 msgr2=0x55ee70a13970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab259c640 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 0x55ee70a13970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab259c640 1 -- 172.21.15.159:0/2993630449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 msgr2=0x55ee70a18100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab259c640 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a18100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab259c640 1 -- 172.21.15.159:0/2993630449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee70a13eb0 con 0x55ee70a05480 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab359e640 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 0x55ee70a13970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1ab259c640 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a05480 0x55ee70a13430 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009df0 tx=0x7f1aa8009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c77899a85f98daa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1a96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:51.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1a96ff5640 1 -- 172.21.15.159:0/2993630449 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa801e070 con 0x55ee70a05480 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1a96ff5640 1 -- 172.21.15.159:0/2993630449 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1aa8004ce0 con 0x55ee70a05480 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.667+0000 7f1abb56f740 1 -- 172.21.15.159:0/2993630449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aa801f040 con 0x55ee70a05480 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1a96ff5640 1 -- 172.21.15.159:0/2993630449 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1aa8044050 con 0x55ee70a05480 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1abb56f740 10 client.16305 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1abb56f740 1 -- 172.21.15.159:0/2993630449 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ee70a8a190 con 0x55ee70a05480 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1a96ff5640 1 -- 172.21.15.159:0/2993630449 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa801f040 con 0x55ee70a05480 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1a96ff5640 1 -- 172.21.15.159:0/2993630449 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f1aa800fa20 con 0x55ee70a05480 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1abb56f740 10 client.16305 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1abb56f740 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1abb56f740 20 client.16305 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee70a8a810 0x55ee70a8cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1abb56f740 4 client.16305 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:50:51.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1abb56f740 1 -- 172.21.15.159:0/2993630449 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ee70a222a0 con 0x55ee70a8a810 2024-09-19T06:50:51.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.668+0000 7f1ab359e640 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee70a8a810 0x55ee70a8cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.669+0000 7f1a96ff5640 10 client.16305 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:51.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.669+0000 7f1ab359e640 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee70a8a810 0x55ee70a8cc30 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c088ad8f9a0bae server_cookie=cb8bd5156478f9fe in_seq=0 out_seq=0 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.669+0000 7f1a96ff5640 1 -- 172.21.15.159:0/2993630449 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ee70a222a0 con 0x55ee70a8a810 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.669+0000 7f1a96ff5640 10 client.16305 handle_command_reply: tid=0 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 client.16305 shutdown 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 -- 172.21.15.159:0/2993630449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a05480 msgr2=0x55ee70a13430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a05480 0x55ee70a13430 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009df0 tx=0x7f1aa8009fd0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 -- 172.21.15.159:0/2993630449 shutdown_connections 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55ee70a8a810 0x55ee70a8cc30 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee70a0fd40 0x55ee70a13970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1a96ff5640 0 client.16305 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ee70a05480 0x55ee70a13430 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 --2- 172.21.15.159:0/2993630449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee70a04b60 0x55ee70a18100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 -- 172.21.15.159:0/2993630449 >> 172.21.15.159:0/2993630449 conn(0x55ee70a010f0 msgr2=0x55ee70a0d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 -- 172.21.15.159:0/2993630449 shutdown_connections 2024-09-19T06:50:51.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 1 -- 172.21.15.159:0/2993630449 wait complete. 2024-09-19T06:50:51.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.670+0000 7f1abb56f740 20 client.16305 trim_cache size 0 max 16384 2024-09-19T06:50:51.676 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:50:51.676 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:50:51.676 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "e71f0a06-436b-426e-9d48-2c6767eeae27", 2024-09-19T06:50:51.676 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:50:51.676 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:50:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 -- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a9c0a33b0 msgr2=0x7f1a9c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a9c0a33b0 0x7f1a9c0a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40a4b40 tx=0x7f1aa40bc040 comp rx=0 tx=0).stop 2024-09-19T06:50:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 -- 172.21.15.159:0/1272747159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ab4101df0 msgr2=0x7f1ab41a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ab4101df0 0x7f1ab41a4630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400e9f0 tx=0x7f1aa400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 -- 172.21.15.159:0/1272747159 shutdown_connections 2024-09-19T06:50:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1a9c0a33b0 0x7f1a9c0a5870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab4106f20 0x7f1ab410db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ab41027a0 0x7f1ab41a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 --2- 172.21.15.159:0/1272747159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ab4101df0 0x7f1ab41a4630 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 -- 172.21.15.159:0/1272747159 >> 172.21.15.159:0/1272747159 conn(0x7f1ab40fd8b0 msgr2=0x7f1ab40fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 -- 172.21.15.159:0/1272747159 shutdown_connections 2024-09-19T06:50:51.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:51.671+0000 7f1ab9196640 1 -- 172.21.15.159:0/1272747159 wait complete. 2024-09-19T06:50:52.524 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:50:52.549 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:52 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:50:52.549 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:52 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:52.549 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:52 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:50:52.549 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:52 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:52.813 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:52.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:52 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:50:52.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:52 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:52.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:52 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:50:52.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:52 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:52 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:50:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:52 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:52 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:50:52.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:52 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:53.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.313+0000 7fe36558c640 1 -- 172.21.15.159:0/1320657410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe360106f30 msgr2=0x7fe36010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:53.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.313+0000 7fe36558c640 1 --2- 172.21.15.159:0/1320657410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe360106f30 0x7fe36010eab0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe350009900 tx=0x7fe35002a410 comp rx=0 tx=0).stop 2024-09-19T06:50:53.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.313+0000 7fe36558c640 1 -- 172.21.15.159:0/1320657410 shutdown_connections 2024-09-19T06:50:53.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.313+0000 7fe36558c640 1 --2- 172.21.15.159:0/1320657410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe360106f30 0x7fe36010eab0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.313+0000 7fe36558c640 1 --2- 172.21.15.159:0/1320657410 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe360100cc0 0x7fe360106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.313+0000 7fe36558c640 1 --2- 172.21.15.159:0/1320657410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360100310 0x7fe3601006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.313+0000 7fe36558c640 1 -- 172.21.15.159:0/1320657410 >> 172.21.15.159:0/1320657410 conn(0x7fe360077210 msgr2=0x7fe3600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:53.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.313+0000 7fe36558c640 1 -- 172.21.15.159:0/1320657410 shutdown_connections 2024-09-19T06:50:53.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.313+0000 7fe36558c640 1 -- 172.21.15.159:0/1320657410 wait complete. 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.314+0000 7fe36558c640 1 Processor -- start 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.314+0000 7fe36558c640 1 -- start start 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe36558c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe360100310 0x7fe360101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe36558c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe360100cc0 0x7fe3601017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe36558c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f30 0x7fe360101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe36558c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe360111f90 con 0x7fe360100310 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe36558c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe360111e10 con 0x7fe360100cc0 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe36558c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe360112110 con 0x7fe360106f30 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe35effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe360100310 0x7fe360101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe35effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe360100310 0x7fe360101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52268/0 (socket says 172.21.15.159:52268) 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe35effd640 1 -- 172.21.15.159:0/1080336416 learned_addr learned my addr 172.21.15.159:0/1080336416 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:53.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f30 0x7fe360101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe360100cc0 0x7fe3601017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe35f7fe640 1 -- 172.21.15.159:0/1080336416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe360100cc0 msgr2=0x7fe3601017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.315+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe360100cc0 0x7fe3601017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.316+0000 7fe35f7fe640 1 -- 172.21.15.159:0/1080336416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe360100310 msgr2=0x7fe360101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.316+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe360100310 0x7fe360101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.316+0000 7fe35f7fe640 1 -- 172.21.15.159:0/1080336416 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3601a6890 con 0x7fe360106f30 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.316+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f30 0x7fe360101d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe350009230 tx=0x7fe350005e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.316+0000 7fe357fff640 1 -- 172.21.15.159:0/1080336416 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35003f030 con 0x7fe360106f30 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.316+0000 7fe357fff640 1 -- 172.21.15.159:0/1080336416 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe350004350 con 0x7fe360106f30 2024-09-19T06:50:53.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.316+0000 7fe36558c640 1 -- 172.21.15.159:0/1080336416 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3601a6b20 con 0x7fe360106f30 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.316+0000 7fe357fff640 1 -- 172.21.15.159:0/1080336416 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350035070 con 0x7fe360106f30 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.316+0000 7fe36558c640 1 -- 172.21.15.159:0/1080336416 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3601a7000 con 0x7fe360106f30 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.318+0000 7fe357fff640 1 -- 172.21.15.159:0/1080336416 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe350042030 con 0x7fe360106f30 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.319+0000 7fe367965740 1 Processor -- start 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.319+0000 7fe367965740 1 -- start start 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.319+0000 7fe367965740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572688824a0 0x557268882880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.319+0000 7fe357fff640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe34c0a33b0 0x7fe34c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.319+0000 7fe367965740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557268882dc0 0x55726888d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.319+0000 7fe367965740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x55726888fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.319+0000 7fe367965740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5572687e82e0 con 0x557268882dc0 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.319+0000 7fe367965740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55726878fce0 con 0x55726888d680 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.319+0000 7fe367965740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5572687e42a0 con 0x5572688824a0 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35effd640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe34c0a33b0 0x7fe34c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x55726888fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557268882dc0 0x55726888d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557268882dc0 0x55726888d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52280/0 (socket says 172.21.15.159:52280) 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35e7fc640 1 -- 172.21.15.159:0/242971075 learned_addr learned my addr 172.21.15.159:0/242971075 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x55726888fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:33770/0 (socket says 172.21.15.159:33770) 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/242971075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572688824a0 0x557268882880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe357fff640 1 -- 172.21.15.159:0/1080336416 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe3500efcf0 con 0x7fe360106f30 2024-09-19T06:50:53.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35f7fe640 1 -- 172.21.15.159:0/242971075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572688824a0 msgr2=0x557268882880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/242971075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572688824a0 0x557268882880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35f7fe640 1 -- 172.21.15.159:0/242971075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557268882dc0 msgr2=0x55726888d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/242971075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557268882dc0 0x55726888d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35f7fe640 1 -- 172.21.15.159:0/242971075 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557268774440 con 0x55726888d680 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/242971075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557268882dc0 0x55726888d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35effd640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe34c0a33b0 0x7fe34c0a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe358009fd0 tx=0x7fe358009500 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/242971075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x55726888fa70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe3500ed3b0 tx=0x7fe350049590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a0e28d546fe7130 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe3557fa640 1 -- 172.21.15.159:0/242971075 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350049040 con 0x55726888d680 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe3557fa640 1 -- 172.21.15.159:0/242971075 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3500ce850 con 0x55726888d680 2024-09-19T06:50:53.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.320+0000 7fe3557fa640 1 -- 172.21.15.159:0/242971075 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3500c02f0 con 0x55726888d680 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.321+0000 7fe367965740 1 -- 172.21.15.159:0/242971075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 msgr2=0x55726888fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.321+0000 7fe367965740 1 --2- 172.21.15.159:0/242971075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x55726888fa70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe3500ed3b0 tx=0x7fe350049590 comp rx=0 tx=0).stop 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.321+0000 7fe367965740 1 -- 172.21.15.159:0/242971075 shutdown_connections 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.321+0000 7fe367965740 1 --2- 172.21.15.159:0/242971075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x55726888fa70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.321+0000 7fe367965740 1 --2- 172.21.15.159:0/242971075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557268882dc0 0x55726888d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.321+0000 7fe367965740 1 --2- 172.21.15.159:0/242971075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5572688824a0 0x557268882880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.321+0000 7fe367965740 1 -- 172.21.15.159:0/242971075 >> 172.21.15.159:0/242971075 conn(0x55726887ea30 msgr2=0x55726887ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.321+0000 7fe367965740 1 -- 172.21.15.159:0/242971075 shutdown_connections 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.321+0000 7fe367965740 1 -- 172.21.15.159:0/242971075 wait complete. 2024-09-19T06:50:53.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe367965740 1 -- start start 2024-09-19T06:50:53.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe367965740 1 Processor -- start 2024-09-19T06:50:53.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe367965740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572688824a0 0x55726888cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe367965740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x55726888a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe367965740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55726888d680 0x55726888a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe367965740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557268890010 con 0x55726888d680 2024-09-19T06:50:53.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe367965740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5572687a3050 con 0x5572688824a0 2024-09-19T06:50:53.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe367965740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557268890190 con 0x557268882dc0 2024-09-19T06:50:53.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe367965740 10 client.0 _ll_register_callbacks cb 0x5572687e3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:53.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe35effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572688824a0 0x55726888cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe35e7fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x55726888a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55726888d680 0x55726888a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe35effd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572688824a0 0x55726888cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:33774/0 (socket says 172.21.15.159:33774) 2024-09-19T06:50:53.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe35e7fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x55726888a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:53652/0 (socket says 172.21.15.159:53652) 2024-09-19T06:50:53.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.322+0000 7fe35effd640 1 -- 172.21.15.159:0/4028285595 learned_addr learned my addr 172.21.15.159:0/4028285595 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:53.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe35e7fc640 1 -- 172.21.15.159:0/4028285595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572688824a0 msgr2=0x55726888cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:53.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572688824a0 0x55726888cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe35e7fc640 1 -- 172.21.15.159:0/4028285595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55726888d680 msgr2=0x55726888a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:53.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55726888d680 0x55726888a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe35e7fc640 1 -- 172.21.15.159:0/4028285595 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572685593c0 con 0x557268882dc0 2024-09-19T06:50:53.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe35effd640 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572688824a0 0x55726888cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:53.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x55726888a270 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe348009fd0 tx=0x7fe3480039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a77b7f789c35bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:53.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe3467fc640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:50:53.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe3467fc640 1 -- 172.21.15.159:0/4028285595 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348005220 con 0x557268882dc0 2024-09-19T06:50:53.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe3467fc640 1 -- 172.21.15.159:0/4028285595 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe3480053c0 con 0x557268882dc0 2024-09-19T06:50:53.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe367965740 1 -- 172.21.15.159:0/4028285595 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3500ce850 con 0x557268882dc0 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe3467fc640 1 -- 172.21.15.159:0/4028285595 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe3480055c0 con 0x557268882dc0 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe367965740 10 client.25723 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe367965740 1 -- 172.21.15.159:0/4028285595 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55726889b990 con 0x557268882dc0 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.323+0000 7fe3467fc640 1 -- 172.21.15.159:0/4028285595 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3500ce850 con 0x557268882dc0 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe3467fc640 1 -- 172.21.15.159:0/4028285595 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe348025070 con 0x557268882dc0 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe367965740 10 client.25723 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe367965740 10 client.25723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe367965740 20 client.25723 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe367965740 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55726889cda0 0x55726889f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe367965740 4 client.25723 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe367965740 1 -- 172.21.15.159:0/4028285595 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572687f5850 con 0x55726889cda0 2024-09-19T06:50:53.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe35effd640 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55726889cda0 0x55726889f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe35effd640 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55726889cda0 0x55726889f1c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22abe7fbfd67a9b5 server_cookie=e04865ef611a7c47 in_seq=0 out_seq=0 2024-09-19T06:50:53.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.324+0000 7fe3467fc640 10 client.25723 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:53.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe3467fc640 1 -- 172.21.15.159:0/4028285595 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572687f5850 con 0x55726889cda0 2024-09-19T06:50:53.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe3467fc640 10 client.25723 handle_command_reply: tid=0 2024-09-19T06:50:53.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 client.25723 shutdown 2024-09-19T06:50:53.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 -- 172.21.15.159:0/4028285595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 msgr2=0x55726888a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:53.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x55726888a270 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe348009fd0 tx=0x7fe3480039c0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 -- 172.21.15.159:0/4028285595 shutdown_connections 2024-09-19T06:50:53.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55726889cda0 0x55726889f1c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55726888d680 0x55726888a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe3467fc640 0 client.25723 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:53.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x55726888a270 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 --2- 172.21.15.159:0/4028285595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572688824a0 0x55726888cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 -- 172.21.15.159:0/4028285595 >> 172.21.15.159:0/4028285595 conn(0x55726887ea30 msgr2=0x557268884760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:53.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 -- 172.21.15.159:0/4028285595 shutdown_connections 2024-09-19T06:50:53.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.325+0000 7fe367965740 1 -- 172.21.15.159:0/4028285595 wait complete. 2024-09-19T06:50:53.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.326+0000 7fe367965740 20 client.25723 trim_cache size 0 max 16384 2024-09-19T06:50:53.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.346+0000 7fe367965740 1 Processor -- start 2024-09-19T06:50:53.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.346+0000 7fe367965740 1 -- start start 2024-09-19T06:50:53.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe367965740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x5572688991c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe367965740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x5572688a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe367965740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x5572688a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe367965740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601adaa0 con 0x5572688824a0 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe367965740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601b0320 con 0x55726888d680 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe367965740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601ae110 con 0x557268882dc0 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe35effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x5572688991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe35e7fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x5572688a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe35effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x5572688991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52286/0 (socket says 172.21.15.159:52286) 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe35effd640 1 -- 172.21.15.159:0/4217395441 learned_addr learned my addr 172.21.15.159:0/4217395441 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x5572688a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe35e7fc640 1 -- 172.21.15.159:0/4217395441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 msgr2=0x5572688a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x5572688a4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe35e7fc640 1 -- 172.21.15.159:0/4217395441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 msgr2=0x5572688991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:53.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.347+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x5572688991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.348+0000 7fe35e7fc640 1 -- 172.21.15.159:0/4217395441 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572688822d0 con 0x557268882dc0 2024-09-19T06:50:53.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.348+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x5572688a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:53.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.348+0000 7fe35effd640 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x5572688991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:53.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.348+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x5572688a4a70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe3480097c0 tx=0x7fe348005d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40d14fcfd8598990 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:53.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.348+0000 7fe354ff9640 1 -- 172.21.15.159:0/4217395441 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34802d070 con 0x557268882dc0 2024-09-19T06:50:53.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.348+0000 7fe354ff9640 1 -- 172.21.15.159:0/4217395441 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe348004350 con 0x557268882dc0 2024-09-19T06:50:53.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.348+0000 7fe354ff9640 1 -- 172.21.15.159:0/4217395441 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348011c20 con 0x557268882dc0 2024-09-19T06:50:53.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 -- 172.21.15.159:0/4217395441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 msgr2=0x5572688a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:53.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x5572688a4a70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe3480097c0 tx=0x7fe348005d30 comp rx=0 tx=0).stop 2024-09-19T06:50:53.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 -- 172.21.15.159:0/4217395441 shutdown_connections 2024-09-19T06:50:53.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x5572688a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x5572688a4a70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 --2- 172.21.15.159:0/4217395441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x5572688991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 -- 172.21.15.159:0/4217395441 >> 172.21.15.159:0/4217395441 conn(0x55726887ea30 msgr2=0x557268888b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 -- 172.21.15.159:0/4217395441 shutdown_connections 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 -- 172.21.15.159:0/4217395441 wait complete. 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 -- start start 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.349+0000 7fe367965740 1 Processor -- start 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe367965740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x557268895c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe367965740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x557268887150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe367965740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x557268887890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe367965740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601ae7e0 con 0x5572688824a0 2024-09-19T06:50:53.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe367965740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601afc50 con 0x55726888d680 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe367965740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601aeeb0 con 0x557268882dc0 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe367965740 10 client.0 _ll_register_callbacks cb 0x7fe348009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x557268895c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x557268887890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x557268887890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:33782/0 (socket says 172.21.15.159:33782) 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35f7fe640 1 -- 172.21.15.159:0/1570738251 learned_addr learned my addr 172.21.15.159:0/1570738251 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35e7fc640 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x557268887150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35f7fe640 1 -- 172.21.15.159:0/1570738251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 msgr2=0x557268887150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x557268887150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35f7fe640 1 -- 172.21.15.159:0/1570738251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 msgr2=0x557268895c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x557268895c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35f7fe640 1 -- 172.21.15.159:0/1570738251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557268906a40 con 0x55726888d680 2024-09-19T06:50:53.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35effd640 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x557268895c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe35f7fe640 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x557268887890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe3500b89c0 tx=0x7fe350003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e6ec6c53bbd48ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.350+0000 7fe3467fc640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe3467fc640 1 -- 172.21.15.159:0/1570738251 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3500d4060 con 0x55726888d680 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe3467fc640 1 -- 172.21.15.159:0/1570738251 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe3500b8660 con 0x55726888d680 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe367965740 1 -- 172.21.15.159:0/1570738251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55726888ab40 con 0x55726888d680 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe3467fc640 1 -- 172.21.15.159:0/1570738251 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe350049040 con 0x55726888d680 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe367965740 10 client.25679 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe367965740 1 -- 172.21.15.159:0/1570738251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557268907bb0 con 0x55726888d680 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe3467fc640 1 -- 172.21.15.159:0/1570738251 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55726888ab40 con 0x55726888d680 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe3467fc640 1 -- 172.21.15.159:0/1570738251 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe3500a6040 con 0x55726888d680 2024-09-19T06:50:53.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe367965740 10 client.25679 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe367965740 10 client.25679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe367965740 20 client.25679 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe367965740 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557268908090 0x55726890a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe367965740 4 client.25679 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.351+0000 7fe367965740 1 -- 172.21.15.159:0/1570738251 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5572687efd60 con 0x557268908090 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe35effd640 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557268908090 0x55726890a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe3467fc640 10 client.25679 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe35effd640 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557268908090 0x55726890a480 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d49893bb87bcf73 server_cookie=fd1e5510b0501fb0 in_seq=0 out_seq=0 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe3467fc640 1 -- 172.21.15.159:0/1570738251 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5572687efd60 con 0x557268908090 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe3467fc640 10 client.25679 handle_command_reply: tid=0 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 client.25679 shutdown 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 -- 172.21.15.159:0/1570738251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 msgr2=0x557268887890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:53.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x557268887890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe3500b89c0 tx=0x7fe350003f90 comp rx=0 tx=0).stop 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 -- 172.21.15.159:0/1570738251 shutdown_connections 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557268908090 0x55726890a480 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55726888d680 0x557268887890 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557268882dc0 0x557268887150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 --2- 172.21.15.159:0/1570738251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5572688824a0 0x557268895c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe3467fc640 0 client.25679 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 -- 172.21.15.159:0/1570738251 >> 172.21.15.159:0/1570738251 conn(0x55726887ea30 msgr2=0x55726888c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 -- 172.21.15.159:0/1570738251 shutdown_connections 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.352+0000 7fe367965740 1 -- 172.21.15.159:0/1570738251 wait complete. 2024-09-19T06:50:53.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe367965740 20 client.25679 trim_cache size 0 max 16384 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: "e71f0a06-436b-426e-9d48-2c6767eeae27": { 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "e71f0a06-436b-426e-9d48-2c6767eeae27", 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:50:53.361 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:50:53.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 -- 172.21.15.159:0/1080336416 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe34c0a33b0 msgr2=0x7fe34c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:53.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe34c0a33b0 0x7fe34c0a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe358009fd0 tx=0x7fe358009500 comp rx=0 tx=0).stop 2024-09-19T06:50:53.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 -- 172.21.15.159:0/1080336416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f30 msgr2=0x7fe360101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:53.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f30 0x7fe360101d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe350009230 tx=0x7fe350005e70 comp rx=0 tx=0).stop 2024-09-19T06:50:53.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 -- 172.21.15.159:0/1080336416 shutdown_connections 2024-09-19T06:50:53.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe34c0a33b0 0x7fe34c0a5870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe360106f30 0x7fe360101d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe360100cc0 0x7fe3601017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 --2- 172.21.15.159:0/1080336416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe360100310 0x7fe360101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:53.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 -- 172.21.15.159:0/1080336416 >> 172.21.15.159:0/1080336416 conn(0x7fe360077210 msgr2=0x7fe360105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:53.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 -- 172.21.15.159:0/1080336416 shutdown_connections 2024-09-19T06:50:53.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:50:53.353+0000 7fe36558c640 1 -- 172.21.15.159:0/1080336416 wait complete. 2024-09-19T06:50:53.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:53 smithi203 ceph-mon[35473]: pgmap v121: 97 pgs: 97 active+clean; 48 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.0 MiB/s wr, 529 op/s 2024-09-19T06:50:53.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:53 smithi189 ceph-mon[34880]: pgmap v121: 97 pgs: 97 active+clean; 48 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.0 MiB/s wr, 529 op/s 2024-09-19T06:50:53.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:53 smithi159 ceph-mon[30935]: pgmap v121: 97 pgs: 97 active+clean; 48 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.0 MiB/s wr, 529 op/s 2024-09-19T06:50:54.074 INFO:tasks.cephfs.filesystem:scrub status for tag:e71f0a06-436b-426e-9d48-2c6767eeae27 - {'path': '/', 'tag': 'e71f0a06-436b-426e-9d48-2c6767eeae27', 'options': 'recursive,force'} 2024-09-19T06:50:54.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:54 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:50:54.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:54 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:50:54.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:54 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:50:55.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:55 smithi203 ceph-mon[35473]: pgmap v122: 97 pgs: 97 active+clean; 48 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.0 MiB/s wr, 527 op/s 2024-09-19T06:50:55.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:55 smithi189 ceph-mon[34880]: pgmap v122: 97 pgs: 97 active+clean; 48 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.0 MiB/s wr, 527 op/s 2024-09-19T06:50:55.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:55 smithi159 ceph-mon[30935]: pgmap v122: 97 pgs: 97 active+clean; 48 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.0 MiB/s wr, 527 op/s 2024-09-19T06:50:57.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:56 smithi203 ceph-mon[35473]: pgmap v123: 97 pgs: 97 active+clean; 48 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 5.2 MiB/s wr, 1.28k op/s 2024-09-19T06:50:57.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:56 smithi189 ceph-mon[34880]: pgmap v123: 97 pgs: 97 active+clean; 48 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 5.2 MiB/s wr, 1.28k op/s 2024-09-19T06:50:57.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:56 smithi159 ceph-mon[30935]: pgmap v123: 97 pgs: 97 active+clean; 48 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 5.2 MiB/s wr, 1.28k op/s 2024-09-19T06:50:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:50:58 smithi203 ceph-mon[35473]: pgmap v124: 97 pgs: 97 active+clean; 48 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.0 MiB/s wr, 1.10k op/s 2024-09-19T06:50:59.120 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0x9ff773 2024-09-19T06:50:59.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:50:58 smithi189 ceph-mon[34880]: pgmap v124: 97 pgs: 97 active+clean; 48 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.0 MiB/s wr, 1.10k op/s 2024-09-19T06:50:59.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:50:58 smithi159 ceph-mon[30935]: pgmap v124: 97 pgs: 97 active+clean; 48 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.0 MiB/s wr, 1.10k op/s 2024-09-19T06:50:59.463 INFO:tasks.workunit.client.0.smithi159.stdout:20000 punch from 0x34ddcb to 0x35324f, (0x5484 bytes) 2024-09-19T06:50:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.653+0000 7f1b1c15f640 1 -- 172.21.15.159:0/845075259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14107b80 msgr2=0x7f1b14107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.653+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/845075259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14107b80 0x7f1b14107f60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009930 tx=0x7f1b1002a420 comp rx=0 tx=0).stop 2024-09-19T06:50:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.653+0000 7f1b1c15f640 1 -- 172.21.15.159:0/845075259 shutdown_connections 2024-09-19T06:50:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.653+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/845075259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b14102480 0x7f1b1410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.653+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/845075259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b14101ae0 0x7f1b14101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.653+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/845075259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14107b80 0x7f1b14107f60 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.653+0000 7f1b1c15f640 1 -- 172.21.15.159:0/845075259 >> 172.21.15.159:0/845075259 conn(0x7f1b140fd7e0 msgr2=0x7f1b140ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.653+0000 7f1b1c15f640 1 -- 172.21.15.159:0/845075259 shutdown_connections 2024-09-19T06:50:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.653+0000 7f1b1c15f640 1 -- 172.21.15.159:0/845075259 wait complete. 2024-09-19T06:50:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b1c15f640 1 Processor -- start 2024-09-19T06:50:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b1c15f640 1 -- start start 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b1c15f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b14101ae0 0x7f1b140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b1c15f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14102480 0x7f1b14074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b1c15f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b14107b80 0x7f1b14074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b1c15f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14111f30 con 0x7f1b14102480 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b1c15f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14111db0 con 0x7f1b14101ae0 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b1c15f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141120b0 con 0x7f1b14107b80 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b196fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14102480 0x7f1b14074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b196fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14102480 0x7f1b14074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49158/0 (socket says 172.21.15.159:49158) 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b19efb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b14101ae0 0x7f1b140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.654+0000 7f1b196fa640 1 -- 172.21.15.159:0/2613121042 learned_addr learned my addr 172.21.15.159:0/2613121042 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b14107b80 0x7f1b14074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b196fa640 1 -- 172.21.15.159:0/2613121042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b14107b80 msgr2=0x7f1b14074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b196fa640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b14107b80 0x7f1b14074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b196fa640 1 -- 172.21.15.159:0/2613121042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b14101ae0 msgr2=0x7f1b140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b196fa640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b14101ae0 0x7f1b140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b196fa640 1 -- 172.21.15.159:0/2613121042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b141a6820 con 0x7f1b14102480 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b14107b80 0x7f1b14074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b196fa640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14102480 0x7f1b14074a30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e9f0 tx=0x7f1b0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b0affd640 1 -- 172.21.15.159:0/2613121042 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400cd80 con 0x7f1b14102480 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b1c15f640 1 -- 172.21.15.159:0/2613121042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b141a6b10 con 0x7f1b14102480 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b0affd640 1 -- 172.21.15.159:0/2613121042 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b04005500 con 0x7f1b14102480 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b0affd640 1 -- 172.21.15.159:0/2613121042 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04010690 con 0x7f1b14102480 2024-09-19T06:50:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.655+0000 7f1b1c15f640 1 -- 172.21.15.159:0/2613121042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b141a7060 con 0x7f1b14102480 2024-09-19T06:50:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.658+0000 7f1b0affd640 1 -- 172.21.15.159:0/2613121042 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1b040046c0 con 0x7f1b14102480 2024-09-19T06:50:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.658+0000 7f1b1efd6740 1 Processor -- start 2024-09-19T06:50:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.658+0000 7f1b1efd6740 1 -- start start 2024-09-19T06:50:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d95180aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 0x55d951815770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d9518180a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d95176f2f0 con 0x55d95180aaf0 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d951717270 con 0x55d951815cb0 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d95176b2b0 con 0x55d95180b410 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d95180aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d95180aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49172/0 (socket says 172.21.15.159:49172) 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 -- 172.21.15.159:0/1586656790 learned_addr learned my addr 172.21.15.159:0/1586656790 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b19efb640 1 --2- 172.21.15.159:0/1586656790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 0x55d951815770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b196fa640 1 --2- 172.21.15.159:0/1586656790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d9518180a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b0affd640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1b000a3460 0x7f1b000a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 -- 172.21.15.159:0/1586656790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 msgr2=0x55d951815770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/1586656790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 0x55d951815770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 -- 172.21.15.159:0/1586656790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 msgr2=0x55d9518180a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/1586656790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d9518180a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 -- 172.21.15.159:0/1586656790 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d951716340 con 0x55d95180aaf0 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b0affd640 1 -- 172.21.15.159:0/2613121042 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1b040d0170 con 0x7f1b14102480 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/1586656790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d95180aed0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c011790 tx=0x7f1b0c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793938765270ba58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1b000a3460 0x7f1b000a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.659+0000 7f1afffff640 1 -- 172.21.15.159:0/1586656790 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c00f9a0 con 0x55d95180aaf0 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.660+0000 7f1afffff640 1 -- 172.21.15.159:0/1586656790 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0c00fd40 con 0x55d95180aaf0 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.660+0000 7f1afffff640 1 -- 172.21.15.159:0/1586656790 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c01cbc0 con 0x55d95180aaf0 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 -- 172.21.15.159:0/1586656790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 msgr2=0x55d95180aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1b000a3460 0x7f1b000a5920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c020000 tx=0x7f1b0c021000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/1586656790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d95180aed0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c011790 tx=0x7f1b0c011b90 comp rx=0 tx=0).stop 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 -- 172.21.15.159:0/1586656790 shutdown_connections 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/1586656790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d9518180a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/1586656790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 0x55d951815770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/1586656790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d95180aed0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 -- 172.21.15.159:0/1586656790 >> 172.21.15.159:0/1586656790 conn(0x55d951807060 msgr2=0x55d951807440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 -- 172.21.15.159:0/1586656790 shutdown_connections 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 -- 172.21.15.159:0/1586656790 wait complete. 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 -- start start 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.661+0000 7f1b1efd6740 1 Processor -- start 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951812bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 0x55d951813110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d951813650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d951818880 con 0x55d95180aaf0 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d9516f8290 con 0x55d951815cb0 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d951818a00 con 0x55d95180b410 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1efd6740 10 client.0 _ll_register_callbacks cb 0x55d951729140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b19efb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951812bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b19efb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951812bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49188/0 (socket says 172.21.15.159:49188) 2024-09-19T06:50:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b19efb640 1 -- 172.21.15.159:0/569688453 learned_addr learned my addr 172.21.15.159:0/569688453 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b196fa640 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 0x55d951813110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d951813650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b19efb640 1 -- 172.21.15.159:0/569688453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 msgr2=0x55d951813110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b19efb640 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 0x55d951813110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b19efb640 1 -- 172.21.15.159:0/569688453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 msgr2=0x55d951813650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b19efb640 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d951813650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b19efb640 1 -- 172.21.15.159:0/569688453 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d951482210 con 0x55d95180aaf0 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d951813650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b196fa640 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 0x55d951813110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b19efb640 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951812bd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1b1002a940 tx=0x7f1b100317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db90a89b7e1bc128 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1afd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1afd7fa640 1 -- 172.21.15.159:0/569688453 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10035040 con 0x55d95180aaf0 2024-09-19T06:50:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1afd7fa640 1 -- 172.21.15.159:0/569688453 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1b10004460 con 0x55d95180aaf0 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.662+0000 7f1b1efd6740 1 -- 172.21.15.159:0/569688453 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b0c00fd40 con 0x55d95180aaf0 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1afd7fa640 1 -- 172.21.15.159:0/569688453 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b10005020 con 0x55d95180aaf0 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1b1efd6740 10 client.16335 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1b1efd6740 1 -- 172.21.15.159:0/569688453 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d95154e620 con 0x55d95180aaf0 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1afd7fa640 1 -- 172.21.15.159:0/569688453 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0c00fd40 con 0x55d95180aaf0 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1afd7fa640 1 -- 172.21.15.159:0/569688453 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f1b1004c070 con 0x55d95180aaf0 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1b1efd6740 10 client.16335 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1b1efd6740 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1b1efd6740 20 client.16335 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d951825c40 0x55d951828030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1b1efd6740 4 client.16335 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1b1efd6740 1 -- 172.21.15.159:0/569688453 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d95177ca20 con 0x55d951825c40 2024-09-19T06:50:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.663+0000 7f1b196fa640 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d951825c40 0x55d951828030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.664+0000 7f1afd7fa640 10 client.16335 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.664+0000 7f1b196fa640 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d951825c40 0x55d951828030 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cdcea89241d70 server_cookie=7238b50d090bba2a in_seq=0 out_seq=0 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1afd7fa640 1 -- 172.21.15.159:0/569688453 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d95177ca20 con 0x55d951825c40 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1afd7fa640 10 client.16335 handle_command_reply: tid=0 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 client.16335 shutdown 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 -- 172.21.15.159:0/569688453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 msgr2=0x55d951812bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951812bd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1b1002a940 tx=0x7f1b100317e0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 -- 172.21.15.159:0/569688453 shutdown_connections 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d951825c40 0x55d951828030 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1afd7fa640 0 client.16335 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d951813650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180b410 0x55d951813110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/569688453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951812bd0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 -- 172.21.15.159:0/569688453 >> 172.21.15.159:0/569688453 conn(0x55d951807060 msgr2=0x55d95180cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 -- 172.21.15.159:0/569688453 shutdown_connections 2024-09-19T06:50:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 1 -- 172.21.15.159:0/569688453 wait complete. 2024-09-19T06:50:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.665+0000 7f1b1efd6740 20 client.16335 trim_cache size 0 max 16384 2024-09-19T06:50:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.682+0000 7f1b1efd6740 1 Processor -- start 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.682+0000 7f1b1efd6740 1 -- start start 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.682+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951806b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.682+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d95180b410 0x55d95180cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.682+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d951815cb0 0x55d951813480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.682+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141ada00 con 0x55d95180aaf0 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.682+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141b0280 con 0x55d95180b410 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141ae070 con 0x55d951815cb0 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b19efb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951806b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b196fa640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d95180b410 0x55d95180cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b19efb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951806b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49204/0 (socket says 172.21.15.159:49204) 2024-09-19T06:50:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b196fa640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d95180b410 0x55d95180cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:34890/0 (socket says 172.21.15.159:34890) 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b19efb640 1 -- 172.21.15.159:0/3224190150 learned_addr learned my addr 172.21.15.159:0/3224190150 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/3224190150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d951815cb0 0x55d951813480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b19efb640 1 -- 172.21.15.159:0/3224190150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d951815cb0 msgr2=0x55d951813480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b19efb640 1 --2- 172.21.15.159:0/3224190150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d951815cb0 0x55d951813480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b19efb640 1 -- 172.21.15.159:0/3224190150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d95180b410 msgr2=0x55d95180cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b19efb640 1 --2- 172.21.15.159:0/3224190150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d95180b410 0x55d95180cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b19efb640 1 -- 172.21.15.159:0/3224190150 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d951811100 con 0x55d95180aaf0 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1b19efb640 1 --2- 172.21.15.159:0/3224190150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951806b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1b100096c0 tx=0x7f1b1002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a72d1578650f8a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1aff7fe640 1 -- 172.21.15.159:0/3224190150 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10052070 con 0x55d95180aaf0 2024-09-19T06:50:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1aff7fe640 1 -- 172.21.15.159:0/3224190150 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b10041070 con 0x55d95180aaf0 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.683+0000 7f1aff7fe640 1 -- 172.21.15.159:0/3224190150 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10035030 con 0x55d95180aaf0 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 -- 172.21.15.159:0/3224190150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 msgr2=0x55d951806b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/3224190150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951806b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1b100096c0 tx=0x7f1b1002a420 comp rx=0 tx=0).stop 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 -- 172.21.15.159:0/3224190150 shutdown_connections 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/3224190150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d951815cb0 0x55d951813480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/3224190150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d95180b410 0x55d95180cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/3224190150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180aaf0 0x55d951806b00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 -- 172.21.15.159:0/3224190150 >> 172.21.15.159:0/3224190150 conn(0x55d951807060 msgr2=0x55d95180c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 -- 172.21.15.159:0/3224190150 shutdown_connections 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 -- 172.21.15.159:0/3224190150 wait complete. 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 -- start start 2024-09-19T06:50:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.684+0000 7f1b1efd6740 1 Processor -- start 2024-09-19T06:50:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180aaf0 0x55d951819400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180b410 0x55d951819940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b1efd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d9518888b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141ae740 con 0x55d95180b410 2024-09-19T06:50:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141afbb0 con 0x55d951815cb0 2024-09-19T06:50:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b1efd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b141aee10 con 0x55d95180aaf0 2024-09-19T06:50:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b1efd6740 10 client.0 _ll_register_callbacks cb 0x7f1b10009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b196fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180b410 0x55d951819940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b196fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180b410 0x55d951819940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49206/0 (socket says 172.21.15.159:49206) 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b19efb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180aaf0 0x55d951819400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b196fa640 1 -- 172.21.15.159:0/137352922 learned_addr learned my addr 172.21.15.159:0/137352922 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d9518888b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b196fa640 1 -- 172.21.15.159:0/137352922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180aaf0 msgr2=0x55d951819400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b196fa640 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180aaf0 0x55d951819400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b196fa640 1 -- 172.21.15.159:0/137352922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 msgr2=0x55d9518888b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b196fa640 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d9518888b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b196fa640 1 -- 172.21.15.159:0/137352922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d951888f20 con 0x55d95180b410 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b1a6fc640 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d9518888b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1b196fa640 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180b410 0x55d951819940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400cf40 tx=0x7f1b04096f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9818404e60621a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.685+0000 7f1afd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:50:59.692 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1afd7fa640 1 -- 172.21.15.159:0/137352922 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0409c1f0 con 0x55d95180b410 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1afd7fa640 1 -- 172.21.15.159:0/137352922 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1b04098a90 con 0x55d95180b410 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b1efd6740 1 -- 172.21.15.159:0/137352922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b10041070 con 0x55d95180b410 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1afd7fa640 1 -- 172.21.15.159:0/137352922 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b0409bd80 con 0x55d95180b410 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b1efd6740 10 client.16341 fetch_fsmap learned FSMap version 24 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b1efd6740 1 -- 172.21.15.159:0/137352922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d951890310 con 0x55d95180b410 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1afd7fa640 1 -- 172.21.15.159:0/137352922 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b10041070 con 0x55d95180b410 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1afd7fa640 1 -- 172.21.15.159:0/137352922 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f1b040a4c00 con 0x55d95180b410 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b1efd6740 10 client.16341 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b1efd6740 10 client.16341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b1efd6740 20 client.16341 populate_metadata read hostname 'smithi159' 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d951890a40 0x55d951892e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b1efd6740 4 client.16341 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b1efd6740 1 -- 172.21.15.159:0/137352922 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d951776d70 con 0x55d951890a40 2024-09-19T06:50:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.686+0000 7f1b19efb640 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d951890a40 0x55d951892e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.687+0000 7f1afd7fa640 10 client.16341 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.687+0000 7f1b19efb640 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d951890a40 0x55d951892e60 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f574dde9c15af34 server_cookie=1ad34041db1242 in_seq=0 out_seq=0 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1afd7fa640 1 -- 172.21.15.159:0/137352922 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d951776d70 con 0x55d951890a40 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1afd7fa640 10 client.16341 handle_command_reply: tid=0 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 client.16341 shutdown 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 -- 172.21.15.159:0/137352922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180b410 msgr2=0x55d951819940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180b410 0x55d951819940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400cf40 tx=0x7f1b04096f90 comp rx=0 tx=0).stop 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 -- 172.21.15.159:0/137352922 shutdown_connections 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d951890a40 0x55d951892e60 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d951815cb0 0x55d9518888b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d95180b410 0x55d951819940 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 --2- 172.21.15.159:0/137352922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d95180aaf0 0x55d951819400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1afd7fa640 0 client.16341 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:50:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 -- 172.21.15.159:0/137352922 >> 172.21.15.159:0/137352922 conn(0x55d951807060 msgr2=0x55d95180cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 -- 172.21.15.159:0/137352922 shutdown_connections 2024-09-19T06:50:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 1 -- 172.21.15.159:0/137352922 wait complete. 2024-09-19T06:50:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.705+0000 7f1b1efd6740 20 client.16341 trim_cache size 0 max 16384 2024-09-19T06:50:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:50:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:50:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:50:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:50:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 -- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1b000a3460 msgr2=0x7f1b000a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1b000a3460 0x7f1b000a5920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c020000 tx=0x7f1b0c021000 comp rx=0 tx=0).stop 2024-09-19T06:50:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 -- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14102480 msgr2=0x7f1b14074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14102480 0x7f1b14074a30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e9f0 tx=0x7f1b0400edf0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 -- 172.21.15.159:0/2613121042 shutdown_connections 2024-09-19T06:50:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1b000a3460 0x7f1b000a5920 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b14107b80 0x7f1b14074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b14102480 0x7f1b14074a30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 --2- 172.21.15.159:0/2613121042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b14101ae0 0x7f1b140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 -- 172.21.15.159:0/2613121042 >> 172.21.15.159:0/2613121042 conn(0x7f1b140fd7e0 msgr2=0x7f1b140fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 -- 172.21.15.159:0/2613121042 shutdown_connections 2024-09-19T06:50:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:50:59.706+0000 7f1b1c15f640 1 -- 172.21.15.159:0/2613121042 wait complete. 2024-09-19T06:51:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:00 smithi203 ceph-mon[35473]: pgmap v125: 97 pgs: 97 active+clean; 48 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.0 MiB/s wr, 1.10k op/s 2024-09-19T06:51:01.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:00 smithi189 ceph-mon[34880]: pgmap v125: 97 pgs: 97 active+clean; 48 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.0 MiB/s wr, 1.10k op/s 2024-09-19T06:51:01.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:00 smithi159 ceph-mon[30935]: pgmap v125: 97 pgs: 97 active+clean; 48 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.0 MiB/s wr, 1.10k op/s 2024-09-19T06:51:02.949 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:02 smithi159 ceph-mon[30935]: pgmap v126: 97 pgs: 97 active+clean; 50 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.1 MiB/s wr, 1.48k op/s 2024-09-19T06:51:03.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:02 smithi203 ceph-mon[35473]: pgmap v126: 97 pgs: 97 active+clean; 50 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.1 MiB/s wr, 1.48k op/s 2024-09-19T06:51:03.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:02 smithi189 ceph-mon[34880]: pgmap v126: 97 pgs: 97 active+clean; 50 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.1 MiB/s wr, 1.48k op/s 2024-09-19T06:51:05.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:04 smithi203 ceph-mon[35473]: pgmap v127: 97 pgs: 97 active+clean; 50 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.2 MiB/s wr, 1.13k op/s 2024-09-19T06:51:05.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:04 smithi189 ceph-mon[34880]: pgmap v127: 97 pgs: 97 active+clean; 50 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.2 MiB/s wr, 1.13k op/s 2024-09-19T06:51:05.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:04 smithi159 ceph-mon[30935]: pgmap v127: 97 pgs: 97 active+clean; 50 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.2 MiB/s wr, 1.13k op/s 2024-09-19T06:51:06.149 INFO:tasks.workunit.client.0.smithi159.stdout:30000 trunc from 0x7a5444 to 0x143a5 2024-09-19T06:51:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:06 smithi203 ceph-mon[35473]: pgmap v128: 97 pgs: 97 active+clean; 54 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.2 MiB/s wr, 1.46k op/s 2024-09-19T06:51:07.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:06 smithi189 ceph-mon[34880]: pgmap v128: 97 pgs: 97 active+clean; 54 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.2 MiB/s wr, 1.46k op/s 2024-09-19T06:51:07.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:06 smithi159 ceph-mon[30935]: pgmap v128: 97 pgs: 97 active+clean; 54 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.2 MiB/s wr, 1.46k op/s 2024-09-19T06:51:09.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:08 smithi203 ceph-mon[35473]: pgmap v129: 97 pgs: 97 active+clean; 54 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 4.0 MiB/s wr, 708 op/s 2024-09-19T06:51:09.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:08 smithi189 ceph-mon[34880]: pgmap v129: 97 pgs: 97 active+clean; 54 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 4.0 MiB/s wr, 708 op/s 2024-09-19T06:51:09.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:08 smithi159 ceph-mon[30935]: pgmap v129: 97 pgs: 97 active+clean; 54 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 4.0 MiB/s wr, 708 op/s 2024-09-19T06:51:09.801 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0x9ffb01 2024-09-19T06:51:11.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:10 smithi203 ceph-mon[35473]: pgmap v130: 97 pgs: 97 active+clean; 54 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 4.0 MiB/s wr, 708 op/s 2024-09-19T06:51:11.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:10 smithi189 ceph-mon[34880]: pgmap v130: 97 pgs: 97 active+clean; 54 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 4.0 MiB/s wr, 708 op/s 2024-09-19T06:51:11.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:10 smithi159 ceph-mon[30935]: pgmap v130: 97 pgs: 97 active+clean; 54 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 4.0 MiB/s wr, 708 op/s 2024-09-19T06:51:12.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:11 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:51:12.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:11 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:51:12.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:11 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:51:12.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.802+0000 7fced8253640 1 -- 172.21.15.159:0/459795788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0101960 msgr2=0x7fced0101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:12.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.802+0000 7fced8253640 1 --2- 172.21.15.159:0/459795788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0101960 0x7fced0101d40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009900 tx=0x7fcecc02a410 comp rx=0 tx=0).stop 2024-09-19T06:51:12.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.802+0000 7fced8253640 1 -- 172.21.15.159:0/459795788 shutdown_connections 2024-09-19T06:51:12.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.803+0000 7fced8253640 1 --2- 172.21.15.159:0/459795788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced0106ea0 0x7fced010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.803+0000 7fced8253640 1 --2- 172.21.15.159:0/459795788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fced0102310 0x7fced0106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.804 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.803+0000 7fced8253640 1 --2- 172.21.15.159:0/459795788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0101960 0x7fced0101d40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.803+0000 7fced8253640 1 -- 172.21.15.159:0/459795788 >> 172.21.15.159:0/459795788 conn(0x7fced0075db0 msgr2=0x7fced00761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.803+0000 7fced8253640 1 -- 172.21.15.159:0/459795788 shutdown_connections 2024-09-19T06:51:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.803+0000 7fced8253640 1 -- 172.21.15.159:0/459795788 wait complete. 2024-09-19T06:51:12.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.803+0000 7fced8253640 1 Processor -- start 2024-09-19T06:51:12.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.803+0000 7fced8253640 1 -- start start 2024-09-19T06:51:12.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced8253640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced0101960 0x7fced0199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced8253640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fced0106ea0 0x7fced01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.807 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced8253640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0199c40 0x7fced01a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced8253640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fced0110e70 con 0x7fced0199c40 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced8253640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fced0110cf0 con 0x7fced0106ea0 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced8253640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fced0110ff0 con 0x7fced0101960 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced67f0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0199c40 0x7fced01a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced57ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fced0106ea0 0x7fced01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced67f0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0199c40 0x7fced01a41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44306/0 (socket says 172.21.15.159:44306) 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced67f0640 1 -- 172.21.15.159:0/1627003586 learned_addr learned my addr 172.21.15.159:0/1627003586 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced5fef640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced0101960 0x7fced0199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced67f0640 1 -- 172.21.15.159:0/1627003586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced0101960 msgr2=0x7fced0199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced67f0640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced0101960 0x7fced0199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced67f0640 1 -- 172.21.15.159:0/1627003586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fced0106ea0 msgr2=0x7fced01996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced67f0640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fced0106ea0 0x7fced01996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced67f0640 1 -- 172.21.15.159:0/1627003586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced01a49c0 con 0x7fced0199c40 2024-09-19T06:51:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced57ee640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fced0106ea0 0x7fced01996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.804+0000 7fced67f0640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0199c40 0x7fced01a41f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcec800eb10 tx=0x7fcec800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.805+0000 7fcec6ffd640 1 -- 172.21.15.159:0/1627003586 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8004b20 con 0x7fced0199c40 2024-09-19T06:51:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.805+0000 7fced8253640 1 -- 172.21.15.159:0/1627003586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced01a4cb0 con 0x7fced0199c40 2024-09-19T06:51:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.805+0000 7fcec6ffd640 1 -- 172.21.15.159:0/1627003586 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcec8004cc0 con 0x7fced0199c40 2024-09-19T06:51:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.805+0000 7fcec6ffd640 1 -- 172.21.15.159:0/1627003586 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8010760 con 0x7fced0199c40 2024-09-19T06:51:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.805+0000 7fced8253640 1 -- 172.21.15.159:0/1627003586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced01a5200 con 0x7fced0199c40 2024-09-19T06:51:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.807+0000 7fcedafee740 1 Processor -- start 2024-09-19T06:51:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.808+0000 7fcec6ffd640 1 -- 172.21.15.159:0/1627003586 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fcec8005020 con 0x7fced0199c40 2024-09-19T06:51:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.808+0000 7fcedafee740 1 -- start start 2024-09-19T06:51:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.808+0000 7fcedafee740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934e9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.808+0000 7fcedafee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.808+0000 7fcedafee740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.808+0000 7fcedafee740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56189344e2f0 con 0x5618934e9af0 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.808+0000 7fcedafee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5618933f6270 con 0x5618934ea410 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.808+0000 7fcedafee740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56189344a2b0 con 0x5618934f4cb0 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced57ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934e9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced57ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934e9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44318/0 (socket says 172.21.15.159:44318) 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced57ee640 1 -- 172.21.15.159:0/523956491 learned_addr learned my addr 172.21.15.159:0/523956491 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced5fef640 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced57ee640 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fcec6ffd640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcebc0a3460 0x7fcebc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced5fef640 1 -- 172.21.15.159:0/523956491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 msgr2=0x5618934f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced67f0640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcebc0a3460 0x7fcebc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced5fef640 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced5fef640 1 -- 172.21.15.159:0/523956491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 msgr2=0x5618934e9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced5fef640 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934e9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced5fef640 1 -- 172.21.15.159:0/523956491 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618933f5340 con 0x5618934ea410 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced57ee640 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fcec6ffd640 1 -- 172.21.15.159:0/1627003586 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fcec80d0380 con 0x7fced0199c40 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced5fef640 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f4770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcecc02aa00 tx=0x7fcecc005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36e4a548deacddb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fcebbfff640 1 -- 172.21.15.159:0/523956491 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc035040 con 0x5618934ea410 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fcebbfff640 1 -- 172.21.15.159:0/523956491 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcecc004400 con 0x5618934ea410 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fced67f0640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcebc0a3460 0x7fcebc0a5920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcec809c5c0 tx=0x7fcec8091ac0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.809+0000 7fcebbfff640 1 -- 172.21.15.159:0/523956491 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc004e50 con 0x5618934ea410 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.810+0000 7fcedafee740 1 -- 172.21.15.159:0/523956491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 msgr2=0x5618934f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.810+0000 7fcedafee740 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f4770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcecc02aa00 tx=0x7fcecc005de0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.810+0000 7fcedafee740 1 -- 172.21.15.159:0/523956491 shutdown_connections 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.810+0000 7fcedafee740 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.810+0000 7fcedafee740 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f4770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.810+0000 7fcedafee740 1 --2- 172.21.15.159:0/523956491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934e9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.810+0000 7fcedafee740 1 -- 172.21.15.159:0/523956491 >> 172.21.15.159:0/523956491 conn(0x5618934e6060 msgr2=0x5618934e6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 -- 172.21.15.159:0/523956491 shutdown_connections 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 -- 172.21.15.159:0/523956491 wait complete. 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 -- start start 2024-09-19T06:51:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 Processor -- start 2024-09-19T06:51:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5618934f7880 con 0x5618934e9af0 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5618933d7290 con 0x5618934ea410 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5618934f7a00 con 0x5618934f4cb0 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fcedafee740 10 client.0 _ll_register_callbacks cb 0x561893408140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.811+0000 7fced57ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced57ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934f1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44322/0 (socket says 172.21.15.159:44322) 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced57ee640 1 -- 172.21.15.159:0/854239215 learned_addr learned my addr 172.21.15.159:0/854239215 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced5fef640 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced57ee640 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced57ee640 1 -- 172.21.15.159:0/854239215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 msgr2=0x5618934f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced57ee640 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced57ee640 1 -- 172.21.15.159:0/854239215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 msgr2=0x5618934f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced57ee640 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced57ee640 1 -- 172.21.15.159:0/854239215 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561893161210 con 0x5618934e9af0 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced5fef640 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fced57ee640 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934f1b60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fcec000f610 tx=0x7fcec0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d08e7a3335ab24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fceb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fceb97fa640 1 -- 172.21.15.159:0/854239215 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0004030 con 0x5618934e9af0 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fceb97fa640 1 -- 172.21.15.159:0/854239215 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fcec0009040 con 0x5618934e9af0 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fcedafee740 1 -- 172.21.15.159:0/854239215 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcecc004400 con 0x5618934e9af0 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fceb97fa640 1 -- 172.21.15.159:0/854239215 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcec00041d0 con 0x5618934e9af0 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fcedafee740 10 client.16353 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fcedafee740 1 -- 172.21.15.159:0/854239215 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56189322d620 con 0x5618934e9af0 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.812+0000 7fceb97fa640 1 -- 172.21.15.159:0/854239215 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcecc004400 con 0x5618934e9af0 2024-09-19T06:51:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fceb97fa640 1 -- 172.21.15.159:0/854239215 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fcec0028070 con 0x5618934e9af0 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fcedafee740 10 client.16353 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fcedafee740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fcedafee740 20 client.16353 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fcedafee740 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561893504ba0 0x561893506f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fcedafee740 4 client.16353 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fcedafee740 1 -- 172.21.15.159:0/854239215 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56189345ba20 con 0x561893504ba0 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fced5fef640 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561893504ba0 0x561893506f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fceb97fa640 10 client.16353 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.813+0000 7fced5fef640 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561893504ba0 0x561893506f90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d2171ce08e9bc44 server_cookie=4fdc2c98c0784618 in_seq=0 out_seq=0 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fceb97fa640 1 -- 172.21.15.159:0/854239215 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56189345ba20 con 0x561893504ba0 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fceb97fa640 10 client.16353 handle_command_reply: tid=0 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 client.16353 shutdown 2024-09-19T06:51:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 -- 172.21.15.159:0/854239215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 msgr2=0x5618934f1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934f1b60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fcec000f610 tx=0x7fcec0004730 comp rx=0 tx=0).stop 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 -- 172.21.15.159:0/854239215 shutdown_connections 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561893504ba0 0x561893506f90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fceb97fa640 0 client.16353 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 --2- 172.21.15.159:0/854239215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934f1b60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 -- 172.21.15.159:0/854239215 >> 172.21.15.159:0/854239215 conn(0x5618934e6060 msgr2=0x5618934ebdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 -- 172.21.15.159:0/854239215 shutdown_connections 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.814+0000 7fcedafee740 1 -- 172.21.15.159:0/854239215 wait complete. 2024-09-19T06:51:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.815+0000 7fcedafee740 20 client.16353 trim_cache size 0 max 16384 2024-09-19T06:51:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.831+0000 7fcedafee740 1 Processor -- start 2024-09-19T06:51:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.831+0000 7fcedafee740 1 -- start start 2024-09-19T06:51:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.831+0000 7fcedafee740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934ec5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.831+0000 7fcedafee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.831+0000 7fcedafee740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.831+0000 7fcedafee740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fced01ab860 con 0x5618934e9af0 2024-09-19T06:51:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.831+0000 7fcedafee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fced01ae0e0 con 0x5618934ea410 2024-09-19T06:51:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.831+0000 7fcedafee740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fced01abed0 con 0x5618934f4cb0 2024-09-19T06:51:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced57ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934ec5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced5fef640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced57ee640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934ec5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44334/0 (socket says 172.21.15.159:44334) 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced57ee640 1 -- 172.21.15.159:0/4230647419 learned_addr learned my addr 172.21.15.159:0/4230647419 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced57ee640 1 --2- 172.21.15.159:0/4230647419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced5fef640 1 -- 172.21.15.159:0/4230647419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 msgr2=0x5618934f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced5fef640 1 --2- 172.21.15.159:0/4230647419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced5fef640 1 -- 172.21.15.159:0/4230647419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 msgr2=0x5618934ec5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced5fef640 1 --2- 172.21.15.159:0/4230647419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934ec5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced5fef640 1 -- 172.21.15.159:0/4230647419 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561893507300 con 0x5618934ea410 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced57ee640 1 --2- 172.21.15.159:0/4230647419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fced5fef640 1 --2- 172.21.15.159:0/4230647419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcecc031550 tx=0x7fcecc005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30426deef175c8e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fcebb7fe640 1 -- 172.21.15.159:0/4230647419 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc035050 con 0x5618934ea410 2024-09-19T06:51:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fcebb7fe640 1 -- 172.21.15.159:0/4230647419 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcecc0046c0 con 0x5618934ea410 2024-09-19T06:51:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.832+0000 7fcebb7fe640 1 -- 172.21.15.159:0/4230647419 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc003850 con 0x5618934ea410 2024-09-19T06:51:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 -- 172.21.15.159:0/4230647419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 msgr2=0x5618934f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 --2- 172.21.15.159:0/4230647419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcecc031550 tx=0x7fcecc005b50 comp rx=0 tx=0).stop 2024-09-19T06:51:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 -- 172.21.15.159:0/4230647419 shutdown_connections 2024-09-19T06:51:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 --2- 172.21.15.159:0/4230647419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 --2- 172.21.15.159:0/4230647419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934ea410 0x5618934f20b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 --2- 172.21.15.159:0/4230647419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934e9af0 0x5618934ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 -- 172.21.15.159:0/4230647419 >> 172.21.15.159:0/4230647419 conn(0x5618934e6060 msgr2=0x5618934f3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 -- 172.21.15.159:0/4230647419 shutdown_connections 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 -- 172.21.15.159:0/4230647419 wait complete. 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 -- start start 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.833+0000 7fcedafee740 1 Processor -- start 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fcedafee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934e9af0 0x5618934fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fcedafee740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934ea410 0x5618934fd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fcedafee740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934edf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fcedafee740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fced01ac5a0 con 0x5618934ea410 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fcedafee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fced01ada10 con 0x5618934e9af0 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fcedafee740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fced01acc70 con 0x5618934f4cb0 2024-09-19T06:51:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fcedafee740 10 client.0 _ll_register_callbacks cb 0x7fcec0011550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced5fef640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934ea410 0x5618934fd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced5fef640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934ea410 0x5618934fd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44342/0 (socket says 172.21.15.159:44342) 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced5fef640 1 -- 172.21.15.159:0/2227790059 learned_addr learned my addr 172.21.15.159:0/2227790059 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced57ee640 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934e9af0 0x5618934fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced57ee640 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced5fef640 1 -- 172.21.15.159:0/2227790059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 msgr2=0x5618934edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced5fef640 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934edf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced5fef640 1 -- 172.21.15.159:0/2227790059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934e9af0 msgr2=0x5618934fccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced5fef640 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934e9af0 0x5618934fccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.834+0000 7fced5fef640 1 -- 172.21.15.159:0/2227790059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618934ee4b0 con 0x5618934ea410 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fced5fef640 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934ea410 0x5618934fd200 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcecc053040 tx=0x7fcecc005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b561212324aba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fceb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fceb97fa640 1 -- 172.21.15.159:0/2227790059 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc035040 con 0x5618934ea410 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fceb97fa640 1 -- 172.21.15.159:0/2227790059 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fcecc0317c0 con 0x5618934ea410 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fcedafee740 1 -- 172.21.15.159:0/2227790059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcecc0046c0 con 0x5618934ea410 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fceb97fa640 1 -- 172.21.15.159:0/2227790059 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcecc068050 con 0x5618934ea410 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fcedafee740 10 client.16359 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fcedafee740 1 -- 172.21.15.159:0/2227790059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56189356ef70 con 0x5618934ea410 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fceb97fa640 1 -- 172.21.15.159:0/2227790059 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcecc0046c0 con 0x5618934ea410 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fceb97fa640 1 -- 172.21.15.159:0/2227790059 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fcecc050480 con 0x5618934ea410 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fcedafee740 10 client.16359 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fcedafee740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fcedafee740 20 client.16359 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fcedafee740 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56189356f260 0x561893571650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fcedafee740 4 client.16359 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:51:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fcedafee740 1 -- 172.21.15.159:0/2227790059 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561893455d70 con 0x56189356f260 2024-09-19T06:51:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.835+0000 7fced57ee640 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56189356f260 0x561893571650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.836+0000 7fceb97fa640 10 client.16359 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.836+0000 7fced57ee640 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56189356f260 0x561893571650 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e732c3f1cf05e47 server_cookie=2e62d7087c9c34d6 in_seq=0 out_seq=0 2024-09-19T06:51:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.851+0000 7fceb97fa640 1 -- 172.21.15.159:0/2227790059 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561893455d70 con 0x56189356f260 2024-09-19T06:51:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.851+0000 7fceb97fa640 10 client.16359 handle_command_reply: tid=0 2024-09-19T06:51:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.851+0000 7fcedafee740 1 client.16359 shutdown 2024-09-19T06:51:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 -- 172.21.15.159:0/2227790059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934ea410 msgr2=0x5618934fd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934ea410 0x5618934fd200 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcecc053040 tx=0x7fcecc005de0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 -- 172.21.15.159:0/2227790059 shutdown_connections 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56189356f260 0x561893571650 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5618934f4cb0 0x5618934edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618934ea410 0x5618934fd200 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 --2- 172.21.15.159:0/2227790059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618934e9af0 0x5618934fccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 -- 172.21.15.159:0/2227790059 >> 172.21.15.159:0/2227790059 conn(0x5618934e6060 msgr2=0x5618934e49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fceb97fa640 0 client.16359 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 -- 172.21.15.159:0/2227790059 shutdown_connections 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 1 -- 172.21.15.159:0/2227790059 wait complete. 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.852+0000 7fcedafee740 20 client.16359 trim_cache size 0 max 16384 2024-09-19T06:51:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:51:12.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:51:12.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:51:12.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:51:12.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 -- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcebc0a3460 msgr2=0x7fcebc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:12.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcebc0a3460 0x7fcebc0a5920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcec809c5c0 tx=0x7fcec8091ac0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 -- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0199c40 msgr2=0x7fced01a41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0199c40 0x7fced01a41f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcec800eb10 tx=0x7fcec800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 -- 172.21.15.159:0/1627003586 shutdown_connections 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcebc0a3460 0x7fcebc0a5920 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fced0199c40 0x7fced01a41f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fced0106ea0 0x7fced01996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 --2- 172.21.15.159:0/1627003586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced0101960 0x7fced0199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 -- 172.21.15.159:0/1627003586 >> 172.21.15.159:0/1627003586 conn(0x7fced0075db0 msgr2=0x7fced00ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 -- 172.21.15.159:0/1627003586 shutdown_connections 2024-09-19T06:51:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:12.853+0000 7fced8253640 1 -- 172.21.15.159:0/1627003586 wait complete. 2024-09-19T06:51:13.159 INFO:tasks.workunit.client.0.smithi159.stdout:40000 mapwrite 0x1becad thru 0x1c6a92 (0x7de6 bytes) 2024-09-19T06:51:13.242 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:12 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:51:13.242 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:12 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:51:13.242 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:12 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:51:13.242 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:12 smithi203 ceph-mon[35473]: pgmap v131: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.0 MiB/s wr, 1.02k op/s 2024-09-19T06:51:13.289 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:12 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:51:13.289 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:12 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:51:13.289 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:12 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:51:13.289 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:12 smithi189 ceph-mon[34880]: pgmap v131: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.0 MiB/s wr, 1.02k op/s 2024-09-19T06:51:13.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:12 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:51:13.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:12 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:51:13.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:12 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:51:13.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:12 smithi159 ceph-mon[30935]: pgmap v131: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.0 MiB/s wr, 1.02k op/s 2024-09-19T06:51:13.673 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T06:51:13.673 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T06:51:13.673 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:51:13.952 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:14.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.614+0000 7fb1fd85f640 1 -- 172.21.15.159:0/3150713382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8106f10 msgr2=0x7fb1f810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:14.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.614+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/3150713382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8106f10 0x7fb1f810ea90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009ca0 tx=0x7fb1f002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.614+0000 7fb1fd85f640 1 -- 172.21.15.159:0/3150713382 shutdown_connections 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.614+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/3150713382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8106f10 0x7fb1f810ea90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.614+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/3150713382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f8102790 0x7fb1f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.614+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/3150713382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f8101de0 0x7fb1f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.614+0000 7fb1fd85f640 1 -- 172.21.15.159:0/3150713382 >> 172.21.15.159:0/3150713382 conn(0x7fb1f80fd880 msgr2=0x7fb1f80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.614+0000 7fb1fd85f640 1 -- 172.21.15.159:0/3150713382 shutdown_connections 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.614+0000 7fb1fd85f640 1 -- 172.21.15.159:0/3150713382 wait complete. 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.615+0000 7fb1fd85f640 1 Processor -- start 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.615+0000 7fb1fd85f640 1 -- start start 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.615+0000 7fb1fd85f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f8101de0 0x7fb1f81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.615+0000 7fb1fd85f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8102790 0x7fb1f81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:14.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.615+0000 7fb1fd85f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f8106f10 0x7fb1f819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.615+0000 7fb1fd85f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f8111f70 con 0x7fb1f8102790 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.615+0000 7fb1fd85f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f8111df0 con 0x7fb1f8106f10 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.615+0000 7fb1fd85f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f81120f0 con 0x7fb1f8101de0 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f6ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f8101de0 0x7fb1f81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1effff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8102790 0x7fb1f81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f8106f10 0x7fb1f819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f6ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f8101de0 0x7fb1f81983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:52376/0 (socket says 172.21.15.159:52376) 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1effff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8102790 0x7fb1f81988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44346/0 (socket says 172.21.15.159:44346) 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f8106f10 0x7fb1f819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:41530/0 (socket says 172.21.15.159:41530) 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f6ffd640 1 -- 172.21.15.159:0/1800996313 learned_addr learned my addr 172.21.15.159:0/1800996313 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f77fe640 1 -- 172.21.15.159:0/1800996313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f8101de0 msgr2=0x7fb1f81983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f77fe640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f8101de0 0x7fb1f81983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f77fe640 1 -- 172.21.15.159:0/1800996313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8102790 msgr2=0x7fb1f81988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f77fe640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8102790 0x7fb1f81988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f77fe640 1 -- 172.21.15.159:0/1800996313 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f819d360 con 0x7fb1f8106f10 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f6ffd640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f8101de0 0x7fb1f81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1f77fe640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f8106f10 0x7fb1f819cc80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb1f002ade0 tx=0x7fb1f00319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1fc85d640 1 -- 172.21.15.159:0/1800996313 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0003b70 con 0x7fb1f8106f10 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f819d5f0 con 0x7fb1f8106f10 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1fc85d640 1 -- 172.21.15.159:0/1800996313 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1f0003d10 con 0x7fb1f8106f10 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.616+0000 7fb1fc85d640 1 -- 172.21.15.159:0/1800996313 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f002fba0 con 0x7fb1f8106f10 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.617+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f81a4f30 con 0x7fb1f8106f10 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.618+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f81021c0 con 0x7fb1f8106f10 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.619+0000 7fb1fc85d640 1 -- 172.21.15.159:0/1800996313 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb1f00046c0 con 0x7fb1f8106f10 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.620+0000 7fb1fc85d640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e40a3430 0x7fb1e40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:14.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.620+0000 7fb1f6ffd640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e40a3430 0x7fb1e40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:14.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.620+0000 7fb1fc85d640 1 -- 172.21.15.159:0/1800996313 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb1f00f0ac0 con 0x7fb1f8106f10 2024-09-19T06:51:14.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.620+0000 7fb1f6ffd640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e40a3430 0x7fb1e40a58f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8011550 tx=0x7fb1e8005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:14.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.624+0000 7fb1fc85d640 1 -- 172.21.15.159:0/1800996313 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1f00bd580 con 0x7fb1f8106f10 2024-09-19T06:51:14.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.869+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1f810a120 con 0x7fb1f8106f10 2024-09-19T06:51:14.871 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:14 smithi159 ceph-mon[30935]: pgmap v132: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.9 MiB/s wr, 648 op/s 2024-09-19T06:51:14.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.870+0000 7fb1fc85d640 1 -- 172.21.15.159:0/1800996313 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7fb1f00bce80 con 0x7fb1f8106f10 2024-09-19T06:51:14.872 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:51:14.872 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:51:14.873 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:51:14.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e40a3430 msgr2=0x7fb1e40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:14.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e40a3430 0x7fb1e40a58f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8011550 tx=0x7fb1e8005f90 comp rx=0 tx=0).stop 2024-09-19T06:51:14.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f8106f10 msgr2=0x7fb1f819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:14.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f8106f10 0x7fb1f819cc80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb1f002ade0 tx=0x7fb1f00319f0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 shutdown_connections 2024-09-19T06:51:14.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e40a3430 0x7fb1e40a58f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f8106f10 0x7fb1f819cc80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8102790 0x7fb1f81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 --2- 172.21.15.159:0/1800996313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f8101de0 0x7fb1f81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:14.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 >> 172.21.15.159:0/1800996313 conn(0x7fb1f80fd880 msgr2=0x7fb1f80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:14.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 shutdown_connections 2024-09-19T06:51:14.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:14.873+0000 7fb1fd85f640 1 -- 172.21.15.159:0/1800996313 wait complete. 2024-09-19T06:51:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:14 smithi203 ceph-mon[35473]: pgmap v132: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.9 MiB/s wr, 648 op/s 2024-09-19T06:51:15.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:14 smithi189 ceph-mon[34880]: pgmap v132: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.9 MiB/s wr, 648 op/s 2024-09-19T06:51:15.705 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T06:51:15.705 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T06:51:15.988 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:16.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:15 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1800996313' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:16.111 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:15 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1800996313' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:16.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:15 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1800996313' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:16.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.586+0000 7f3bdb891640 1 -- 172.21.15.159:0/2963880433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4101400 msgr2=0x7f3bd410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:16.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.586+0000 7f3bdb891640 1 --2- 172.21.15.159:0/2963880433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4101400 0x7f3bd410d930 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009cd0 tx=0x7f3bcc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.586+0000 7f3bdb891640 1 -- 172.21.15.159:0/2963880433 shutdown_connections 2024-09-19T06:51:16.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.586+0000 7f3bdb891640 1 --2- 172.21.15.159:0/2963880433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4101400 0x7f3bd410d930 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.586+0000 7f3bdb891640 1 --2- 172.21.15.159:0/2963880433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bd4100a60 0x7f3bd4100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.586+0000 7f3bdb891640 1 --2- 172.21.15.159:0/2963880433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4106a60 0x7f3bd4106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.586+0000 7f3bdb891640 1 -- 172.21.15.159:0/2963880433 >> 172.21.15.159:0/2963880433 conn(0x7f3bd40fc780 msgr2=0x7f3bd40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:16.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.587+0000 7f3bdb891640 1 -- 172.21.15.159:0/2963880433 shutdown_connections 2024-09-19T06:51:16.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.587+0000 7f3bdb891640 1 -- 172.21.15.159:0/2963880433 wait complete. 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.587+0000 7f3bdb891640 1 Processor -- start 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.587+0000 7f3bdb891640 1 -- start start 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bdb891640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4100a60 0x7f3bd419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bdb891640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4101400 0x7f3bd419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bdb891640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bd4106a60 0x7f3bd419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bdb891640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4110e60 con 0x7f3bd4100a60 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bdb891640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4110ce0 con 0x7f3bd4106a60 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bdb891640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4110fe0 con 0x7f3bd4101400 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd962d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4100a60 0x7f3bd419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd962d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4100a60 0x7f3bd419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44374/0 (socket says 172.21.15.159:44374) 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd962d640 1 -- 172.21.15.159:0/981949196 learned_addr learned my addr 172.21.15.159:0/981949196 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bd4106a60 0x7f3bd419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4101400 0x7f3bd419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd962d640 1 -- 172.21.15.159:0/981949196 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4101400 msgr2=0x7f3bd419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd962d640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4101400 0x7f3bd419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd962d640 1 -- 172.21.15.159:0/981949196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bd4106a60 msgr2=0x7f3bd419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd962d640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bd4106a60 0x7f3bd419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd962d640 1 -- 172.21.15.159:0/981949196 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd419f590 con 0x7f3bd4100a60 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.588+0000 7f3bd962d640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4100a60 0x7f3bd419a5e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000e9f0 tx=0x7f3bd000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:16.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.589+0000 7f3bca7fc640 1 -- 172.21.15.159:0/981949196 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd000cd80 con 0x7f3bd4100a60 2024-09-19T06:51:16.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.589+0000 7f3bdb891640 1 -- 172.21.15.159:0/981949196 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd419f880 con 0x7f3bd4100a60 2024-09-19T06:51:16.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.589+0000 7f3bca7fc640 1 -- 172.21.15.159:0/981949196 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bd0010910 con 0x7f3bd4100a60 2024-09-19T06:51:16.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.589+0000 7f3bca7fc640 1 -- 172.21.15.159:0/981949196 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00188f0 con 0x7f3bd4100a60 2024-09-19T06:51:16.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.589+0000 7f3bdb891640 1 -- 172.21.15.159:0/981949196 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd41a7160 con 0x7f3bd4100a60 2024-09-19T06:51:16.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bddc6a740 1 Processor -- start 2024-09-19T06:51:16.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bca7fc640 1 -- 172.21.15.159:0/981949196 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3bd0010ac0 con 0x7f3bd4100a60 2024-09-19T06:51:16.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bddc6a740 1 -- start start 2024-09-19T06:51:16.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a970443b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a970450d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a9703a92a0 con 0x55a970443760 2024-09-19T06:51:16.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a970350b10 con 0x55a97044e940 2024-09-19T06:51:16.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a9703a5260 con 0x55a970444080 2024-09-19T06:51:16.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bd9e2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a970443b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bd8e2c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a970450d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bd9e2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a970443b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44384/0 (socket says 172.21.15.159:44384) 2024-09-19T06:51:16.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1949569559 learned_addr learned my addr 172.21.15.159:0/1949569559 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:16.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bd8e2c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a970450d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:41558/0 (socket says 172.21.15.159:41558) 2024-09-19T06:51:16.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.592+0000 7f3bd962d640 1 --2- 172.21.15.159:0/1949569559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1949569559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 msgr2=0x55a97044e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:16.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1949569559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1949569559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 msgr2=0x55a970450d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:16.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1949569559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a970450d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1949569559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97011ab90 con 0x55a970443760 2024-09-19T06:51:16.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/1949569559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a970450d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:16.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bca7fc640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3bc00a33b0 0x7f3bc00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bca7fc640 1 -- 172.21.15.159:0/981949196 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f3bd00d0070 con 0x7f3bd4100a60 2024-09-19T06:51:16.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1949569559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a970443b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009cd0 tx=0x7f3bcc009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81a8c2f8d6c4263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:16.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.593+0000 7f3bd962d640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3bc00a33b0 0x7f3bc00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.594+0000 7f3bd962d640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3bc00a33b0 0x7f3bc00a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00cd840 tx=0x7f3bd00d3bc0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:16.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.594+0000 7f3bbf7fe640 1 -- 172.21.15.159:0/1949569559 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc048070 con 0x55a970443760 2024-09-19T06:51:16.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.594+0000 7f3bbf7fe640 1 -- 172.21.15.159:0/1949569559 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bcc036070 con 0x55a970443760 2024-09-19T06:51:16.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.594+0000 7f3bbf7fe640 1 -- 172.21.15.159:0/1949569559 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc004400 con 0x55a970443760 2024-09-19T06:51:16.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1949569559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 msgr2=0x55a970443b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:16.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1949569559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a970443b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009cd0 tx=0x7f3bcc009a20 comp rx=0 tx=0).stop 2024-09-19T06:51:16.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1949569559 shutdown_connections 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1949569559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a970450d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1949569559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1949569559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a970443b40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1949569559 >> 172.21.15.159:0/1949569559 conn(0x55a97043fcf0 msgr2=0x55a9704400d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1949569559 shutdown_connections 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1949569559 wait complete. 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 -- start start 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.595+0000 7f3bddc6a740 1 Processor -- start 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a97044b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a97044c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a970451510 con 0x55a970443760 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a9703316e0 con 0x55a97044e940 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a970451690 con 0x55a970444080 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bddc6a740 10 client.0 _ll_register_callbacks cb 0x55a970355a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a97044b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd8e2c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a97044b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44392/0 (socket says 172.21.15.159:44392) 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd8e2c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:52420/0 (socket says 172.21.15.159:52420) 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1032051838 learned_addr learned my addr 172.21.15.159:0/1032051838 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a97044c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1032051838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 msgr2=0x55a97044bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1032051838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 msgr2=0x55a97044c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:16.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a97044c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1032051838 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a97045aa50 con 0x55a970443760 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a97044b880 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005e30 tx=0x7f3bcc003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ae9f4609fe9afe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.596+0000 7f3bbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1032051838 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc048040 con 0x55a970443760 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1032051838 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f3bcc0318c0 con 0x55a970443760 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1032051838 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bcc036070 con 0x55a970443760 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1032051838 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3bcc05e050 con 0x55a970443760 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bddc6a740 10 client.16377 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1032051838 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a970451510 con 0x55a970443760 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1032051838 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bcc036070 con 0x55a970443760 2024-09-19T06:51:16.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1032051838 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f3bcc042030 con 0x55a970443760 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bddc6a740 10 client.16377 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bddc6a740 10 client.16377 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bddc6a740 20 client.16377 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a97045e560 0x55a970460950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bddc6a740 4 client.16377 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1032051838 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9703b69d0 con 0x55a97045e560 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.597+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a97045e560 0x55a970460950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.598+0000 7f3bbcff9640 10 client.16377 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.598+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a97045e560 0x55a970460950 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3996370c83d0b9d server_cookie=e519da40742bd548 in_seq=0 out_seq=0 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.598+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1032051838 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9703b69d0 con 0x55a97045e560 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.598+0000 7f3bbcff9640 10 client.16377 handle_command_reply: tid=0 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 client.16377 shutdown 2024-09-19T06:51:16.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1032051838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 msgr2=0x55a97044b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a97044b880 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005e30 tx=0x7f3bcc003ef0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1032051838 shutdown_connections 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a97045e560 0x55a970460950 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a97044c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bbcff9640 0 client.16377 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970444080 0x55a97044bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1032051838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970443760 0x55a97044b880 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1032051838 >> 172.21.15.159:0/1032051838 conn(0x55a97043fcf0 msgr2=0x55a970445a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1032051838 shutdown_connections 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1032051838 wait complete. 2024-09-19T06:51:16.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.599+0000 7f3bddc6a740 20 client.16377 trim_cache size 0 max 16384 2024-09-19T06:51:16.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.617+0000 7f3bddc6a740 1 Processor -- start 2024-09-19T06:51:16.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.617+0000 7f3bddc6a740 1 -- start start 2024-09-19T06:51:16.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.617+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a97044a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.617+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 0x55a970465fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.617+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a9704664f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.617+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd41ada40 con 0x55a970444080 2024-09-19T06:51:16.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.617+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd41b02c0 con 0x55a97044e940 2024-09-19T06:51:16.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.617+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd41ae0b0 con 0x55a970443760 2024-09-19T06:51:16.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a97044a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a97044a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:52436/0 (socket says 172.21.15.159:52436) 2024-09-19T06:51:16.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1709267332 learned_addr learned my addr 172.21.15.159:0/1709267332 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:16.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/1709267332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 0x55a970465fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1709267332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a9704664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1709267332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 msgr2=0x55a9704664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1709267332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a9704664f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1709267332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 msgr2=0x55a970465fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1709267332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 0x55a970465fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1709267332 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a970440980 con 0x55a970443760 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1709267332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a97044a7e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc003fc0 tx=0x7f3bcc045040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62b7fad12e8920eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bbeffd640 1 -- 172.21.15.159:0/1709267332 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc030dc0 con 0x55a970443760 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bbeffd640 1 -- 172.21.15.159:0/1709267332 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bcc036070 con 0x55a970443760 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.618+0000 7f3bbeffd640 1 -- 172.21.15.159:0/1709267332 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0044e0 con 0x55a970443760 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.619+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1709267332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 msgr2=0x55a97044a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:16.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.619+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1709267332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a97044a7e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc003fc0 tx=0x7f3bcc045040 comp rx=0 tx=0).stop 2024-09-19T06:51:16.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.619+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1709267332 shutdown_connections 2024-09-19T06:51:16.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.619+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1709267332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a9704664f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.619+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1709267332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 0x55a970465fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.619+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1709267332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a97044a7e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.619+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1709267332 >> 172.21.15.159:0/1709267332 conn(0x55a97043fcf0 msgr2=0x55a97044d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:16.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.619+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1709267332 shutdown_connections 2024-09-19T06:51:16.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.619+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1709267332 wait complete. 2024-09-19T06:51:16.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.620+0000 7f3bddc6a740 1 -- start start 2024-09-19T06:51:16.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.620+0000 7f3bddc6a740 1 Processor -- start 2024-09-19T06:51:16.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.620+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a9704568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.620+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 0x55a970456e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.620+0000 7f3bddc6a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a9704538b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.620+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd41ae780 con 0x55a970444080 2024-09-19T06:51:16.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.620+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd41afbf0 con 0x55a97044e940 2024-09-19T06:51:16.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.620+0000 7f3bddc6a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd41aee50 con 0x55a970443760 2024-09-19T06:51:16.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.620+0000 7f3bddc6a740 10 client.0 _ll_register_callbacks cb 0x7f3bd00d3a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:16.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a9704568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a9704568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:52444/0 (socket says 172.21.15.159:52444) 2024-09-19T06:51:16.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1176411755 learned_addr learned my addr 172.21.15.159:0/1176411755 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:16.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a9704538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 0x55a970456e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1176411755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 msgr2=0x55a9704538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:16.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a9704538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1176411755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 msgr2=0x55a970456e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:16.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 0x55a970456e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 -- 172.21.15.159:0/1176411755 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a970453df0 con 0x55a970443760 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 0x55a970456e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bd9e2e640 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a9704568e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005d50 tx=0x7f3bcc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=440524184af6034e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.621+0000 7f3bbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.622+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1176411755 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc048050 con 0x55a970443760 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.622+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1176411755 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f3bcc02e040 con 0x55a970443760 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.622+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1176411755 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bcc036070 con 0x55a970443760 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.622+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1176411755 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3bcc030b30 con 0x55a970443760 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.622+0000 7f3bddc6a740 10 client.25789 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.622+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1176411755 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a9704c9770 con 0x55a970443760 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.622+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1176411755 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bcc036070 con 0x55a970443760 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.622+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1176411755 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f3bcc075020 con 0x55a970443760 2024-09-19T06:51:16.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.623+0000 7f3bddc6a740 10 client.25789 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:16.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.623+0000 7f3bddc6a740 10 client.25789 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:51:16.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.623+0000 7f3bddc6a740 20 client.25789 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:16.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.623+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a9704c9e40 0x55a9704cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:16.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.623+0000 7f3bddc6a740 4 client.25789 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T06:51:16.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.623+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1176411755 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55a9703b0d20 con 0x55a9704c9e40 2024-09-19T06:51:16.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.623+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a9704c9e40 0x55a9704cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:16.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.624+0000 7f3bbcff9640 10 client.25789 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:16.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:16.624+0000 7f3bd8e2c640 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a9704c9e40 0x55a9704cc260 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d21ee24c8ad2bd3 server_cookie=ab9d99d64149b715 in_seq=0 out_seq=0 2024-09-19T06:51:16.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:16 smithi159 ceph-mon[30935]: pgmap v133: 97 pgs: 97 active+clean; 55 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.6 MiB/s wr, 951 op/s 2024-09-19T06:51:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:16 smithi203 ceph-mon[35473]: pgmap v133: 97 pgs: 97 active+clean; 55 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.6 MiB/s wr, 951 op/s 2024-09-19T06:51:17.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:16 smithi189 ceph-mon[34880]: pgmap v133: 97 pgs: 97 active+clean; 55 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.6 MiB/s wr, 951 op/s 2024-09-19T06:51:17.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bbcff9640 1 -- 172.21.15.159:0/1176411755 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a9703b0d20 con 0x55a9704c9e40 2024-09-19T06:51:17.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bbcff9640 10 client.25789 handle_command_reply: tid=0 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 client.25789 shutdown 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1176411755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 msgr2=0x55a9704568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a9704568e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005d50 tx=0x7f3bcc009920 comp rx=0 tx=0).stop 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1176411755 shutdown_connections 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a9704c9e40 0x55a9704cc260 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a97044e940 0x55a9704538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bbcff9640 0 client.25789 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a970444080 0x55a970456e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 --2- 172.21.15.159:0/1176411755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a970443760 0x55a9704568e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1176411755 >> 172.21.15.159:0/1176411755 conn(0x55a97043fcf0 msgr2=0x55a97043e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1176411755 shutdown_connections 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 1 -- 172.21.15.159:0/1176411755 wait complete. 2024-09-19T06:51:17.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.484+0000 7f3bddc6a740 20 client.25789 trim_cache size 0 max 16384 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 24, 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 18, 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout: "92b553f0": { 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 18, 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:51:17.487 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 149.8, 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:17.488 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:17.489 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:17.489 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:17.489 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:51:17.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 -- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3bc00a33b0 msgr2=0x7f3bc00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3bc00a33b0 0x7f3bc00a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00cd840 tx=0x7f3bd00d3bc0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 -- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4100a60 msgr2=0x7f3bd419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4100a60 0x7f3bd419a5e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000e9f0 tx=0x7f3bd000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 -- 172.21.15.159:0/981949196 shutdown_connections 2024-09-19T06:51:17.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3bc00a33b0 0x7f3bc00a5870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bd4106a60 0x7f3bd419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4101400 0x7f3bd419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 --2- 172.21.15.159:0/981949196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd4100a60 0x7f3bd419a5e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 -- 172.21.15.159:0/981949196 >> 172.21.15.159:0/981949196 conn(0x7f3bd40fc780 msgr2=0x7f3bd410c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:17.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 -- 172.21.15.159:0/981949196 shutdown_connections 2024-09-19T06:51:17.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:17.485+0000 7f3bdb891640 1 -- 172.21.15.159:0/981949196 wait complete. 2024-09-19T06:51:18.309 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '92b553f0', quiesce took 4.6 seconds. Will release after: 25.200000000000003 2024-09-19T06:51:19.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:18 smithi203 ceph-mon[35473]: pgmap v134: 97 pgs: 97 active+clean; 55 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 619 op/s 2024-09-19T06:51:19.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:18 smithi189 ceph-mon[34880]: pgmap v134: 97 pgs: 97 active+clean; 55 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 619 op/s 2024-09-19T06:51:19.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:18 smithi159 ceph-mon[30935]: pgmap v134: 97 pgs: 97 active+clean; 55 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 619 op/s 2024-09-19T06:51:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:20 smithi203 ceph-mon[35473]: pgmap v135: 97 pgs: 97 active+clean; 55 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 619 op/s 2024-09-19T06:51:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:20 smithi189 ceph-mon[34880]: pgmap v135: 97 pgs: 97 active+clean; 55 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 619 op/s 2024-09-19T06:51:21.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:20 smithi159 ceph-mon[30935]: pgmap v135: 97 pgs: 97 active+clean; 55 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 619 op/s 2024-09-19T06:51:23.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:22 smithi203 ceph-mon[35473]: pgmap v136: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 3.7 MiB/s wr, 626 op/s 2024-09-19T06:51:23.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:22 smithi189 ceph-mon[34880]: pgmap v136: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 3.7 MiB/s wr, 626 op/s 2024-09-19T06:51:23.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:22 smithi159 ceph-mon[30935]: pgmap v136: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 3.7 MiB/s wr, 626 op/s 2024-09-19T06:51:24.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:51:24.339 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:24.722 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:24 smithi159 ceph-mon[30935]: pgmap v137: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 308 op/s 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.802+0000 7fe88b6e2640 1 -- 172.21.15.159:0/66958047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe88410c180 msgr2=0x7fe88410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.802+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/66958047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe88410c180 0x7fe88410e600 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009ca0 tx=0x7fe87c02a950 comp rx=0 tx=0).stop 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.802+0000 7fe88b6e2640 1 -- 172.21.15.159:0/66958047 shutdown_connections 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.802+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/66958047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe88410c180 0x7fe88410e600 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.802+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/66958047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8841036c0 0x7fe88410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.802+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/66958047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe884102da0 0x7fe884103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.802+0000 7fe88b6e2640 1 -- 172.21.15.159:0/66958047 >> 172.21.15.159:0/66958047 conn(0x7fe8840fc7a0 msgr2=0x7fe8840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.802+0000 7fe88b6e2640 1 -- 172.21.15.159:0/66958047 shutdown_connections 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.802+0000 7fe88b6e2640 1 -- 172.21.15.159:0/66958047 wait complete. 2024-09-19T06:51:24.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88b6e2640 1 Processor -- start 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88b6e2640 1 -- start start 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88b6e2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884102da0 0x7fe884100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88b6e2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8841036c0 0x7fe884100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88b6e2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe88410c180 0x7fe884101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88b6e2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe884111f20 con 0x7fe884102da0 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88b6e2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe884111da0 con 0x7fe8841036c0 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88b6e2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8841120a0 con 0x7fe88410c180 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88947e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884102da0 0x7fe884100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88947e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884102da0 0x7fe884100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49156/0 (socket says 172.21.15.159:49156) 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe88947e640 1 -- 172.21.15.159:0/3558744868 learned_addr learned my addr 172.21.15.159:0/3558744868 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.803+0000 7fe889c7f640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe88410c180 0x7fe884101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe888c7d640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8841036c0 0x7fe884100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe88947e640 1 -- 172.21.15.159:0/3558744868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe88410c180 msgr2=0x7fe884101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe88947e640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe88410c180 0x7fe884101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe88947e640 1 -- 172.21.15.159:0/3558744868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8841036c0 msgr2=0x7fe884100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe88947e640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8841036c0 0x7fe884100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe88947e640 1 -- 172.21.15.159:0/3558744868 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8841a6880 con 0x7fe884102da0 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe888c7d640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8841036c0 0x7fe884100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe88947e640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884102da0 0x7fe884100a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d950 tx=0x7fe88000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe87a7fc640 1 -- 172.21.15.159:0/3558744868 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880017070 con 0x7fe884102da0 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe87a7fc640 1 -- 172.21.15.159:0/3558744868 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe880009c30 con 0x7fe884102da0 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe88b6e2640 1 -- 172.21.15.159:0/3558744868 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8841a6b70 con 0x7fe884102da0 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe87a7fc640 1 -- 172.21.15.159:0/3558744868 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88000f6b0 con 0x7fe884102da0 2024-09-19T06:51:24.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.804+0000 7fe88b6e2640 1 -- 172.21.15.159:0/3558744868 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8841a7100 con 0x7fe884102da0 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.806+0000 7fe87a7fc640 1 -- 172.21.15.159:0/3558744868 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe8800109d0 con 0x7fe884102da0 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe88dabb740 1 Processor -- start 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe88dabb740 1 -- start start 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbdc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 0x55f06cbe9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe88dabb740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f06cb422e0 con 0x55f06cbdc4a0 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe88dabb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f06cae9ce0 con 0x55f06cbe7680 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe88dabb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f06cb3e2a0 con 0x55f06cbdcdc0 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe87a7fc640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8700a3430 0x7fe8700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe889c7f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbdc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe889c7f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbdc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49160/0 (socket says 172.21.15.159:49160) 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe889c7f640 1 -- 172.21.15.159:0/3173521333 learned_addr learned my addr 172.21.15.159:0/3173521333 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.807+0000 7fe88947e640 1 --2- 172.21.15.159:0/3173521333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe889c7f640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8700a3430 0x7fe8700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe888c7d640 1 --2- 172.21.15.159:0/3173521333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 0x55f06cbe9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe87a7fc640 1 -- 172.21.15.159:0/3558744868 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe8800cf8e0 con 0x7fe884102da0 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe889c7f640 1 -- 172.21.15.159:0/3173521333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 msgr2=0x55f06cbe7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe889c7f640 1 --2- 172.21.15.159:0/3173521333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe889c7f640 1 -- 172.21.15.159:0/3173521333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 msgr2=0x55f06cbe9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe889c7f640 1 --2- 172.21.15.159:0/3173521333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 0x55f06cbe9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe889c7f640 1 -- 172.21.15.159:0/3173521333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f06cace440 con 0x55f06cbdc4a0 2024-09-19T06:51:24.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe889c7f640 1 --2- 172.21.15.159:0/3173521333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbdc880 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe87c004ad0 tx=0x7fe87c02fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742e49d7c52c9fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe86f7fe640 1 -- 172.21.15.159:0/3173521333 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c043050 con 0x55f06cbdc4a0 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe86f7fe640 1 -- 172.21.15.159:0/3173521333 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe87c044040 con 0x55f06cbdc4a0 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe86f7fe640 1 -- 172.21.15.159:0/3173521333 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c04d020 con 0x55f06cbdc4a0 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.808+0000 7fe889c7f640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8700a3430 0x7fe8700a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe87c04e000 tx=0x7fe87c04c000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 -- 172.21.15.159:0/3173521333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 msgr2=0x55f06cbdc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 --2- 172.21.15.159:0/3173521333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbdc880 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe87c004ad0 tx=0x7fe87c02fd10 comp rx=0 tx=0).stop 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 -- 172.21.15.159:0/3173521333 shutdown_connections 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 --2- 172.21.15.159:0/3173521333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 0x55f06cbe9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 --2- 172.21.15.159:0/3173521333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 --2- 172.21.15.159:0/3173521333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbdc880 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 -- 172.21.15.159:0/3173521333 >> 172.21.15.159:0/3173521333 conn(0x55f06cbd8a30 msgr2=0x55f06cbd8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:24.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 -- 172.21.15.159:0/3173521333 shutdown_connections 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 -- 172.21.15.159:0/3173521333 wait complete. 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 -- start start 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.809+0000 7fe88dabb740 1 Processor -- start 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdc4a0 0x55f06cbe6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 0x55f06cbe4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe88dabb740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f06cbea1f0 con 0x55f06cbdcdc0 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe88dabb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f06cafd050 con 0x55f06cbe7680 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe88dabb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f06cbea370 con 0x55f06cbdc4a0 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe88dabb740 10 client.0 _ll_register_callbacks cb 0x55f06cb3d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe888c7d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe888c7d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49174/0 (socket says 172.21.15.159:49174) 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe888c7d640 1 -- 172.21.15.159:0/578604589 learned_addr learned my addr 172.21.15.159:0/578604589 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe88947e640 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdc4a0 0x55f06cbe6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe889c7f640 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 0x55f06cbe4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe888c7d640 1 -- 172.21.15.159:0/578604589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdc4a0 msgr2=0x55f06cbe6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe888c7d640 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdc4a0 0x55f06cbe6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe888c7d640 1 -- 172.21.15.159:0/578604589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 msgr2=0x55f06cbe4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe888c7d640 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 0x55f06cbe4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe888c7d640 1 -- 172.21.15.159:0/578604589 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f06c8b33c0 con 0x55f06cbdcdc0 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe88947e640 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdc4a0 0x55f06cbe6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe888c7d640 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe4250 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe874012470 tx=0x7fe874012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3121428ab8aad13a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.810+0000 7fe86cff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe86cff9640 1 -- 172.21.15.159:0/578604589 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87401f060 con 0x55f06cbdcdc0 2024-09-19T06:51:24.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88dabb740 1 -- 172.21.15.159:0/578604589 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe87c044040 con 0x55f06cbdcdc0 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe86cff9640 1 -- 172.21.15.159:0/578604589 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe874004460 con 0x55f06cbdcdc0 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe86cff9640 1 -- 172.21.15.159:0/578604589 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe8740035f0 con 0x55f06cbdcdc0 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88dabb740 10 client.16392 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88dabb740 1 -- 172.21.15.159:0/578604589 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f06cbf5c20 con 0x55f06cbdcdc0 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe86cff9640 1 -- 172.21.15.159:0/578604589 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe87c044040 con 0x55f06cbdcdc0 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe86cff9640 1 -- 172.21.15.159:0/578604589 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe874019030 con 0x55f06cbdcdc0 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88dabb740 10 client.16392 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88dabb740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88dabb740 20 client.16392 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88dabb740 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f06cbf7130 0x55f06cbf9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88dabb740 4 client.16392 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88dabb740 1 -- 172.21.15.159:0/578604589 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f06cb4f850 con 0x55f06cbf7130 2024-09-19T06:51:24.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.811+0000 7fe88947e640 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f06cbf7130 0x55f06cbf9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.812+0000 7fe86cff9640 10 client.16392 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.812+0000 7fe88947e640 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f06cbf7130 0x55f06cbf9590 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76cbb856966f28d server_cookie=5878583c27f1d856 in_seq=0 out_seq=0 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.812+0000 7fe86cff9640 1 -- 172.21.15.159:0/578604589 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f06cb4f850 con 0x55f06cbf7130 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.812+0000 7fe86cff9640 10 client.16392 handle_command_reply: tid=0 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.812+0000 7fe88dabb740 1 client.16392 shutdown 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 -- 172.21.15.159:0/578604589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdcdc0 msgr2=0x55f06cbe4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe4250 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe874012470 tx=0x7fe874012870 comp rx=0 tx=0).stop 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 -- 172.21.15.159:0/578604589 shutdown_connections 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f06cbf7130 0x55f06cbf9590 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbe7680 0x55f06cbe4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdcdc0 0x55f06cbe4250 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe86cff9640 0 client.16392 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:24.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 --2- 172.21.15.159:0/578604589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdc4a0 0x55f06cbe6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 -- 172.21.15.159:0/578604589 >> 172.21.15.159:0/578604589 conn(0x55f06cbd8a30 msgr2=0x55f06cbd7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:24.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 -- 172.21.15.159:0/578604589 shutdown_connections 2024-09-19T06:51:24.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 1 -- 172.21.15.159:0/578604589 wait complete. 2024-09-19T06:51:24.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.813+0000 7fe88dabb740 20 client.16392 trim_cache size 0 max 16384 2024-09-19T06:51:24.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe88dabb740 1 Processor -- start 2024-09-19T06:51:24.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe88dabb740 1 -- start start 2024-09-19T06:51:24.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdc4a0 0x55f06cbf3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 0x55f06cbfee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbe7680 0x55f06cbff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe88dabb740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe8841adaa0 con 0x55f06cbe7680 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe88dabb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8841b0320 con 0x55f06cbdc4a0 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe88dabb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8841ae110 con 0x55f06cbdcdc0 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe889c7f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbe7680 0x55f06cbff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe88947e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdc4a0 0x55f06cbf3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe889c7f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbe7680 0x55f06cbff3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49180/0 (socket says 172.21.15.159:49180) 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe889c7f640 1 -- 172.21.15.159:0/2398402448 learned_addr learned my addr 172.21.15.159:0/2398402448 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.830+0000 7fe888c7d640 1 --2- 172.21.15.159:0/2398402448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 0x55f06cbfee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe888c7d640 1 -- 172.21.15.159:0/2398402448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdc4a0 msgr2=0x55f06cbf3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe888c7d640 1 --2- 172.21.15.159:0/2398402448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdc4a0 0x55f06cbf3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe888c7d640 1 -- 172.21.15.159:0/2398402448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbe7680 msgr2=0x55f06cbff3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe888c7d640 1 --2- 172.21.15.159:0/2398402448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbe7680 0x55f06cbff3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe888c7d640 1 -- 172.21.15.159:0/2398402448 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f06cbe27a0 con 0x55f06cbdcdc0 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe88947e640 1 --2- 172.21.15.159:0/2398402448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdc4a0 0x55f06cbf3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe888c7d640 1 --2- 172.21.15.159:0/2398402448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 0x55f06cbfee60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe874010ba0 tx=0x7fe8740224c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90adb00eb34eafa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe86effd640 1 -- 172.21.15.159:0/2398402448 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874010e10 con 0x55f06cbdcdc0 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe86effd640 1 -- 172.21.15.159:0/2398402448 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe874010910 con 0x55f06cbdcdc0 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.831+0000 7fe86effd640 1 -- 172.21.15.159:0/2398402448 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874003c30 con 0x55f06cbdcdc0 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 -- 172.21.15.159:0/2398402448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 msgr2=0x55f06cbfee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 --2- 172.21.15.159:0/2398402448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 0x55f06cbfee60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe874010ba0 tx=0x7fe8740224c0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 -- 172.21.15.159:0/2398402448 shutdown_connections 2024-09-19T06:51:24.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 --2- 172.21.15.159:0/2398402448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbe7680 0x55f06cbff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 --2- 172.21.15.159:0/2398402448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbdcdc0 0x55f06cbfee60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 --2- 172.21.15.159:0/2398402448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdc4a0 0x55f06cbf3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 -- 172.21.15.159:0/2398402448 >> 172.21.15.159:0/2398402448 conn(0x55f06cbd8a30 msgr2=0x55f06cbe62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 -- 172.21.15.159:0/2398402448 shutdown_connections 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 -- 172.21.15.159:0/2398402448 wait complete. 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 -- start start 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 Processor -- start 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdcdc0 0x55f06cbed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbe7680 0x55f06cc59e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe8841ae7e0 con 0x55f06cbdc4a0 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8841afc50 con 0x55f06cbdcdc0 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.832+0000 7fe88dabb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8841aeeb0 con 0x55f06cbe7680 2024-09-19T06:51:24.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88dabb740 10 client.0 _ll_register_callbacks cb 0x7fe874009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88947e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88947e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbecbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49196/0 (socket says 172.21.15.159:49196) 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88947e640 1 -- 172.21.15.159:0/4119610671 learned_addr learned my addr 172.21.15.159:0/4119610671 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe889c7f640 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbe7680 0x55f06cc59e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe888c7d640 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdcdc0 0x55f06cbed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88947e640 1 -- 172.21.15.159:0/4119610671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbe7680 msgr2=0x55f06cc59e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88947e640 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbe7680 0x55f06cc59e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88947e640 1 -- 172.21.15.159:0/4119610671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdcdc0 msgr2=0x55f06cbed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88947e640 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdcdc0 0x55f06cbed0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88947e640 1 -- 172.21.15.159:0/4119610671 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f06cc5a440 con 0x55f06cbdc4a0 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe889c7f640 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbe7680 0x55f06cc59e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88947e640 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbecbb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe88009c440 tx=0x7fe880097e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aee3d85d25acf04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe86cff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:24.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe86cff9640 1 -- 172.21.15.159:0/4119610671 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880020040 con 0x55f06cbdc4a0 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe86cff9640 1 -- 172.21.15.159:0/4119610671 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe880098200 con 0x55f06cbdc4a0 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88dabb740 1 -- 172.21.15.159:0/4119610671 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe874010910 con 0x55f06cbdc4a0 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe86cff9640 1 -- 172.21.15.159:0/4119610671 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe8800a4800 con 0x55f06cbdc4a0 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.833+0000 7fe88dabb740 10 client.16398 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe88dabb740 1 -- 172.21.15.159:0/4119610671 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f06cc617e0 con 0x55f06cbdc4a0 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe86cff9640 1 -- 172.21.15.159:0/4119610671 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe874010910 con 0x55f06cbdc4a0 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe86cff9640 1 -- 172.21.15.159:0/4119610671 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe880086140 con 0x55f06cbdc4a0 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe88dabb740 10 client.16398 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe88dabb740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe88dabb740 20 client.16398 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe88dabb740 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f06cbf7130 0x55f06cc63ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe88dabb740 4 client.16398 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe88dabb740 1 -- 172.21.15.159:0/4119610671 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f06cb49d60 con 0x55f06cbf7130 2024-09-19T06:51:24.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe888c7d640 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f06cbf7130 0x55f06cc63ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe888c7d640 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f06cbf7130 0x55f06cc63ec0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7ba9ffafbd36f63 server_cookie=20d380aeb7fd22e9 in_seq=0 out_seq=0 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.834+0000 7fe86cff9640 10 client.16398 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe86cff9640 1 -- 172.21.15.159:0/4119610671 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f06cb49d60 con 0x55f06cbf7130 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe86cff9640 10 client.16398 handle_command_reply: tid=0 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 client.16398 shutdown 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 -- 172.21.15.159:0/4119610671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 msgr2=0x55f06cbecbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbecbb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe88009c440 tx=0x7fe880097e30 comp rx=0 tx=0).stop 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 -- 172.21.15.159:0/4119610671 shutdown_connections 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f06cbf7130 0x55f06cc63ec0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f06cbe7680 0x55f06cc59e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f06cbdcdc0 0x55f06cbed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe86cff9640 0 client.16398 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:24.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 --2- 172.21.15.159:0/4119610671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f06cbdc4a0 0x55f06cbecbb0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 -- 172.21.15.159:0/4119610671 >> 172.21.15.159:0/4119610671 conn(0x55f06cbd8a30 msgr2=0x55f06cbe29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:24.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 -- 172.21.15.159:0/4119610671 shutdown_connections 2024-09-19T06:51:24.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 1 -- 172.21.15.159:0/4119610671 wait complete. 2024-09-19T06:51:24.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.835+0000 7fe88dabb740 20 client.16398 trim_cache size 0 max 16384 2024-09-19T06:51:24.853 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:51:24.853 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:51:24.853 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:51:24.853 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:51:24.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 -- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8700a3430 msgr2=0x7fe8700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:24.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8700a3430 0x7fe8700a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe87c04e000 tx=0x7fe87c04c000 comp rx=0 tx=0).stop 2024-09-19T06:51:24.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 -- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884102da0 msgr2=0x7fe884100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:24.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884102da0 0x7fe884100a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d950 tx=0x7fe88000de10 comp rx=0 tx=0).stop 2024-09-19T06:51:24.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 -- 172.21.15.159:0/3558744868 shutdown_connections 2024-09-19T06:51:24.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe8700a3430 0x7fe8700a58f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe88410c180 0x7fe884101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8841036c0 0x7fe884100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 --2- 172.21.15.159:0/3558744868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe884102da0 0x7fe884100a00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:24.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 -- 172.21.15.159:0/3558744868 >> 172.21.15.159:0/3558744868 conn(0x7fe8840fc7a0 msgr2=0x7fe8840fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:24.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 -- 172.21.15.159:0/3558744868 shutdown_connections 2024-09-19T06:51:24.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:24.836+0000 7fe88b6e2640 1 -- 172.21.15.159:0/3558744868 wait complete. 2024-09-19T06:51:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:24 smithi203 ceph-mon[35473]: pgmap v137: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 308 op/s 2024-09-19T06:51:25.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:24 smithi189 ceph-mon[34880]: pgmap v137: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 308 op/s 2024-09-19T06:51:25.884 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:51:25.884 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:51:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.946+0000 7fac7e8ac640 1 -- 172.21.15.159:0/1921562949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781009b0 msgr2=0x7fac78100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.946+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/1921562949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781009b0 0x7fac78100e10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009930 tx=0x7fac6c02a420 comp rx=0 tx=0).stop 2024-09-19T06:51:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.947+0000 7fac7e8ac640 1 -- 172.21.15.159:0/1921562949 shutdown_connections 2024-09-19T06:51:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.947+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/1921562949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78101350 0x7fac7810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.947+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/1921562949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781009b0 0x7fac78100e10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.947+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/1921562949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac781069c0 0x7fac78106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.947+0000 7fac7e8ac640 1 -- 172.21.15.159:0/1921562949 >> 172.21.15.159:0/1921562949 conn(0x7fac78077990 msgr2=0x7fac780fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.947+0000 7fac7e8ac640 1 -- 172.21.15.159:0/1921562949 shutdown_connections 2024-09-19T06:51:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.947+0000 7fac7e8ac640 1 -- 172.21.15.159:0/1921562949 wait complete. 2024-09-19T06:51:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.947+0000 7fac7e8ac640 1 Processor -- start 2024-09-19T06:51:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.947+0000 7fac7e8ac640 1 -- start start 2024-09-19T06:51:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7e8ac640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac781009b0 0x7fac780fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7e8ac640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78101350 0x7fac780fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7e8ac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781069c0 0x7fac780fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7e8ac640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fac78110e00 con 0x7fac781069c0 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7e8ac640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac78110c80 con 0x7fac781009b0 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7e8ac640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac78110f80 con 0x7fac78101350 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7ce49640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781069c0 0x7fac780fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7ce49640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781069c0 0x7fac780fd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49216/0 (socket says 172.21.15.159:49216) 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7ce49640 1 -- 172.21.15.159:0/3572449155 learned_addr learned my addr 172.21.15.159:0/3572449155 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac77fff640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac781009b0 0x7fac780fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac777fe640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78101350 0x7fac780fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7ce49640 1 -- 172.21.15.159:0/3572449155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78101350 msgr2=0x7fac780fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7ce49640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78101350 0x7fac780fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7ce49640 1 -- 172.21.15.159:0/3572449155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac781009b0 msgr2=0x7fac780fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7ce49640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac781009b0 0x7fac780fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7ce49640 1 -- 172.21.15.159:0/3572449155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac781a6800 con 0x7fac781069c0 2024-09-19T06:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7ce49640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781069c0 0x7fac780fd860 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fac7000eb10 tx=0x7fac7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac757fa640 1 -- 172.21.15.159:0/3572449155 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70004b20 con 0x7fac781069c0 2024-09-19T06:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7e8ac640 1 -- 172.21.15.159:0/3572449155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac781a6af0 con 0x7fac781069c0 2024-09-19T06:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac757fa640 1 -- 172.21.15.159:0/3572449155 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac70004cc0 con 0x7fac781069c0 2024-09-19T06:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac757fa640 1 -- 172.21.15.159:0/3572449155 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70010760 con 0x7fac781069c0 2024-09-19T06:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.948+0000 7fac7e8ac640 1 -- 172.21.15.159:0/3572449155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac781a7060 con 0x7fac781069c0 2024-09-19T06:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac8164c740 1 Processor -- start 2024-09-19T06:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac757fa640 1 -- 172.21.15.159:0/3572449155 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fac70005020 con 0x7fac781069c0 2024-09-19T06:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac8164c740 1 -- start start 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac8164c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 0x562d10f45ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac8164c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f50770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac8164c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac8164c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562d10eaa2f0 con 0x562d10f50cb0 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac8164c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d10e52270 con 0x562d10f46410 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac8164c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562d10ea62b0 con 0x562d10f45af0 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49222/0 (socket says 172.21.15.159:49222) 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac777fe640 1 -- 172.21.15.159:0/2985968300 learned_addr learned my addr 172.21.15.159:0/2985968300 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac777fe640 1 --2- 172.21.15.159:0/2985968300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 0x562d10f45ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.951+0000 7fac77fff640 1 --2- 172.21.15.159:0/2985968300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f50770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac757fa640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fac600a3460 0x7fac600a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac777fe640 1 -- 172.21.15.159:0/2985968300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 msgr2=0x562d10f45ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac777fe640 1 --2- 172.21.15.159:0/2985968300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 0x562d10f45ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac777fe640 1 -- 172.21.15.159:0/2985968300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 msgr2=0x562d10f50770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac777fe640 1 --2- 172.21.15.159:0/2985968300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f50770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac777fe640 1 -- 172.21.15.159:0/2985968300 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d10e51340 con 0x562d10f50cb0 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac7ce49640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fac600a3460 0x7fac600a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac757fa640 1 -- 172.21.15.159:0/3572449155 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fac700d04e0 con 0x7fac781069c0 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac777fe640 1 --2- 172.21.15.159:0/2985968300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f530a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009930 tx=0x7fac6c005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4599d2735528fc3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac5e7fc640 1 -- 172.21.15.159:0/2985968300 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c035040 con 0x562d10f50cb0 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac5e7fc640 1 -- 172.21.15.159:0/2985968300 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac6c031840 con 0x562d10f50cb0 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.952+0000 7fac5e7fc640 1 -- 172.21.15.159:0/2985968300 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c003c60 con 0x562d10f50cb0 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 -- 172.21.15.159:0/2985968300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 msgr2=0x562d10f530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac7ce49640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fac600a3460 0x7fac600a5920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac700ce200 tx=0x7fac70087040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 --2- 172.21.15.159:0/2985968300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f530a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009930 tx=0x7fac6c005b50 comp rx=0 tx=0).stop 2024-09-19T06:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 -- 172.21.15.159:0/2985968300 shutdown_connections 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 --2- 172.21.15.159:0/2985968300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f530a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 --2- 172.21.15.159:0/2985968300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f50770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 --2- 172.21.15.159:0/2985968300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 0x562d10f45ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 -- 172.21.15.159:0/2985968300 >> 172.21.15.159:0/2985968300 conn(0x562d10f42060 msgr2=0x562d10f42440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 -- 172.21.15.159:0/2985968300 shutdown_connections 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 -- 172.21.15.159:0/2985968300 wait complete. 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.953+0000 7fac8164c740 1 -- start start 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac8164c740 1 Processor -- start 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac8164c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 0x562d10f4dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac8164c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f4e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac8164c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f4e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac8164c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562d10f538d0 con 0x562d10f50cb0 2024-09-19T06:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac8164c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d10e33290 con 0x562d10f46410 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac8164c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562d10f53a50 con 0x562d10f45af0 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac8164c740 10 client.0 _ll_register_callbacks cb 0x562d10e64140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f4e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f4e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49238/0 (socket says 172.21.15.159:49238) 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac777fe640 1 -- 172.21.15.159:0/1733408268 learned_addr learned my addr 172.21.15.159:0/1733408268 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac77fff640 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f4e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac777fe640 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 0x562d10f4dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac777fe640 1 -- 172.21.15.159:0/1733408268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 msgr2=0x562d10f4dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac777fe640 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 0x562d10f4dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac777fe640 1 -- 172.21.15.159:0/1733408268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 msgr2=0x562d10f4e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac777fe640 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f4e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac777fe640 1 -- 172.21.15.159:0/1733408268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d10bbd210 con 0x562d10f50cb0 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.954+0000 7fac77fff640 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f4e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac777fe640 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f4e620 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fac6c000c00 tx=0x7fac6c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e09996ed84bf09d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac577fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac577fe640 1 -- 172.21.15.159:0/1733408268 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c035040 con 0x562d10f50cb0 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac577fe640 1 -- 172.21.15.159:0/1733408268 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fac6c004480 con 0x562d10f50cb0 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac8164c740 1 -- 172.21.15.159:0/1733408268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac6c031840 con 0x562d10f50cb0 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac577fe640 1 -- 172.21.15.159:0/1733408268 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fac6c0036c0 con 0x562d10f50cb0 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac8164c740 10 client.16410 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac8164c740 1 -- 172.21.15.159:0/1733408268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d10c89620 con 0x562d10f50cb0 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac577fe640 1 -- 172.21.15.159:0/1733408268 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac6c031840 con 0x562d10f50cb0 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac577fe640 1 -- 172.21.15.159:0/1733408268 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fac6c03a040 con 0x562d10f50cb0 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac8164c740 10 client.16410 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac8164c740 10 client.16410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac8164c740 20 client.16410 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac8164c740 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d10f60b40 0x562d10f62f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac8164c740 4 client.16410 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.955+0000 7fac8164c740 1 -- 172.21.15.159:0/1733408268 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d10eb7a20 con 0x562d10f60b40 2024-09-19T06:51:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.956+0000 7fac77fff640 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d10f60b40 0x562d10f62f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.956+0000 7fac577fe640 10 client.16410 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.956+0000 7fac77fff640 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d10f60b40 0x562d10f62f30 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab17cffaa4520a99 server_cookie=940039f865bd4eb0 in_seq=0 out_seq=0 2024-09-19T06:51:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac577fe640 1 -- 172.21.15.159:0/1733408268 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d10eb7a20 con 0x562d10f60b40 2024-09-19T06:51:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac577fe640 10 client.16410 handle_command_reply: tid=0 2024-09-19T06:51:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 client.16410 shutdown 2024-09-19T06:51:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 -- 172.21.15.159:0/1733408268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 msgr2=0x562d10f4e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f4e620 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fac6c000c00 tx=0x7fac6c003960 comp rx=0 tx=0).stop 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 -- 172.21.15.159:0/1733408268 shutdown_connections 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d10f60b40 0x562d10f62f30 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f50cb0 0x562d10f4e620 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac577fe640 0 client.16410 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f4e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 --2- 172.21.15.159:0/1733408268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f45af0 0x562d10f4dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 -- 172.21.15.159:0/1733408268 >> 172.21.15.159:0/1733408268 conn(0x562d10f42060 msgr2=0x562d10f47d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 -- 172.21.15.159:0/1733408268 shutdown_connections 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 1 -- 172.21.15.159:0/1733408268 wait complete. 2024-09-19T06:51:25.965 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.957+0000 7fac8164c740 20 client.16410 trim_cache size 0 max 16384 2024-09-19T06:51:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac8164c740 1 Processor -- start 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac8164c740 1 -- start start 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac8164c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f45af0 0x562d10f48560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac8164c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f46410 0x562d10f4e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac8164c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f50cb0 0x562d10f65f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac8164c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fac781adad0 con 0x562d10f46410 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac8164c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac781b0350 con 0x562d10f45af0 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac8164c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac781ae140 con 0x562d10f50cb0 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac77fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f46410 0x562d10f4e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac777fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f45af0 0x562d10f48560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac77fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f46410 0x562d10f4e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49240/0 (socket says 172.21.15.159:49240) 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.987+0000 7fac77fff640 1 -- 172.21.15.159:0/2800410111 learned_addr learned my addr 172.21.15.159:0/2800410111 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac777fe640 1 --2- 172.21.15.159:0/2800410111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f50cb0 0x562d10f65f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac777fe640 1 -- 172.21.15.159:0/2800410111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f50cb0 msgr2=0x562d10f65f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac777fe640 1 --2- 172.21.15.159:0/2800410111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f50cb0 0x562d10f65f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac777fe640 1 -- 172.21.15.159:0/2800410111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f46410 msgr2=0x562d10f4e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac777fe640 1 --2- 172.21.15.159:0/2800410111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f46410 0x562d10f4e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac777fe640 1 -- 172.21.15.159:0/2800410111 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d10f41e90 con 0x562d10f45af0 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac77fff640 1 --2- 172.21.15.159:0/2800410111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f46410 0x562d10f4e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac777fe640 1 --2- 172.21.15.159:0/2800410111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f45af0 0x562d10f48560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac6c003930 tx=0x7fac6c02a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d09670b34751873 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac5dffb640 1 -- 172.21.15.159:0/2800410111 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c035040 con 0x562d10f45af0 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac5dffb640 1 -- 172.21.15.159:0/2800410111 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac6c031640 con 0x562d10f45af0 2024-09-19T06:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.988+0000 7fac5dffb640 1 -- 172.21.15.159:0/2800410111 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c03d6e0 con 0x562d10f45af0 2024-09-19T06:51:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.989+0000 7fac8164c740 1 -- 172.21.15.159:0/2800410111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f45af0 msgr2=0x562d10f48560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.989+0000 7fac8164c740 1 --2- 172.21.15.159:0/2800410111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f45af0 0x562d10f48560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac6c003930 tx=0x7fac6c02a420 comp rx=0 tx=0).stop 2024-09-19T06:51:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.989+0000 7fac8164c740 1 -- 172.21.15.159:0/2800410111 shutdown_connections 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.989+0000 7fac8164c740 1 --2- 172.21.15.159:0/2800410111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f50cb0 0x562d10f65f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.989+0000 7fac8164c740 1 --2- 172.21.15.159:0/2800410111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f46410 0x562d10f4e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.989+0000 7fac8164c740 1 --2- 172.21.15.159:0/2800410111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f45af0 0x562d10f48560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.989+0000 7fac8164c740 1 -- 172.21.15.159:0/2800410111 >> 172.21.15.159:0/2800410111 conn(0x562d10f42060 msgr2=0x562d10f4fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.989+0000 7fac8164c740 1 -- 172.21.15.159:0/2800410111 shutdown_connections 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.989+0000 7fac8164c740 1 -- 172.21.15.159:0/2800410111 wait complete. 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac8164c740 1 -- start start 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac8164c740 1 Processor -- start 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac8164c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f45af0 0x562d10f630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac8164c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f63620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac8164c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f50cb0 0x562d10fc9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac8164c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fac781ae810 con 0x562d10f45af0 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac8164c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac781afc80 con 0x562d10f46410 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac8164c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac781aeee0 con 0x562d10f50cb0 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac8164c740 10 client.0 _ll_register_callbacks cb 0x7fac680097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.990+0000 7fac777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f45af0 0x562d10f630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f45af0 0x562d10f630e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49242/0 (socket says 172.21.15.159:49242) 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac777fe640 1 -- 172.21.15.159:0/4294612618 learned_addr learned my addr 172.21.15.159:0/4294612618 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac77fff640 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f63620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac777fe640 1 -- 172.21.15.159:0/4294612618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f50cb0 msgr2=0x562d10fc9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac777fe640 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f50cb0 0x562d10fc9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac777fe640 1 -- 172.21.15.159:0/4294612618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 msgr2=0x562d10f63620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac777fe640 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f63620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac777fe640 1 -- 172.21.15.159:0/4294612618 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d10fc99b0 con 0x562d10f45af0 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac777fe640 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f45af0 0x562d10f630e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fac6c04a5a0 tx=0x7fac6c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d7c11cb0300dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac577fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac577fe640 1 -- 172.21.15.159:0/4294612618 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c066020 con 0x562d10f45af0 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac577fe640 1 -- 172.21.15.159:0/4294612618 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fac6c04ab50 con 0x562d10f45af0 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac8164c740 1 -- 172.21.15.159:0/4294612618 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac6c031640 con 0x562d10f45af0 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac577fe640 1 -- 172.21.15.159:0/4294612618 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fac6c035040 con 0x562d10f45af0 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac8164c740 10 client.16416 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac8164c740 1 -- 172.21.15.159:0/4294612618 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d10fc99b0 con 0x562d10f45af0 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.991+0000 7fac577fe640 1 -- 172.21.15.159:0/4294612618 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac6c031640 con 0x562d10f45af0 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac577fe640 1 -- 172.21.15.159:0/4294612618 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fac6c03da80 con 0x562d10f45af0 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac8164c740 10 client.16416 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac8164c740 10 client.16416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac8164c740 20 client.16416 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac8164c740 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d10fcaed0 0x562d10fcd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac8164c740 4 client.16416 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:51:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac8164c740 1 -- 172.21.15.159:0/4294612618 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562d10eb1d70 con 0x562d10fcaed0 2024-09-19T06:51:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac77fff640 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d10fcaed0 0x562d10fcd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac577fe640 10 client.16416 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:25.992+0000 7fac77fff640 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d10fcaed0 0x562d10fcd2c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8837b737e2def575 server_cookie=fe1f024053217ef2 in_seq=0 out_seq=0 2024-09-19T06:51:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.005+0000 7fac577fe640 1 -- 172.21.15.159:0/4294612618 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562d10eb1d70 con 0x562d10fcaed0 2024-09-19T06:51:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.005+0000 7fac577fe640 10 client.16416 handle_command_reply: tid=0 2024-09-19T06:51:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.005+0000 7fac8164c740 1 client.16416 shutdown 2024-09-19T06:51:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.005+0000 7fac8164c740 1 -- 172.21.15.159:0/4294612618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f45af0 msgr2=0x562d10f630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.005+0000 7fac8164c740 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f45af0 0x562d10f630e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fac6c04a5a0 tx=0x7fac6c003960 comp rx=0 tx=0).stop 2024-09-19T06:51:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac8164c740 1 -- 172.21.15.159:0/4294612618 shutdown_connections 2024-09-19T06:51:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac8164c740 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d10fcaed0 0x562d10fcd2c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac8164c740 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d10f50cb0 0x562d10fc9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac577fe640 0 client.16416 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac8164c740 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d10f46410 0x562d10f63620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac8164c740 1 --2- 172.21.15.159:0/4294612618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d10f45af0 0x562d10f630e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac8164c740 1 -- 172.21.15.159:0/4294612618 >> 172.21.15.159:0/4294612618 conn(0x562d10f42060 msgr2=0x562d10f5bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac8164c740 1 -- 172.21.15.159:0/4294612618 shutdown_connections 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac8164c740 1 -- 172.21.15.159:0/4294612618 wait complete. 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac8164c740 20 client.16416 trim_cache size 0 max 16384 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:51:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:51:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:51:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:51:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac7e8ac640 1 -- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fac600a3460 msgr2=0x7fac600a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fac600a3460 0x7fac600a5920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac700ce200 tx=0x7fac70087040 comp rx=0 tx=0).stop 2024-09-19T06:51:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac7e8ac640 1 -- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781069c0 msgr2=0x7fac780fd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.006+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781069c0 0x7fac780fd860 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fac7000eb10 tx=0x7fac7000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.007+0000 7fac7e8ac640 1 -- 172.21.15.159:0/3572449155 shutdown_connections 2024-09-19T06:51:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.007+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fac600a3460 0x7fac600a5920 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.007+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac781069c0 0x7fac780fd860 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.007+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78101350 0x7fac780fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.007+0000 7fac7e8ac640 1 --2- 172.21.15.159:0/3572449155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac781009b0 0x7fac780fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.007+0000 7fac7e8ac640 1 -- 172.21.15.159:0/3572449155 >> 172.21.15.159:0/3572449155 conn(0x7fac78077990 msgr2=0x7fac780699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.007+0000 7fac7e8ac640 1 -- 172.21.15.159:0/3572449155 shutdown_connections 2024-09-19T06:51:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:26.007+0000 7fac7e8ac640 1 -- 172.21.15.159:0/3572449155 wait complete. 2024-09-19T06:51:26.156 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.662+0000 7fe5a1d75640 1 -- 172.21.15.159:0/1985182126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102570 msgr2=0x7fe59c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.662+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/1985182126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102570 0x7fe59c1029b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe584009900 tx=0x7fe58402a480 comp rx=0 tx=0).stop 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.662+0000 7fe5a1d75640 1 -- 172.21.15.159:0/1985182126 shutdown_connections 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.662+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/1985182126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe59c102ef0 0x7fe59c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.662+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/1985182126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102570 0x7fe59c1029b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.662+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/1985182126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe59c100e20 0x7fe59c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.662+0000 7fe5a1d75640 1 -- 172.21.15.159:0/1985182126 >> 172.21.15.159:0/1985182126 conn(0x7fe59c0fc7d0 msgr2=0x7fe59c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.662+0000 7fe5a1d75640 1 -- 172.21.15.159:0/1985182126 shutdown_connections 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.662+0000 7fe5a1d75640 1 -- 172.21.15.159:0/1985182126 wait complete. 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe5a1d75640 1 Processor -- start 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe5a1d75640 1 -- start start 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe5a1d75640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe59c100e20 0x7fe59c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe5a1d75640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe59c102570 0x7fe59c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe5a1d75640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102ef0 0x7fe59c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe5a1d75640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c110fc0 con 0x7fe59c102ef0 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe5a1d75640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c110e40 con 0x7fe59c100e20 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe5a1d75640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c111140 con 0x7fe59c102570 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe59bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102ef0 0x7fe59c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe59bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102ef0 0x7fe59c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49248/0 (socket says 172.21.15.159:49248) 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe59bfff640 1 -- 172.21.15.159:0/3003082189 learned_addr learned my addr 172.21.15.159:0/3003082189 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe59b7fe640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe59c100e20 0x7fe59c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe59bfff640 1 -- 172.21.15.159:0/3003082189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe59c102570 msgr2=0x7fe59c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe59bfff640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe59c102570 0x7fe59c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe59bfff640 1 -- 172.21.15.159:0/3003082189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe59c100e20 msgr2=0x7fe59c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe59bfff640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe59c100e20 0x7fe59c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.663+0000 7fe59bfff640 1 -- 172.21.15.159:0/3003082189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59c1a6ae0 con 0x7fe59c102ef0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.664+0000 7fe59bfff640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102ef0 0x7fe59c0fd700 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe59400b970 tx=0x7fe59400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.664+0000 7fe5997fa640 1 -- 172.21.15.159:0/3003082189 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594019070 con 0x7fe59c102ef0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.664+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59c1a6dd0 con 0x7fe59c102ef0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.664+0000 7fe5997fa640 1 -- 172.21.15.159:0/3003082189 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe59400cb40 con 0x7fe59c102ef0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.664+0000 7fe5997fa640 1 -- 172.21.15.159:0/3003082189 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594007650 con 0x7fe59c102ef0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.664+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59c1a72e0 con 0x7fe59c102ef0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.665+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe59c101200 con 0x7fe59c102ef0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.666+0000 7fe5997fa640 1 -- 172.21.15.159:0/3003082189 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe59401c070 con 0x7fe59c102ef0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.667+0000 7fe5997fa640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe5880a3430 0x7fe5880a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.667+0000 7fe59b7fe640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe5880a3430 0x7fe5880a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.667+0000 7fe5997fa640 1 -- 172.21.15.159:0/3003082189 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe594099af0 con 0x7fe59c102ef0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.667+0000 7fe59b7fe640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe5880a3430 0x7fe5880a58f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe58c005fd0 tx=0x7fe58c005850 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.672+0000 7fe5997fa640 1 -- 172.21.15.159:0/3003082189 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe59409c150 con 0x7fe59c102ef0 2024-09-19T06:51:26.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.874+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe59c0fe1b0 con 0x7fe59c102ef0 2024-09-19T06:51:26.876 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:26 smithi159 ceph-mon[30935]: pgmap v138: 97 pgs: 97 active+clean; 47 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 312 op/s 2024-09-19T06:51:26.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.875+0000 7fe5997fa640 1 -- 172.21.15.159:0/3003082189 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7fe59409ba50 con 0x7fe59c102ef0 2024-09-19T06:51:26.877 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:51:26.877 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:51:26.877 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe5880a3430 msgr2=0x7fe5880a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe5880a3430 0x7fe5880a58f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe58c005fd0 tx=0x7fe58c005850 comp rx=0 tx=0).stop 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102ef0 msgr2=0x7fe59c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102ef0 0x7fe59c0fd700 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe59400b970 tx=0x7fe59400be30 comp rx=0 tx=0).stop 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 shutdown_connections 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe5880a3430 0x7fe5880a58f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe59c102ef0 0x7fe59c0fd700 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe59c102570 0x7fe59c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 --2- 172.21.15.159:0/3003082189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe59c100e20 0x7fe59c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.877+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 >> 172.21.15.159:0/3003082189 conn(0x7fe59c0fc7d0 msgr2=0x7fe59c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.878+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 shutdown_connections 2024-09-19T06:51:26.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:26.878+0000 7fe5a1d75640 1 -- 172.21.15.159:0/3003082189 wait complete. 2024-09-19T06:51:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:26 smithi203 ceph-mon[35473]: pgmap v138: 97 pgs: 97 active+clean; 47 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 312 op/s 2024-09-19T06:51:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:26 smithi189 ceph-mon[34880]: pgmap v138: 97 pgs: 97 active+clean; 47 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 312 op/s 2024-09-19T06:51:27.619 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:51:27.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:27 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3003082189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:27.908 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:27 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3003082189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:28.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:27 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3003082189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:28.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.391+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/1420767221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78106f10 msgr2=0x7f1c7810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.391+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/1420767221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78106f10 0x7f1c7810ea90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009ca0 tx=0x7f1c7002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.391+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/1420767221 shutdown_connections 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.391+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/1420767221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78106f10 0x7f1c7810ea90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.391+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/1420767221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c78102790 0x7f1c781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.391+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/1420767221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c78101de0 0x7f1c781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.391+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/1420767221 >> 172.21.15.159:0/1420767221 conn(0x7f1c780fd8c0 msgr2=0x7f1c780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.391+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/1420767221 shutdown_connections 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.391+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/1420767221 wait complete. 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c7d9ab640 1 Processor -- start 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c7d9ab640 1 -- start start 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c7d9ab640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78101de0 0x7f1c781983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c7d9ab640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c78102790 0x7f1c78198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c7d9ab640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c78106f10 0x7f1c7819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c7d9ab640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78111f70 con 0x7f1c78101de0 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c7d9ab640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78111df0 con 0x7f1c78102790 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c7d9ab640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781120f0 con 0x7f1c78106f10 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c76ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78101de0 0x7f1c781983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c76ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78101de0 0x7f1c781983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49266/0 (socket says 172.21.15.159:49266) 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c76ffd640 1 -- 172.21.15.159:0/2216722082 learned_addr learned my addr 172.21.15.159:0/2216722082 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c76ffd640 1 -- 172.21.15.159:0/2216722082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c78106f10 msgr2=0x7f1c7819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c777fe640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c78106f10 0x7f1c7819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c76ffd640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c78106f10 0x7f1c7819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c76ffd640 1 -- 172.21.15.159:0/2216722082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c78102790 msgr2=0x7f1c78198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c76ffd640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c78102790 0x7f1c78198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c76ffd640 1 -- 172.21.15.159:0/2216722082 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7819d3a0 con 0x7f1c78101de0 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.392+0000 7f1c777fe640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c78106f10 0x7f1c7819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:28.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.393+0000 7f1c76ffd640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78101de0 0x7f1c781983f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800d950 tx=0x7f1c6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.393+0000 7f1c7c9a9640 1 -- 172.21.15.159:0/2216722082 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68017070 con 0x7f1c78101de0 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.393+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/2216722082 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7819d690 con 0x7f1c78101de0 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.393+0000 7f1c7c9a9640 1 -- 172.21.15.159:0/2216722082 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c68009c30 con 0x7f1c78101de0 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.393+0000 7f1c7c9a9640 1 -- 172.21.15.159:0/2216722082 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800f6b0 con 0x7f1c78101de0 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.393+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/2216722082 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c781a4f70 con 0x7f1c78101de0 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.395+0000 7f1c7c9a9640 1 -- 172.21.15.159:0/2216722082 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1c680109d0 con 0x7f1c78101de0 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.395+0000 7f1c7fd84740 1 Processor -- start 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.395+0000 7f1c7fd84740 1 -- start start 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4efb40 0x55560c4ee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c7c9a9640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1c640a33b0 0x7f1c640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 0x55560c4eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4fd780 0x55560c4ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55560c4542f0 con 0x55560c4fd780 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55560c3fbcf0 con 0x55560c4ee5d0 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55560c4502b0 con 0x55560c4efb40 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4fd780 0x55560c4ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c76ffd640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1c640a33b0 0x7f1c640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4fd780 0x55560c4ffb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49268/0 (socket says 172.21.15.159:49268) 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 -- 172.21.15.159:0/2745844547 learned_addr learned my addr 172.21.15.159:0/2745844547 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c7c9a9640 1 -- 172.21.15.159:0/2216722082 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1c680cfad0 con 0x7f1c78101de0 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c6ffff640 1 --2- 172.21.15.159:0/2745844547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 0x55560c4eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 --2- 172.21.15.159:0/2745844547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4efb40 0x55560c4ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 -- 172.21.15.159:0/2745844547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4efb40 msgr2=0x55560c4ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 --2- 172.21.15.159:0/2745844547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4efb40 0x55560c4ee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 -- 172.21.15.159:0/2745844547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 msgr2=0x55560c4eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 --2- 172.21.15.159:0/2745844547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 0x55560c4eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 -- 172.21.15.159:0/2745844547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55560c3e03a0 con 0x55560c4fd780 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c777fe640 1 --2- 172.21.15.159:0/2745844547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4fd780 0x55560c4ffb70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1c70006010 tx=0x7f1c70004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06e15f2d5117a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c76ffd640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1c640a33b0 0x7f1c640a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c6809ba20 tx=0x7f1c6806daa0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.396+0000 7f1c6dffb640 1 -- 172.21.15.159:0/2745844547 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70003970 con 0x55560c4fd780 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c6dffb640 1 -- 172.21.15.159:0/2745844547 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c70036050 con 0x55560c4fd780 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c6dffb640 1 -- 172.21.15.159:0/2745844547 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700043c0 con 0x55560c4fd780 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c7fd84740 1 -- 172.21.15.159:0/2745844547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4fd780 msgr2=0x55560c4ffb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/2745844547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4fd780 0x55560c4ffb70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1c70006010 tx=0x7f1c70004a80 comp rx=0 tx=0).stop 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c7fd84740 1 -- 172.21.15.159:0/2745844547 shutdown_connections 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/2745844547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4fd780 0x55560c4ffb70 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/2745844547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 0x55560c4eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/2745844547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4efb40 0x55560c4ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c7fd84740 1 -- 172.21.15.159:0/2745844547 >> 172.21.15.159:0/2745844547 conn(0x55560c4b7310 msgr2=0x55560c4eac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:28.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c7fd84740 1 -- 172.21.15.159:0/2745844547 shutdown_connections 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.397+0000 7f1c7fd84740 1 -- 172.21.15.159:0/2745844547 wait complete. 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c7fd84740 1 -- start start 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c7fd84740 1 Processor -- start 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 0x55560c4fd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4fa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 0x55560c4fa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55560c500420 con 0x55560c4efb40 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55560c40f060 con 0x55560c4ee5d0 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55560c5005a0 con 0x55560c4fd780 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c7fd84740 10 client.0 _ll_register_callbacks cb 0x55560c1628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4fa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49282/0 (socket says 172.21.15.159:49282) 2024-09-19T06:51:28.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c6ffff640 1 -- 172.21.15.159:0/1294771097 learned_addr learned my addr 172.21.15.159:0/1294771097 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c777fe640 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 0x55560c4fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c777fe640 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 0x55560c4fa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c6ffff640 1 -- 172.21.15.159:0/1294771097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 msgr2=0x55560c4fa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c6ffff640 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 0x55560c4fa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c6ffff640 1 -- 172.21.15.159:0/1294771097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 msgr2=0x55560c4fd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c6ffff640 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 0x55560c4fd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.398+0000 7f1c6ffff640 1 -- 172.21.15.159:0/1294771097 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55560c1c53c0 con 0x55560c4efb40 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c6ffff640 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4fa3f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000e680 tx=0x7f1c6000eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ca110c1b241849 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1294771097 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60004220 con 0x55560c4efb40 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1294771097 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1c600043c0 con 0x55560c4efb40 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1294771097 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c70036050 con 0x55560c4efb40 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1294771097 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1c6000ee80 con 0x55560c4efb40 2024-09-19T06:51:28.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c7fd84740 10 client.16434 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1294771097 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55560c50bf10 con 0x55560c4efb40 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1294771097 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c70036050 con 0x55560c4efb40 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1294771097 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f1c60021070 con 0x55560c4efb40 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c7fd84740 10 client.16434 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c7fd84740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c7fd84740 20 client.16434 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55560c50d420 0x55560c50f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c7fd84740 4 client.16434 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.399+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1294771097 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55560c461860 con 0x55560c50d420 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.400+0000 7f1c777fe640 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55560c50d420 0x55560c50f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.400+0000 7f1c777fe640 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55560c50d420 0x55560c50f810 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e62a82c4494c9c7 server_cookie=ddddde82ab02cef0 in_seq=0 out_seq=0 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.400+0000 7f1c56ffd640 10 client.16434 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:28.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1294771097 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55560c461860 con 0x55560c50d420 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c56ffd640 10 client.16434 handle_command_reply: tid=0 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 client.16434 shutdown 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1294771097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 msgr2=0x55560c4fa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4fa3f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000e680 tx=0x7f1c6000eb40 comp rx=0 tx=0).stop 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1294771097 shutdown_connections 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55560c50d420 0x55560c50f810 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 0x55560c4fa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4fa3f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1294771097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4ee5d0 0x55560c4fd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1294771097 >> 172.21.15.159:0/1294771097 conn(0x55560c4b7310 msgr2=0x55560c4f0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c56ffd640 0 client.16434 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1294771097 shutdown_connections 2024-09-19T06:51:28.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1294771097 wait complete. 2024-09-19T06:51:28.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.401+0000 7f1c7fd84740 20 client.16434 trim_cache size 0 max 16384 2024-09-19T06:51:28.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c7fd84740 1 Processor -- start 2024-09-19T06:51:28.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c7fd84740 1 -- start start 2024-09-19T06:51:28.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4ee5d0 0x55560c4fa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4efb40 0x55560c5096f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 0x55560c4f5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781a9750 con 0x55560c4ee5d0 2024-09-19T06:51:28.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781abfd0 con 0x55560c4efb40 2024-09-19T06:51:28.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781a9dc0 con 0x55560c4fd780 2024-09-19T06:51:28.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4ee5d0 0x55560c4fa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4ee5d0 0x55560c4fa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49286/0 (socket says 172.21.15.159:49286) 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c777fe640 1 -- 172.21.15.159:0/3448521751 learned_addr learned my addr 172.21.15.159:0/3448521751 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.414+0000 7f1c777fe640 1 --2- 172.21.15.159:0/3448521751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 0x55560c4f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c777fe640 1 -- 172.21.15.159:0/3448521751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 msgr2=0x55560c4f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c777fe640 1 --2- 172.21.15.159:0/3448521751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 0x55560c4f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c777fe640 1 -- 172.21.15.159:0/3448521751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4efb40 msgr2=0x55560c5096f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c6ffff640 1 --2- 172.21.15.159:0/3448521751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4efb40 0x55560c5096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c777fe640 1 --2- 172.21.15.159:0/3448521751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4efb40 0x55560c5096f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c777fe640 1 -- 172.21.15.159:0/3448521751 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55560c4eb960 con 0x55560c4ee5d0 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c777fe640 1 --2- 172.21.15.159:0/3448521751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4ee5d0 0x55560c4fa3c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009dc0 tx=0x7f1c70031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0ca00a918f5663 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c6d7fa640 1 -- 172.21.15.159:0/3448521751 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700314d0 con 0x55560c4ee5d0 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c6d7fa640 1 -- 172.21.15.159:0/3448521751 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c70036040 con 0x55560c4ee5d0 2024-09-19T06:51:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.415+0000 7f1c6d7fa640 1 -- 172.21.15.159:0/3448521751 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70004300 con 0x55560c4ee5d0 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 -- 172.21.15.159:0/3448521751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4ee5d0 msgr2=0x55560c4fa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/3448521751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4ee5d0 0x55560c4fa3c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009dc0 tx=0x7f1c70031a90 comp rx=0 tx=0).stop 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 -- 172.21.15.159:0/3448521751 shutdown_connections 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/3448521751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4fd780 0x55560c4f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/3448521751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4efb40 0x55560c5096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/3448521751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4ee5d0 0x55560c4fa3c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 -- 172.21.15.159:0/3448521751 >> 172.21.15.159:0/3448521751 conn(0x55560c4b7310 msgr2=0x55560c4f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 -- 172.21.15.159:0/3448521751 shutdown_connections 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 -- 172.21.15.159:0/3448521751 wait complete. 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 -- start start 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 Processor -- start 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4ee5d0 0x55560c505da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4fd780 0x55560c4f7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781aa490 con 0x55560c4efb40 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781ab900 con 0x55560c4fd780 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.416+0000 7f1c7fd84740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781aab60 con 0x55560c4ee5d0 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c7fd84740 10 client.0 _ll_register_callbacks cb 0x7f1c60005ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4f6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49290/0 (socket says 172.21.15.159:49290) 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c6ffff640 1 -- 172.21.15.159:0/1012963526 learned_addr learned my addr 172.21.15.159:0/1012963526 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c777fe640 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4ee5d0 0x55560c505da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c777fe640 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4fd780 0x55560c4f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c6ffff640 1 -- 172.21.15.159:0/1012963526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4ee5d0 msgr2=0x55560c505da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:28.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c6ffff640 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4ee5d0 0x55560c505da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c6ffff640 1 -- 172.21.15.159:0/1012963526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4fd780 msgr2=0x55560c4f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c6ffff640 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4fd780 0x55560c4f7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c6ffff640 1 -- 172.21.15.159:0/1012963526 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55560c4f7b40 con 0x55560c4efb40 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c777fe640 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4ee5d0 0x55560c505da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c6ffff640 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4f6fc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1c60001eb0 tx=0x7f1c6000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d68d315a451a62e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1012963526 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60027040 con 0x55560c4efb40 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1012963526 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f1c600037f0 con 0x55560c4efb40 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1012963526 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c70036040 con 0x55560c4efb40 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1012963526 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1c6000a680 con 0x55560c4efb40 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c7fd84740 10 client.16440 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.417+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1012963526 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55560c577f60 con 0x55560c4efb40 2024-09-19T06:51:28.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1012963526 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c70036040 con 0x55560c4efb40 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1012963526 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f1c6002a070 con 0x55560c4efb40 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c7fd84740 10 client.16440 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c7fd84740 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c7fd84740 20 client.16440 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55560c5786d0 0x55560c57aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c7fd84740 4 client.16440 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1012963526 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55560c45bd70 con 0x55560c5786d0 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c777fe640 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55560c5786d0 0x55560c57aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c777fe640 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55560c5786d0 0x55560c57aaf0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3f3a8c973d150a5 server_cookie=1d71c6fcbbb75bfd in_seq=0 out_seq=0 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.418+0000 7f1c56ffd640 10 client.16440 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c56ffd640 1 -- 172.21.15.159:0/1012963526 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55560c45bd70 con 0x55560c5786d0 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c56ffd640 10 client.16440 handle_command_reply: tid=0 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 client.16440 shutdown 2024-09-19T06:51:28.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1012963526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 msgr2=0x55560c4f6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4f6fc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1c60001eb0 tx=0x7f1c6000ca30 comp rx=0 tx=0).stop 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1012963526 shutdown_connections 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55560c5786d0 0x55560c57aaf0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55560c4fd780 0x55560c4f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55560c4efb40 0x55560c4f6fc0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c56ffd640 0 client.16440 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 --2- 172.21.15.159:0/1012963526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55560c4ee5d0 0x55560c505da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1012963526 >> 172.21.15.159:0/1012963526 conn(0x55560c4b7310 msgr2=0x55560c4fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1012963526 shutdown_connections 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 1 -- 172.21.15.159:0/1012963526 wait complete. 2024-09-19T06:51:28.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.419+0000 7f1c7fd84740 20 client.16440 trim_cache size 0 max 16384 2024-09-19T06:51:28.433 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:51:28.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1c640a33b0 msgr2=0x7f1c640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1c640a33b0 0x7f1c640a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c6809ba20 tx=0x7f1c6806daa0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78101de0 msgr2=0x7f1c781983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78101de0 0x7f1c781983f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800d950 tx=0x7f1c6800de10 comp rx=0 tx=0).stop 2024-09-19T06:51:28.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/2216722082 shutdown_connections 2024-09-19T06:51:28.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1c640a33b0 0x7f1c640a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c78106f10 0x7f1c7819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c78102790 0x7f1c78198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 --2- 172.21.15.159:0/2216722082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c78101de0 0x7f1c781983f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/2216722082 >> 172.21.15.159:0/2216722082 conn(0x7f1c780fd8c0 msgr2=0x7f1c780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:28.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/2216722082 shutdown_connections 2024-09-19T06:51:28.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:28.420+0000 7f1c7d9ab640 1 -- 172.21.15.159:0/2216722082 wait complete. 2024-09-19T06:51:29.051 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:28 smithi159 ceph-mon[30935]: pgmap v139: 97 pgs: 97 active+clean; 47 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 10 op/s 2024-09-19T06:51:29.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:28 smithi203 ceph-mon[35473]: pgmap v139: 97 pgs: 97 active+clean; 47 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 10 op/s 2024-09-19T06:51:29.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:28 smithi189 ceph-mon[34880]: pgmap v139: 97 pgs: 97 active+clean; 47 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 10 op/s 2024-09-19T06:51:30.240 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:51:30.241 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:51:30.502 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:30.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:30 smithi159 ceph-mon[30935]: pgmap v140: 97 pgs: 97 active+clean; 47 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 10 op/s 2024-09-19T06:51:30.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.947+0000 7f16516d1640 1 -- 172.21.15.159:0/2696523608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100a80 msgr2=0x7f164c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.947+0000 7f16516d1640 1 --2- 172.21.15.159:0/2696523608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100a80 0x7f164c100ee0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1634009930 tx=0x7f163402a420 comp rx=0 tx=0).stop 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.947+0000 7f16516d1640 1 -- 172.21.15.159:0/2696523608 shutdown_connections 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.947+0000 7f16516d1640 1 --2- 172.21.15.159:0/2696523608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c101420 0x7f164c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.947+0000 7f16516d1640 1 --2- 172.21.15.159:0/2696523608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c100a80 0x7f164c100ee0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.947+0000 7f16516d1640 1 --2- 172.21.15.159:0/2696523608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c106a80 0x7f164c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.947+0000 7f16516d1640 1 -- 172.21.15.159:0/2696523608 >> 172.21.15.159:0/2696523608 conn(0x7f164c0fc7a0 msgr2=0x7f164c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.948+0000 7f16516d1640 1 -- 172.21.15.159:0/2696523608 shutdown_connections 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.948+0000 7f16516d1640 1 -- 172.21.15.159:0/2696523608 wait complete. 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f16516d1640 1 Processor -- start 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f16516d1640 1 -- start start 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f16516d1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c100a80 0x7f164c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f16516d1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c101420 0x7f164c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f16516d1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c106a80 0x7f164c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f16516d1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f164c110e80 con 0x7f164c106a80 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f16516d1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f164c110d00 con 0x7f164c100a80 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f16516d1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f164c111000 con 0x7f164c101420 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c106a80 0x7f164c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c106a80 0x7f164c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60038/0 (socket says 172.21.15.159:60038) 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164b7fe640 1 -- 172.21.15.159:0/2985894594 learned_addr learned my addr 172.21.15.159:0/2985894594 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164affd640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c100a80 0x7f164c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f16427fc640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c101420 0x7f164c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164b7fe640 1 -- 172.21.15.159:0/2985894594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c101420 msgr2=0x7f164c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164b7fe640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c101420 0x7f164c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164b7fe640 1 -- 172.21.15.159:0/2985894594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c100a80 msgr2=0x7f164c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164b7fe640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c100a80 0x7f164c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164b7fe640 1 -- 172.21.15.159:0/2985894594 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c19d420 con 0x7f164c106a80 2024-09-19T06:51:30.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.949+0000 7f164affd640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c100a80 0x7f164c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:30.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.950+0000 7f164b7fe640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c106a80 0x7f164c19cd40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f164400cad0 tx=0x7f164400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.950+0000 7f1648ff9640 1 -- 172.21.15.159:0/2985894594 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164400ae20 con 0x7f164c106a80 2024-09-19T06:51:30.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.950+0000 7f1648ff9640 1 -- 172.21.15.159:0/2985894594 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1644005020 con 0x7f164c106a80 2024-09-19T06:51:30.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.950+0000 7f16516d1640 1 -- 172.21.15.159:0/2985894594 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c19d710 con 0x7f164c106a80 2024-09-19T06:51:30.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.950+0000 7f1648ff9640 1 -- 172.21.15.159:0/2985894594 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164400f6f0 con 0x7f164c106a80 2024-09-19T06:51:30.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.950+0000 7f16516d1640 1 -- 172.21.15.159:0/2985894594 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c1a4ff0 con 0x7f164c106a80 2024-09-19T06:51:30.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.952+0000 7f1648ff9640 1 -- 172.21.15.159:0/2985894594 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f16440051d0 con 0x7f164c106a80 2024-09-19T06:51:30.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.952+0000 7f1653aaa740 1 Processor -- start 2024-09-19T06:51:30.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.952+0000 7f1653aaa740 1 -- start start 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f1648ff9640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16380a33b0 0x7f16380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f16427fc640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16380a33b0 0x7f16380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f1648ff9640 1 -- 172.21.15.159:0/2985894594 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f16440d0160 con 0x7f164c106a80 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 0x5610a274be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a275ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a275d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f1653aaa740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5610a26b1280 con 0x5610a275b150 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f1653aaa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5610a2658b10 con 0x5610a274c340 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f1653aaa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5610a26ad240 con 0x5610a274ba20 2024-09-19T06:51:30.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f164b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a275d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f164b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a275d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60040/0 (socket says 172.21.15.159:60040) 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f164b7fe640 1 -- 172.21.15.159:0/1753395494 learned_addr learned my addr 172.21.15.159:0/1753395494 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f164affd640 1 --2- 172.21.15.159:0/1753395494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 0x5610a274be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f16427fc640 1 --2- 172.21.15.159:0/1753395494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a275ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f16427fc640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16380a33b0 0x7f16380a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16340096c0 tx=0x7f1634005e10 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f164b7fe640 1 -- 172.21.15.159:0/1753395494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 msgr2=0x5610a274be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f164b7fe640 1 --2- 172.21.15.159:0/1753395494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 0x5610a274be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f164b7fe640 1 -- 172.21.15.159:0/1753395494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 msgr2=0x5610a275ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f164b7fe640 1 --2- 172.21.15.159:0/1753395494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a275ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.953+0000 7f164b7fe640 1 -- 172.21.15.159:0/1753395494 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610a26651f0 con 0x5610a275b150 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.954+0000 7f164b7fe640 1 --2- 172.21.15.159:0/1753395494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a275d540 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1644098de0 tx=0x7f164409cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fe477f3c18557f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.954+0000 7f16417fa640 1 -- 172.21.15.159:0/1753395494 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164401d040 con 0x5610a275b150 2024-09-19T06:51:30.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.954+0000 7f16417fa640 1 -- 172.21.15.159:0/1753395494 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1644005560 con 0x5610a275b150 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.954+0000 7f16417fa640 1 -- 172.21.15.159:0/1753395494 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440a4e30 con 0x5610a275b150 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.954+0000 7f1653aaa740 1 -- 172.21.15.159:0/1753395494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 msgr2=0x5610a275d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.954+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1753395494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a275d540 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1644098de0 tx=0x7f164409cc50 comp rx=0 tx=0).stop 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 -- 172.21.15.159:0/1753395494 shutdown_connections 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1753395494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a275d540 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1753395494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a275ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1753395494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 0x5610a274be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 -- 172.21.15.159:0/1753395494 >> 172.21.15.159:0/1753395494 conn(0x5610a27480f0 msgr2=0x5610a27484d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 -- 172.21.15.159:0/1753395494 shutdown_connections 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 -- 172.21.15.159:0/1753395494 wait complete. 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 -- start start 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 Processor -- start 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 0x5610a27580e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a2758620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a2758b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5610a275dd20 con 0x5610a275b150 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5610a266bf10 con 0x5610a274c340 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5610a275dea0 con 0x5610a274ba20 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f1653aaa740 10 client.0 _ll_register_callbacks cb 0x5610a2634a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f164b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a2758b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f164b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a2758b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60048/0 (socket says 172.21.15.159:60048) 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f164b7fe640 1 -- 172.21.15.159:0/3650625730 learned_addr learned my addr 172.21.15.159:0/3650625730 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.955+0000 7f164affd640 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 0x5610a27580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f16427fc640 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a2758620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f164b7fe640 1 -- 172.21.15.159:0/3650625730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 msgr2=0x5610a27580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f164b7fe640 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 0x5610a27580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f164b7fe640 1 -- 172.21.15.159:0/3650625730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 msgr2=0x5610a2758620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f164b7fe640 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a2758620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f164b7fe640 1 -- 172.21.15.159:0/3650625730 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610a24226a0 con 0x5610a275b150 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f164b7fe640 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a2758b60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f164409c3a0 tx=0x7f16440b54e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705549d99d7360d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f16327fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f16327fc640 1 -- 172.21.15.159:0/3650625730 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440b9020 con 0x5610a275b150 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f16327fc640 1 -- 172.21.15.159:0/3650625730 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f16440a4e00 con 0x5610a275b150 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f1653aaa740 1 -- 172.21.15.159:0/3650625730 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1644005560 con 0x5610a275b150 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f16327fc640 1 -- 172.21.15.159:0/3650625730 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f164401d070 con 0x5610a275b150 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f1653aaa740 10 client.16452 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f1653aaa740 1 -- 172.21.15.159:0/3650625730 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5610a2769a10 con 0x5610a275b150 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f16327fc640 1 -- 172.21.15.159:0/3650625730 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1644005560 con 0x5610a275b150 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.956+0000 7f16327fc640 1 -- 172.21.15.159:0/3650625730 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f164409b2d0 con 0x5610a275b150 2024-09-19T06:51:30.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.957+0000 7f1653aaa740 10 client.16452 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.957+0000 7f1653aaa740 10 client.16452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.957+0000 7f1653aaa740 20 client.16452 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.957+0000 7f1653aaa740 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610a276ad60 0x5610a276d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.957+0000 7f1653aaa740 4 client.16452 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.957+0000 7f1653aaa740 1 -- 172.21.15.159:0/3650625730 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610a26be7f0 con 0x5610a276ad60 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.957+0000 7f164affd640 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610a276ad60 0x5610a276d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.957+0000 7f164affd640 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610a276ad60 0x5610a276d150 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36f9a86aa55a2b9f server_cookie=cc9a14867d0e24bd in_seq=0 out_seq=0 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.957+0000 7f16327fc640 10 client.16452 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f16327fc640 1 -- 172.21.15.159:0/3650625730 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610a26be7f0 con 0x5610a276ad60 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f16327fc640 10 client.16452 handle_command_reply: tid=0 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 client.16452 shutdown 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 -- 172.21.15.159:0/3650625730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 msgr2=0x5610a2758b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a2758b60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f164409c3a0 tx=0x7f16440b54e0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 -- 172.21.15.159:0/3650625730 shutdown_connections 2024-09-19T06:51:30.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610a276ad60 0x5610a276d150 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a275b150 0x5610a2758b60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a2758620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 --2- 172.21.15.159:0/3650625730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274ba20 0x5610a27580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 -- 172.21.15.159:0/3650625730 >> 172.21.15.159:0/3650625730 conn(0x5610a27480f0 msgr2=0x5610a274de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f16327fc640 0 client.16452 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:30.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 -- 172.21.15.159:0/3650625730 shutdown_connections 2024-09-19T06:51:30.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 1 -- 172.21.15.159:0/3650625730 wait complete. 2024-09-19T06:51:30.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.958+0000 7f1653aaa740 20 client.16452 trim_cache size 0 max 16384 2024-09-19T06:51:30.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f1653aaa740 1 Processor -- start 2024-09-19T06:51:30.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f1653aaa740 1 -- start start 2024-09-19T06:51:30.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a2766840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a27589b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a275b150 0x5610a276fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f1653aaa740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1a9820 con 0x5610a274ba20 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f1653aaa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1ac0a0 con 0x5610a274c340 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f1653aaa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1a9e90 con 0x5610a275b150 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f164affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a2766840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f164affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a2766840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60064/0 (socket says 172.21.15.159:60064) 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.975+0000 7f164affd640 1 -- 172.21.15.159:0/1804838082 learned_addr learned my addr 172.21.15.159:0/1804838082 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f164b7fe640 1 --2- 172.21.15.159:0/1804838082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a275b150 0x5610a276fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f16427fc640 1 --2- 172.21.15.159:0/1804838082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a27589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f164affd640 1 -- 172.21.15.159:0/1804838082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a275b150 msgr2=0x5610a276fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f164affd640 1 --2- 172.21.15.159:0/1804838082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a275b150 0x5610a276fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f164affd640 1 -- 172.21.15.159:0/1804838082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 msgr2=0x5610a27589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f164affd640 1 --2- 172.21.15.159:0/1804838082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a27589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f164affd640 1 -- 172.21.15.159:0/1804838082 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610a274c170 con 0x5610a274ba20 2024-09-19T06:51:30.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f164affd640 1 --2- 172.21.15.159:0/1804838082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a2766840 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f163c005e00 tx=0x7f163c014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db091adbf963c8c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f1640ff9640 1 -- 172.21.15.159:0/1804838082 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c012450 con 0x5610a274ba20 2024-09-19T06:51:30.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f1640ff9640 1 -- 172.21.15.159:0/1804838082 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f163c012ad0 con 0x5610a274ba20 2024-09-19T06:51:30.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.976+0000 7f1640ff9640 1 -- 172.21.15.159:0/1804838082 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c01d980 con 0x5610a274ba20 2024-09-19T06:51:30.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 -- 172.21.15.159:0/1804838082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 msgr2=0x5610a2766840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1804838082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a2766840 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f163c005e00 tx=0x7f163c014840 comp rx=0 tx=0).stop 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 -- 172.21.15.159:0/1804838082 shutdown_connections 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1804838082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a275b150 0x5610a276fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1804838082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a274c340 0x5610a27589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1804838082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a2766840 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 -- 172.21.15.159:0/1804838082 >> 172.21.15.159:0/1804838082 conn(0x5610a27480f0 msgr2=0x5610a2766130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 -- 172.21.15.159:0/1804838082 shutdown_connections 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 -- 172.21.15.159:0/1804838082 wait complete. 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 -- start start 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 Processor -- start 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.977+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a276dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274c340 0x5610a276e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f1653aaa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a275b150 0x5610a276e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f1653aaa740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1aa560 con 0x5610a274ba20 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f1653aaa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1ab9d0 con 0x5610a275b150 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f1653aaa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1aac30 con 0x5610a274c340 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f1653aaa740 10 client.0 _ll_register_callbacks cb 0x7f1634042030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a276dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a276dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60076/0 (socket says 172.21.15.159:60076) 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164affd640 1 -- 172.21.15.159:0/1988234568 learned_addr learned my addr 172.21.15.159:0/1988234568 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f16427fc640 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274c340 0x5610a276e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164b7fe640 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a275b150 0x5610a276e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164affd640 1 -- 172.21.15.159:0/1988234568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274c340 msgr2=0x5610a276e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164affd640 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274c340 0x5610a276e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164affd640 1 -- 172.21.15.159:0/1988234568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a275b150 msgr2=0x5610a276e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164affd640 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a275b150 0x5610a276e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164affd640 1 -- 172.21.15.159:0/1988234568 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610a27d46a0 con 0x5610a274ba20 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164b7fe640 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a275b150 0x5610a276e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f164affd640 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a276dad0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f163c01d5c0 tx=0x7f163c009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3c527431a38df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f16327fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f16327fc640 1 -- 172.21.15.159:0/1988234568 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c004020 con 0x5610a274ba20 2024-09-19T06:51:30.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f16327fc640 1 -- 172.21.15.159:0/1988234568 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f163c0041c0 con 0x5610a274ba20 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f1653aaa740 1 -- 172.21.15.159:0/1988234568 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f163c012ad0 con 0x5610a274ba20 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.978+0000 7f16327fc640 1 -- 172.21.15.159:0/1988234568 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f163c0043c0 con 0x5610a274ba20 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f1653aaa740 10 client.16458 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f1653aaa740 1 -- 172.21.15.159:0/1988234568 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5610a27d5970 con 0x5610a274ba20 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f16327fc640 1 -- 172.21.15.159:0/1988234568 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f163c012ad0 con 0x5610a274ba20 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f16327fc640 1 -- 172.21.15.159:0/1988234568 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f163c036020 con 0x5610a274ba20 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f1653aaa740 10 client.16458 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f1653aaa740 10 client.16458 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f1653aaa740 20 client.16458 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610a27d5f80 0x5610a27d83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f1653aaa740 4 client.16458 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:51:30.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f1653aaa740 1 -- 172.21.15.159:0/1988234568 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5610a26b8d00 con 0x5610a27d5f80 2024-09-19T06:51:30.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.979+0000 7f16427fc640 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610a27d5f80 0x5610a27d83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.980+0000 7f16427fc640 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610a27d5f80 0x5610a27d83a0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf1c058914f1c778 server_cookie=ebacc3bd8820e1b in_seq=0 out_seq=0 2024-09-19T06:51:30.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.980+0000 7f16327fc640 10 client.16458 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:30.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f16327fc640 1 -- 172.21.15.159:0/1988234568 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5610a26b8d00 con 0x5610a27d5f80 2024-09-19T06:51:30.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f16327fc640 10 client.16458 handle_command_reply: tid=0 2024-09-19T06:51:30.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 client.16458 shutdown 2024-09-19T06:51:30.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 -- 172.21.15.159:0/1988234568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 msgr2=0x5610a276dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a276dad0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f163c01d5c0 tx=0x7f163c009dc0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 -- 172.21.15.159:0/1988234568 shutdown_connections 2024-09-19T06:51:30.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610a27d5f80 0x5610a27d83a0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610a275b150 0x5610a276e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610a274c340 0x5610a276e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 --2- 172.21.15.159:0/1988234568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610a274ba20 0x5610a276dad0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f16327fc640 0 client.16458 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:30.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 -- 172.21.15.159:0/1988234568 >> 172.21.15.159:0/1988234568 conn(0x5610a27480f0 msgr2=0x5610a2759fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 -- 172.21.15.159:0/1988234568 shutdown_connections 2024-09-19T06:51:30.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 1 -- 172.21.15.159:0/1988234568 wait complete. 2024-09-19T06:51:30.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.981+0000 7f1653aaa740 20 client.16458 trim_cache size 0 max 16384 2024-09-19T06:51:30.989 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:51:30.989 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:51:30.989 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "b07149f1-c2d2-4153-b4d0-42ae81e29f63", 2024-09-19T06:51:30.989 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:51:30.989 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:51:30.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 -- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16380a33b0 msgr2=0x7f16380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16380a33b0 0x7f16380a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16340096c0 tx=0x7f1634005e10 comp rx=0 tx=0).stop 2024-09-19T06:51:30.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 -- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c106a80 msgr2=0x7f164c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c106a80 0x7f164c19cd40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f164400cad0 tx=0x7f164400cf90 comp rx=0 tx=0).stop 2024-09-19T06:51:30.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 -- 172.21.15.159:0/2985894594 shutdown_connections 2024-09-19T06:51:30.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f16380a33b0 0x7f16380a5870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f164c106a80 0x7f164c19cd40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f164c101420 0x7f164c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 --2- 172.21.15.159:0/2985894594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c100a80 0x7f164c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 -- 172.21.15.159:0/2985894594 >> 172.21.15.159:0/2985894594 conn(0x7f164c0fc7a0 msgr2=0x7f164c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 -- 172.21.15.159:0/2985894594 shutdown_connections 2024-09-19T06:51:30.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:30.982+0000 7f16516d1640 1 -- 172.21.15.159:0/2985894594 wait complete. 2024-09-19T06:51:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:30 smithi203 ceph-mon[35473]: pgmap v140: 97 pgs: 97 active+clean; 47 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 10 op/s 2024-09-19T06:51:31.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:30 smithi189 ceph-mon[34880]: pgmap v140: 97 pgs: 97 active+clean; 47 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 10 op/s 2024-09-19T06:51:31.872 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:31 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:51:31.872 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:31 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:31.872 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:31 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:51:31.899 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:51:32.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:31 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:51:32.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:31 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:32.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:31 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:51:32.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:31 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:51:32.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:31 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:32.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:31 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:51:32.145 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:32.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.597+0000 7fc7d0567640 1 -- 172.21.15.159:0/1113726947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 msgr2=0x7fc7c8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:32.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.597+0000 7fc7d0567640 1 --2- 172.21.15.159:0/1113726947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 0x7fc7c8106e60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009cd0 tx=0x7fc7c402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.597+0000 7fc7d0567640 1 -- 172.21.15.159:0/1113726947 shutdown_connections 2024-09-19T06:51:32.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.597+0000 7fc7d0567640 1 --2- 172.21.15.159:0/1113726947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7c8101420 0x7fc7c810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.597+0000 7fc7d0567640 1 --2- 172.21.15.159:0/1113726947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c8100a80 0x7fc7c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.597+0000 7fc7d0567640 1 --2- 172.21.15.159:0/1113726947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 0x7fc7c8106e60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.597+0000 7fc7d0567640 1 -- 172.21.15.159:0/1113726947 >> 172.21.15.159:0/1113726947 conn(0x7fc7c80fc7a0 msgr2=0x7fc7c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.597+0000 7fc7d0567640 1 -- 172.21.15.159:0/1113726947 shutdown_connections 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.597+0000 7fc7d0567640 1 -- 172.21.15.159:0/1113726947 wait complete. 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7d0567640 1 Processor -- start 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7d0567640 1 -- start start 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7d0567640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c8100a80 0x7fc7c8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7d0567640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7c8101420 0x7fc7c81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7d0567640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 0x7fc7c819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7d0567640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8110e80 con 0x7fc7c8106a80 2024-09-19T06:51:32.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7d0567640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8110d00 con 0x7fc7c8101420 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7d0567640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8111000 con 0x7fc7c8100a80 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7ceb04640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 0x7fc7c819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7ceb04640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 0x7fc7c819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60096/0 (socket says 172.21.15.159:60096) 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7ceb04640 1 -- 172.21.15.159:0/2344179755 learned_addr learned my addr 172.21.15.159:0/2344179755 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7ce303640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c8100a80 0x7fc7c8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7c8101420 0x7fc7c81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.598+0000 7fc7ceb04640 1 -- 172.21.15.159:0/2344179755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c8100a80 msgr2=0x7fc7c8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7ceb04640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c8100a80 0x7fc7c8198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7ceb04640 1 -- 172.21.15.159:0/2344179755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7c8101420 msgr2=0x7fc7c81989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7ceb04640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7c8101420 0x7fc7c81989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7ceb04640 1 -- 172.21.15.159:0/2344179755 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c819d420 con 0x7fc7c8106a80 2024-09-19T06:51:32.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7ceb04640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 0x7fc7c819cd40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c970 tx=0x7fc7c000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7bf7fe640 1 -- 172.21.15.159:0/2344179755 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0007bb0 con 0x7fc7c8106a80 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7d0567640 1 -- 172.21.15.159:0/2344179755 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c819d710 con 0x7fc7c8106a80 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7bf7fe640 1 -- 172.21.15.159:0/2344179755 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c0007d50 con 0x7fc7c8106a80 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7bf7fe640 1 -- 172.21.15.159:0/2344179755 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0018800 con 0x7fc7c8106a80 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.599+0000 7fc7d0567640 1 -- 172.21.15.159:0/2344179755 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c81a4ff0 con 0x7fc7c8106a80 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7bf7fe640 1 -- 172.21.15.159:0/2344179755 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc7c000fa50 con 0x7fc7c8106a80 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7d2940740 1 Processor -- start 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7d2940740 1 -- start start 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 0x55fb74d66760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d75550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 0x55fb74d77e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7d2940740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fb74ccc2e0 con 0x55fb74d66ca0 2024-09-19T06:51:32.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7d2940740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fb74c73ce0 con 0x55fb74d66380 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7d2940740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fb74cc82a0 con 0x55fb74d75a90 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7ce303640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d75550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.602+0000 7fc7ce303640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d75550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60098/0 (socket says 172.21.15.159:60098) 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7ce303640 1 -- 172.21.15.159:0/4026800012 learned_addr learned my addr 172.21.15.159:0/4026800012 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 0x55fb74d77e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 0x55fb74d66760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7bf7fe640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7ce303640 1 -- 172.21.15.159:0/4026800012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 msgr2=0x55fb74d77e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7ce303640 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 0x55fb74d77e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7ce303640 1 -- 172.21.15.159:0/4026800012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 msgr2=0x55fb74d66760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7ce303640 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 0x55fb74d66760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7ce303640 1 -- 172.21.15.159:0/4026800012 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb74c58440 con 0x55fb74d66ca0 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7ceb04640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 0x55fb74d77e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7bf7fe640 1 -- 172.21.15.159:0/2344179755 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fc7c00cfd70 con 0x7fc7c8106a80 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7ce303640 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d75550 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009cd0 tx=0x7fc7c40314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186b49f975de6952 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7bcff9640 1 -- 172.21.15.159:0/4026800012 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4048070 con 0x55fb74d66ca0 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7bcff9640 1 -- 172.21.15.159:0/4026800012 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c4036070 con 0x55fb74d66ca0 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.603+0000 7fc7bcff9640 1 -- 172.21.15.159:0/4026800012 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c40044d0 con 0x55fb74d66ca0 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7d2940740 1 -- 172.21.15.159:0/4026800012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 msgr2=0x55fb74d75550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7ceb04640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7b40a33b0 0x7fc7b40a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00cda90 tx=0x7fc7c006dda0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7d2940740 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d75550 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009cd0 tx=0x7fc7c40314e0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7d2940740 1 -- 172.21.15.159:0/4026800012 shutdown_connections 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7d2940740 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 0x55fb74d77e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7d2940740 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d75550 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7d2940740 1 --2- 172.21.15.159:0/4026800012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 0x55fb74d66760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7d2940740 1 -- 172.21.15.159:0/4026800012 >> 172.21.15.159:0/4026800012 conn(0x55fb74d62a30 msgr2=0x55fb74d62e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7d2940740 1 -- 172.21.15.159:0/4026800012 shutdown_connections 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.604+0000 7fc7d2940740 1 -- 172.21.15.159:0/4026800012 wait complete. 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7d2940740 1 -- start start 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7d2940740 1 Processor -- start 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 0x55fb74d75420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 0x55fb74d72c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7d2940740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fb74d78660 con 0x55fb74d66ca0 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7d2940740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fb74c87050 con 0x55fb74d66380 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7d2940740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fb74d787e0 con 0x55fb74d75a90 2024-09-19T06:51:32.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7d2940740 10 client.0 _ll_register_callbacks cb 0x55fb74cc7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7ce303640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7ce303640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60104/0 (socket says 172.21.15.159:60104) 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7ce303640 1 -- 172.21.15.159:0/2738383545 learned_addr learned my addr 172.21.15.159:0/2738383545 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 0x55fb74d75420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7ce303640 1 -- 172.21.15.159:0/2738383545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 msgr2=0x55fb74d72c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7ce303640 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 0x55fb74d72c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7ce303640 1 -- 172.21.15.159:0/2738383545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 msgr2=0x55fb74d75420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7ce303640 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 0x55fb74d75420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7ce303640 1 -- 172.21.15.159:0/2738383545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb74a3d3c0 con 0x55fb74d66ca0 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.605+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 0x55fb74d75420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:32.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7ce303640 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d726d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4005e30 tx=0x7fc7c4004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f942f792d20f9b4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/2738383545 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4048040 con 0x55fb74d66ca0 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/2738383545 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fc7c4004670 con 0x55fb74d66ca0 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7d2940740 1 -- 172.21.15.159:0/2738383545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c4036070 con 0x55fb74d66ca0 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/2738383545 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc7c405c050 con 0x55fb74d66ca0 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7d2940740 10 client.16470 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7d2940740 1 -- 172.21.15.159:0/2738383545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fb74d78660 con 0x55fb74d66ca0 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/2738383545 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c4036070 con 0x55fb74d66ca0 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/2738383545 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fc7c404b030 con 0x55fb74d66ca0 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7d2940740 10 client.16470 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7d2940740 10 client.16470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7d2940740 20 client.16470 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55fb74d85210 0x55fb74d87600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7d2940740 4 client.16470 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.606+0000 7fc7d2940740 1 -- 172.21.15.159:0/2738383545 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb74cd9850 con 0x55fb74d85210 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.607+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55fb74d85210 0x55fb74d87600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.607+0000 7fc7b1ffb640 10 client.16470 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.607+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55fb74d85210 0x55fb74d87600 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=502b0173ae2ddeb7 server_cookie=74486b562bddc861 in_seq=0 out_seq=0 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/2738383545 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb74cd9850 con 0x55fb74d85210 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7b1ffb640 10 client.16470 handle_command_reply: tid=0 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 client.16470 shutdown 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 -- 172.21.15.159:0/2738383545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 msgr2=0x55fb74d726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d726d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4005e30 tx=0x7fc7c4004480 comp rx=0 tx=0).stop 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 -- 172.21.15.159:0/2738383545 shutdown_connections 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55fb74d85210 0x55fb74d87600 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d75a90 0x55fb74d72c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66ca0 0x55fb74d726d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7b1ffb640 0 client.16470 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:32.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2738383545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66380 0x55fb74d75420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 -- 172.21.15.159:0/2738383545 >> 172.21.15.159:0/2738383545 conn(0x55fb74d62a30 msgr2=0x55fb74d68790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:32.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 -- 172.21.15.159:0/2738383545 shutdown_connections 2024-09-19T06:51:32.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 1 -- 172.21.15.159:0/2738383545 wait complete. 2024-09-19T06:51:32.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.608+0000 7fc7d2940740 20 client.16470 trim_cache size 0 max 16384 2024-09-19T06:51:32.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7d2940740 1 Processor -- start 2024-09-19T06:51:32.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7d2940740 1 -- start start 2024-09-19T06:51:32.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d62a30 0x55fb74d81900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d66380 0x55fb74d6d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 0x55fb74d8ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7d2940740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81a9610 con 0x55fb74d62a30 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7d2940740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81abe90 con 0x55fb74d66ca0 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7d2940740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81a9c80 con 0x55fb74d66380 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7cdb02640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d62a30 0x55fb74d81900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7cdb02640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d62a30 0x55fb74d81900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60120/0 (socket says 172.21.15.159:60120) 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7cdb02640 1 -- 172.21.15.159:0/2748071133 learned_addr learned my addr 172.21.15.159:0/2748071133 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7cdb02640 1 -- 172.21.15.159:0/2748071133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d66380 msgr2=0x55fb74d6d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/2748071133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d66380 0x55fb74d6d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7cdb02640 1 -- 172.21.15.159:0/2748071133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 msgr2=0x55fb74d8ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:32.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/2748071133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 0x55fb74d8ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.625+0000 7fc7cdb02640 1 -- 172.21.15.159:0/2748071133 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb74d66ad0 con 0x55fb74d62a30 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/2748071133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d62a30 0x55fb74d81900 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800cbc0 tx=0x7fc7b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b525e622c1bb361f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7b3fff640 1 -- 172.21.15.159:0/2748071133 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80141d0 con 0x55fb74d62a30 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7b3fff640 1 -- 172.21.15.159:0/2748071133 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b8005500 con 0x55fb74d62a30 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7b3fff640 1 -- 172.21.15.159:0/2748071133 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80148a0 con 0x55fb74d62a30 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7d2940740 1 -- 172.21.15.159:0/2748071133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d62a30 msgr2=0x55fb74d81900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2748071133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d62a30 0x55fb74d81900 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800cbc0 tx=0x7fc7b800cbf0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7d2940740 1 -- 172.21.15.159:0/2748071133 shutdown_connections 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2748071133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 0x55fb74d8ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2748071133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d66380 0x55fb74d6d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7d2940740 1 --2- 172.21.15.159:0/2748071133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d62a30 0x55fb74d81900 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.626+0000 7fc7d2940740 1 -- 172.21.15.159:0/2748071133 >> 172.21.15.159:0/2748071133 conn(0x55fb74d87970 msgr2=0x55fb74d74750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:32.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 -- 172.21.15.159:0/2748071133 shutdown_connections 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 -- 172.21.15.159:0/2748071133 wait complete. 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 -- start start 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 Processor -- start 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d62a30 0x55fb74d7e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66380 0x55fb74d794d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 0x55fb74d79a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81aa350 con 0x55fb74d66380 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81ab7c0 con 0x55fb74d66ca0 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81aaa20 con 0x55fb74d62a30 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7d2940740 10 client.0 _ll_register_callbacks cb 0x7fc7c4046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7ce303640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66380 0x55fb74d794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7ce303640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66380 0x55fb74d794d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60136/0 (socket says 172.21.15.159:60136) 2024-09-19T06:51:32.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7ce303640 1 -- 172.21.15.159:0/1189011162 learned_addr learned my addr 172.21.15.159:0/1189011162 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.627+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d62a30 0x55fb74d7e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 0x55fb74d79a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7ce303640 1 -- 172.21.15.159:0/1189011162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d62a30 msgr2=0x55fb74d7e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7ce303640 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d62a30 0x55fb74d7e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7ce303640 1 -- 172.21.15.159:0/1189011162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 msgr2=0x55fb74d79a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7ce303640 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 0x55fb74d79a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7ce303640 1 -- 172.21.15.159:0/1189011162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb74d7a240 con 0x55fb74d66380 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 0x55fb74d79a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7ce303640 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66380 0x55fb74d794d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4030740 tx=0x7fc7c4030be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac78968b9019232 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:32.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/1189011162 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c403f020 con 0x55fb74d66380 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/1189011162 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fc7c4004460 con 0x55fb74d66380 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7d2940740 1 -- 172.21.15.159:0/1189011162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b8005500 con 0x55fb74d66380 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/1189011162 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc7c4067050 con 0x55fb74d66380 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7d2940740 10 client.16476 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7d2940740 1 -- 172.21.15.159:0/1189011162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fb74defde0 con 0x55fb74d66380 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/1189011162 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b8005500 con 0x55fb74d66380 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.628+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/1189011162 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fc7c404b040 con 0x55fb74d66380 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.629+0000 7fc7d2940740 10 client.16476 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.629+0000 7fc7d2940740 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.629+0000 7fc7d2940740 20 client.16476 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.629+0000 7fc7d2940740 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55fb74d75a90 0x55fb74df24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:32.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.629+0000 7fc7d2940740 4 client.16476 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.629+0000 7fc7d2940740 1 -- 172.21.15.159:0/1189011162 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb74cd3d60 con 0x55fb74d75a90 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.629+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55fb74d75a90 0x55fb74df24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.629+0000 7fc7cdb02640 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55fb74d75a90 0x55fb74df24b0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3283a878f9455517 server_cookie=9d66e9e22970eff9 in_seq=0 out_seq=0 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.629+0000 7fc7b1ffb640 10 client.16476 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7b1ffb640 1 -- 172.21.15.159:0/1189011162 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fb74cd3d60 con 0x55fb74d75a90 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7b1ffb640 10 client.16476 handle_command_reply: tid=0 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 client.16476 shutdown 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 -- 172.21.15.159:0/1189011162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66380 msgr2=0x55fb74d794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66380 0x55fb74d794d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4030740 tx=0x7fc7c4030be0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 -- 172.21.15.159:0/1189011162 shutdown_connections 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55fb74d75a90 0x55fb74df24b0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb74d66ca0 0x55fb74d79a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fb74d66380 0x55fb74d794d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 --2- 172.21.15.159:0/1189011162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb74d62a30 0x55fb74d7e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 -- 172.21.15.159:0/1189011162 >> 172.21.15.159:0/1189011162 conn(0x55fb74d87970 msgr2=0x55fb74d73f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:32.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7b1ffb640 0 client.16476 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:32.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 -- 172.21.15.159:0/1189011162 shutdown_connections 2024-09-19T06:51:32.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 1 -- 172.21.15.159:0/1189011162 wait complete. 2024-09-19T06:51:32.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d2940740 20 client.16476 trim_cache size 0 max 16384 2024-09-19T06:51:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:51:32.639 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:51:32.639 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:51:32.640 INFO:teuthology.orchestra.run.smithi159.stdout: "b07149f1-c2d2-4153-b4d0-42ae81e29f63": { 2024-09-19T06:51:32.640 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:51:32.640 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "b07149f1-c2d2-4153-b4d0-42ae81e29f63", 2024-09-19T06:51:32.640 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:51:32.640 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:32.640 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:32.640 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:51:32.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 -- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7b40a33b0 msgr2=0x7fc7b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:32.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7b40a33b0 0x7fc7b40a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00cda90 tx=0x7fc7c006dda0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 -- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 msgr2=0x7fc7c819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:32.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 0x7fc7c819cd40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c970 tx=0x7fc7c000ce30 comp rx=0 tx=0).stop 2024-09-19T06:51:32.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 -- 172.21.15.159:0/2344179755 shutdown_connections 2024-09-19T06:51:32.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c8106a80 0x7fc7c819cd40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7c8101420 0x7fc7c81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 --2- 172.21.15.159:0/2344179755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7c8100a80 0x7fc7c8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:32.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.630+0000 7fc7d0567640 1 -- 172.21.15.159:0/2344179755 >> 172.21.15.159:0/2344179755 conn(0x7fc7c80fc7a0 msgr2=0x7fc7c806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:32.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.631+0000 7fc7d0567640 1 -- 172.21.15.159:0/2344179755 shutdown_connections 2024-09-19T06:51:32.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:32.631+0000 7fc7d0567640 1 -- 172.21.15.159:0/2344179755 wait complete. 2024-09-19T06:51:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:32 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:32 smithi159 ceph-mon[30935]: pgmap v141: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 61 KiB/s wr, 397 op/s 2024-09-19T06:51:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:32 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:33.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:32 smithi203 ceph-mon[35473]: pgmap v141: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 61 KiB/s wr, 397 op/s 2024-09-19T06:51:33.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:32 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:33.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:32 smithi189 ceph-mon[34880]: pgmap v141: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 61 KiB/s wr, 397 op/s 2024-09-19T06:51:33.453 INFO:tasks.cephfs.filesystem:scrub status for tag:b07149f1-c2d2-4153-b4d0-42ae81e29f63 - {'path': '/', 'tag': 'b07149f1-c2d2-4153-b4d0-42ae81e29f63', 'options': 'recursive,force'} 2024-09-19T06:51:34.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:34 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:51:34.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:34 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:51:34.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:34 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:51:35.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:35 smithi203 ceph-mon[35473]: pgmap v142: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 5.2 KiB/s wr, 391 op/s 2024-09-19T06:51:35.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:35 smithi189 ceph-mon[34880]: pgmap v142: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 5.2 KiB/s wr, 391 op/s 2024-09-19T06:51:35.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:35 smithi159 ceph-mon[30935]: pgmap v142: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 5.2 KiB/s wr, 391 op/s 2024-09-19T06:51:37.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:36 smithi203 ceph-mon[35473]: pgmap v143: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 5.2 KiB/s wr, 392 op/s 2024-09-19T06:51:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:36 smithi189 ceph-mon[34880]: pgmap v143: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 5.2 KiB/s wr, 392 op/s 2024-09-19T06:51:37.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:36 smithi159 ceph-mon[30935]: pgmap v143: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 5.2 KiB/s wr, 392 op/s 2024-09-19T06:51:39.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:38 smithi203 ceph-mon[35473]: pgmap v144: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 341 B/s wr, 388 op/s 2024-09-19T06:51:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 -- 172.21.15.159:0/1224648140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b501009e0 msgr2=0x7f6b50100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 --2- 172.21.15.159:0/1224648140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b501009e0 0x7f6b50100e40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009930 tx=0x7f6b4402a420 comp rx=0 tx=0).stop 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 -- 172.21.15.159:0/1224648140 shutdown_connections 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 --2- 172.21.15.159:0/1224648140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b50101380 0x7f6b5010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 --2- 172.21.15.159:0/1224648140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b501009e0 0x7f6b50100e40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 --2- 172.21.15.159:0/1224648140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b501069f0 0x7f6b50106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 -- 172.21.15.159:0/1224648140 >> 172.21.15.159:0/1224648140 conn(0x7f6b500fc6c0 msgr2=0x7f6b500feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 -- 172.21.15.159:0/1224648140 shutdown_connections 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 -- 172.21.15.159:0/1224648140 wait complete. 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 Processor -- start 2024-09-19T06:51:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.108+0000 7f6b567cf640 1 -- start start 2024-09-19T06:51:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b567cf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b501009e0 0x7f6b501972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b567cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b50101380 0x7f6b501977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b567cf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b501069f0 0x7f6b5019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b567cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50110e80 con 0x7f6b50101380 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b567cf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50110d00 con 0x7f6b501009e0 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b567cf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50111000 con 0x7f6b501069f0 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b50101380 0x7f6b501977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b50101380 0x7f6b501977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60148/0 (socket says 172.21.15.159:60148) 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4f7fe640 1 -- 172.21.15.159:0/4008527827 learned_addr learned my addr 172.21.15.159:0/4008527827 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4f7fe640 1 -- 172.21.15.159:0/4008527827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b501069f0 msgr2=0x7f6b5019bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b501009e0 0x7f6b501972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b501069f0 0x7f6b5019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b501069f0 0x7f6b5019bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4f7fe640 1 -- 172.21.15.159:0/4008527827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b501009e0 msgr2=0x7f6b501972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b501009e0 0x7f6b501972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4f7fe640 1 -- 172.21.15.159:0/4008527827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5019c2a0 con 0x7f6b50101380 2024-09-19T06:51:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b501009e0 0x7f6b501972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.109+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b50101380 0x7f6b501977f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6b4402a940 tx=0x7f6b44003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.110+0000 7f6b4d7fa640 1 -- 172.21.15.159:0/4008527827 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4403f070 con 0x7f6b50101380 2024-09-19T06:51:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.110+0000 7f6b4d7fa640 1 -- 172.21.15.159:0/4008527827 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b4403b460 con 0x7f6b50101380 2024-09-19T06:51:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.110+0000 7f6b567cf640 1 -- 172.21.15.159:0/4008527827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5019c530 con 0x7f6b50101380 2024-09-19T06:51:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.110+0000 7f6b4d7fa640 1 -- 172.21.15.159:0/4008527827 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44035030 con 0x7f6b50101380 2024-09-19T06:51:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.110+0000 7f6b567cf640 1 -- 172.21.15.159:0/4008527827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b501a3e20 con 0x7f6b50101380 2024-09-19T06:51:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.112+0000 7f6b4d7fa640 1 -- 172.21.15.159:0/4008527827 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6b44042070 con 0x7f6b50101380 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.112+0000 7f6b59646740 1 Processor -- start 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.112+0000 7f6b59646740 1 -- start start 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.112+0000 7f6b59646740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b59646740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13ab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b59646740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 0x5555f13ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b59646740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5555f13032f0 con 0x5555f13a0d00 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b59646740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5555f12ab270 con 0x5555f13a1620 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b59646740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5555f12ff2b0 con 0x5555f13abec0 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b4d7fa640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b380a34e0 0x7f6b380a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13a10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60158/0 (socket says 172.21.15.159:60158) 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 -- 172.21.15.159:0/795413122 learned_addr learned my addr 172.21.15.159:0/795413122 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b4d7fa640 1 -- 172.21.15.159:0/4008527827 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f6b440f0610 con 0x7f6b50101380 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/795413122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 0x5555f13ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b380a34e0 0x7f6b380a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/795413122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 -- 172.21.15.159:0/795413122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 msgr2=0x5555f13ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/795413122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 0x5555f13ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 -- 172.21.15.159:0/795413122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 msgr2=0x5555f13ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/795413122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 -- 172.21.15.159:0/795413122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f12aa340 con 0x5555f13a0d00 2024-09-19T06:51:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/795413122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13a10e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6b48012cd0 tx=0x7f6b4800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc756e37b15ba4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.113+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b380a34e0 0x7f6b380a59a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800afd0 tx=0x7f6b4801a000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b367fc640 1 -- 172.21.15.159:0/795413122 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48020070 con 0x5555f13a0d00 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b367fc640 1 -- 172.21.15.159:0/795413122 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b4800aab0 con 0x5555f13a0d00 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b367fc640 1 -- 172.21.15.159:0/795413122 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b480113e0 con 0x5555f13a0d00 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b59646740 1 -- 172.21.15.159:0/795413122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 msgr2=0x5555f13a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b59646740 1 --2- 172.21.15.159:0/795413122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13a10e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6b48012cd0 tx=0x7f6b4800f730 comp rx=0 tx=0).stop 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b59646740 1 -- 172.21.15.159:0/795413122 shutdown_connections 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b59646740 1 --2- 172.21.15.159:0/795413122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 0x5555f13ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b59646740 1 --2- 172.21.15.159:0/795413122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b59646740 1 --2- 172.21.15.159:0/795413122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13a10e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b59646740 1 -- 172.21.15.159:0/795413122 >> 172.21.15.159:0/795413122 conn(0x5555f139d270 msgr2=0x5555f139d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b59646740 1 -- 172.21.15.159:0/795413122 shutdown_connections 2024-09-19T06:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.114+0000 7f6b59646740 1 -- 172.21.15.159:0/795413122 wait complete. 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b59646740 1 -- start start 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b59646740 1 Processor -- start 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b59646740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 0x5555f13a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b59646740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a1620 0x5555f13a9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b59646740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13abec0 0x5555f13a9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b59646740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5555f13aea90 con 0x5555f13a1620 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b59646740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5555f128c290 con 0x5555f13abec0 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b59646740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5555f13aec10 con 0x5555f13a0d00 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b59646740 10 client.0 _ll_register_callbacks cb 0x5555f12bd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b4f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a1620 0x5555f13a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b4f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a1620 0x5555f13a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60172/0 (socket says 172.21.15.159:60172) 2024-09-19T06:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.115+0000 7f6b4f7fe640 1 -- 172.21.15.159:0/129173959 learned_addr learned my addr 172.21.15.159:0/129173959 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13abec0 0x5555f13a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 0x5555f13a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b4f7fe640 1 -- 172.21.15.159:0/129173959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 msgr2=0x5555f13a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 0x5555f13a8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b4f7fe640 1 -- 172.21.15.159:0/129173959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13abec0 msgr2=0x5555f13a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13abec0 0x5555f13a9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b4f7fe640 1 -- 172.21.15.159:0/129173959 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555f1016210 con 0x5555f13a1620 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a1620 0x5555f13a9400 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6b440edd90 tx=0x7f6b44009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52927aded374fe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/129173959 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44049040 con 0x5555f13a1620 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/129173959 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f6b440b8f30 con 0x5555f13a1620 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b59646740 1 -- 172.21.15.159:0/129173959 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b4800aab0 con 0x5555f13a1620 2024-09-19T06:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/129173959 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b440bcfc0 con 0x5555f13a1620 2024-09-19T06:51:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b59646740 10 client.16488 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b59646740 1 -- 172.21.15.159:0/129173959 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5555f10e2620 con 0x5555f13a1620 2024-09-19T06:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.116+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/129173959 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b4800aab0 con 0x5555f13a1620 2024-09-19T06:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/129173959 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f6b4403b9a0 con 0x5555f13a1620 2024-09-19T06:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b59646740 10 client.16488 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b59646740 10 client.16488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b59646740 20 client.16488 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b59646740 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5555f13bbec0 0x5555f13be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b59646740 4 client.16488 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b59646740 1 -- 172.21.15.159:0/129173959 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555f1310a20 con 0x5555f13bbec0 2024-09-19T06:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5555f13bbec0 0x5555f13be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b2f7fe640 10 client.16488 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.117+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5555f13bbec0 0x5555f13be2b0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9823ec435c4b3d9d server_cookie=f0580016017f1107 in_seq=0 out_seq=0 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/129173959 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555f1310a20 con 0x5555f13bbec0 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b2f7fe640 10 client.16488 handle_command_reply: tid=0 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 client.16488 shutdown 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 -- 172.21.15.159:0/129173959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a1620 msgr2=0x5555f13a9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a1620 0x5555f13a9400 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6b440edd90 tx=0x7f6b44009260 comp rx=0 tx=0).stop 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 -- 172.21.15.159:0/129173959 shutdown_connections 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5555f13bbec0 0x5555f13be2b0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13abec0 0x5555f13a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a1620 0x5555f13a9400 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b2f7fe640 0 client.16488 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 --2- 172.21.15.159:0/129173959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 0x5555f13a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 -- 172.21.15.159:0/129173959 >> 172.21.15.159:0/129173959 conn(0x5555f139d270 msgr2=0x5555f139a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 -- 172.21.15.159:0/129173959 shutdown_connections 2024-09-19T06:51:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 1 -- 172.21.15.159:0/129173959 wait complete. 2024-09-19T06:51:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.118+0000 7f6b59646740 20 client.16488 trim_cache size 0 max 16384 2024-09-19T06:51:39.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:38 smithi189 ceph-mon[34880]: pgmap v144: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 341 B/s wr, 388 op/s 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b59646740 1 Processor -- start 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b59646740 1 -- start start 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b59646740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b59646740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b59646740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 0x5555f13a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b59646740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501a9680 con 0x5555f13a0d00 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b59646740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501abf00 con 0x5555f13a1620 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b59646740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501a9cf0 con 0x5555f13abec0 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60184/0 (socket says 172.21.15.159:60184) 2024-09-19T06:51:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4ffff640 1 -- 172.21.15.159:0/2858147194 learned_addr learned my addr 172.21.15.159:0/2858147194 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4ffff640 1 -- 172.21.15.159:0/2858147194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 msgr2=0x5555f13a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 0x5555f13a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 0x5555f13a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4ffff640 1 -- 172.21.15.159:0/2858147194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 msgr2=0x5555f13c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4ffff640 1 -- 172.21.15.159:0/2858147194 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f13be930 con 0x5555f13a0d00 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.133+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 0x5555f13a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13c3bc0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000b7f0 tx=0x7f6b40005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623f0edeaad7d4d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b35ffb640 1 -- 172.21.15.159:0/2858147194 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40021020 con 0x5555f13a0d00 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b35ffb640 1 -- 172.21.15.159:0/2858147194 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b4001cb00 con 0x5555f13a0d00 2024-09-19T06:51:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b35ffb640 1 -- 172.21.15.159:0/2858147194 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000eba0 con 0x5555f13a0d00 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b59646740 1 -- 172.21.15.159:0/2858147194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 msgr2=0x5555f13c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b59646740 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13c3bc0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000b7f0 tx=0x7f6b40005ee0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b59646740 1 -- 172.21.15.159:0/2858147194 shutdown_connections 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b59646740 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13abec0 0x5555f13a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b59646740 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b59646740 1 --2- 172.21.15.159:0/2858147194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13a0d00 0x5555f13c3bc0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b59646740 1 -- 172.21.15.159:0/2858147194 >> 172.21.15.159:0/2858147194 conn(0x5555f139d270 msgr2=0x5555f13aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b59646740 1 -- 172.21.15.159:0/2858147194 shutdown_connections 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.134+0000 7f6b59646740 1 -- 172.21.15.159:0/2858147194 wait complete. 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b59646740 1 -- start start 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b59646740 1 Processor -- start 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b59646740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 0x5555f13b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b59646740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b59646740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13abec0 0x5555f13b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b59646740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501aa3c0 con 0x5555f13abec0 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b59646740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501ab830 con 0x5555f13a1620 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b59646740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501aaa90 con 0x5555f13a0d00 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b59646740 10 client.0 _ll_register_callbacks cb 0x7f6b44009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b54d6c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13abec0 0x5555f13b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b54d6c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13abec0 0x5555f13b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60188/0 (socket says 172.21.15.159:60188) 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b54d6c640 1 -- 172.21.15.159:0/4063016515 learned_addr learned my addr 172.21.15.159:0/4063016515 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.135+0000 7f6b4ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 0x5555f13b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b4ffff640 1 -- 172.21.15.159:0/4063016515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 msgr2=0x5555f13b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b4ffff640 1 -- 172.21.15.159:0/4063016515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13abec0 msgr2=0x5555f13b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13abec0 0x5555f13b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b4ffff640 1 -- 172.21.15.159:0/4063016515 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555f13a0b30 con 0x5555f13a0d00 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b54d6c640 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13abec0 0x5555f13b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b4ffff640 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 0x5555f13b3ea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000e840 tx=0x7f6b4000e5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb847e96e1209a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/4063016515 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40021030 con 0x5555f13a0d00 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b59646740 1 -- 172.21.15.159:0/4063016515 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b4001cb00 con 0x5555f13a0d00 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/4063016515 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f6b4001c830 con 0x5555f13a0d00 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/4063016515 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b4002a070 con 0x5555f13a0d00 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b59646740 10 client.25870 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.136+0000 7f6b59646740 1 -- 172.21.15.159:0/4063016515 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5555f1426e40 con 0x5555f13a0d00 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.137+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/4063016515 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b4001cb00 con 0x5555f13a0d00 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.137+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/4063016515 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f6b40035070 con 0x5555f13a0d00 2024-09-19T06:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.137+0000 7f6b59646740 10 client.25870 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.137+0000 7f6b59646740 10 client.25870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.137+0000 7f6b59646740 20 client.25870 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.137+0000 7f6b59646740 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5555f1427450 0x5555f1429840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.137+0000 7f6b59646740 4 client.25870 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.137+0000 7f6b59646740 1 -- 172.21.15.159:0/4063016515 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5555f130ad70 con 0x5555f1427450 2024-09-19T06:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.137+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5555f1427450 0x5555f1429840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.138+0000 7f6b2f7fe640 10 client.25870 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.138+0000 7f6b4f7fe640 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5555f1427450 0x5555f1429840 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a426daab57c2c8 server_cookie=b3edf3bdc68574ad in_seq=0 out_seq=0 2024-09-19T06:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.144+0000 7f6b2f7fe640 1 -- 172.21.15.159:0/4063016515 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5555f130ad70 con 0x5555f1427450 2024-09-19T06:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.144+0000 7f6b2f7fe640 10 client.25870 handle_command_reply: tid=0 2024-09-19T06:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.144+0000 7f6b59646740 1 client.25870 shutdown 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 -- 172.21.15.159:0/4063016515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 msgr2=0x5555f13b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 0x5555f13b3ea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000e840 tx=0x7f6b4000e5e0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 -- 172.21.15.159:0/4063016515 shutdown_connections 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5555f1427450 0x5555f1429840 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5555f13abec0 0x5555f13b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b2f7fe640 0 client.25870 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5555f13a1620 0x5555f13b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 --2- 172.21.15.159:0/4063016515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5555f13a0d00 0x5555f13b3ea0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 -- 172.21.15.159:0/4063016515 >> 172.21.15.159:0/4063016515 conn(0x5555f139d270 msgr2=0x5555f13aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 -- 172.21.15.159:0/4063016515 shutdown_connections 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 1 -- 172.21.15.159:0/4063016515 wait complete. 2024-09-19T06:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b59646740 20 client.25870 trim_cache size 0 max 16384 2024-09-19T06:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b567cf640 1 -- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b380a34e0 msgr2=0x7f6b380a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b567cf640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b380a34e0 0x7f6b380a59a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800afd0 tx=0x7f6b4801a000 comp rx=0 tx=0).stop 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b567cf640 1 -- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b50101380 msgr2=0x7f6b501977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.145+0000 7f6b567cf640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b50101380 0x7f6b501977f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6b4402a940 tx=0x7f6b44003c00 comp rx=0 tx=0).stop 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.146+0000 7f6b567cf640 1 -- 172.21.15.159:0/4008527827 shutdown_connections 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.146+0000 7f6b567cf640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6b380a34e0 0x7f6b380a59a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.146+0000 7f6b567cf640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b501069f0 0x7f6b5019bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.146+0000 7f6b567cf640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b50101380 0x7f6b501977f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.146+0000 7f6b567cf640 1 --2- 172.21.15.159:0/4008527827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b501009e0 0x7f6b501972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.146+0000 7f6b567cf640 1 -- 172.21.15.159:0/4008527827 >> 172.21.15.159:0/4008527827 conn(0x7f6b500fc6c0 msgr2=0x7f6b500fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.146+0000 7f6b567cf640 1 -- 172.21.15.159:0/4008527827 shutdown_connections 2024-09-19T06:51:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:39.146+0000 7f6b567cf640 1 -- 172.21.15.159:0/4008527827 wait complete. 2024-09-19T06:51:39.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:38 smithi159 ceph-mon[30935]: pgmap v144: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 341 B/s wr, 388 op/s 2024-09-19T06:51:41.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:40 smithi203 ceph-mon[35473]: pgmap v145: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 341 B/s wr, 388 op/s 2024-09-19T06:51:41.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:40 smithi189 ceph-mon[34880]: pgmap v145: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 341 B/s wr, 388 op/s 2024-09-19T06:51:41.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:40 smithi159 ceph-mon[30935]: pgmap v145: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 341 B/s wr, 388 op/s 2024-09-19T06:51:43.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:42 smithi203 ceph-mon[35473]: pgmap v146: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 1.6 KiB/s wr, 390 op/s 2024-09-19T06:51:43.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:42 smithi189 ceph-mon[34880]: pgmap v146: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 1.6 KiB/s wr, 390 op/s 2024-09-19T06:51:43.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:42 smithi159 ceph-mon[30935]: pgmap v146: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 1.6 KiB/s wr, 390 op/s 2024-09-19T06:51:43.509 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:51:43.771 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:44.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 -- 172.21.15.159:0/1825921475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102ef0 msgr2=0x7f731c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 --2- 172.21.15.159:0/1825921475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102ef0 0x7f731c10da40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7314009ca0 tx=0x7f731402a950 comp rx=0 tx=0).stop 2024-09-19T06:51:44.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 -- 172.21.15.159:0/1825921475 shutdown_connections 2024-09-19T06:51:44.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 --2- 172.21.15.159:0/1825921475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102ef0 0x7f731c10da40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 --2- 172.21.15.159:0/1825921475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f731c102570 0x7f731c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 --2- 172.21.15.159:0/1825921475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c100e20 0x7f731c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 -- 172.21.15.159:0/1825921475 >> 172.21.15.159:0/1825921475 conn(0x7f731c0fc7d0 msgr2=0x7f731c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 -- 172.21.15.159:0/1825921475 shutdown_connections 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 -- 172.21.15.159:0/1825921475 wait complete. 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.235+0000 7f7324291640 1 Processor -- start 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f7324291640 1 -- start start 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f7324291640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f731c100e20 0x7f731c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f7324291640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102570 0x7f731c198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f7324291640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c102ef0 0x7f731c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f7324291640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f731c110f80 con 0x7f731c102570 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f7324291640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f731c110e00 con 0x7f731c102ef0 2024-09-19T06:51:44.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f7324291640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f731c111100 con 0x7f731c100e20 2024-09-19T06:51:44.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732182c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102570 0x7f731c198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732182c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102570 0x7f731c198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46190/0 (socket says 172.21.15.159:46190) 2024-09-19T06:51:44.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732182c640 1 -- 172.21.15.159:0/4003236122 learned_addr learned my addr 172.21.15.159:0/4003236122 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:44.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732202d640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f731c100e20 0x7f731c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732282e640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c102ef0 0x7f731c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732182c640 1 -- 172.21.15.159:0/4003236122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f731c100e20 msgr2=0x7f731c198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732182c640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f731c100e20 0x7f731c198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732182c640 1 -- 172.21.15.159:0/4003236122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c102ef0 msgr2=0x7f731c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732182c640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c102ef0 0x7f731c19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732182c640 1 -- 172.21.15.159:0/4003236122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731c19d4b0 con 0x7f731c102570 2024-09-19T06:51:44.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.236+0000 7f732182c640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102570 0x7f731c198a40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d950 tx=0x7f730c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.237+0000 7f73137fe640 1 -- 172.21.15.159:0/4003236122 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c017030 con 0x7f731c102570 2024-09-19T06:51:44.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.237+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f731c19d7a0 con 0x7f731c102570 2024-09-19T06:51:44.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.237+0000 7f73137fe640 1 -- 172.21.15.159:0/4003236122 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f730c004020 con 0x7f731c102570 2024-09-19T06:51:44.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.237+0000 7f73137fe640 1 -- 172.21.15.159:0/4003236122 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c0047a0 con 0x7f731c102570 2024-09-19T06:51:44.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.237+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f731c1a5080 con 0x7f731c102570 2024-09-19T06:51:44.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.238+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f731c101200 con 0x7f731c102570 2024-09-19T06:51:44.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.240+0000 7f73137fe640 1 -- 172.21.15.159:0/4003236122 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f730c0041d0 con 0x7f731c102570 2024-09-19T06:51:44.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.241+0000 7f73137fe640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73080a33b0 0x7f73080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.241+0000 7f732202d640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73080a33b0 0x7f73080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.241+0000 7f73137fe640 1 -- 172.21.15.159:0/4003236122 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f730c0cf6e0 con 0x7f731c102570 2024-09-19T06:51:44.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.241+0000 7f732202d640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73080a33b0 0x7f73080a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f731800bbe0 tx=0x7f731800b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.245+0000 7f73137fe640 1 -- 172.21.15.159:0/4003236122 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f730c09c090 con 0x7f731c102570 2024-09-19T06:51:44.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.450+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f731c10a0a0 con 0x7f731c102570 2024-09-19T06:51:44.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.451+0000 7f73137fe640 1 -- 172.21.15.159:0/4003236122 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f730c09b990 con 0x7f731c102570 2024-09-19T06:51:44.452 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:51:44.453 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:51:44.453 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:51:44.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73080a33b0 msgr2=0x7f73080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73080a33b0 0x7f73080a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f731800bbe0 tx=0x7f731800b390 comp rx=0 tx=0).stop 2024-09-19T06:51:44.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102570 msgr2=0x7f731c198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102570 0x7f731c198a40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d950 tx=0x7f730c00de10 comp rx=0 tx=0).stop 2024-09-19T06:51:44.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 shutdown_connections 2024-09-19T06:51:44.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73080a33b0 0x7f73080a5870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f731c102ef0 0x7f731c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f731c102570 0x7f731c198a40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 --2- 172.21.15.159:0/4003236122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f731c100e20 0x7f731c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 >> 172.21.15.159:0/4003236122 conn(0x7f731c0fc7d0 msgr2=0x7f731c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 shutdown_connections 2024-09-19T06:51:44.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:44.453+0000 7f7324291640 1 -- 172.21.15.159:0/4003236122 wait complete. 2024-09-19T06:51:44.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:44 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/4003236122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:44.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:44 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/4003236122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:44.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:44 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/4003236122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:45.223 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id 92b553f0 --release --await' 2024-09-19T06:51:45.224 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id 92b553f0 --release --await 2024-09-19T06:51:45.475 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:45.762 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:45 smithi159 ceph-mon[30935]: pgmap v147: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T06:51:45.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:45 smithi203 ceph-mon[35473]: pgmap v147: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T06:51:45.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:45 smithi189 ceph-mon[34880]: pgmap v147: 97 pgs: 97 active+clean; 47 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 -- 172.21.15.159:0/2600223128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c101420 msgr2=0x7fbf6c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 --2- 172.21.15.159:0/2600223128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c101420 0x7fbf6c10d950 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009cd0 tx=0x7fbf6402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 -- 172.21.15.159:0/2600223128 shutdown_connections 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 --2- 172.21.15.159:0/2600223128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c101420 0x7fbf6c10d950 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 --2- 172.21.15.159:0/2600223128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf6c100a80 0x7fbf6c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 --2- 172.21.15.159:0/2600223128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf6c106a80 0x7fbf6c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 -- 172.21.15.159:0/2600223128 >> 172.21.15.159:0/2600223128 conn(0x7fbf6c0fc7a0 msgr2=0x7fbf6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 -- 172.21.15.159:0/2600223128 shutdown_connections 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 -- 172.21.15.159:0/2600223128 wait complete. 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 Processor -- start 2024-09-19T06:51:45.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.978+0000 7fbf7259b640 1 -- start start 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf7259b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf6c100a80 0x7fbf6c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf7259b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf6c101420 0x7fbf6c197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf7259b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c106a80 0x7fbf6c19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf7259b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c110e80 con 0x7fbf6c106a80 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf7259b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c110d00 con 0x7fbf6c101420 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf7259b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c111000 con 0x7fbf6c100a80 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf70b38640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c106a80 0x7fbf6c19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf70b38640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c106a80 0x7fbf6c19bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46194/0 (socket says 172.21.15.159:46194) 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf70b38640 1 -- 172.21.15.159:0/1836879995 learned_addr learned my addr 172.21.15.159:0/1836879995 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf6b7fe640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf6c101420 0x7fbf6c197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf6c100a80 0x7fbf6c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf70b38640 1 -- 172.21.15.159:0/1836879995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf6c100a80 msgr2=0x7fbf6c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf70b38640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf6c100a80 0x7fbf6c197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf70b38640 1 -- 172.21.15.159:0/1836879995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf6c101420 msgr2=0x7fbf6c197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf70b38640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf6c101420 0x7fbf6c197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf70b38640 1 -- 172.21.15.159:0/1836879995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c19c1f0 con 0x7fbf6c106a80 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf6b7fe640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf6c101420 0x7fbf6c197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.979+0000 7fbf70b38640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c106a80 0x7fbf6c19bb10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbf64006010 tx=0x7fbf64003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.980+0000 7fbf697fa640 1 -- 172.21.15.159:0/1836879995 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64004450 con 0x7fbf6c106a80 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.980+0000 7fbf697fa640 1 -- 172.21.15.159:0/1836879995 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf64003e10 con 0x7fbf6c106a80 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.980+0000 7fbf7259b640 1 -- 172.21.15.159:0/1836879995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6c19c480 con 0x7fbf6c106a80 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.980+0000 7fbf697fa640 1 -- 172.21.15.159:0/1836879995 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf640466e0 con 0x7fbf6c106a80 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.980+0000 7fbf7259b640 1 -- 172.21.15.159:0/1836879995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6c1a3dc0 con 0x7fbf6c106a80 2024-09-19T06:51:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf697fa640 1 -- 172.21.15.159:0/1836879995 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fbf640305a0 con 0x7fbf6c106a80 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf74974740 1 Processor -- start 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf74974740 1 -- start start 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf697fa640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf580a3430 0x7fbf580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf74974740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538f9a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf74974740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9ab90 0x562538fa4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf74974740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538fa5450 0x562538fa7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf74974740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562538efd620 con 0x562538f9a270 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf74974740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562538ea4e50 con 0x562538f9ab90 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.982+0000 7fbf74974740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562538ef95e0 con 0x562538fa5450 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538f9a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538f9a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46204/0 (socket says 172.21.15.159:46204) 2024-09-19T06:51:45.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6bfff640 1 -- 172.21.15.159:0/3896882806 learned_addr learned my addr 172.21.15.159:0/3896882806 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6b7fe640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf580a3430 0x7fbf580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf697fa640 1 -- 172.21.15.159:0/1836879995 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fbf6402e030 con 0x7fbf6c106a80 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf70b38640 1 --2- 172.21.15.159:0/3896882806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538fa5450 0x562538fa7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6bfff640 1 -- 172.21.15.159:0/3896882806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538fa5450 msgr2=0x562538fa7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/3896882806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538fa5450 0x562538fa7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6bfff640 1 -- 172.21.15.159:0/3896882806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9ab90 msgr2=0x562538fa4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/3896882806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9ab90 0x562538fa4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6bfff640 1 -- 172.21.15.159:0/3896882806 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562538e95d40 con 0x562538f9a270 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6b7fe640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf580a3430 0x7fbf580a58f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c105ff0 tx=0x7fbf5400e350 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/3896882806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538f9a650 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00bac0 tx=0x7fbf5c00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44e59397651a162 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf627fc640 1 -- 172.21.15.159:0/3896882806 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c017420 con 0x562538f9a270 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf627fc640 1 -- 172.21.15.159:0/3896882806 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf5c017aa0 con 0x562538f9a270 2024-09-19T06:51:45.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.983+0000 7fbf627fc640 1 -- 172.21.15.159:0/3896882806 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c00faa0 con 0x562538f9a270 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 -- 172.21.15.159:0/3896882806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 msgr2=0x562538f9a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 --2- 172.21.15.159:0/3896882806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538f9a650 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00bac0 tx=0x7fbf5c00bf80 comp rx=0 tx=0).stop 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 -- 172.21.15.159:0/3896882806 shutdown_connections 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 --2- 172.21.15.159:0/3896882806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538fa5450 0x562538fa7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 --2- 172.21.15.159:0/3896882806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9ab90 0x562538fa4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 --2- 172.21.15.159:0/3896882806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538f9a650 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 -- 172.21.15.159:0/3896882806 >> 172.21.15.159:0/3896882806 conn(0x562538f96800 msgr2=0x562538f96be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 -- 172.21.15.159:0/3896882806 shutdown_connections 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 -- 172.21.15.159:0/3896882806 wait complete. 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.984+0000 7fbf74974740 1 -- start start 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf74974740 1 Processor -- start 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf74974740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538fa22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf74974740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 0x562538fa27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf74974740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538fa5450 0x562538fa2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf74974740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562538fa8020 con 0x562538f9a270 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf74974740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562538e85f10 con 0x562538fa5450 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf74974740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562538fa81a0 con 0x562538f9ab90 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf74974740 10 client.0 _ll_register_callbacks cb 0x562538ea9db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf6bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538fa22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf6bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538fa22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46218/0 (socket says 172.21.15.159:46218) 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf6bfff640 1 -- 172.21.15.159:0/3972491130 learned_addr learned my addr 172.21.15.159:0/3972491130 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf6b7fe640 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 0x562538fa27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf70b38640 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538fa5450 0x562538fa2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf6bfff640 1 -- 172.21.15.159:0/3972491130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 msgr2=0x562538fa27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 0x562538fa27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf6bfff640 1 -- 172.21.15.159:0/3972491130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538fa5450 msgr2=0x562538fa2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.985+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538fa5450 0x562538fa2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf6bfff640 1 -- 172.21.15.159:0/3972491130 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562538c0c580 con 0x562538f9a270 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf70b38640 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538fa5450 0x562538fa2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538fa22a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00df40 tx=0x7fbf5c004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae8c736453b8b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/3972491130 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c027030 con 0x562538f9a270 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/3972491130 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fbf5c0176b0 con 0x562538f9a270 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf74974740 1 -- 172.21.15.159:0/3972491130 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf5c017aa0 con 0x562538f9a270 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/3972491130 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbf5c031050 con 0x562538f9a270 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf74974740 10 client.16512 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf74974740 1 -- 172.21.15.159:0/3972491130 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562538cd6960 con 0x562538f9a270 2024-09-19T06:51:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/3972491130 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf5c017aa0 con 0x562538f9a270 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/3972491130 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fbf5c0239a0 con 0x562538f9a270 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf74974740 10 client.16512 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf74974740 10 client.16512 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.986+0000 7fbf74974740 20 client.16512 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.987+0000 7fbf74974740 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562538fb4f70 0x562538fb7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.987+0000 7fbf74974740 4 client.16512 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.987+0000 7fbf74974740 1 -- 172.21.15.159:0/3972491130 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562538f0ab90 con 0x562538fb4f70 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.987+0000 7fbf6b7fe640 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562538fb4f70 0x562538fb7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.987+0000 7fbf6b7fe640 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562538fb4f70 0x562538fb7360 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adb638fd75d8f127 server_cookie=2c1c9f6e65dc51fd in_seq=0 out_seq=0 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.987+0000 7fbf4b7fe640 10 client.16512 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/3972491130 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562538f0ab90 con 0x562538fb4f70 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf4b7fe640 10 client.16512 handle_command_reply: tid=0 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 client.16512 shutdown 2024-09-19T06:51:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 -- 172.21.15.159:0/3972491130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 msgr2=0x562538fa22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538fa22a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00df40 tx=0x7fbf5c004720 comp rx=0 tx=0).stop 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 -- 172.21.15.159:0/3972491130 shutdown_connections 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562538fb4f70 0x562538fb7360 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538fa5450 0x562538fa2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 0x562538fa27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf4b7fe640 0 client.16512 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 --2- 172.21.15.159:0/3972491130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538f9a270 0x562538fa22a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 -- 172.21.15.159:0/3972491130 >> 172.21.15.159:0/3972491130 conn(0x562538f96800 msgr2=0x562538f93750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 -- 172.21.15.159:0/3972491130 shutdown_connections 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 1 -- 172.21.15.159:0/3972491130 wait complete. 2024-09-19T06:51:46.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:45.988+0000 7fbf74974740 20 client.16512 trim_cache size 0 max 16384 2024-09-19T06:51:46.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf74974740 1 Processor -- start 2024-09-19T06:51:46.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf74974740 1 -- start start 2024-09-19T06:51:46.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf74974740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9a270 0x562538f9d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf74974740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9ab90 0x562538f93640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf74974740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538fbca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf74974740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c1a95f0 con 0x562538fa5450 2024-09-19T06:51:46.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf74974740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c1abe70 con 0x562538f9ab90 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf74974740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c1a9c60 con 0x562538f9a270 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf70b38640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538fbca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf70b38640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538fbca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46224/0 (socket says 172.21.15.159:46224) 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf70b38640 1 -- 172.21.15.159:0/286254758 learned_addr learned my addr 172.21.15.159:0/286254758 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf6b7fe640 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9ab90 0x562538f93640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9a270 0x562538f9d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf70b38640 1 -- 172.21.15.159:0/286254758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9a270 msgr2=0x562538f9d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.005+0000 7fbf70b38640 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9a270 0x562538f9d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf70b38640 1 -- 172.21.15.159:0/286254758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9ab90 msgr2=0x562538f93640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf70b38640 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9ab90 0x562538f93640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf70b38640 1 -- 172.21.15.159:0/286254758 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562538f96630 con 0x562538fa5450 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9a270 0x562538f9d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:46.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf70b38640 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538fbca10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009ca0 tx=0x7fbf640bd5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f860c893554ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf61ffb640 1 -- 172.21.15.159:0/286254758 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf640d6070 con 0x562538fa5450 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf61ffb640 1 -- 172.21.15.159:0/286254758 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf64036040 con 0x562538fa5450 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf61ffb640 1 -- 172.21.15.159:0/286254758 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf640a80d0 con 0x562538fa5450 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf74974740 1 -- 172.21.15.159:0/286254758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 msgr2=0x562538fbca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf74974740 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538fbca10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009ca0 tx=0x7fbf640bd5f0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf74974740 1 -- 172.21.15.159:0/286254758 shutdown_connections 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf74974740 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538fbca10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf74974740 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9ab90 0x562538f93640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf74974740 1 --2- 172.21.15.159:0/286254758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9a270 0x562538f9d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.006+0000 7fbf74974740 1 -- 172.21.15.159:0/286254758 >> 172.21.15.159:0/286254758 conn(0x562538f96800 msgr2=0x562538f92f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 -- 172.21.15.159:0/286254758 shutdown_connections 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 -- 172.21.15.159:0/286254758 wait complete. 2024-09-19T06:51:46.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 -- start start 2024-09-19T06:51:46.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 Processor -- start 2024-09-19T06:51:46.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9a270 0x562538fad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 0x562538fadb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538faa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c1aa330 con 0x562538fa5450 2024-09-19T06:51:46.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c1ab7a0 con 0x562538f9a270 2024-09-19T06:51:46.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c1aaa00 con 0x562538f9ab90 2024-09-19T06:51:46.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf74974740 10 client.0 _ll_register_callbacks cb 0x7fbf5c00b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:46.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.007+0000 7fbf70b38640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538faa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf70b38640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538faa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46230/0 (socket says 172.21.15.159:46230) 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf6b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 0x562538fadb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf70b38640 1 -- 172.21.15.159:0/4064855716 learned_addr learned my addr 172.21.15.159:0/4064855716 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9a270 0x562538fad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf70b38640 1 -- 172.21.15.159:0/4064855716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 msgr2=0x562538fadb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf70b38640 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 0x562538fadb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf70b38640 1 -- 172.21.15.159:0/4064855716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9a270 msgr2=0x562538fad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf70b38640 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9a270 0x562538fad5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf70b38640 1 -- 172.21.15.159:0/4064855716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562538faaa50 con 0x562538fa5450 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf70b38640 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538faa3c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbf64005fc0 tx=0x7fbf64030b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339bfd423db0f4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/4064855716 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf640d6040 con 0x562538fa5450 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/4064855716 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fbf64030890 con 0x562538fa5450 2024-09-19T06:51:46.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf74974740 1 -- 172.21.15.159:0/4064855716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf64036040 con 0x562538fa5450 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/4064855716 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbf640c1da0 con 0x562538fa5450 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf74974740 10 client.16518 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.008+0000 7fbf74974740 1 -- 172.21.15.159:0/4064855716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562539020320 con 0x562538fa5450 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/4064855716 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf64036040 con 0x562538fa5450 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/4064855716 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fbf6404e070 con 0x562538fa5450 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf74974740 10 client.16518 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf74974740 10 client.16518 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf74974740 20 client.16518 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf74974740 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562539020980 0x562539022da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf74974740 4 client.16518 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "92b553f0", "release": true, "await": true}] 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf74974740 1 -- 172.21.15.159:0/4064855716 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "set_id": "92b553f0", "release": true, "await": true}) -- 0x562538f050a0 con 0x562539020980 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562539020980 0x562539022da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf4b7fe640 10 client.16518 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:46.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.009+0000 7fbf6bfff640 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562539020980 0x562539022da0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b384242282d997c server_cookie=96b539424cb3018 in_seq=0 out_seq=0 2024-09-19T06:51:46.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf4b7fe640 1 -- 172.21.15.159:0/4064855716 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562538f050a0 con 0x562539020980 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf4b7fe640 10 client.16518 handle_command_reply: tid=0 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 client.16518 shutdown 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 -- 172.21.15.159:0/4064855716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 msgr2=0x562538faa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538faa3c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbf64005fc0 tx=0x7fbf64030b80 comp rx=0 tx=0).stop 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 -- 172.21.15.159:0/4064855716 shutdown_connections 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562539020980 0x562539022da0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562538fa5450 0x562538faa3c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562538f9ab90 0x562538fadb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf4b7fe640 0 client.16518 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 --2- 172.21.15.159:0/4064855716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562538f9a270 0x562538fad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 -- 172.21.15.159:0/4064855716 >> 172.21.15.159:0/4064855716 conn(0x562538f96800 msgr2=0x562538f92f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 -- 172.21.15.159:0/4064855716 shutdown_connections 2024-09-19T06:51:46.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 1 -- 172.21.15.159:0/4064855716 wait complete. 2024-09-19T06:51:46.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.192+0000 7fbf74974740 20 client.16518 trim_cache size 0 max 16384 2024-09-19T06:51:46.195 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:51:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 24, 2024-09-19T06:51:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:51:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 20, 2024-09-19T06:51:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:51:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "92b553f0": { 2024-09-19T06:51:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 20, 2024-09-19T06:51:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 149.8, 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:46.197 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 -- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf580a3430 msgr2=0x7fbf580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf580a3430 0x7fbf580a58f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c105ff0 tx=0x7fbf5400e350 comp rx=0 tx=0).stop 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 -- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c106a80 msgr2=0x7fbf6c19bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c106a80 0x7fbf6c19bb10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbf64006010 tx=0x7fbf64003c20 comp rx=0 tx=0).stop 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 -- 172.21.15.159:0/1836879995 shutdown_connections 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf580a3430 0x7fbf580a58f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c106a80 0x7fbf6c19bb10 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf6c101420 0x7fbf6c197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 --2- 172.21.15.159:0/1836879995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf6c100a80 0x7fbf6c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 -- 172.21.15.159:0/1836879995 >> 172.21.15.159:0/1836879995 conn(0x7fbf6c0fc7a0 msgr2=0x7fbf6c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 -- 172.21.15.159:0/1836879995 shutdown_connections 2024-09-19T06:51:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:46.193+0000 7fbf7259b640 1 -- 172.21.15.159:0/1836879995 wait complete. 2024-09-19T06:51:46.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:46 smithi159 ceph-mon[30935]: pgmap v148: 97 pgs: 97 active+clean; 48 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 152 KiB/s wr, 25 op/s 2024-09-19T06:51:46.987 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '92b553f0', total seconds elapsed: 33.3 2024-09-19T06:51:46.987 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T06:51:46.988 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:51:47.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:46 smithi203 ceph-mon[35473]: pgmap v148: 97 pgs: 97 active+clean; 48 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 152 KiB/s wr, 25 op/s 2024-09-19T06:51:47.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:46 smithi189 ceph-mon[34880]: pgmap v148: 97 pgs: 97 active+clean; 48 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 152 KiB/s wr, 25 op/s 2024-09-19T06:51:47.268 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:47.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 -- 172.21.15.159:0/3285572484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 msgr2=0x7fb2001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 --2- 172.21.15.159:0/3285572484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 0x7fb2001029b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009900 tx=0x7fb1f402a480 comp rx=0 tx=0).stop 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 -- 172.21.15.159:0/3285572484 shutdown_connections 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 --2- 172.21.15.159:0/3285572484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb200102ef0 0x7fb20010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 --2- 172.21.15.159:0/3285572484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 0x7fb2001029b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 --2- 172.21.15.159:0/3285572484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb200100e20 0x7fb200101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 -- 172.21.15.159:0/3285572484 >> 172.21.15.159:0/3285572484 conn(0x7fb2000fc7d0 msgr2=0x7fb2000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 -- 172.21.15.159:0/3285572484 shutdown_connections 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 -- 172.21.15.159:0/3285572484 wait complete. 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.756+0000 7fb205af6640 1 Processor -- start 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb205af6640 1 -- start start 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb205af6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb200100e20 0x7fb2001984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:47.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb205af6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 0x7fb200198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb205af6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb200102ef0 0x7fb20019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb205af6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb200110f80 con 0x7fb200102570 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb205af6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb200110e00 con 0x7fb200102ef0 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb205af6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb200111100 con 0x7fb200100e20 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1feffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 0x7fb200198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1feffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 0x7fb200198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46250/0 (socket says 172.21.15.159:46250) 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1feffd640 1 -- 172.21.15.159:0/742029401 learned_addr learned my addr 172.21.15.159:0/742029401 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1fffff640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb200102ef0 0x7fb20019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1ff7fe640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb200100e20 0x7fb2001984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1feffd640 1 -- 172.21.15.159:0/742029401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb200100e20 msgr2=0x7fb2001984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1feffd640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb200100e20 0x7fb2001984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1feffd640 1 -- 172.21.15.159:0/742029401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb200102ef0 msgr2=0x7fb20019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1feffd640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb200102ef0 0x7fb20019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1feffd640 1 -- 172.21.15.159:0/742029401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20019d470 con 0x7fb200102570 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.757+0000 7fb1feffd640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 0x7fb200198a00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4006010 tx=0x7fb1f4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.758+0000 7fb1fcff9640 1 -- 172.21.15.159:0/742029401 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f403f070 con 0x7fb200102570 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.758+0000 7fb1fcff9640 1 -- 172.21.15.159:0/742029401 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1f4031c30 con 0x7fb200102570 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.758+0000 7fb1fcff9640 1 -- 172.21.15.159:0/742029401 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4035030 con 0x7fb200102570 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.758+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20019d700 con 0x7fb200102570 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.758+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2001a5040 con 0x7fb200102570 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.759+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2001021b0 con 0x7fb200102570 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.760+0000 7fb1fcff9640 1 -- 172.21.15.159:0/742029401 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb1f4042070 con 0x7fb200102570 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.760+0000 7fb1fcff9640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e80a33b0 0x7fb1e80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:47.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.761+0000 7fb1ff7fe640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e80a33b0 0x7fb1e80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:47.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.761+0000 7fb1fcff9640 1 -- 172.21.15.159:0/742029401 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb1f40f0450 con 0x7fb200102570 2024-09-19T06:51:47.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.761+0000 7fb1ff7fe640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e80a33b0 0x7fb1e80a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0005fd0 tx=0x7fb1f0005850 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:47.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:47.765+0000 7fb1fcff9640 1 -- 172.21.15.159:0/742029401 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1f40bce00 con 0x7fb200102570 2024-09-19T06:51:48.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.003+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2001a5210 con 0x7fb200102570 2024-09-19T06:51:48.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.003+0000 7fb1fcff9640 1 -- 172.21.15.159:0/742029401 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7fb1f40bc700 con 0x7fb200102570 2024-09-19T06:51:48.005 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:51:48.005 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:51:48.005 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:51:48.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e80a33b0 msgr2=0x7fb1e80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:48.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e80a33b0 0x7fb1e80a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0005fd0 tx=0x7fb1f0005850 comp rx=0 tx=0).stop 2024-09-19T06:51:48.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 msgr2=0x7fb200198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:48.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 0x7fb200198a00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4006010 tx=0x7fb1f4003c10 comp rx=0 tx=0).stop 2024-09-19T06:51:48.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 shutdown_connections 2024-09-19T06:51:48.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb1e80a33b0 0x7fb1e80a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:48.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb200102ef0 0x7fb20019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:48.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb200102570 0x7fb200198a00 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:48.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 --2- 172.21.15.159:0/742029401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb200100e20 0x7fb2001984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:48.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 >> 172.21.15.159:0/742029401 conn(0x7fb2000fc7d0 msgr2=0x7fb200069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:48.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 shutdown_connections 2024-09-19T06:51:48.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:48.006+0000 7fb205af6640 1 -- 172.21.15.159:0/742029401 wait complete. 2024-09-19T06:51:48.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:48 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/742029401' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:48.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:48 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/742029401' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:48.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:48 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/742029401' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:48.815 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T06:51:48.816 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T06:51:49.091 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:49.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:49 smithi203 ceph-mon[35473]: pgmap v149: 97 pgs: 97 active+clean; 48 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 152 KiB/s wr, 24 op/s 2024-09-19T06:51:49.366 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:49 smithi159 ceph-mon[30935]: pgmap v149: 97 pgs: 97 active+clean; 48 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 152 KiB/s wr, 24 op/s 2024-09-19T06:51:49.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:49 smithi189 ceph-mon[34880]: pgmap v149: 97 pgs: 97 active+clean; 48 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 152 KiB/s wr, 24 op/s 2024-09-19T06:51:49.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.605+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2123792422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c8100a80 msgr2=0x7ff6c8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.605+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2123792422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c8100a80 0x7ff6c8100ee0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009930 tx=0x7ff6b002a420 comp rx=0 tx=0).stop 2024-09-19T06:51:49.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.605+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2123792422 shutdown_connections 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.605+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2123792422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6c8101420 0x7ff6c810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.605+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2123792422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c8100a80 0x7ff6c8100ee0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.605+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2123792422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8106a80 0x7ff6c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.605+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2123792422 >> 172.21.15.159:0/2123792422 conn(0x7ff6c80fc7a0 msgr2=0x7ff6c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.605+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2123792422 shutdown_connections 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.605+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2123792422 wait complete. 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6cde3a640 1 Processor -- start 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6cde3a640 1 -- start start 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6cde3a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6c8100a80 0x7ff6c8199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6cde3a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8101420 0x7ff6c8199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6cde3a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c8106a80 0x7ff6c81a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6cde3a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c8110e80 con 0x7ff6c8106a80 2024-09-19T06:51:49.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6cde3a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c8110d00 con 0x7ff6c8100a80 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6cde3a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c8111000 con 0x7ff6c8101420 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6c8100a80 0x7ff6c8199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c8106a80 0x7ff6c81a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6c8100a80 0x7ff6c8199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:37868/0 (socket says 172.21.15.159:37868) 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6c77fe640 1 -- 172.21.15.159:0/2426562608 learned_addr learned my addr 172.21.15.159:0/2426562608 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.606+0000 7ff6bffff640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8101420 0x7ff6c8199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c7fff640 1 -- 172.21.15.159:0/2426562608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8101420 msgr2=0x7ff6c8199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c7fff640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8101420 0x7ff6c8199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c7fff640 1 -- 172.21.15.159:0/2426562608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6c8100a80 msgr2=0x7ff6c8199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c7fff640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6c8100a80 0x7ff6c8199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c7fff640 1 -- 172.21.15.159:0/2426562608 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c81a48d0 con 0x7ff6c8106a80 2024-09-19T06:51:49.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6c8100a80 0x7ff6c8199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c7fff640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c8106a80 0x7ff6c81a4390 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009fd0 tx=0x7ff6c000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c57fa640 1 -- 172.21.15.159:0/2426562608 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000ce20 con 0x7ff6c8106a80 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2426562608 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c81a4aa0 con 0x7ff6c8106a80 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c57fa640 1 -- 172.21.15.159:0/2426562608 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6c0005020 con 0x7ff6c8106a80 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.607+0000 7ff6c57fa640 1 -- 172.21.15.159:0/2426562608 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0010720 con 0x7ff6c8106a80 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.608+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2426562608 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c81a4f60 con 0x7ff6c8106a80 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.610+0000 7ff6c57fa640 1 -- 172.21.15.159:0/2426562608 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ff6c0005540 con 0x7ff6c8106a80 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6c57fa640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff6b40a33b0 0x7ff6b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6d0213740 1 Processor -- start 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6d0213740 1 -- start start 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6c57fa640 1 -- 172.21.15.159:0/2426562608 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7ff6c00d0400 con 0x7ff6c8106a80 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff6b40a33b0 0x7ff6b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbccb1940 0x55efbccb3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6d0213740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55efbcc0c2a0 con 0x55efbcca6760 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6d0213740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55efbcbb3b10 con 0x55efbccb1940 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6d0213740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55efbcc08260 con 0x55efbcca7080 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35690/0 (socket says 172.21.15.159:35690) 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6bffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6c77fe640 1 -- 172.21.15.159:0/2902115881 learned_addr learned my addr 172.21.15.159:0/2902115881 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6c7fff640 1 --2- 172.21.15.159:0/2902115881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbccb1940 0x55efbccb3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6bffff640 1 -- 172.21.15.159:0/2902115881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbccb1940 msgr2=0x55efbccb3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6bffff640 1 --2- 172.21.15.159:0/2902115881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbccb1940 0x55efbccb3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6bffff640 1 -- 172.21.15.159:0/2902115881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 msgr2=0x55efbcca6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6bffff640 1 --2- 172.21.15.159:0/2902115881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff6b40a33b0 0x7ff6b40a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8011a00 tx=0x7ff6b8011e00 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.611+0000 7ff6bffff640 1 -- 172.21.15.159:0/2902115881 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbc97db90 con 0x55efbcca7080 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.612+0000 7ff6bffff640 1 --2- 172.21.15.159:0/2902115881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb1400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0005940 tx=0x7ff6b0005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b958bbc9fbc171b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.612+0000 7ff6bdffb640 1 -- 172.21.15.159:0/2902115881 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0040070 con 0x55efbcca7080 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.612+0000 7ff6bdffb640 1 -- 172.21.15.159:0/2902115881 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6b00317b0 con 0x55efbcca7080 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.612+0000 7ff6bdffb640 1 -- 172.21.15.159:0/2902115881 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0035040 con 0x55efbcca7080 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 -- 172.21.15.159:0/2902115881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 msgr2=0x55efbccb1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 --2- 172.21.15.159:0/2902115881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb1400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0005940 tx=0x7ff6b0005bd0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 -- 172.21.15.159:0/2902115881 shutdown_connections 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 --2- 172.21.15.159:0/2902115881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbccb1940 0x55efbccb3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 --2- 172.21.15.159:0/2902115881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb1400 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 --2- 172.21.15.159:0/2902115881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 -- 172.21.15.159:0/2902115881 >> 172.21.15.159:0/2902115881 conn(0x55efbcca2cf0 msgr2=0x55efbcca30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:49.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 -- 172.21.15.159:0/2902115881 shutdown_connections 2024-09-19T06:51:49.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 -- 172.21.15.159:0/2902115881 wait complete. 2024-09-19T06:51:49.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 -- start start 2024-09-19T06:51:49.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.613+0000 7ff6d0213740 1 Processor -- start 2024-09-19T06:51:49.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca6760 0x55efbccae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 0x55efbccaed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccaf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6d0213740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55efbccb4510 con 0x55efbccb1940 2024-09-19T06:51:49.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6d0213740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55efbcb946e0 con 0x55efbcca7080 2024-09-19T06:51:49.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca6760 0x55efbccae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccaf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6d0213740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55efbccb4690 con 0x55efbcca6760 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6bffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 0x55efbccaed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca6760 0x55efbccae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:34832/0 (socket says 172.21.15.159:34832) 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccaf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35694/0 (socket says 172.21.15.159:35694) 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6c77fe640 1 -- 172.21.15.159:0/1619792137 learned_addr learned my addr 172.21.15.159:0/1619792137 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6d0213740 10 client.0 _ll_register_callbacks cb 0x55efbcbb8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6bffff640 1 -- 172.21.15.159:0/1619792137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca6760 msgr2=0x55efbccae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6bffff640 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca6760 0x55efbccae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6bffff640 1 -- 172.21.15.159:0/1619792137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 msgr2=0x55efbccaf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6bffff640 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccaf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6bffff640 1 -- 172.21.15.159:0/1619792137 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efbccbd9d0 con 0x55efbcca7080 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca6760 0x55efbccae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6c7fff640 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccaf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6bffff640 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 0x55efbccaed20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55efbcca3b50 tx=0x7ff6b0005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a97af572ebf1f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.614+0000 7ff6a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1619792137 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0040070 con 0x55efbcca7080 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6d0213740 1 -- 172.21.15.159:0/1619792137 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6b00317b0 con 0x55efbcca7080 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1619792137 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7ff6b0005400 con 0x55efbcca7080 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1619792137 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff6b0035050 con 0x55efbcca7080 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6d0213740 10 client.25841 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6d0213740 1 -- 172.21.15.159:0/1619792137 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55efbccc0270 con 0x55efbcca7080 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1619792137 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6b00317b0 con 0x55efbcca7080 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1619792137 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7ff6b0004b80 con 0x55efbcca7080 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6d0213740 10 client.25841 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:49.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6d0213740 10 client.25841 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6d0213740 20 client.25841 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55efbccc15c0 0x55efbccc39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6d0213740 4 client.25841 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.615+0000 7ff6d0213740 1 -- 172.21.15.159:0/1619792137 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efbcc199d0 con 0x55efbccc15c0 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.616+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55efbccc15c0 0x55efbccc39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.616+0000 7ff6a6ffd640 10 client.25841 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.616+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55efbccc15c0 0x55efbccc39b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66203b10838c3545 server_cookie=4e6721b6f011baeb in_seq=0 out_seq=0 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1619792137 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55efbcc199d0 con 0x55efbccc15c0 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6a6ffd640 10 client.25841 handle_command_reply: tid=0 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 client.25841 shutdown 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 -- 172.21.15.159:0/1619792137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 msgr2=0x55efbccaed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 0x55efbccaed20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55efbcca3b50 tx=0x7ff6b0005e50 comp rx=0 tx=0).stop 2024-09-19T06:51:49.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 -- 172.21.15.159:0/1619792137 shutdown_connections 2024-09-19T06:51:49.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55efbccc15c0 0x55efbccc39b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccaf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 0x55efbccaed20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6a6ffd640 0 client.25841 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:49.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1619792137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca6760 0x55efbccae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 -- 172.21.15.159:0/1619792137 >> 172.21.15.159:0/1619792137 conn(0x55efbcca2cf0 msgr2=0x55efbcca8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:49.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 -- 172.21.15.159:0/1619792137 shutdown_connections 2024-09-19T06:51:49.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.617+0000 7ff6d0213740 1 -- 172.21.15.159:0/1619792137 wait complete. 2024-09-19T06:51:49.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.618+0000 7ff6d0213740 20 client.25841 trim_cache size 0 max 16384 2024-09-19T06:51:49.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6d0213740 1 Processor -- start 2024-09-19T06:51:49.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6d0213740 1 -- start start 2024-09-19T06:51:49.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 0x55efbccc9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbccb1940 0x55efbccc9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6d0213740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c81ab940 con 0x55efbcca6760 2024-09-19T06:51:49.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6d0213740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c81ae1c0 con 0x55efbcca7080 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6d0213740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c81abfb0 con 0x55efbccb1940 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35704/0 (socket says 172.21.15.159:35704) 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6c77fe640 1 -- 172.21.15.159:0/3745205499 learned_addr learned my addr 172.21.15.159:0/3745205499 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.637+0000 7ff6c7fff640 1 --2- 172.21.15.159:0/3745205499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbccb1940 0x55efbccc9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6bffff640 1 --2- 172.21.15.159:0/3745205499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 0x55efbccc9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6c77fe640 1 -- 172.21.15.159:0/3745205499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbccb1940 msgr2=0x55efbccc9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/3745205499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbccb1940 0x55efbccc9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6c77fe640 1 -- 172.21.15.159:0/3745205499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 msgr2=0x55efbccc9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/3745205499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 0x55efbccc9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6c77fe640 1 -- 172.21.15.159:0/3745205499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbcca2b20 con 0x55efbcca6760 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/3745205499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca88c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800f790 tx=0x7ff6b8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f561ad2669da8e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6bd7fa640 1 -- 172.21.15.159:0/3745205499 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b801a040 con 0x55efbcca6760 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6bd7fa640 1 -- 172.21.15.159:0/3745205499 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6b8005500 con 0x55efbcca6760 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.638+0000 7ff6bd7fa640 1 -- 172.21.15.159:0/3745205499 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8004d30 con 0x55efbcca6760 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 -- 172.21.15.159:0/3745205499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 msgr2=0x55efbcca88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 --2- 172.21.15.159:0/3745205499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca88c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800f790 tx=0x7ff6b8020000 comp rx=0 tx=0).stop 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 -- 172.21.15.159:0/3745205499 shutdown_connections 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 --2- 172.21.15.159:0/3745205499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbccb1940 0x55efbccc9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 --2- 172.21.15.159:0/3745205499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca7080 0x55efbccc9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 --2- 172.21.15.159:0/3745205499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbcca6760 0x55efbcca88c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 -- 172.21.15.159:0/3745205499 >> 172.21.15.159:0/3745205499 conn(0x55efbcca2cf0 msgr2=0x55efbcca81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 -- 172.21.15.159:0/3745205499 shutdown_connections 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 -- 172.21.15.159:0/3745205499 wait complete. 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.639+0000 7ff6d0213740 1 -- start start 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6d0213740 1 Processor -- start 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca6760 0x55efbccb58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6d0213740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccb6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6d0213740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c81ac680 con 0x55efbccb1940 2024-09-19T06:51:49.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6d0213740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c81adaf0 con 0x55efbcca6760 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6d0213740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c81acd50 con 0x55efbcca7080 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6d0213740 10 client.0 _ll_register_callbacks cb 0x7ff6b00095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccb6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccb6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35706/0 (socket says 172.21.15.159:35706) 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6bffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6c7fff640 1 -- 172.21.15.159:0/1055894584 learned_addr learned my addr 172.21.15.159:0/1055894584 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca6760 0x55efbccb58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6bffff640 1 -- 172.21.15.159:0/1055894584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca6760 msgr2=0x55efbccb58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6bffff640 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca6760 0x55efbccb58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6bffff640 1 -- 172.21.15.159:0/1055894584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 msgr2=0x55efbccb6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6bffff640 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccb6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6bffff640 1 -- 172.21.15.159:0/1055894584 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efbcc9e260 con 0x55efbcca7080 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6c7fff640 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccb6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6bffff640 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb5e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0003730 tx=0x7ff6b00317e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=168aad197aaa6ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.640+0000 7ff6a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1055894584 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0040070 con 0x55efbcca7080 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1055894584 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7ff6b0005440 con 0x55efbcca7080 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6d0213740 1 -- 172.21.15.159:0/1055894584 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6b8005500 con 0x55efbcca7080 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1055894584 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff6b0005640 con 0x55efbcca7080 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6d0213740 10 client.25903 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6d0213740 1 -- 172.21.15.159:0/1055894584 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55efbcd2c340 con 0x55efbcca7080 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1055894584 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6b8005500 con 0x55efbcca7080 2024-09-19T06:51:49.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1055894584 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7ff6b005e9f0 con 0x55efbcca7080 2024-09-19T06:51:49.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6d0213740 10 client.25903 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:49.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6d0213740 10 client.25903 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:51:49.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6d0213740 20 client.25903 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:49.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55efbcd2ca70 0x55efbcd2ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6d0213740 4 client.25903 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T06:51:49.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.641+0000 7ff6d0213740 1 -- 172.21.15.159:0/1055894584 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55efbcc13d20 con 0x55efbcd2ca70 2024-09-19T06:51:49.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.642+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55efbcd2ca70 0x55efbcd2ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.642+0000 7ff6c77fe640 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55efbcd2ca70 0x55efbcd2ee90 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3689443e819a70ce server_cookie=4ba89cbc26f2d68c in_seq=0 out_seq=0 2024-09-19T06:51:49.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:49.642+0000 7ff6a6ffd640 10 client.25903 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:50.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6a6ffd640 1 -- 172.21.15.159:0/1055894584 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55efbcc13d20 con 0x55efbcd2ca70 2024-09-19T06:51:50.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6a6ffd640 10 client.25903 handle_command_reply: tid=0 2024-09-19T06:51:50.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 client.25903 shutdown 2024-09-19T06:51:50.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 -- 172.21.15.159:0/1055894584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 msgr2=0x55efbccb5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:50.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb5e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0003730 tx=0x7ff6b00317e0 comp rx=0 tx=0).stop 2024-09-19T06:51:50.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 -- 172.21.15.159:0/1055894584 shutdown_connections 2024-09-19T06:51:50.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55efbcd2ca70 0x55efbcd2ee90 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:50.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55efbccb1940 0x55efbccb6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:50.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efbcca7080 0x55efbccb5e30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6a6ffd640 0 client.25903 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 --2- 172.21.15.159:0/1055894584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55efbcca6760 0x55efbccb58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 -- 172.21.15.159:0/1055894584 >> 172.21.15.159:0/1055894584 conn(0x55efbcca2cf0 msgr2=0x55efbcca1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 -- 172.21.15.159:0/1055894584 shutdown_connections 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.458+0000 7ff6d0213740 1 -- 172.21.15.159:0/1055894584 wait complete. 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6d0213740 20 client.25903 trim_cache size 0 max 16384 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 24, 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:51:50.462 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 22, 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "f9db16ee": { 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 22, 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 149.8, 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:51:50.463 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:51:50.464 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:51:50.464 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "QUIESCED", 2024-09-19T06:51:50.464 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:51:50.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:50.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:50.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:50.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:50.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:51:50.464 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:51:50.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff6b40a33b0 msgr2=0x7ff6b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:50.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff6b40a33b0 0x7ff6b40a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8011a00 tx=0x7ff6b8011e00 comp rx=0 tx=0).stop 2024-09-19T06:51:50.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c8106a80 msgr2=0x7ff6c81a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:50.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c8106a80 0x7ff6c81a4390 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009fd0 tx=0x7ff6c000ef10 comp rx=0 tx=0).stop 2024-09-19T06:51:50.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2426562608 shutdown_connections 2024-09-19T06:51:50.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff6b40a33b0 0x7ff6b40a5870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:50.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c8106a80 0x7ff6c81a4390 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:50.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8101420 0x7ff6c8199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:50.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 --2- 172.21.15.159:0/2426562608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6c8100a80 0x7ff6c8199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:50.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.459+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2426562608 >> 172.21.15.159:0/2426562608 conn(0x7ff6c80fc7a0 msgr2=0x7ff6c80fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:50.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.460+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2426562608 shutdown_connections 2024-09-19T06:51:50.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:51:50.460+0000 7ff6cde3a640 1 -- 172.21.15.159:0/2426562608 wait complete. 2024-09-19T06:51:50.768 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:50 smithi159 ceph-mon[30935]: pgmap v150: 97 pgs: 97 active+clean; 48 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 152 KiB/s wr, 24 op/s 2024-09-19T06:51:51.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:50 smithi203 ceph-mon[35473]: pgmap v150: 97 pgs: 97 active+clean; 48 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 152 KiB/s wr, 24 op/s 2024-09-19T06:51:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:50 smithi189 ceph-mon[34880]: pgmap v150: 97 pgs: 97 active+clean; 48 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 152 KiB/s wr, 24 op/s 2024-09-19T06:51:51.222 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f9db16ee', quiesce took 4.2 seconds. Will release after: 25.6 2024-09-19T06:51:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.242+0000 7f536b318640 1 -- 172.21.15.159:0/2111540798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364102ce0 msgr2=0x7f53641030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.242+0000 7f536b318640 1 --2- 172.21.15.159:0/2111540798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364102ce0 0x7f53641030c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5354009ca0 tx=0x7f535402a950 comp rx=0 tx=0).stop 2024-09-19T06:51:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.242+0000 7f536b318640 1 -- 172.21.15.159:0/2111540798 shutdown_connections 2024-09-19T06:51:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.242+0000 7f536b318640 1 --2- 172.21.15.159:0/2111540798 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f536410c0b0 0x7f536410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.242+0000 7f536b318640 1 --2- 172.21.15.159:0/2111540798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5364103600 0x7f536410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.242+0000 7f536b318640 1 --2- 172.21.15.159:0/2111540798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364102ce0 0x7f53641030c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.242+0000 7f536b318640 1 -- 172.21.15.159:0/2111540798 >> 172.21.15.159:0/2111540798 conn(0x7f5364077990 msgr2=0x7f53640fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.242+0000 7f536b318640 1 -- 172.21.15.159:0/2111540798 shutdown_connections 2024-09-19T06:51:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.242+0000 7f536b318640 1 -- 172.21.15.159:0/2111540798 wait complete. 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f536b318640 1 Processor -- start 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f536b318640 1 -- start start 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f536b318640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5364102ce0 0x7f5364198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f536b318640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364103600 0x7f5364198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f536b318640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f536410c0b0 0x7f536419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f536b318640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5364111eb0 con 0x7f5364103600 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f536b318640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5364111d30 con 0x7f5364102ce0 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f536b318640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5364112030 con 0x7f536410c0b0 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f53688b3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364103600 0x7f5364198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f53690b4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5364102ce0 0x7f5364198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f53688b3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364103600 0x7f5364198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35714/0 (socket says 172.21.15.159:35714) 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.243+0000 7f53688b3640 1 -- 172.21.15.159:0/3627291081 learned_addr learned my addr 172.21.15.159:0/3627291081 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53698b5640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f536410c0b0 0x7f536419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53688b3640 1 -- 172.21.15.159:0/3627291081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f536410c0b0 msgr2=0x7f536419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53688b3640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f536410c0b0 0x7f536419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53688b3640 1 -- 172.21.15.159:0/3627291081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5364102ce0 msgr2=0x7f5364198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53688b3640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5364102ce0 0x7f5364198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53688b3640 1 -- 172.21.15.159:0/3627291081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536419d330 con 0x7f5364103600 2024-09-19T06:51:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53698b5640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f536410c0b0 0x7f536419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53688b3640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364103600 0x7f5364198880 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f535800c920 tx=0x7f535800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53627fc640 1 -- 172.21.15.159:0/3627291081 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358007c70 con 0x7f5364103600 2024-09-19T06:51:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f536b318640 1 -- 172.21.15.159:0/3627291081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536419d620 con 0x7f5364103600 2024-09-19T06:51:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53627fc640 1 -- 172.21.15.159:0/3627291081 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5358007e10 con 0x7f5364103600 2024-09-19T06:51:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f53627fc640 1 -- 172.21.15.159:0/3627291081 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358018890 con 0x7f5364103600 2024-09-19T06:51:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.244+0000 7f536b318640 1 -- 172.21.15.159:0/3627291081 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53641a4eb0 con 0x7f5364103600 2024-09-19T06:51:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.246+0000 7f53627fc640 1 -- 172.21.15.159:0/3627291081 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5358018a70 con 0x7f5364103600 2024-09-19T06:51:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.247+0000 7f536e0b3740 1 Processor -- start 2024-09-19T06:51:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.247+0000 7f536e0b3740 1 -- start start 2024-09-19T06:51:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.247+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88ccaf0 0x5584c88cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.247+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88cd410 0x5584c88d7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.247+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88d7cb0 0x5584c88da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.247+0000 7f536e0b3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5584c88312f0 con 0x5584c88cd410 2024-09-19T06:51:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.247+0000 7f536e0b3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5584c87d9270 con 0x5584c88ccaf0 2024-09-19T06:51:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.247+0000 7f536e0b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5584c882d2b0 con 0x5584c88d7cb0 2024-09-19T06:51:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53690b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88cd410 0x5584c88d7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53690b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88cd410 0x5584c88d7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35726/0 (socket says 172.21.15.159:35726) 2024-09-19T06:51:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53690b4640 1 -- 172.21.15.159:0/989369973 learned_addr learned my addr 172.21.15.159:0/989369973 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53627fc640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f534c0a3460 0x7f534c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53698b5640 1 --2- 172.21.15.159:0/989369973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88ccaf0 0x5584c88cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53688b3640 1 --2- 172.21.15.159:0/989369973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88d7cb0 0x5584c88da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53698b5640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f534c0a3460 0x7f534c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53627fc640 1 -- 172.21.15.159:0/3627291081 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f53580cfea0 con 0x7f5364103600 2024-09-19T06:51:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53690b4640 1 -- 172.21.15.159:0/989369973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88d7cb0 msgr2=0x5584c88da0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53690b4640 1 --2- 172.21.15.159:0/989369973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88d7cb0 0x5584c88da0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53690b4640 1 -- 172.21.15.159:0/989369973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88ccaf0 msgr2=0x5584c88cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53690b4640 1 --2- 172.21.15.159:0/989369973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88ccaf0 0x5584c88cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53690b4640 1 -- 172.21.15.159:0/989369973 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c87d8340 con 0x5584c88cd410 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53690b4640 1 --2- 172.21.15.159:0/989369973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88cd410 0x5584c88d7770 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5354035000 tx=0x7f535402ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef39f82350bfac49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f53698b5640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f534c0a3460 0x7f534c0a5920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f535c005fd0 tx=0x7f535c005850 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f534b7fe640 1 -- 172.21.15.159:0/989369973 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354048070 con 0x5584c88cd410 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f534b7fe640 1 -- 172.21.15.159:0/989369973 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f535402fa80 con 0x5584c88cd410 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.248+0000 7f534b7fe640 1 -- 172.21.15.159:0/989369973 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354034040 con 0x5584c88cd410 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 -- 172.21.15.159:0/989369973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88cd410 msgr2=0x5584c88d7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 --2- 172.21.15.159:0/989369973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88cd410 0x5584c88d7770 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5354035000 tx=0x7f535402ff10 comp rx=0 tx=0).stop 2024-09-19T06:51:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 -- 172.21.15.159:0/989369973 shutdown_connections 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 --2- 172.21.15.159:0/989369973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88d7cb0 0x5584c88da0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 --2- 172.21.15.159:0/989369973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88cd410 0x5584c88d7770 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 --2- 172.21.15.159:0/989369973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88ccaf0 0x5584c88cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 -- 172.21.15.159:0/989369973 >> 172.21.15.159:0/989369973 conn(0x5584c88c9060 msgr2=0x5584c88c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 -- 172.21.15.159:0/989369973 shutdown_connections 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 -- 172.21.15.159:0/989369973 wait complete. 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.249+0000 7f536e0b3740 1 -- start start 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f536e0b3740 1 Processor -- start 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 0x5584c88d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 0x5584c88d5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f536e0b3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5584c88da880 con 0x5584c88d7cb0 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f536e0b3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5584c87ba290 con 0x5584c88cd410 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f536e0b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5584c88daa00 con 0x5584c88ccaf0 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f536e0b3740 10 client.0 _ll_register_callbacks cb 0x5584c87eb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f53698b5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f53698b5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88d55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35740/0 (socket says 172.21.15.159:35740) 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f53698b5640 1 -- 172.21.15.159:0/3522478375 learned_addr learned my addr 172.21.15.159:0/3522478375 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f53690b4640 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 0x5584c88d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.250+0000 7f53688b3640 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 0x5584c88d5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f53698b5640 1 -- 172.21.15.159:0/3522478375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 msgr2=0x5584c88d4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f53698b5640 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 0x5584c88d4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f53698b5640 1 -- 172.21.15.159:0/3522478375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 msgr2=0x5584c88d5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f53698b5640 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 0x5584c88d5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f53698b5640 1 -- 172.21.15.159:0/3522478375 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c8544210 con 0x5584c88d7cb0 2024-09-19T06:51:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f53688b3640 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 0x5584c88d5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f53690b4640 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 0x5584c88d4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f53698b5640 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88d55a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f535c011da0 tx=0x7f535c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1ed3991d311458 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f5348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f5348ff9640 1 -- 172.21.15.159:0/3522478375 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c026070 con 0x5584c88d7cb0 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f5348ff9640 1 -- 172.21.15.159:0/3522478375 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f535c00fbc0 con 0x5584c88d7cb0 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f536e0b3740 1 -- 172.21.15.159:0/3522478375 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f535402fa80 con 0x5584c88d7cb0 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f5348ff9640 1 -- 172.21.15.159:0/3522478375 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f535c031050 con 0x5584c88d7cb0 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f536e0b3740 10 client.16554 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f536e0b3740 1 -- 172.21.15.159:0/3522478375 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5584c8610620 con 0x5584c88d7cb0 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.251+0000 7f5348ff9640 1 -- 172.21.15.159:0/3522478375 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f535402fa80 con 0x5584c88d7cb0 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f5348ff9640 1 -- 172.21.15.159:0/3522478375 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f535c01f3b0 con 0x5584c88d7cb0 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f536e0b3740 10 client.16554 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f536e0b3740 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f536e0b3740 20 client.16554 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f536e0b3740 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5584c88e7b30 0x5584c88e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f536e0b3740 4 client.16554 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f536e0b3740 1 -- 172.21.15.159:0/3522478375 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584c883ea20 con 0x5584c88e7b30 2024-09-19T06:51:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f53690b4640 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5584c88e7b30 0x5584c88e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f5348ff9640 10 client.16554 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.252+0000 7f53690b4640 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5584c88e7b30 0x5584c88e9fc0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f220acccb60649f server_cookie=b0398bd26331e44d in_seq=0 out_seq=0 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f5348ff9640 1 -- 172.21.15.159:0/3522478375 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584c883ea20 con 0x5584c88e7b30 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f5348ff9640 10 client.16554 handle_command_reply: tid=0 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 client.16554 shutdown 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 -- 172.21.15.159:0/3522478375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 msgr2=0x5584c88d55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88d55a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f535c011da0 tx=0x7f535c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 -- 172.21.15.159:0/3522478375 shutdown_connections 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5584c88e7b30 0x5584c88e9fc0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88d55a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f5348ff9640 0 client.16554 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 0x5584c88d5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 --2- 172.21.15.159:0/3522478375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 0x5584c88d4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 -- 172.21.15.159:0/3522478375 >> 172.21.15.159:0/3522478375 conn(0x5584c88c9060 msgr2=0x5584c88cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 -- 172.21.15.159:0/3522478375 shutdown_connections 2024-09-19T06:51:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 1 -- 172.21.15.159:0/3522478375 wait complete. 2024-09-19T06:51:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.253+0000 7f536e0b3740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T06:51:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f536e0b3740 1 Processor -- start 2024-09-19T06:51:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f536e0b3740 1 -- start start 2024-09-19T06:51:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 0x5584c88d53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 0x5584c88cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88ef920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f536e0b3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f53641ab860 con 0x5584c88d7cb0 2024-09-19T06:51:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f536e0b3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53641ae0e0 con 0x5584c88cd410 2024-09-19T06:51:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f536e0b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53641abed0 con 0x5584c88ccaf0 2024-09-19T06:51:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f53698b5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88ef920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f53698b5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88ef920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35752/0 (socket says 172.21.15.159:35752) 2024-09-19T06:51:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f53698b5640 1 -- 172.21.15.159:0/429703134 learned_addr learned my addr 172.21.15.159:0/429703134 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f53698b5640 1 -- 172.21.15.159:0/429703134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 msgr2=0x5584c88d53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f53698b5640 1 --2- 172.21.15.159:0/429703134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 0x5584c88d53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f53698b5640 1 -- 172.21.15.159:0/429703134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 msgr2=0x5584c88cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f53698b5640 1 --2- 172.21.15.159:0/429703134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 0x5584c88cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.268+0000 7f53698b5640 1 -- 172.21.15.159:0/429703134 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c88c8e90 con 0x5584c88d7cb0 2024-09-19T06:51:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f53698b5640 1 --2- 172.21.15.159:0/429703134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88ef920 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f535c011820 tx=0x7f535c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2a666660a910e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f534affd640 1 -- 172.21.15.159:0/429703134 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c026040 con 0x5584c88d7cb0 2024-09-19T06:51:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f534affd640 1 -- 172.21.15.159:0/429703134 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f535c005030 con 0x5584c88d7cb0 2024-09-19T06:51:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f534affd640 1 -- 172.21.15.159:0/429703134 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c00fa70 con 0x5584c88d7cb0 2024-09-19T06:51:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f536e0b3740 1 -- 172.21.15.159:0/429703134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 msgr2=0x5584c88ef920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f536e0b3740 1 --2- 172.21.15.159:0/429703134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88ef920 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f535c011820 tx=0x7f535c00c960 comp rx=0 tx=0).stop 2024-09-19T06:51:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f536e0b3740 1 -- 172.21.15.159:0/429703134 shutdown_connections 2024-09-19T06:51:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f536e0b3740 1 --2- 172.21.15.159:0/429703134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88d7cb0 0x5584c88ef920 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f536e0b3740 1 --2- 172.21.15.159:0/429703134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88cd410 0x5584c88cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f536e0b3740 1 --2- 172.21.15.159:0/429703134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88ccaf0 0x5584c88d53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f536e0b3740 1 -- 172.21.15.159:0/429703134 >> 172.21.15.159:0/429703134 conn(0x5584c88c9060 msgr2=0x5584c88ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f536e0b3740 1 -- 172.21.15.159:0/429703134 shutdown_connections 2024-09-19T06:51:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.269+0000 7f536e0b3740 1 -- 172.21.15.159:0/429703134 wait complete. 2024-09-19T06:51:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f536e0b3740 1 -- start start 2024-09-19T06:51:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f536e0b3740 1 Processor -- start 2024-09-19T06:51:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88ccaf0 0x5584c88e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88cd410 0x5584c88db5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f536e0b3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88d7cb0 0x5584c88dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f536e0b3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f53641ac5a0 con 0x5584c88ccaf0 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f536e0b3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53641ada10 con 0x5584c88d7cb0 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f536e0b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53641acc70 con 0x5584c88cd410 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f536e0b3740 10 client.0 _ll_register_callbacks cb 0x7f535c011c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f53690b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88ccaf0 0x5584c88e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f53690b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88ccaf0 0x5584c88e02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35754/0 (socket says 172.21.15.159:35754) 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.270+0000 7f53690b4640 1 -- 172.21.15.159:0/2558547139 learned_addr learned my addr 172.21.15.159:0/2558547139 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53688b3640 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88cd410 0x5584c88db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53698b5640 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88d7cb0 0x5584c88dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53690b4640 1 -- 172.21.15.159:0/2558547139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88cd410 msgr2=0x5584c88db5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53690b4640 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88cd410 0x5584c88db5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53690b4640 1 -- 172.21.15.159:0/2558547139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88d7cb0 msgr2=0x5584c88dbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53690b4640 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88d7cb0 0x5584c88dbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53690b4640 1 -- 172.21.15.159:0/2558547139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c88c9cf0 con 0x5584c88ccaf0 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53698b5640 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88d7cb0 0x5584c88dbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53688b3640 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88cd410 0x5584c88db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f53690b4640 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88ccaf0 0x5584c88e02a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5354046040 tx=0x7f5354005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e081c7e14edbaff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f5348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f5348ff9640 1 -- 172.21.15.159:0/2558547139 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354054070 con 0x5584c88ccaf0 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f5348ff9640 1 -- 172.21.15.159:0/2558547139 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f5354009880 con 0x5584c88ccaf0 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f536e0b3740 1 -- 172.21.15.159:0/2558547139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f535c005030 con 0x5584c88ccaf0 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f5348ff9640 1 -- 172.21.15.159:0/2558547139 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5354060050 con 0x5584c88ccaf0 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f536e0b3740 10 client.16560 fetch_fsmap learned FSMap version 24 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f536e0b3740 1 -- 172.21.15.159:0/2558547139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5584c89525f0 con 0x5584c88ccaf0 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f5348ff9640 1 -- 172.21.15.159:0/2558547139 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f535c005030 con 0x5584c88ccaf0 2024-09-19T06:51:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f5348ff9640 1 -- 172.21.15.159:0/2558547139 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f5354004270 con 0x5584c88ccaf0 2024-09-19T06:51:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f536e0b3740 10 client.16560 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:51:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f536e0b3740 10 client.16560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:51:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f536e0b3740 20 client.16560 populate_metadata read hostname 'smithi159' 2024-09-19T06:51:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.271+0000 7f536e0b3740 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5584c8952930 0x5584c8954d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.272+0000 7f536e0b3740 4 client.16560 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:51:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.272+0000 7f536e0b3740 1 -- 172.21.15.159:0/2558547139 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584c88d0700 con 0x5584c8952930 2024-09-19T06:51:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.272+0000 7f53688b3640 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5584c8952930 0x5584c8954d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.272+0000 7f53688b3640 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5584c8952930 0x5584c8954d20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bcce39241b1217 server_cookie=76392feef010e999 in_seq=0 out_seq=0 2024-09-19T06:51:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.272+0000 7f5348ff9640 10 client.16560 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f5348ff9640 1 -- 172.21.15.159:0/2558547139 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584c88d0700 con 0x5584c8952930 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f5348ff9640 10 client.16560 handle_command_reply: tid=0 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 client.16560 shutdown 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 -- 172.21.15.159:0/2558547139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88ccaf0 msgr2=0x5584c88e02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88ccaf0 0x5584c88e02a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5354046040 tx=0x7f5354005fa0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 -- 172.21.15.159:0/2558547139 shutdown_connections 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5584c8952930 0x5584c8954d20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5584c88d7cb0 0x5584c88dbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f5348ff9640 0 client.16560 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:51:52.285 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5584c88cd410 0x5584c88db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.286 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 --2- 172.21.15.159:0/2558547139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5584c88ccaf0 0x5584c88e02a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.286 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 -- 172.21.15.159:0/2558547139 >> 172.21.15.159:0/2558547139 conn(0x5584c88c9060 msgr2=0x5584c88d6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:52.286 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 -- 172.21.15.159:0/2558547139 shutdown_connections 2024-09-19T06:51:52.286 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 1 -- 172.21.15.159:0/2558547139 wait complete. 2024-09-19T06:51:52.286 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.283+0000 7f536e0b3740 20 client.16560 trim_cache size 0 max 16384 2024-09-19T06:51:52.286 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:51:52.286 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:51:52.286 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:51:52.287 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:51:52.287 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 -- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f534c0a3460 msgr2=0x7f534c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f534c0a3460 0x7f534c0a5920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f535c005fd0 tx=0x7f535c005850 comp rx=0 tx=0).stop 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 -- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364103600 msgr2=0x7f5364198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364103600 0x7f5364198880 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f535800c920 tx=0x7f535800cde0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 -- 172.21.15.159:0/3627291081 shutdown_connections 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f534c0a3460 0x7f534c0a5920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f536410c0b0 0x7f536419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5364103600 0x7f5364198880 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 --2- 172.21.15.159:0/3627291081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5364102ce0 0x7f5364198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 -- 172.21.15.159:0/3627291081 >> 172.21.15.159:0/3627291081 conn(0x7f5364077990 msgr2=0x7f53640fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 -- 172.21.15.159:0/3627291081 shutdown_connections 2024-09-19T06:51:52.288 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:51:52.284+0000 7f536b318640 1 -- 172.21.15.159:0/3627291081 wait complete. 2024-09-19T06:51:53.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:52 smithi203 ceph-mon[35473]: pgmap v151: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 189 op/s 2024-09-19T06:51:53.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:52 smithi189 ceph-mon[34880]: pgmap v151: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 189 op/s 2024-09-19T06:51:53.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:52 smithi159 ceph-mon[30935]: pgmap v151: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 189 op/s 2024-09-19T06:51:54.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:54 smithi159 ceph-mon[30935]: pgmap v152: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-19T06:51:55.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:54 smithi203 ceph-mon[35473]: pgmap v152: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-19T06:51:55.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:54 smithi189 ceph-mon[34880]: pgmap v152: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-19T06:51:57.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:56 smithi203 ceph-mon[35473]: pgmap v153: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 190 op/s 2024-09-19T06:51:57.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:56 smithi189 ceph-mon[34880]: pgmap v153: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 190 op/s 2024-09-19T06:51:57.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:56 smithi159 ceph-mon[30935]: pgmap v153: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 190 op/s 2024-09-19T06:51:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:51:58 smithi203 ceph-mon[35473]: pgmap v154: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.0 MiB/s wr, 168 op/s 2024-09-19T06:51:59.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:51:58 smithi189 ceph-mon[34880]: pgmap v154: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.0 MiB/s wr, 168 op/s 2024-09-19T06:51:59.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:51:58 smithi159 ceph-mon[30935]: pgmap v154: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.0 MiB/s wr, 168 op/s 2024-09-19T06:52:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:00 smithi203 ceph-mon[35473]: pgmap v155: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.0 MiB/s wr, 168 op/s 2024-09-19T06:52:01.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:00 smithi189 ceph-mon[34880]: pgmap v155: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.0 MiB/s wr, 168 op/s 2024-09-19T06:52:01.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:00 smithi159 ceph-mon[30935]: pgmap v155: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.0 MiB/s wr, 168 op/s 2024-09-19T06:52:02.950 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:02 smithi159 ceph-mon[30935]: pgmap v156: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.1 MiB/s wr, 184 op/s 2024-09-19T06:52:03.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:02 smithi203 ceph-mon[35473]: pgmap v156: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.1 MiB/s wr, 184 op/s 2024-09-19T06:52:03.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:02 smithi189 ceph-mon[34880]: pgmap v156: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.1 MiB/s wr, 184 op/s 2024-09-19T06:52:03.454 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:52:03.721 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:04.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.209+0000 7f724a789640 1 -- 172.21.15.159:0/4253673801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244101de0 msgr2=0x7f72441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:04.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.209+0000 7f724a789640 1 --2- 172.21.15.159:0/4253673801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244101de0 0x7f72441021c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7234009900 tx=0x7f723402a410 comp rx=0 tx=0).stop 2024-09-19T06:52:04.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.210+0000 7f724a789640 1 -- 172.21.15.159:0/4253673801 shutdown_connections 2024-09-19T06:52:04.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.210+0000 7f724a789640 1 --2- 172.21.15.159:0/4253673801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7244106f10 0x7f724410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.210+0000 7f724a789640 1 --2- 172.21.15.159:0/4253673801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7244102790 0x7f72441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.210+0000 7f724a789640 1 --2- 172.21.15.159:0/4253673801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244101de0 0x7f72441021c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.210+0000 7f724a789640 1 -- 172.21.15.159:0/4253673801 >> 172.21.15.159:0/4253673801 conn(0x7f72440fd8e0 msgr2=0x7f72440ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:04.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.210+0000 7f724a789640 1 -- 172.21.15.159:0/4253673801 shutdown_connections 2024-09-19T06:52:04.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.210+0000 7f724a789640 1 -- 172.21.15.159:0/4253673801 wait complete. 2024-09-19T06:52:04.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.210+0000 7f724a789640 1 Processor -- start 2024-09-19T06:52:04.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.210+0000 7f724a789640 1 -- start start 2024-09-19T06:52:04.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f724a789640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7244101de0 0x7f72441984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f724a789640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7244102790 0x7f7244198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f724a789640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244106f10 0x7f724419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f724a789640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7244111f30 con 0x7f7244106f10 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f724a789640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7244111db0 con 0x7f7244102790 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f724a789640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72441120b0 con 0x7f7244101de0 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f7248d26640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244106f10 0x7f724419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f7248d26640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244106f10 0x7f724419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53840/0 (socket says 172.21.15.159:53840) 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f7248d26640 1 -- 172.21.15.159:0/3495973238 learned_addr learned my addr 172.21.15.159:0/3495973238 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f72437fe640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7244102790 0x7f7244198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f7243fff640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7244101de0 0x7f72441984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f7248d26640 1 -- 172.21.15.159:0/3495973238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7244101de0 msgr2=0x7f72441984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f7248d26640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7244101de0 0x7f72441984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f7248d26640 1 -- 172.21.15.159:0/3495973238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7244102790 msgr2=0x7f7244198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f7248d26640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7244102790 0x7f7244198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f7248d26640 1 -- 172.21.15.159:0/3495973238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724419d480 con 0x7f7244106f10 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.211+0000 7f72437fe640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7244102790 0x7f7244198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.212+0000 7f7248d26640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244106f10 0x7f724419cda0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f723c00cad0 tx=0x7f723c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.212+0000 7f72417fa640 1 -- 172.21.15.159:0/3495973238 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c00ae20 con 0x7f7244106f10 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.212+0000 7f724a789640 1 -- 172.21.15.159:0/3495973238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724419d770 con 0x7f7244106f10 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.212+0000 7f72417fa640 1 -- 172.21.15.159:0/3495973238 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f723c005020 con 0x7f7244106f10 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.212+0000 7f72417fa640 1 -- 172.21.15.159:0/3495973238 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c00f6f0 con 0x7f7244106f10 2024-09-19T06:52:04.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.212+0000 7f724a789640 1 -- 172.21.15.159:0/3495973238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72441a5050 con 0x7f7244106f10 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.214+0000 7f72417fa640 1 -- 172.21.15.159:0/3495973238 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f723c0051d0 con 0x7f7244106f10 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.215+0000 7f72417fa640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f722c0a33b0 0x7f722c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.215+0000 7f7243fff640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f722c0a33b0 0x7f722c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.215+0000 7f72417fa640 1 -- 172.21.15.159:0/3495973238 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f723c0cfe90 con 0x7f7244106f10 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.215+0000 7f724cb62740 1 Processor -- start 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.215+0000 7f7243fff640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f722c0a33b0 0x7f722c0a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7234005ab0 tx=0x7f7234005a20 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.215+0000 7f724cb62740 1 -- start start 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f724cb62740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d19880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f724cb62740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d24140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f724cb62740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 0x55b6c5d26a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f724cb62740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5c7f2e0 con 0x55b6c5d194a0 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f724cb62740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5c26ce0 con 0x55b6c5d19dc0 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f724cb62740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5c7b2a0 con 0x55b6c5d24680 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7243fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d19880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7243fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d19880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53852/0 (socket says 172.21.15.159:53852) 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7243fff640 1 -- 172.21.15.159:0/2609409827 learned_addr learned my addr 172.21.15.159:0/2609409827 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f72437fe640 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d24140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7248d26640 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 0x55b6c5d26a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7243fff640 1 -- 172.21.15.159:0/2609409827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 msgr2=0x55b6c5d26a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7243fff640 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 0x55b6c5d26a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7243fff640 1 -- 172.21.15.159:0/2609409827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d19dc0 msgr2=0x55b6c5d24140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:04.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7243fff640 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d24140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7243fff640 1 -- 172.21.15.159:0/2609409827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c5c0b440 con 0x55b6c5d194a0 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f72437fe640 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d24140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f7243fff640 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d19880 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7234033000 tx=0x7f723403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0e7a478ec2f2be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f722a7fc640 1 -- 172.21.15.159:0/2609409827 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723404b070 con 0x55b6c5d194a0 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f722a7fc640 1 -- 172.21.15.159:0/2609409827 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72340318e0 con 0x55b6c5d194a0 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.216+0000 7f722a7fc640 1 -- 172.21.15.159:0/2609409827 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234035050 con 0x55b6c5d194a0 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.217+0000 7f724cb62740 1 -- 172.21.15.159:0/2609409827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 msgr2=0x55b6c5d19880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.217+0000 7f724cb62740 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d19880 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7234033000 tx=0x7f723403c000 comp rx=0 tx=0).stop 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.217+0000 7f724cb62740 1 -- 172.21.15.159:0/2609409827 shutdown_connections 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.217+0000 7f724cb62740 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 0x55b6c5d26a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.217+0000 7f724cb62740 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d24140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.217+0000 7f724cb62740 1 --2- 172.21.15.159:0/2609409827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d19880 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.217+0000 7f724cb62740 1 -- 172.21.15.159:0/2609409827 >> 172.21.15.159:0/2609409827 conn(0x55b6c5d15a30 msgr2=0x55b6c5d15e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.217+0000 7f724cb62740 1 -- 172.21.15.159:0/2609409827 shutdown_connections 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.217+0000 7f724cb62740 1 -- 172.21.15.159:0/2609409827 wait complete. 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f724cb62740 1 -- start start 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f724cb62740 1 Processor -- start 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f724cb62740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d194a0 0x55b6c5d23f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f724cb62740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d21210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f724cb62740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 0x55b6c5d21750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f724cb62740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5d27250 con 0x55b6c5d19dc0 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f724cb62740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5c3a050 con 0x55b6c5d194a0 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f724cb62740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5d273d0 con 0x55b6c5d24680 2024-09-19T06:52:04.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f724cb62740 10 client.0 _ll_register_callbacks cb 0x55b6c5c7a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:04.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f72437fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d21210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f72437fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d21210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53866/0 (socket says 172.21.15.159:53866) 2024-09-19T06:52:04.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f7248d26640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 0x55b6c5d21750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.218+0000 7f72437fe640 1 -- 172.21.15.159:0/3870635156 learned_addr learned my addr 172.21.15.159:0/3870635156 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:04.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f7243fff640 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d194a0 0x55b6c5d23f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72437fe640 1 -- 172.21.15.159:0/3870635156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 msgr2=0x55b6c5d21750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:04.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72437fe640 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 0x55b6c5d21750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72437fe640 1 -- 172.21.15.159:0/3870635156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d194a0 msgr2=0x55b6c5d23f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72437fe640 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d194a0 0x55b6c5d23f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72437fe640 1 -- 172.21.15.159:0/3870635156 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c59f03c0 con 0x55b6c5d19dc0 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72437fe640 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d21210 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7238013710 tx=0x7f7238013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8973f1cc1041a181 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72237fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72237fe640 1 -- 172.21.15.159:0/3870635156 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238020060 con 0x55b6c5d19dc0 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72237fe640 1 -- 172.21.15.159:0/3870635156 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f7238011dd0 con 0x55b6c5d19dc0 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f724cb62740 1 -- 172.21.15.159:0/3870635156 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72340318e0 con 0x55b6c5d19dc0 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f72237fe640 1 -- 172.21.15.159:0/3870635156 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f723800f450 con 0x55b6c5d19dc0 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f724cb62740 10 client.16572 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.219+0000 7f724cb62740 1 -- 172.21.15.159:0/3870635156 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b6c5d32c20 con 0x55b6c5d19dc0 2024-09-19T06:52:04.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.220+0000 7f72237fe640 1 -- 172.21.15.159:0/3870635156 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72340318e0 con 0x55b6c5d19dc0 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.220+0000 7f72237fe640 1 -- 172.21.15.159:0/3870635156 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f723801a030 con 0x55b6c5d19dc0 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.220+0000 7f724cb62740 10 client.16572 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.220+0000 7f724cb62740 10 client.16572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.220+0000 7f724cb62740 20 client.16572 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.220+0000 7f724cb62740 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b6c5d340e0 0x55b6c5d36530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.220+0000 7f724cb62740 4 client.16572 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.220+0000 7f724cb62740 1 -- 172.21.15.159:0/3870635156 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6c5c8c850 con 0x55b6c5d340e0 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.220+0000 7f7243fff640 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b6c5d340e0 0x55b6c5d36530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f7243fff640 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b6c5d340e0 0x55b6c5d36530 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e8622d0969774ca server_cookie=fc85c7f67402c5ea in_seq=0 out_seq=0 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f72237fe640 10 client.16572 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f72237fe640 1 -- 172.21.15.159:0/3870635156 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6c5c8c850 con 0x55b6c5d340e0 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f72237fe640 10 client.16572 handle_command_reply: tid=0 2024-09-19T06:52:04.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f724cb62740 1 client.16572 shutdown 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f724cb62740 1 -- 172.21.15.159:0/3870635156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d19dc0 msgr2=0x55b6c5d21210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f724cb62740 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d21210 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7238013710 tx=0x7f7238013bd0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f724cb62740 1 -- 172.21.15.159:0/3870635156 shutdown_connections 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f724cb62740 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b6c5d340e0 0x55b6c5d36530 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f724cb62740 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d24680 0x55b6c5d21750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f724cb62740 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d19dc0 0x55b6c5d21210 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f724cb62740 1 --2- 172.21.15.159:0/3870635156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d194a0 0x55b6c5d23f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.221+0000 7f724cb62740 1 -- 172.21.15.159:0/3870635156 >> 172.21.15.159:0/3870635156 conn(0x55b6c5d15a30 msgr2=0x55b6c5d14b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.222+0000 7f72237fe640 0 client.16572 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.222+0000 7f724cb62740 1 -- 172.21.15.159:0/3870635156 shutdown_connections 2024-09-19T06:52:04.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.222+0000 7f724cb62740 1 -- 172.21.15.159:0/3870635156 wait complete. 2024-09-19T06:52:04.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.222+0000 7f724cb62740 20 client.16572 trim_cache size 0 max 16384 2024-09-19T06:52:04.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f724cb62740 1 Processor -- start 2024-09-19T06:52:04.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f724cb62740 1 -- start start 2024-09-19T06:52:04.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f724cb62740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f724cb62740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d24680 0x55b6c5d3be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f724cb62740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d3c340 0x55b6c5d1e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f724cb62740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f72441ab9e0 con 0x55b6c5d194a0 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f724cb62740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72441ae260 con 0x55b6c5d24680 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f724cb62740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72441ac050 con 0x55b6c5d3c340 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f7243fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f7243fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53876/0 (socket says 172.21.15.159:53876) 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.254+0000 7f7243fff640 1 -- 172.21.15.159:0/3993386381 learned_addr learned my addr 172.21.15.159:0/3993386381 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7248d26640 1 --2- 172.21.15.159:0/3993386381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d3c340 0x55b6c5d1e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7243fff640 1 -- 172.21.15.159:0/3993386381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d3c340 msgr2=0x55b6c5d1e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7243fff640 1 --2- 172.21.15.159:0/3993386381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d3c340 0x55b6c5d1e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7243fff640 1 -- 172.21.15.159:0/3993386381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d24680 msgr2=0x55b6c5d3be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:04.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7243fff640 1 --2- 172.21.15.159:0/3993386381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d24680 0x55b6c5d3be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7243fff640 1 -- 172.21.15.159:0/3993386381 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c5d192d0 con 0x55b6c5d194a0 2024-09-19T06:52:04.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7243fff640 1 --2- 172.21.15.159:0/3993386381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d304b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7234003b60 tx=0x7f7234003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78a7011a56108c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:04.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7229ffb640 1 -- 172.21.15.159:0/3993386381 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234059070 con 0x55b6c5d194a0 2024-09-19T06:52:04.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7229ffb640 1 -- 172.21.15.159:0/3993386381 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7234005510 con 0x55b6c5d194a0 2024-09-19T06:52:04.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.255+0000 7f7229ffb640 1 -- 172.21.15.159:0/3993386381 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723403f040 con 0x55b6c5d194a0 2024-09-19T06:52:04.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 -- 172.21.15.159:0/3993386381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 msgr2=0x55b6c5d304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:04.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 --2- 172.21.15.159:0/3993386381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d304b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7234003b60 tx=0x7f7234003c30 comp rx=0 tx=0).stop 2024-09-19T06:52:04.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 -- 172.21.15.159:0/3993386381 shutdown_connections 2024-09-19T06:52:04.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 --2- 172.21.15.159:0/3993386381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d3c340 0x55b6c5d1e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 --2- 172.21.15.159:0/3993386381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d24680 0x55b6c5d3be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 --2- 172.21.15.159:0/3993386381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d194a0 0x55b6c5d304b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 -- 172.21.15.159:0/3993386381 >> 172.21.15.159:0/3993386381 conn(0x55b6c5d15a30 msgr2=0x55b6c5d1c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 -- 172.21.15.159:0/3993386381 shutdown_connections 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 -- 172.21.15.159:0/3993386381 wait complete. 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.256+0000 7f724cb62740 1 -- start start 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f724cb62740 1 Processor -- start 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f724cb62740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d194a0 0x55b6c5d283f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f724cb62740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d24680 0x55b6c5d28930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f724cb62740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d3c340 0x55b6c5d28e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f724cb62740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f72441ac720 con 0x55b6c5d24680 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f724cb62740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72441adb90 con 0x55b6c5d3c340 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f724cb62740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72441acdf0 con 0x55b6c5d194a0 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f724cb62740 10 client.0 _ll_register_callbacks cb 0x7f72380096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f72437fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d24680 0x55b6c5d28930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f72437fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d24680 0x55b6c5d28930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53888/0 (socket says 172.21.15.159:53888) 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f72437fe640 1 -- 172.21.15.159:0/3861061244 learned_addr learned my addr 172.21.15.159:0/3861061244 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f7243fff640 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d194a0 0x55b6c5d283f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.257+0000 7f7248d26640 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d3c340 0x55b6c5d28e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72437fe640 1 -- 172.21.15.159:0/3861061244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d194a0 msgr2=0x55b6c5d283f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72437fe640 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d194a0 0x55b6c5d283f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72437fe640 1 -- 172.21.15.159:0/3861061244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d3c340 msgr2=0x55b6c5d28e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72437fe640 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d3c340 0x55b6c5d28e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72437fe640 1 -- 172.21.15.159:0/3861061244 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c5d9de50 con 0x55b6c5d24680 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f7248d26640 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d3c340 0x55b6c5d28e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f7243fff640 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d194a0 0x55b6c5d283f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72437fe640 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d24680 0x55b6c5d28930 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7238023950 tx=0x7f7238023e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9975565c671eb531 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72237fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72237fe640 1 -- 172.21.15.159:0/3861061244 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72380117b0 con 0x55b6c5d24680 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72237fe640 1 -- 172.21.15.159:0/3861061244 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f72380233e0 con 0x55b6c5d24680 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f724cb62740 1 -- 172.21.15.159:0/3861061244 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7234005510 con 0x55b6c5d24680 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72237fe640 1 -- 172.21.15.159:0/3861061244 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7238035050 con 0x55b6c5d24680 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f724cb62740 10 client.16578 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f724cb62740 1 -- 172.21.15.159:0/3861061244 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b6c5d9f140 con 0x55b6c5d24680 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.258+0000 7f72237fe640 1 -- 172.21.15.159:0/3861061244 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7234005510 con 0x55b6c5d24680 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f72237fe640 1 -- 172.21.15.159:0/3861061244 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f723802c070 con 0x55b6c5d24680 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f724cb62740 10 client.16578 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:04.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f724cb62740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f724cb62740 20 client.16578 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f724cb62740 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b6c5d9f860 0x55b6c5da1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f724cb62740 4 client.16578 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f724cb62740 1 -- 172.21.15.159:0/3861061244 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b6c5c86d60 con 0x55b6c5d9f860 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f7243fff640 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b6c5d9f860 0x55b6c5da1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f7243fff640 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b6c5d9f860 0x55b6c5da1c80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af6968c7a51c76c server_cookie=63b686db39c6bad4 in_seq=0 out_seq=0 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.259+0000 7f72237fe640 10 client.16578 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f72237fe640 1 -- 172.21.15.159:0/3861061244 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b6c5c86d60 con 0x55b6c5d9f860 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f72237fe640 10 client.16578 handle_command_reply: tid=0 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 client.16578 shutdown 2024-09-19T06:52:04.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 -- 172.21.15.159:0/3861061244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d24680 msgr2=0x55b6c5d28930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:04.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d24680 0x55b6c5d28930 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7238023950 tx=0x7f7238023e50 comp rx=0 tx=0).stop 2024-09-19T06:52:04.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 -- 172.21.15.159:0/3861061244 shutdown_connections 2024-09-19T06:52:04.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b6c5d9f860 0x55b6c5da1c80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6c5d3c340 0x55b6c5d28e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b6c5d24680 0x55b6c5d28930 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 --2- 172.21.15.159:0/3861061244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6c5d194a0 0x55b6c5d283f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f72237fe640 0 client.16578 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:04.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 -- 172.21.15.159:0/3861061244 >> 172.21.15.159:0/3861061244 conn(0x55b6c5d15a30 msgr2=0x55b6c5d1fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:04.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 -- 172.21.15.159:0/3861061244 shutdown_connections 2024-09-19T06:52:04.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 1 -- 172.21.15.159:0/3861061244 wait complete. 2024-09-19T06:52:04.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.260+0000 7f724cb62740 20 client.16578 trim_cache size 0 max 16384 2024-09-19T06:52:04.268 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:52:04.268 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:52:04.268 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:52:04.268 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:52:04.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 -- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f722c0a33b0 msgr2=0x7f722c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:04.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f722c0a33b0 0x7f722c0a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7234005ab0 tx=0x7f7234005a20 comp rx=0 tx=0).stop 2024-09-19T06:52:04.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 -- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244106f10 msgr2=0x7f724419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:04.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244106f10 0x7f724419cda0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f723c00cad0 tx=0x7f723c00cf90 comp rx=0 tx=0).stop 2024-09-19T06:52:04.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 -- 172.21.15.159:0/3495973238 shutdown_connections 2024-09-19T06:52:04.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f722c0a33b0 0x7f722c0a5870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7244106f10 0x7f724419cda0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7244102790 0x7f7244198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 --2- 172.21.15.159:0/3495973238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7244101de0 0x7f72441984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:04.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 -- 172.21.15.159:0/3495973238 >> 172.21.15.159:0/3495973238 conn(0x7f72440fd8e0 msgr2=0x7f72440fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:04.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 -- 172.21.15.159:0/3495973238 shutdown_connections 2024-09-19T06:52:04.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:04.261+0000 7f724a789640 1 -- 172.21.15.159:0/3495973238 wait complete. 2024-09-19T06:52:05.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:04 smithi203 ceph-mon[35473]: pgmap v157: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-09-19T06:52:05.116 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:04 smithi159 ceph-mon[30935]: pgmap v157: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-09-19T06:52:05.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:04 smithi189 ceph-mon[34880]: pgmap v157: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-09-19T06:52:05.144 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:52:05.144 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:52:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.385+0000 7f395f017640 1 -- 172.21.15.159:0/3477822334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3958103620 msgr2=0x7f395810bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.385+0000 7f395f017640 1 --2- 172.21.15.159:0/3477822334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3958103620 0x7f395810bb00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3944009900 tx=0x7f394402a410 comp rx=0 tx=0).stop 2024-09-19T06:52:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.385+0000 7f395f017640 1 -- 172.21.15.159:0/3477822334 shutdown_connections 2024-09-19T06:52:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.385+0000 7f395f017640 1 --2- 172.21.15.159:0/3477822334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f395810c120 0x7f395810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.385+0000 7f395f017640 1 --2- 172.21.15.159:0/3477822334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3958103620 0x7f395810bb00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.385+0000 7f395f017640 1 --2- 172.21.15.159:0/3477822334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3958102d00 0x7f39581030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.385+0000 7f395f017640 1 -- 172.21.15.159:0/3477822334 >> 172.21.15.159:0/3477822334 conn(0x7f39580fc6b0 msgr2=0x7f39580fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.385+0000 7f395f017640 1 -- 172.21.15.159:0/3477822334 shutdown_connections 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.385+0000 7f395f017640 1 -- 172.21.15.159:0/3477822334 wait complete. 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395f017640 1 Processor -- start 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395f017640 1 -- start start 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395f017640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3958102d00 0x7f3958100950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395f017640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3958103620 0x7f3958100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395f017640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f395810c120 0x7f39581013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395f017640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3958111eb0 con 0x7f395810c120 2024-09-19T06:52:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395f017640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3958111d30 con 0x7f3958103620 2024-09-19T06:52:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395f017640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3958112030 con 0x7f3958102d00 2024-09-19T06:52:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395d5b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f395810c120 0x7f39581013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395d5b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f395810c120 0x7f39581013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53906/0 (socket says 172.21.15.159:53906) 2024-09-19T06:52:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395d5b4640 1 -- 172.21.15.159:0/3571478422 learned_addr learned my addr 172.21.15.159:0/3571478422 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f3957fff640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3958103620 0x7f3958100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.386+0000 7f395cdb3640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3958102d00 0x7f3958100950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f395d5b4640 1 -- 172.21.15.159:0/3571478422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3958102d00 msgr2=0x7f3958100950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f395d5b4640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3958102d00 0x7f3958100950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f395d5b4640 1 -- 172.21.15.159:0/3571478422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3958103620 msgr2=0x7f3958100e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f395d5b4640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3958103620 0x7f3958100e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f395d5b4640 1 -- 172.21.15.159:0/3571478422 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39581a6860 con 0x7f395810c120 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f395cdb3640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3958102d00 0x7f3958100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f395d5b4640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f395810c120 0x7f39581013d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f395000eaa0 tx=0x7f395000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f3955ffb640 1 -- 172.21.15.159:0/3571478422 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395000cdb0 con 0x7f395810c120 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f395f017640 1 -- 172.21.15.159:0/3571478422 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39581a6b50 con 0x7f395810c120 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f3955ffb640 1 -- 172.21.15.159:0/3571478422 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3950005020 con 0x7f395810c120 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f3955ffb640 1 -- 172.21.15.159:0/3571478422 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395001f060 con 0x7f395810c120 2024-09-19T06:52:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.387+0000 7f395f017640 1 -- 172.21.15.159:0/3571478422 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39581a7070 con 0x7f395810c120 2024-09-19T06:52:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3955ffb640 1 -- 172.21.15.159:0/3571478422 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f39500054d0 con 0x7f395810c120 2024-09-19T06:52:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3961e89740 1 Processor -- start 2024-09-19T06:52:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3961e89740 1 -- start start 2024-09-19T06:52:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3961e89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa29ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3961e89740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa34770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3961e89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 0x55d07fa370a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3961e89740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d07f98e2f0 con 0x55d07fa2a410 2024-09-19T06:52:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3961e89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d07f936270 con 0x55d07fa29af0 2024-09-19T06:52:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3961e89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d07f98a2b0 con 0x55d07fa34cb0 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.390+0000 7f3955ffb640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39480a3460 0x7f39480a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f395cdb3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa34770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3957fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa29ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f395cdb3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa34770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53910/0 (socket says 172.21.15.159:53910) 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f395cdb3640 1 -- 172.21.15.159:0/1129912324 learned_addr learned my addr 172.21.15.159:0/1129912324 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3955ffb640 1 -- 172.21.15.159:0/3571478422 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f39500cff00 con 0x7f395810c120 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f395d5b4640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39480a3460 0x7f39480a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3957fff640 1 --2- 172.21.15.159:0/1129912324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 0x55d07fa370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3957fff640 1 -- 172.21.15.159:0/1129912324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 msgr2=0x55d07fa370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3957fff640 1 --2- 172.21.15.159:0/1129912324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 0x55d07fa370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3957fff640 1 -- 172.21.15.159:0/1129912324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 msgr2=0x55d07fa34770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3957fff640 1 --2- 172.21.15.159:0/1129912324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa34770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3957fff640 1 -- 172.21.15.159:0/1129912324 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07f935340 con 0x55d07fa29af0 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f395cdb3640 1 --2- 172.21.15.159:0/1129912324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa34770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f395d5b4640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39480a3460 0x7f39480a5920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f395000efd0 tx=0x7f39500bc040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3957fff640 1 --2- 172.21.15.159:0/1129912324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa29ed0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3944005940 tx=0x7f39440314e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67dd82fc601148a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3942ffd640 1 -- 172.21.15.159:0/1129912324 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944044070 con 0x55d07fa29af0 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3942ffd640 1 -- 172.21.15.159:0/1129912324 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39440318f0 con 0x55d07fa29af0 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.391+0000 7f3942ffd640 1 -- 172.21.15.159:0/1129912324 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944035030 con 0x55d07fa29af0 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.392+0000 7f3961e89740 1 -- 172.21.15.159:0/1129912324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 msgr2=0x55d07fa29ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.392+0000 7f3961e89740 1 --2- 172.21.15.159:0/1129912324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa29ed0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3944005940 tx=0x7f39440314e0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.392+0000 7f3961e89740 1 -- 172.21.15.159:0/1129912324 shutdown_connections 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.392+0000 7f3961e89740 1 --2- 172.21.15.159:0/1129912324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 0x55d07fa370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.392+0000 7f3961e89740 1 --2- 172.21.15.159:0/1129912324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa34770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.392+0000 7f3961e89740 1 --2- 172.21.15.159:0/1129912324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa29ed0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.392+0000 7f3961e89740 1 -- 172.21.15.159:0/1129912324 >> 172.21.15.159:0/1129912324 conn(0x55d07fa26060 msgr2=0x55d07fa26440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.392+0000 7f3961e89740 1 -- 172.21.15.159:0/1129912324 shutdown_connections 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.392+0000 7f3961e89740 1 -- 172.21.15.159:0/1129912324 wait complete. 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3961e89740 1 -- start start 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3961e89740 1 Processor -- start 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3961e89740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa29af0 0x55d07fa31b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3961e89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 0x55d07fa320b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3961e89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa34cb0 0x55d07fa325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3961e89740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d07fa37880 con 0x55d07fa29af0 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3961e89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d07f917290 con 0x55d07fa34cb0 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3961e89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d07fa37a00 con 0x55d07fa2a410 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3961e89740 10 client.0 _ll_register_callbacks cb 0x55d07f948140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3957fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa29af0 0x55d07fa31b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3957fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa29af0 0x55d07fa31b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53924/0 (socket says 172.21.15.159:53924) 2024-09-19T06:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3957fff640 1 -- 172.21.15.159:0/2813009011 learned_addr learned my addr 172.21.15.159:0/2813009011 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.393+0000 7f3957fff640 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa34cb0 0x55d07fa325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f395cdb3640 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 0x55d07fa320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3957fff640 1 -- 172.21.15.159:0/2813009011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 msgr2=0x55d07fa320b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3957fff640 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 0x55d07fa320b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3957fff640 1 -- 172.21.15.159:0/2813009011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa34cb0 msgr2=0x55d07fa325f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3957fff640 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa34cb0 0x55d07fa325f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3957fff640 1 -- 172.21.15.159:0/2813009011 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d07f6a1210 con 0x55d07fa29af0 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3957fff640 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa29af0 0x55d07fa31b70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3944032dd0 tx=0x7f3944031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7994718e1b31155 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3937fff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3937fff640 1 -- 172.21.15.159:0/2813009011 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944054060 con 0x55d07fa29af0 2024-09-19T06:52:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3961e89740 1 -- 172.21.15.159:0/2813009011 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39440318f0 con 0x55d07fa29af0 2024-09-19T06:52:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3937fff640 1 -- 172.21.15.159:0/2813009011 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f3944004230 con 0x55d07fa29af0 2024-09-19T06:52:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3937fff640 1 -- 172.21.15.159:0/2813009011 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3944035070 con 0x55d07fa29af0 2024-09-19T06:52:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3961e89740 10 client.16590 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3961e89740 1 -- 172.21.15.159:0/2813009011 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d07f76d620 con 0x55d07fa29af0 2024-09-19T06:52:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.394+0000 7f3937fff640 1 -- 172.21.15.159:0/2813009011 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39440318f0 con 0x55d07fa29af0 2024-09-19T06:52:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.395+0000 7f3937fff640 1 -- 172.21.15.159:0/2813009011 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f39440035f0 con 0x55d07fa29af0 2024-09-19T06:52:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.395+0000 7f3961e89740 10 client.16590 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.395+0000 7f3961e89740 10 client.16590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.395+0000 7f3961e89740 20 client.16590 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.395+0000 7f3961e89740 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d07fa44a60 0x55d07fa46e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.395+0000 7f3961e89740 4 client.16590 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.395+0000 7f3961e89740 1 -- 172.21.15.159:0/2813009011 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d07f99ba20 con 0x55d07fa44a60 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.395+0000 7f395cdb3640 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d07fa44a60 0x55d07fa46e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.396+0000 7f3937fff640 10 client.16590 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.396+0000 7f395cdb3640 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d07fa44a60 0x55d07fa46e50 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7cc1c8f13a13ea6 server_cookie=ac039e7e1329080e in_seq=0 out_seq=0 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.396+0000 7f3937fff640 1 -- 172.21.15.159:0/2813009011 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d07f99ba20 con 0x55d07fa44a60 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3937fff640 10 client.16590 handle_command_reply: tid=0 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 client.16590 shutdown 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 -- 172.21.15.159:0/2813009011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa29af0 msgr2=0x55d07fa31b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa29af0 0x55d07fa31b70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3944032dd0 tx=0x7f3944031400 comp rx=0 tx=0).stop 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 -- 172.21.15.159:0/2813009011 shutdown_connections 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d07fa44a60 0x55d07fa46e50 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa34cb0 0x55d07fa325f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 0x55d07fa320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 --2- 172.21.15.159:0/2813009011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa29af0 0x55d07fa31b70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 -- 172.21.15.159:0/2813009011 >> 172.21.15.159:0/2813009011 conn(0x55d07fa26060 msgr2=0x55d07fa2bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3937fff640 0 client.16590 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 -- 172.21.15.159:0/2813009011 shutdown_connections 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 1 -- 172.21.15.159:0/2813009011 wait complete. 2024-09-19T06:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.397+0000 7f3961e89740 20 client.16590 trim_cache size 0 max 16384 2024-09-19T06:52:05.407 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.412+0000 7f3961e89740 1 Processor -- start 2024-09-19T06:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.412+0000 7f3961e89740 1 -- start start 2024-09-19T06:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3961e89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa32420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3961e89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 0x55d07fa403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3961e89740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa34cb0 0x55d07fa2edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3961e89740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f39581ada00 con 0x55d07fa34cb0 2024-09-19T06:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3961e89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39581b0280 con 0x55d07fa29af0 2024-09-19T06:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3961e89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39581ae070 con 0x55d07fa2a410 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa34cb0 0x55d07fa2edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa34cb0 0x55d07fa2edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53928/0 (socket says 172.21.15.159:53928) 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 -- 172.21.15.159:0/1203782353 learned_addr learned my addr 172.21.15.159:0/1203782353 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 --2- 172.21.15.159:0/1203782353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa32420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f395cdb3640 1 --2- 172.21.15.159:0/1203782353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 0x55d07fa403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 -- 172.21.15.159:0/1203782353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 msgr2=0x55d07fa403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 --2- 172.21.15.159:0/1203782353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 0x55d07fa403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 -- 172.21.15.159:0/1203782353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 msgr2=0x55d07fa32420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 --2- 172.21.15.159:0/1203782353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa32420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 -- 172.21.15.159:0/1203782353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07fa2ac90 con 0x55d07fa34cb0 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.413+0000 7f3957fff640 1 --2- 172.21.15.159:0/1203782353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa34cb0 0x55d07fa2edd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3944009900 tx=0x7f394403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a0ba64d7d8ea86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f39427fc640 1 -- 172.21.15.159:0/1203782353 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944054070 con 0x55d07fa34cb0 2024-09-19T06:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f39427fc640 1 -- 172.21.15.159:0/1203782353 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f394404d020 con 0x55d07fa34cb0 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f39427fc640 1 -- 172.21.15.159:0/1203782353 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944044040 con 0x55d07fa34cb0 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f3961e89740 1 -- 172.21.15.159:0/1203782353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa34cb0 msgr2=0x55d07fa2edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f3961e89740 1 --2- 172.21.15.159:0/1203782353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa34cb0 0x55d07fa2edd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3944009900 tx=0x7f394403f040 comp rx=0 tx=0).stop 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f3961e89740 1 -- 172.21.15.159:0/1203782353 shutdown_connections 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f3961e89740 1 --2- 172.21.15.159:0/1203782353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa34cb0 0x55d07fa2edd0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f3961e89740 1 --2- 172.21.15.159:0/1203782353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa2a410 0x55d07fa403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f3961e89740 1 --2- 172.21.15.159:0/1203782353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa32420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f3961e89740 1 -- 172.21.15.159:0/1203782353 >> 172.21.15.159:0/1203782353 conn(0x55d07fa26060 msgr2=0x55d07fa3fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f3961e89740 1 -- 172.21.15.159:0/1203782353 shutdown_connections 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.414+0000 7f3961e89740 1 -- 172.21.15.159:0/1203782353 wait complete. 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3961e89740 1 -- start start 2024-09-19T06:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3961e89740 1 Processor -- start 2024-09-19T06:52:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3961e89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa4a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3961e89740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa47a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3961e89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 0x55d07fa480f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3961e89740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f39581ae740 con 0x55d07fa2a410 2024-09-19T06:52:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3961e89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39581afbb0 con 0x55d07fa29af0 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3961e89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39581aee10 con 0x55d07fa34cb0 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3961e89740 10 client.0 _ll_register_callbacks cb 0x7f394c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f395cdb3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa47a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f395cdb3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa47a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53936/0 (socket says 172.21.15.159:53936) 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f395cdb3640 1 -- 172.21.15.159:0/1561986434 learned_addr learned my addr 172.21.15.159:0/1561986434 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3957fff640 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 0x55d07fa480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.415+0000 7f3957fff640 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa4a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f395cdb3640 1 -- 172.21.15.159:0/1561986434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 msgr2=0x55d07fa480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f395cdb3640 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 0x55d07fa480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f395cdb3640 1 -- 172.21.15.159:0/1561986434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 msgr2=0x55d07fa4a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f395cdb3640 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa4a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f395cdb3640 1 -- 172.21.15.159:0/1561986434 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d07faae3a0 con 0x55d07fa2a410 2024-09-19T06:52:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f395cdb3640 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa47a90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f394c004700 tx=0x7f394c009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff42a89ee5bbbfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f3937fff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f3937fff640 1 -- 172.21.15.159:0/1561986434 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c01e410 con 0x55d07fa2a410 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f3937fff640 1 -- 172.21.15.159:0/1561986434 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f394c01e5b0 con 0x55d07fa2a410 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f3961e89740 1 -- 172.21.15.159:0/1561986434 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f394404d020 con 0x55d07fa2a410 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f3937fff640 1 -- 172.21.15.159:0/1561986434 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f394c01e7b0 con 0x55d07fa2a410 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f3961e89740 10 client.16596 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.416+0000 7f3961e89740 1 -- 172.21.15.159:0/1561986434 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d07faaf560 con 0x55d07fa2a410 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.417+0000 7f3937fff640 1 -- 172.21.15.159:0/1561986434 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f394404d020 con 0x55d07fa2a410 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.417+0000 7f3937fff640 1 -- 172.21.15.159:0/1561986434 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f394c026400 con 0x55d07fa2a410 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.417+0000 7f3961e89740 10 client.16596 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.417+0000 7f3961e89740 10 client.16596 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.417+0000 7f3961e89740 20 client.16596 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.417+0000 7f3961e89740 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d07faafcc0 0x55d07fab20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.417+0000 7f3961e89740 4 client.16596 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:52:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.417+0000 7f3961e89740 1 -- 172.21.15.159:0/1561986434 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d07f995d70 con 0x55d07faafcc0 2024-09-19T06:52:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.417+0000 7f3957fff640 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d07faafcc0 0x55d07fab20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.418+0000 7f3957fff640 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d07faafcc0 0x55d07fab20e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c143c56d0ba12f3d server_cookie=119b7d3828062de6 in_seq=0 out_seq=0 2024-09-19T06:52:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.418+0000 7f3937fff640 10 client.16596 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3937fff640 1 -- 172.21.15.159:0/1561986434 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d07f995d70 con 0x55d07faafcc0 2024-09-19T06:52:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3937fff640 10 client.16596 handle_command_reply: tid=0 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 client.16596 shutdown 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 -- 172.21.15.159:0/1561986434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 msgr2=0x55d07fa47a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa47a90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f394c004700 tx=0x7f394c009f10 comp rx=0 tx=0).stop 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 -- 172.21.15.159:0/1561986434 shutdown_connections 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d07faafcc0 0x55d07fab20e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d07fa34cb0 0x55d07fa480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3937fff640 0 client.16596 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d07fa2a410 0x55d07fa47a90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 --2- 172.21.15.159:0/1561986434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07fa29af0 0x55d07fa4a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 -- 172.21.15.159:0/1561986434 >> 172.21.15.159:0/1561986434 conn(0x55d07fa26060 msgr2=0x55d07fa404b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 -- 172.21.15.159:0/1561986434 shutdown_connections 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 1 -- 172.21.15.159:0/1561986434 wait complete. 2024-09-19T06:52:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.427+0000 7f3961e89740 20 client.16596 trim_cache size 0 max 16384 2024-09-19T06:52:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:52:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:52:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:52:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 -- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39480a3460 msgr2=0x7f39480a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39480a3460 0x7f39480a5920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f395000efd0 tx=0x7f39500bc040 comp rx=0 tx=0).stop 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 -- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f395810c120 msgr2=0x7f39581013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f395810c120 0x7f39581013d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f395000eaa0 tx=0x7f395000ef60 comp rx=0 tx=0).stop 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 -- 172.21.15.159:0/3571478422 shutdown_connections 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39480a3460 0x7f39480a5920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f395810c120 0x7f39581013d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3958103620 0x7f3958100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 --2- 172.21.15.159:0/3571478422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3958102d00 0x7f3958100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 -- 172.21.15.159:0/3571478422 >> 172.21.15.159:0/3571478422 conn(0x7f39580fc6b0 msgr2=0x7f39580fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 -- 172.21.15.159:0/3571478422 shutdown_connections 2024-09-19T06:52:05.432 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:05.428+0000 7f395f017640 1 -- 172.21.15.159:0/3571478422 wait complete. 2024-09-19T06:52:05.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.949+0000 7f387fed5640 1 -- 172.21.15.159:0/4294958708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878100b30 msgr2=0x7f3878100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.949+0000 7f387fed5640 1 --2- 172.21.15.159:0/4294958708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878100b30 0x7f3878100f10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3870009900 tx=0x7f387002a470 comp rx=0 tx=0).stop 2024-09-19T06:52:05.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.949+0000 7f387fed5640 1 -- 172.21.15.159:0/4294958708 shutdown_connections 2024-09-19T06:52:05.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.949+0000 7f387fed5640 1 --2- 172.21.15.159:0/4294958708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3878105f40 0x7f38781063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.949+0000 7f387fed5640 1 --2- 172.21.15.159:0/4294958708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878101450 0x7f3878105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.949+0000 7f387fed5640 1 --2- 172.21.15.159:0/4294958708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878100b30 0x7f3878100f10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.949+0000 7f387fed5640 1 -- 172.21.15.159:0/4294958708 >> 172.21.15.159:0/4294958708 conn(0x7f38780fc7a0 msgr2=0x7f38780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.949+0000 7f387fed5640 1 -- 172.21.15.159:0/4294958708 shutdown_connections 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.949+0000 7f387fed5640 1 -- 172.21.15.159:0/4294958708 wait complete. 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387fed5640 1 Processor -- start 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387fed5640 1 -- start start 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387fed5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3878100b30 0x7f38781a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387fed5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878101450 0x7f38781a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387fed5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878105f40 0x7f387819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387fed5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f38781185c0 con 0x7f3878105f40 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387fed5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3878118440 con 0x7f3878101450 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387fed5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3878118740 con 0x7f3878100b30 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387e472640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878105f40 0x7f387819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387e472640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878105f40 0x7f387819e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53954/0 (socket says 172.21.15.159:53954) 2024-09-19T06:52:05.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387e472640 1 -- 172.21.15.159:0/607777559 learned_addr learned my addr 172.21.15.159:0/607777559 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387dc71640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3878100b30 0x7f38781a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.950+0000 7f387d470640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878101450 0x7f38781a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f387e472640 1 -- 172.21.15.159:0/607777559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3878100b30 msgr2=0x7f38781a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f387e472640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3878100b30 0x7f38781a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f387e472640 1 -- 172.21.15.159:0/607777559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878101450 msgr2=0x7f38781a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f387e472640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878101450 0x7f38781a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f387e472640 1 -- 172.21.15.159:0/607777559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387819f000 con 0x7f3878105f40 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f387e472640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878105f40 0x7f387819e8d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f386800cce0 tx=0x7f386800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f3876ffd640 1 -- 172.21.15.159:0/607777559 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386800f450 con 0x7f3878105f40 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f3876ffd640 1 -- 172.21.15.159:0/607777559 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f386800fad0 con 0x7f3878105f40 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387819f2f0 con 0x7f3878105f40 2024-09-19T06:52:05.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f3876ffd640 1 -- 172.21.15.159:0/607777559 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868018c10 con 0x7f3878105f40 2024-09-19T06:52:05.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.951+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38781ab5e0 con 0x7f3878105f40 2024-09-19T06:52:05.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.952+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3878105920 con 0x7f3878105f40 2024-09-19T06:52:05.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.953+0000 7f3876ffd640 1 -- 172.21.15.159:0/607777559 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f386800f5f0 con 0x7f3878105f40 2024-09-19T06:52:05.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.954+0000 7f3876ffd640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38600a33b0 0x7f38600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:05.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.954+0000 7f3876ffd640 1 -- 172.21.15.159:0/607777559 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f38680d03f0 con 0x7f3878105f40 2024-09-19T06:52:05.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.954+0000 7f387dc71640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38600a33b0 0x7f38600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:05.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.954+0000 7f387dc71640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38600a33b0 0x7f38600a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3870009230 tx=0x7f38700058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:05.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:05.957+0000 7f3876ffd640 1 -- 172.21.15.159:0/607777559 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3868014030 con 0x7f3878105f40 2024-09-19T06:52:06.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.160+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f387819fe00 con 0x7f3878105f40 2024-09-19T06:52:06.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.160+0000 7f3876ffd640 1 -- 172.21.15.159:0/607777559 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f386809ce30 con 0x7f3878105f40 2024-09-19T06:52:06.162 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:52:06.162 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:52:06.162 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:52:06.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38600a33b0 msgr2=0x7f38600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:06.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38600a33b0 0x7f38600a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3870009230 tx=0x7f38700058d0 comp rx=0 tx=0).stop 2024-09-19T06:52:06.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878105f40 msgr2=0x7f387819e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:06.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878105f40 0x7f387819e8d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f386800cce0 tx=0x7f386800a620 comp rx=0 tx=0).stop 2024-09-19T06:52:06.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 shutdown_connections 2024-09-19T06:52:06.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f38600a33b0 0x7f38600a5870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:06.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3878105f40 0x7f387819e8d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:06.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3878101450 0x7f38781a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:06.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 --2- 172.21.15.159:0/607777559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3878100b30 0x7f38781a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:06.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 >> 172.21.15.159:0/607777559 conn(0x7f38780fc7a0 msgr2=0x7f38781038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:06.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 shutdown_connections 2024-09-19T06:52:06.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:06.163+0000 7f387fed5640 1 -- 172.21.15.159:0/607777559 wait complete. 2024-09-19T06:52:06.474 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:06 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/607777559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:06.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:06 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/607777559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:06.637 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:06 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/607777559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:06.897 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:52:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:07.522 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:07 smithi159 ceph-mon[30935]: pgmap v158: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-09-19T06:52:07.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:07 smithi203 ceph-mon[35473]: pgmap v158: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-09-19T06:52:07.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.602+0000 7f792348b640 1 -- 172.21.15.159:0/1490047397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c106f10 msgr2=0x7f791c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:07.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.602+0000 7f792348b640 1 --2- 172.21.15.159:0/1490047397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c106f10 0x7f791c10ea90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f790c009900 tx=0x7f790c02a410 comp rx=0 tx=0).stop 2024-09-19T06:52:07.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.602+0000 7f792348b640 1 -- 172.21.15.159:0/1490047397 shutdown_connections 2024-09-19T06:52:07.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.602+0000 7f792348b640 1 --2- 172.21.15.159:0/1490047397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c106f10 0x7f791c10ea90 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.602+0000 7f792348b640 1 --2- 172.21.15.159:0/1490047397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f791c102790 0x7f791c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.602+0000 7f792348b640 1 --2- 172.21.15.159:0/1490047397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c101de0 0x7f791c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.602+0000 7f792348b640 1 -- 172.21.15.159:0/1490047397 >> 172.21.15.159:0/1490047397 conn(0x7f791c0fd8c0 msgr2=0x7f791c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:07.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.602+0000 7f792348b640 1 -- 172.21.15.159:0/1490047397 shutdown_connections 2024-09-19T06:52:07.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.602+0000 7f792348b640 1 -- 172.21.15.159:0/1490047397 wait complete. 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f792348b640 1 Processor -- start 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f792348b640 1 -- start start 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f792348b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c101de0 0x7f791c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f792348b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f791c102790 0x7f791c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f792348b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c106f10 0x7f791c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f792348b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f791c111f70 con 0x7f791c101de0 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f792348b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f791c111df0 con 0x7f791c106f10 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f792348b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f791c1120f0 con 0x7f791c102790 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f7921227640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c101de0 0x7f791c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.603+0000 7f7921227640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c101de0 0x7f791c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53966/0 (socket says 172.21.15.159:53966) 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f7921227640 1 -- 172.21.15.159:0/2018639717 learned_addr learned my addr 172.21.15.159:0/2018639717 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:07.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f7921a28640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c106f10 0x7f791c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f7920a26640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f791c102790 0x7f791c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f7921227640 1 -- 172.21.15.159:0/2018639717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f791c102790 msgr2=0x7f791c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f7921227640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f791c102790 0x7f791c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f7921227640 1 -- 172.21.15.159:0/2018639717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c106f10 msgr2=0x7f791c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f7921227640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c106f10 0x7f791c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f7921227640 1 -- 172.21.15.159:0/2018639717 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c19d3a0 con 0x7f791c101de0 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f7921227640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c101de0 0x7f791c1983f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f791400d950 tx=0x7f791400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f791a7fc640 1 -- 172.21.15.159:0/2018639717 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914017070 con 0x7f791c101de0 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f791a7fc640 1 -- 172.21.15.159:0/2018639717 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7914009c30 con 0x7f791c101de0 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f792348b640 1 -- 172.21.15.159:0/2018639717 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791c19d690 con 0x7f791c101de0 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f791a7fc640 1 -- 172.21.15.159:0/2018639717 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791400f6b0 con 0x7f791c101de0 2024-09-19T06:52:07.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.604+0000 7f792348b640 1 -- 172.21.15.159:0/2018639717 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f791c1a4f70 con 0x7f791c101de0 2024-09-19T06:52:07.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f791a7fc640 1 -- 172.21.15.159:0/2018639717 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f79140109d0 con 0x7f791c101de0 2024-09-19T06:52:07.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7925864740 1 Processor -- start 2024-09-19T06:52:07.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7925864740 1 -- start start 2024-09-19T06:52:07.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7925864740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de463090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7925864740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de463a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7925864740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de470760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7925864740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5571de3c92f0 con 0x5571de464b40 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7925864740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5571de370cf0 con 0x5571de46e370 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7925864740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5571de3c52b0 con 0x5571de4635d0 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7921a28640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de463090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7921a28640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de463090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53982/0 (socket says 172.21.15.159:53982) 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.607+0000 7f7921a28640 1 -- 172.21.15.159:0/510257280 learned_addr learned my addr 172.21.15.159:0/510257280 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f7921227640 1 --2- 172.21.15.159:0/510257280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de463a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f7920a26640 1 --2- 172.21.15.159:0/510257280 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de470760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f7921a28640 1 -- 172.21.15.159:0/510257280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 msgr2=0x5571de463a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f7921a28640 1 --2- 172.21.15.159:0/510257280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de463a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f7921a28640 1 -- 172.21.15.159:0/510257280 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 msgr2=0x5571de470760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:07.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f7921a28640 1 --2- 172.21.15.159:0/510257280 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de470760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f7921a28640 1 -- 172.21.15.159:0/510257280 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571de3553a0 con 0x5571de464b40 2024-09-19T06:52:07.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f791a7fc640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f79040a33b0 0x7f79040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f7921227640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f79040a33b0 0x7f79040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f7921a28640 1 --2- 172.21.15.159:0/510257280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de463090 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f790c009900 tx=0x7f790c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bd519de17e7a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:07.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f791a7fc640 1 -- 172.21.15.159:0/2018639717 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f79140cf8f0 con 0x7f791c101de0 2024-09-19T06:52:07.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f79037fe640 1 -- 172.21.15.159:0/510257280 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c040070 con 0x5571de464b40 2024-09-19T06:52:07.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f79037fe640 1 -- 172.21.15.159:0/510257280 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f790c031970 con 0x5571de464b40 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.608+0000 7f79037fe640 1 -- 172.21.15.159:0/510257280 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c035040 con 0x5571de464b40 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 -- 172.21.15.159:0/510257280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 msgr2=0x5571de463090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7921227640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f79040a33b0 0x7f79040a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79140cd0c0 tx=0x7f79140d54a0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 --2- 172.21.15.159:0/510257280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de463090 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f790c009900 tx=0x7f790c005e70 comp rx=0 tx=0).stop 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 -- 172.21.15.159:0/510257280 shutdown_connections 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 --2- 172.21.15.159:0/510257280 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de470760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 --2- 172.21.15.159:0/510257280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de463a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 --2- 172.21.15.159:0/510257280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de463090 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 -- 172.21.15.159:0/510257280 >> 172.21.15.159:0/510257280 conn(0x5571de42c310 msgr2=0x5571de45fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 -- 172.21.15.159:0/510257280 shutdown_connections 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 -- 172.21.15.159:0/510257280 wait complete. 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.609+0000 7f7925864740 1 -- start start 2024-09-19T06:52:07.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7925864740 1 Processor -- start 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7925864740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de4635d0 0x5571de46dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7925864740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de464b40 0x5571de46aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7925864740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de46b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7925864740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5571de471010 con 0x5571de4635d0 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7925864740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5571de384060 con 0x5571de46e370 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7925864740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5571de471190 con 0x5571de464b40 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7925864740 10 client.0 _ll_register_callbacks cb 0x5571de0d78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7921a28640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de4635d0 0x5571de46dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7921a28640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de4635d0 0x5571de46dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53996/0 (socket says 172.21.15.159:53996) 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7921a28640 1 -- 172.21.15.159:0/1982405192 learned_addr learned my addr 172.21.15.159:0/1982405192 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7921a28640 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de46b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7920a26640 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de464b40 0x5571de46aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7921a28640 1 -- 172.21.15.159:0/1982405192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de464b40 msgr2=0x5571de46aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:07.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7921a28640 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de464b40 0x5571de46aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7921a28640 1 -- 172.21.15.159:0/1982405192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 msgr2=0x5571de46b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7921a28640 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de46b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7921a28640 1 -- 172.21.15.159:0/1982405192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571de13a3c0 con 0x5571de4635d0 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.610+0000 7f7920a26640 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de464b40 0x5571de46aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7921a28640 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de4635d0 0x5571de46dcf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f790c004770 tx=0x7f790c0055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8b86b03043098b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7900ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7900ff9640 1 -- 172.21.15.159:0/1982405192 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c051060 con 0x5571de4635d0 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7900ff9640 1 -- 172.21.15.159:0/1982405192 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f790c004250 con 0x5571de4635d0 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7925864740 1 -- 172.21.15.159:0/1982405192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f790c031970 con 0x5571de4635d0 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7900ff9640 1 -- 172.21.15.159:0/1982405192 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f790c035040 con 0x5571de4635d0 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7925864740 10 client.16614 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7925864740 1 -- 172.21.15.159:0/1982405192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5571de47ca80 con 0x5571de4635d0 2024-09-19T06:52:07.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7900ff9640 1 -- 172.21.15.159:0/1982405192 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f790c031970 con 0x5571de4635d0 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7900ff9640 1 -- 172.21.15.159:0/1982405192 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f790c003860 con 0x5571de4635d0 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7925864740 10 client.16614 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7925864740 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7925864740 20 client.16614 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7925864740 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5571de47ddd0 0x5571de4801c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7925864740 4 client.16614 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.611+0000 7f7925864740 1 -- 172.21.15.159:0/1982405192 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571de3d6860 con 0x5571de47ddd0 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.612+0000 7f7920a26640 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5571de47ddd0 0x5571de4801c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.612+0000 7f7920a26640 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5571de47ddd0 0x5571de4801c0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fbfab6a6220c728 server_cookie=25a07ce1804c2794 in_seq=0 out_seq=0 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.612+0000 7f7900ff9640 10 client.16614 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7900ff9640 1 -- 172.21.15.159:0/1982405192 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571de3d6860 con 0x5571de47ddd0 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7900ff9640 10 client.16614 handle_command_reply: tid=0 2024-09-19T06:52:07.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 client.16614 shutdown 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 -- 172.21.15.159:0/1982405192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de4635d0 msgr2=0x5571de46dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de4635d0 0x5571de46dcf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f790c004770 tx=0x7f790c0055c0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 -- 172.21.15.159:0/1982405192 shutdown_connections 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5571de47ddd0 0x5571de4801c0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de46b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de464b40 0x5571de46aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 --2- 172.21.15.159:0/1982405192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de4635d0 0x5571de46dcf0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7900ff9640 0 client.16614 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 -- 172.21.15.159:0/1982405192 >> 172.21.15.159:0/1982405192 conn(0x5571de42c310 msgr2=0x5571de465960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 -- 172.21.15.159:0/1982405192 shutdown_connections 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 1 -- 172.21.15.159:0/1982405192 wait complete. 2024-09-19T06:52:07.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.613+0000 7f7925864740 20 client.16614 trim_cache size 0 max 16384 2024-09-19T06:52:07.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7925864740 1 Processor -- start 2024-09-19T06:52:07.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7925864740 1 -- start start 2024-09-19T06:52:07.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7925864740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de466120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7925864740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de466660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7925864740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de4857c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7925864740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f791c1ab800 con 0x5571de464b40 2024-09-19T06:52:07.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7925864740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f791c1ae080 con 0x5571de46e370 2024-09-19T06:52:07.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7925864740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f791c1abe70 con 0x5571de4635d0 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7920a26640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de466660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7920a26640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de466660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54012/0 (socket says 172.21.15.159:54012) 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7920a26640 1 -- 172.21.15.159:0/1144672035 learned_addr learned my addr 172.21.15.159:0/1144672035 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7921a28640 1 --2- 172.21.15.159:0/1144672035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de466120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7920a26640 1 -- 172.21.15.159:0/1144672035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 msgr2=0x5571de466120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7920a26640 1 --2- 172.21.15.159:0/1144672035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de466120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7920a26640 1 -- 172.21.15.159:0/1144672035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 msgr2=0x5571de4857c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7920a26640 1 --2- 172.21.15.159:0/1144672035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de4857c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.626+0000 7f7920a26640 1 -- 172.21.15.159:0/1144672035 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571de471160 con 0x5571de464b40 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7920a26640 1 --2- 172.21.15.159:0/1144672035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de466660 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x5571de464070 tx=0x7f7910009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebea8a453693dd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7902ffd640 1 -- 172.21.15.159:0/1144672035 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910003b70 con 0x5571de464b40 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7902ffd640 1 -- 172.21.15.159:0/1144672035 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7910010de0 con 0x5571de464b40 2024-09-19T06:52:07.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7902ffd640 1 -- 172.21.15.159:0/1144672035 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791001d3f0 con 0x5571de464b40 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7925864740 1 -- 172.21.15.159:0/1144672035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 msgr2=0x5571de466660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7925864740 1 --2- 172.21.15.159:0/1144672035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de466660 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x5571de464070 tx=0x7f7910009760 comp rx=0 tx=0).stop 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7925864740 1 -- 172.21.15.159:0/1144672035 shutdown_connections 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7925864740 1 --2- 172.21.15.159:0/1144672035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de4857c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7925864740 1 --2- 172.21.15.159:0/1144672035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de466660 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7925864740 1 --2- 172.21.15.159:0/1144672035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de466120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.627+0000 7f7925864740 1 -- 172.21.15.159:0/1144672035 >> 172.21.15.159:0/1144672035 conn(0x5571de42c310 msgr2=0x5571de45ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 -- 172.21.15.159:0/1144672035 shutdown_connections 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 -- 172.21.15.159:0/1144672035 wait complete. 2024-09-19T06:52:07.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 -- start start 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 Processor -- start 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de476600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de476b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de4733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f791c1ac540 con 0x5571de464b40 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f791c1ad9b0 con 0x5571de46e370 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f791c1acc10 con 0x5571de4635d0 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7925864740 10 client.0 _ll_register_callbacks cb 0x7f7910009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7920a26640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de476b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7920a26640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de476b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54026/0 (socket says 172.21.15.159:54026) 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.628+0000 7f7920a26640 1 -- 172.21.15.159:0/2749181557 learned_addr learned my addr 172.21.15.159:0/2749181557 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7921a28640 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de476600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7921a28640 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de4733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7920a26640 1 -- 172.21.15.159:0/2749181557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 msgr2=0x5571de476600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7920a26640 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de476600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7920a26640 1 -- 172.21.15.159:0/2749181557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 msgr2=0x5571de4733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7920a26640 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de4733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7920a26640 1 -- 172.21.15.159:0/2749181557 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571de473bf0 con 0x5571de464b40 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7920a26640 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de476b40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f79100095d0 tx=0x7f7910009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a8c1e8aa05c25d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7900ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7900ff9640 1 -- 172.21.15.159:0/2749181557 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910010900 con 0x5571de464b40 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7900ff9640 1 -- 172.21.15.159:0/2749181557 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f7910010aa0 con 0x5571de464b40 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7925864740 1 -- 172.21.15.159:0/2749181557 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7910010de0 con 0x5571de464b40 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7900ff9640 1 -- 172.21.15.159:0/2749181557 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7910004ab0 con 0x5571de464b40 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7925864740 10 client.16620 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.629+0000 7f7925864740 1 -- 172.21.15.159:0/2749181557 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5571de4e9270 con 0x5571de464b40 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7900ff9640 1 -- 172.21.15.159:0/2749181557 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7910010de0 con 0x5571de464b40 2024-09-19T06:52:07.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7900ff9640 1 -- 172.21.15.159:0/2749181557 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f7910005030 con 0x5571de464b40 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7925864740 10 client.16620 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7925864740 10 client.16620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7925864740 20 client.16620 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7925864740 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5571de4e9940 0x5571de4ebd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7925864740 4 client.16620 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7925864740 1 -- 172.21.15.159:0/2749181557 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5571de3d0d70 con 0x5571de4e9940 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7921a28640 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5571de4e9940 0x5571de4ebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7921a28640 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5571de4e9940 0x5571de4ebd60 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc7061901a6c45d1 server_cookie=8b49e5e6140380e7 in_seq=0 out_seq=0 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.630+0000 7f7900ff9640 10 client.16620 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7900ff9640 1 -- 172.21.15.159:0/2749181557 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5571de3d0d70 con 0x5571de4e9940 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7900ff9640 10 client.16620 handle_command_reply: tid=0 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 client.16620 shutdown 2024-09-19T06:52:07.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 -- 172.21.15.159:0/2749181557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 msgr2=0x5571de476b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de476b40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f79100095d0 tx=0x7f7910009ee0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 -- 172.21.15.159:0/2749181557 shutdown_connections 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5571de4e9940 0x5571de4ebd60 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571de46e370 0x5571de4733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5571de464b40 0x5571de476b40 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 --2- 172.21.15.159:0/2749181557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5571de4635d0 0x5571de476600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 -- 172.21.15.159:0/2749181557 >> 172.21.15.159:0/2749181557 conn(0x5571de42c310 msgr2=0x5571de46c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7900ff9640 0 client.16620 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 -- 172.21.15.159:0/2749181557 shutdown_connections 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 1 -- 172.21.15.159:0/2749181557 wait complete. 2024-09-19T06:52:07.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.631+0000 7f7925864740 20 client.16620 trim_cache size 0 max 16384 2024-09-19T06:52:07.638 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:52:07.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 -- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f79040a33b0 msgr2=0x7f79040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f79040a33b0 0x7f79040a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79140cd0c0 tx=0x7f79140d54a0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 -- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c101de0 msgr2=0x7f791c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c101de0 0x7f791c1983f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f791400d950 tx=0x7f791400de10 comp rx=0 tx=0).stop 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 -- 172.21.15.159:0/2018639717 shutdown_connections 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f79040a33b0 0x7f79040a5870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f791c106f10 0x7f791c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f791c102790 0x7f791c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 --2- 172.21.15.159:0/2018639717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f791c101de0 0x7f791c1983f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 -- 172.21.15.159:0/2018639717 >> 172.21.15.159:0/2018639717 conn(0x7f791c0fd8c0 msgr2=0x7f791c0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 -- 172.21.15.159:0/2018639717 shutdown_connections 2024-09-19T06:52:07.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:07.632+0000 7f792348b640 1 -- 172.21.15.159:0/2018639717 wait complete. 2024-09-19T06:52:07.640 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:07 smithi189 ceph-mon[34880]: pgmap v158: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-09-19T06:52:09.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:08 smithi203 ceph-mon[35473]: pgmap v159: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:52:09.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:08 smithi189 ceph-mon[34880]: pgmap v159: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:52:09.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:08 smithi159 ceph-mon[30935]: pgmap v159: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:52:09.493 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:52:09.494 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:52:09.753 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:10.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.255+0000 7fb223c79640 1 -- 172.21.15.159:0/761660783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 msgr2=0x7fb21c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.255+0000 7fb223c79640 1 --2- 172.21.15.159:0/761660783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 0x7fb21c10d950 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb214009cd0 tx=0x7fb21402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.255+0000 7fb223c79640 1 -- 172.21.15.159:0/761660783 shutdown_connections 2024-09-19T06:52:10.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.255+0000 7fb223c79640 1 --2- 172.21.15.159:0/761660783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 0x7fb21c10d950 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.255+0000 7fb223c79640 1 --2- 172.21.15.159:0/761660783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb21c100a80 0x7fb21c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.255+0000 7fb223c79640 1 --2- 172.21.15.159:0/761660783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb21c106a80 0x7fb21c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.255+0000 7fb223c79640 1 -- 172.21.15.159:0/761660783 >> 172.21.15.159:0/761660783 conn(0x7fb21c0fc7a0 msgr2=0x7fb21c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.255+0000 7fb223c79640 1 -- 172.21.15.159:0/761660783 shutdown_connections 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.255+0000 7fb223c79640 1 -- 172.21.15.159:0/761660783 wait complete. 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb223c79640 1 Processor -- start 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb223c79640 1 -- start start 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb223c79640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb21c100a80 0x7fb21c1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb223c79640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 0x7fb21c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb223c79640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb21c106a80 0x7fb21c19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb223c79640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c110ea0 con 0x7fb21c101420 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb223c79640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c110d20 con 0x7fb21c106a80 2024-09-19T06:52:10.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb223c79640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c111020 con 0x7fb21c100a80 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221214640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 0x7fb21c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221214640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 0x7fb21c1978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33336/0 (socket says 172.21.15.159:33336) 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221214640 1 -- 172.21.15.159:0/3458049949 learned_addr learned my addr 172.21.15.159:0/3458049949 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb222216640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb21c106a80 0x7fb21c19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221a15640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb21c100a80 0x7fb21c1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221214640 1 -- 172.21.15.159:0/3458049949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb21c100a80 msgr2=0x7fb21c1973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221214640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb21c100a80 0x7fb21c1973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221214640 1 -- 172.21.15.159:0/3458049949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb21c106a80 msgr2=0x7fb21c19bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221214640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb21c106a80 0x7fb21c19bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221214640 1 -- 172.21.15.159:0/3458049949 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c19c350 con 0x7fb21c101420 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb222216640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb21c106a80 0x7fb21c19bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.256+0000 7fb221a15640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb21c100a80 0x7fb21c1973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.257+0000 7fb221214640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 0x7fb21c1978e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00b4a0 tx=0x7fb20c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.257+0000 7fb212ffd640 1 -- 172.21.15.159:0/3458049949 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c014070 con 0x7fb21c101420 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.257+0000 7fb212ffd640 1 -- 172.21.15.159:0/3458049949 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c010af0 con 0x7fb21c101420 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.257+0000 7fb223c79640 1 -- 172.21.15.159:0/3458049949 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c19c640 con 0x7fb21c101420 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.257+0000 7fb212ffd640 1 -- 172.21.15.159:0/3458049949 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c017d10 con 0x7fb21c101420 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.257+0000 7fb223c79640 1 -- 172.21.15.159:0/3458049949 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c1a3f20 con 0x7fb21c101420 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.259+0000 7fb212ffd640 1 -- 172.21.15.159:0/3458049949 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb20c017070 con 0x7fb21c101420 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.259+0000 7fb226052740 1 Processor -- start 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.259+0000 7fb226052740 1 -- start start 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb226052740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa94e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb226052740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027fa953a0 0x56027faa1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb226052740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027faa1f50 0x56027faa4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb226052740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56027f9fa280 con 0x56027fa94a80 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb226052740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56027f9a1b10 con 0x56027fa953a0 2024-09-19T06:52:10.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb226052740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56027f9f6240 con 0x56027faa1f50 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb212ffd640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2080a3430 0x7fb2080a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb222216640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa94e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb222216640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa94e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33346/0 (socket says 172.21.15.159:33346) 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb222216640 1 -- 172.21.15.159:0/2994160890 learned_addr learned my addr 172.21.15.159:0/2994160890 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb222216640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2080a3430 0x7fb2080a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb212ffd640 1 -- 172.21.15.159:0/3458049949 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb20c0cf050 con 0x7fb21c101420 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb221214640 1 --2- 172.21.15.159:0/2994160890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027faa1f50 0x56027faa4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb221a15640 1 --2- 172.21.15.159:0/2994160890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027fa953a0 0x56027faa1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb222216640 1 -- 172.21.15.159:0/2994160890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027faa1f50 msgr2=0x56027faa4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb222216640 1 --2- 172.21.15.159:0/2994160890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027faa1f50 0x56027faa4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb222216640 1 -- 172.21.15.159:0/2994160890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027fa953a0 msgr2=0x56027faa1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb222216640 1 --2- 172.21.15.159:0/2994160890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027fa953a0 0x56027faa1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.260+0000 7fb222216640 1 -- 172.21.15.159:0/2994160890 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56027f9ae1f0 con 0x56027fa94a80 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.261+0000 7fb222216640 1 --2- 172.21.15.159:0/2994160890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa94e60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb214031d00 tx=0x7fb214031d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40b72cc67109a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.261+0000 7fb222216640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2080a3430 0x7fb2080a58f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb214031da0 tx=0x7fb214048000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.261+0000 7fb207fff640 1 -- 172.21.15.159:0/2994160890 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21404e070 con 0x56027fa94a80 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.261+0000 7fb207fff640 1 -- 172.21.15.159:0/2994160890 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb214036040 con 0x56027fa94a80 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.261+0000 7fb207fff640 1 -- 172.21.15.159:0/2994160890 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2140307e0 con 0x56027fa94a80 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 -- 172.21.15.159:0/2994160890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 msgr2=0x56027fa94e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 --2- 172.21.15.159:0/2994160890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa94e60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb214031d00 tx=0x7fb214031d30 comp rx=0 tx=0).stop 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 -- 172.21.15.159:0/2994160890 shutdown_connections 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 --2- 172.21.15.159:0/2994160890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027faa1f50 0x56027faa4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 --2- 172.21.15.159:0/2994160890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027fa953a0 0x56027faa1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 --2- 172.21.15.159:0/2994160890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa94e60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 -- 172.21.15.159:0/2994160890 >> 172.21.15.159:0/2994160890 conn(0x56027fa910f0 msgr2=0x56027fa914d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 -- 172.21.15.159:0/2994160890 shutdown_connections 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 -- 172.21.15.159:0/2994160890 wait complete. 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 -- start start 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.262+0000 7fb226052740 1 Processor -- start 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa94a80 0x56027fa9eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa953a0 0x56027fa9f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fa9f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56027faa4a60 con 0x56027fa953a0 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56027f9b4f10 con 0x56027faa1f50 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56027faa4be0 con 0x56027fa94a80 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 10 client.0 _ll_register_callbacks cb 0x56027f97da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221214640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa953a0 0x56027fa9f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221214640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa953a0 0x56027fa9f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33358/0 (socket says 172.21.15.159:33358) 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221214640 1 -- 172.21.15.159:0/3608972757 learned_addr learned my addr 172.21.15.159:0/3608972757 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb222216640 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fa9f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221a15640 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa94a80 0x56027fa9eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221214640 1 -- 172.21.15.159:0/3608972757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa94a80 msgr2=0x56027fa9eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221214640 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa94a80 0x56027fa9eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221214640 1 -- 172.21.15.159:0/3608972757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 msgr2=0x56027fa9f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221214640 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fa9f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221214640 1 -- 172.21.15.159:0/3608972757 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56027f76b6a0 con 0x56027fa953a0 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb222216640 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fa9f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb221214640 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa953a0 0x56027fa9f410 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb20c097820 tx=0x7fb20c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d146b6492dbb7341 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb2057fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb2057fa640 1 -- 172.21.15.159:0/3608972757 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c01e040 con 0x56027fa953a0 2024-09-19T06:52:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb2057fa640 1 -- 172.21.15.159:0/3608972757 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb20c0b42e0 con 0x56027fa953a0 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 1 -- 172.21.15.159:0/3608972757 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb214036040 con 0x56027fa953a0 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb2057fa640 1 -- 172.21.15.159:0/3608972757 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb20c09f7c0 con 0x56027fa953a0 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 10 client.16632 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.263+0000 7fb226052740 1 -- 172.21.15.159:0/3608972757 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56027fab0770 con 0x56027fa953a0 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.264+0000 7fb2057fa640 1 -- 172.21.15.159:0/3608972757 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb214036040 con 0x56027fa953a0 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.264+0000 7fb2057fa640 1 -- 172.21.15.159:0/3608972757 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb20c097a80 con 0x56027fa953a0 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.264+0000 7fb226052740 10 client.16632 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.264+0000 7fb226052740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.264+0000 7fb226052740 20 client.16632 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.264+0000 7fb226052740 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56027fab1cd0 0x56027fab40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.264+0000 7fb226052740 4 client.16632 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.264+0000 7fb226052740 1 -- 172.21.15.159:0/3608972757 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56027fa077f0 con 0x56027fab1cd0 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.264+0000 7fb221a15640 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56027fab1cd0 0x56027fab40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.265+0000 7fb221a15640 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56027fab1cd0 0x56027fab40e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6eb88c54715105a server_cookie=20c7873193dc0dbb in_seq=0 out_seq=0 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.265+0000 7fb2057fa640 10 client.16632 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.265+0000 7fb2057fa640 1 -- 172.21.15.159:0/3608972757 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56027fa077f0 con 0x56027fab1cd0 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.265+0000 7fb2057fa640 10 client.16632 handle_command_reply: tid=0 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.265+0000 7fb226052740 1 client.16632 shutdown 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.265+0000 7fb226052740 1 -- 172.21.15.159:0/3608972757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa953a0 msgr2=0x56027fa9f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.265+0000 7fb226052740 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa953a0 0x56027fa9f410 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb20c097820 tx=0x7fb20c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb226052740 1 -- 172.21.15.159:0/3608972757 shutdown_connections 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb226052740 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56027fab1cd0 0x56027fab40e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb226052740 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fa9f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb226052740 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa953a0 0x56027fa9f410 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb2057fa640 0 client.16632 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb226052740 1 --2- 172.21.15.159:0/3608972757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa94a80 0x56027fa9eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb226052740 1 -- 172.21.15.159:0/3608972757 >> 172.21.15.159:0/3608972757 conn(0x56027fa910f0 msgr2=0x56027fa96d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb226052740 1 -- 172.21.15.159:0/3608972757 shutdown_connections 2024-09-19T06:52:10.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb226052740 1 -- 172.21.15.159:0/3608972757 wait complete. 2024-09-19T06:52:10.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.266+0000 7fb226052740 20 client.16632 trim_cache size 0 max 16384 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb226052740 1 Processor -- start 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb226052740 1 -- start start 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb226052740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa96c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb226052740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa953a0 0x56027fab99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb226052740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fab9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb226052740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1a97f0 con 0x56027fa94a80 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb226052740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1ac070 con 0x56027faa1f50 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb226052740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1a9e60 con 0x56027fa953a0 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb221a15640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa96c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.283+0000 7fb221a15640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa96c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33374/0 (socket says 172.21.15.159:33374) 2024-09-19T06:52:10.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb221a15640 1 -- 172.21.15.159:0/1720649328 learned_addr learned my addr 172.21.15.159:0/1720649328 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb222216640 1 --2- 172.21.15.159:0/1720649328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fab9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb221a15640 1 -- 172.21.15.159:0/1720649328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa953a0 msgr2=0x56027fab99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb221a15640 1 --2- 172.21.15.159:0/1720649328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa953a0 0x56027fab99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb221a15640 1 -- 172.21.15.159:0/1720649328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 msgr2=0x56027fab9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb221a15640 1 --2- 172.21.15.159:0/1720649328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fab9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb221a15640 1 -- 172.21.15.159:0/1720649328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56027fa8b680 con 0x56027fa94a80 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb222216640 1 --2- 172.21.15.159:0/1720649328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fab9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb221a15640 1 --2- 172.21.15.159:0/1720649328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa96c70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x56027fab48f0 tx=0x7fb2180094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca52fc187300c89b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb2077fe640 1 -- 172.21.15.159:0/1720649328 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21801a530 con 0x56027fa94a80 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.284+0000 7fb2077fe640 1 -- 172.21.15.159:0/1720649328 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb21801e030 con 0x56027fa94a80 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb2077fe640 1 -- 172.21.15.159:0/1720649328 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218011a50 con 0x56027fa94a80 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb226052740 1 -- 172.21.15.159:0/1720649328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 msgr2=0x56027fa96c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb226052740 1 --2- 172.21.15.159:0/1720649328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa96c70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x56027fab48f0 tx=0x7fb2180094a0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb226052740 1 -- 172.21.15.159:0/1720649328 shutdown_connections 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb226052740 1 --2- 172.21.15.159:0/1720649328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fab9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb226052740 1 --2- 172.21.15.159:0/1720649328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa953a0 0x56027fab99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb226052740 1 --2- 172.21.15.159:0/1720649328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027fa96c70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb226052740 1 -- 172.21.15.159:0/1720649328 >> 172.21.15.159:0/1720649328 conn(0x56027fa910f0 msgr2=0x56027fa96560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb226052740 1 -- 172.21.15.159:0/1720649328 shutdown_connections 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.285+0000 7fb226052740 1 -- 172.21.15.159:0/1720649328 wait complete. 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb226052740 1 -- start start 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb226052740 1 Processor -- start 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb226052740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027faa6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb226052740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa953a0 0x56027faa68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb226052740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fb1b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb226052740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1aa530 con 0x56027fa94a80 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb226052740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1ab9a0 con 0x56027faa1f50 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb226052740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1aac00 con 0x56027fa953a0 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb226052740 10 client.0 _ll_register_callbacks cb 0x7fb20c00b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb221a15640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027faa6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb221a15640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027faa6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33390/0 (socket says 172.21.15.159:33390) 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb221a15640 1 -- 172.21.15.159:0/1291263550 learned_addr learned my addr 172.21.15.159:0/1291263550 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.286+0000 7fb221214640 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa953a0 0x56027faa68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb222216640 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fb1b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb221a15640 1 -- 172.21.15.159:0/1291263550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa953a0 msgr2=0x56027faa68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb221a15640 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa953a0 0x56027faa68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb221a15640 1 -- 172.21.15.159:0/1291263550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 msgr2=0x56027fb1b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb221a15640 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fb1b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb221a15640 1 -- 172.21.15.159:0/1291263550 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56027fb1bf40 con 0x56027fa94a80 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb222216640 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fb1b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb221a15640 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027faa6370 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb218009d50 tx=0x7fb218009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f078675d223612 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb2057fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb2057fa640 1 -- 172.21.15.159:0/1291263550 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2180113e0 con 0x56027fa94a80 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb2057fa640 1 -- 172.21.15.159:0/1291263550 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb218004020 con 0x56027fa94a80 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb226052740 1 -- 172.21.15.159:0/1291263550 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb21801e030 con 0x56027fa94a80 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb2057fa640 1 -- 172.21.15.159:0/1291263550 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb218004220 con 0x56027fa94a80 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb226052740 10 client.16638 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb226052740 1 -- 172.21.15.159:0/1291263550 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56027fb1d1b0 con 0x56027fa94a80 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.287+0000 7fb2057fa640 1 -- 172.21.15.159:0/1291263550 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb21801e030 con 0x56027fa94a80 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb2057fa640 1 -- 172.21.15.159:0/1291263550 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb21800f040 con 0x56027fa94a80 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb226052740 10 client.16638 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb226052740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:10.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb226052740 20 client.16638 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:10.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb226052740 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56027fb1d810 0x56027fb1fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb226052740 4 client.16638 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:52:10.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb226052740 1 -- 172.21.15.159:0/1291263550 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56027fa01d00 con 0x56027fb1d810 2024-09-19T06:52:10.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb221214640 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56027fb1d810 0x56027fb1fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb221214640 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56027fb1d810 0x56027fb1fc30 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22385d02bc0e20a server_cookie=5d5b6bb0c48cab1 in_seq=0 out_seq=0 2024-09-19T06:52:10.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.288+0000 7fb2057fa640 10 client.16638 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:10.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb2057fa640 1 -- 172.21.15.159:0/1291263550 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56027fa01d00 con 0x56027fb1d810 2024-09-19T06:52:10.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb2057fa640 10 client.16638 handle_command_reply: tid=0 2024-09-19T06:52:10.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb226052740 1 client.16638 shutdown 2024-09-19T06:52:10.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb226052740 1 -- 172.21.15.159:0/1291263550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 msgr2=0x56027faa6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb226052740 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027faa6370 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb218009d50 tx=0x7fb218009d80 comp rx=0 tx=0).stop 2024-09-19T06:52:10.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb226052740 1 -- 172.21.15.159:0/1291263550 shutdown_connections 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb226052740 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56027fb1d810 0x56027fb1fc30 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb226052740 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56027faa1f50 0x56027fb1b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb226052740 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56027fa953a0 0x56027faa68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb2057fa640 0 client.16638 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb226052740 1 --2- 172.21.15.159:0/1291263550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56027fa94a80 0x56027faa6370 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.289+0000 7fb226052740 1 -- 172.21.15.159:0/1291263550 >> 172.21.15.159:0/1291263550 conn(0x56027fa910f0 msgr2=0x56027fa90270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb226052740 1 -- 172.21.15.159:0/1291263550 shutdown_connections 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb226052740 1 -- 172.21.15.159:0/1291263550 wait complete. 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb226052740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T06:52:10.297 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:52:10.298 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:52:10.298 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "c6ff7e16-4130-4ac6-9185-365b120835ef", 2024-09-19T06:52:10.298 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:52:10.298 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:52:10.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 -- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2080a3430 msgr2=0x7fb2080a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2080a3430 0x7fb2080a58f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb214031da0 tx=0x7fb214048000 comp rx=0 tx=0).stop 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 -- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 msgr2=0x7fb21c1978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 0x7fb21c1978e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00b4a0 tx=0x7fb20c00b960 comp rx=0 tx=0).stop 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 -- 172.21.15.159:0/3458049949 shutdown_connections 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2080a3430 0x7fb2080a58f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb21c106a80 0x7fb21c19bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb21c101420 0x7fb21c1978e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 --2- 172.21.15.159:0/3458049949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb21c100a80 0x7fb21c1973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 -- 172.21.15.159:0/3458049949 >> 172.21.15.159:0/3458049949 conn(0x7fb21c0fc7a0 msgr2=0x7fb21c0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 -- 172.21.15.159:0/3458049949 shutdown_connections 2024-09-19T06:52:10.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:10.290+0000 7fb223c79640 1 -- 172.21.15.159:0/3458049949 wait complete. 2024-09-19T06:52:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:10 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:52:10.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:10 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:10.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:10 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:52:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:10 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:52:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:10 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:10.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:10 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:52:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:10 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:52:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:10 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:10 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:52:11.102 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:52:11.346 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:11.754 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:11 smithi159 ceph-mon[30935]: pgmap v160: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:52:11.754 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:11 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:11.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:11 smithi203 ceph-mon[35473]: pgmap v160: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:52:11.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:11 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:11.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.835+0000 7f852105a640 1 -- 172.21.15.159:0/1669851117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c106a80 msgr2=0x7f851c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:11.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.835+0000 7f852105a640 1 --2- 172.21.15.159:0/1669851117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c106a80 0x7f851c106e60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f850c009930 tx=0x7f850c02a420 comp rx=0 tx=0).stop 2024-09-19T06:52:11.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.835+0000 7f852105a640 1 -- 172.21.15.159:0/1669851117 shutdown_connections 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.835+0000 7f852105a640 1 --2- 172.21.15.159:0/1669851117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851c101420 0x7f851c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.835+0000 7f852105a640 1 --2- 172.21.15.159:0/1669851117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f851c100a80 0x7f851c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.835+0000 7f852105a640 1 --2- 172.21.15.159:0/1669851117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c106a80 0x7f851c106e60 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.835+0000 7f852105a640 1 -- 172.21.15.159:0/1669851117 >> 172.21.15.159:0/1669851117 conn(0x7f851c0fc7a0 msgr2=0x7f851c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.835+0000 7f852105a640 1 -- 172.21.15.159:0/1669851117 shutdown_connections 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.835+0000 7f852105a640 1 -- 172.21.15.159:0/1669851117 wait complete. 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f852105a640 1 Processor -- start 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f852105a640 1 -- start start 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f852105a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c100a80 0x7f851c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f852105a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f851c101420 0x7f851c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f852105a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851c106a80 0x7f851c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f852105a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f851c110e80 con 0x7f851c100a80 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f852105a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f851c110d00 con 0x7f851c101420 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f852105a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f851c111000 con 0x7f851c106a80 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c100a80 0x7f851c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c100a80 0x7f851c197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33408/0 (socket says 172.21.15.159:33408) 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851ad9d640 1 -- 172.21.15.159:0/1503338662 learned_addr learned my addr 172.21.15.159:0/1503338662 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f8513fff640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f851c101420 0x7f851c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851ad9d640 1 -- 172.21.15.159:0/1503338662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851c106a80 msgr2=0x7f851c19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851b59e640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851c106a80 0x7f851c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851ad9d640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851c106a80 0x7f851c19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851ad9d640 1 -- 172.21.15.159:0/1503338662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f851c101420 msgr2=0x7f851c197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851ad9d640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f851c101420 0x7f851c197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851ad9d640 1 -- 172.21.15.159:0/1503338662 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c19c2b0 con 0x7f851c100a80 2024-09-19T06:52:11.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f8513fff640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f851c101420 0x7f851c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851b59e640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851c106a80 0x7f851c19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.836+0000 7f851ad9d640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c100a80 0x7f851c197300 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f850c009230 tx=0x7f850c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.837+0000 7f8518d99640 1 -- 172.21.15.159:0/1503338662 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c03f030 con 0x7f851c100a80 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.837+0000 7f852105a640 1 -- 172.21.15.159:0/1503338662 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851c19c540 con 0x7f851c100a80 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.837+0000 7f8518d99640 1 -- 172.21.15.159:0/1503338662 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850c003ad0 con 0x7f851c100a80 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.837+0000 7f8518d99640 1 -- 172.21.15.159:0/1503338662 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c035070 con 0x7f851c100a80 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.837+0000 7f852105a640 1 -- 172.21.15.159:0/1503338662 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851c1a3e80 con 0x7f851c100a80 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.839+0000 7f8518d99640 1 -- 172.21.15.159:0/1503338662 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f850c042030 con 0x7f851c100a80 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.839+0000 7f8523433740 1 Processor -- start 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.839+0000 7f8523433740 1 -- start start 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.839+0000 7f8518d99640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f85080a33b0 0x7f85080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f8518d99640 1 -- 172.21.15.159:0/1503338662 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f850c0f0300 con 0x7f851c100a80 2024-09-19T06:52:11.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851b59e640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f85080a33b0 0x7f85080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f8523433740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x564848532780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f8523433740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x56484853f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f8523433740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56484853f890 0x564848541c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f8523433740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5648484982e0 con 0x5648485323a0 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f8523433740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56484843fce0 con 0x564848532cc0 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f8523433740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648484942a0 con 0x56484853f890 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x564848532780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x564848532780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33410/0 (socket says 172.21.15.159:33410) 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851ad9d640 1 -- 172.21.15.159:0/3309460286 learned_addr learned my addr 172.21.15.159:0/3309460286 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f8513fff640 1 --2- 172.21.15.159:0/3309460286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x56484853f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851ad9d640 1 -- 172.21.15.159:0/3309460286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56484853f890 msgr2=0x564848541c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851ad9d640 1 --2- 172.21.15.159:0/3309460286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56484853f890 0x564848541c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851ad9d640 1 -- 172.21.15.159:0/3309460286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 msgr2=0x56484853f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851b59e640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f85080a33b0 0x7f85080a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8514005fd0 tx=0x7f85140093c0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851ad9d640 1 --2- 172.21.15.159:0/3309460286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x56484853f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851ad9d640 1 -- 172.21.15.159:0/3309460286 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564848424440 con 0x5648485323a0 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f851ad9d640 1 --2- 172.21.15.159:0/3309460286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x564848532780 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f850c0b8f80 tx=0x7f850c0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf9765707ae2d4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f85117fa640 1 -- 172.21.15.159:0/3309460286 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c0ef070 con 0x5648485323a0 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.840+0000 7f85117fa640 1 -- 172.21.15.159:0/3309460286 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850c0c0960 con 0x5648485323a0 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f85117fa640 1 -- 172.21.15.159:0/3309460286 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c049040 con 0x5648485323a0 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f8523433740 1 -- 172.21.15.159:0/3309460286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 msgr2=0x564848532780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f8523433740 1 --2- 172.21.15.159:0/3309460286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x564848532780 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f850c0b8f80 tx=0x7f850c0045f0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f8523433740 1 -- 172.21.15.159:0/3309460286 shutdown_connections 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f8523433740 1 --2- 172.21.15.159:0/3309460286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56484853f890 0x564848541c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f8523433740 1 --2- 172.21.15.159:0/3309460286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x56484853f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f8523433740 1 --2- 172.21.15.159:0/3309460286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x564848532780 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f8523433740 1 -- 172.21.15.159:0/3309460286 >> 172.21.15.159:0/3309460286 conn(0x56484852ea30 msgr2=0x56484852ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f8523433740 1 -- 172.21.15.159:0/3309460286 shutdown_connections 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.841+0000 7f8523433740 1 -- 172.21.15.159:0/3309460286 wait complete. 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8523433740 1 -- start start 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8523433740 1 Processor -- start 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8523433740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8523433740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564848532cc0 0x56484853c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8523433740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56484853f890 0x56484853cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8523433740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564848542280 con 0x5648485323a0 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8523433740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564848453050 con 0x56484853f890 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8523433740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564848542400 con 0x564848532cc0 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8523433740 10 client.0 _ll_register_callbacks cb 0x564848493160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33420/0 (socket says 172.21.15.159:33420) 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851ad9d640 1 -- 172.21.15.159:0/249585500 learned_addr learned my addr 172.21.15.159:0/249585500 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851b59e640 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56484853f890 0x56484853cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8513fff640 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564848532cc0 0x56484853c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851ad9d640 1 -- 172.21.15.159:0/249585500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564848532cc0 msgr2=0x56484853c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851ad9d640 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564848532cc0 0x56484853c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851ad9d640 1 -- 172.21.15.159:0/249585500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56484853f890 msgr2=0x56484853cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851ad9d640 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56484853f890 0x56484853cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851ad9d640 1 -- 172.21.15.159:0/249585500 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648482093c0 con 0x5648485323a0 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f851b59e640 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56484853f890 0x56484853cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.842+0000 7f8513fff640 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564848532cc0 0x56484853c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f851ad9d640 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853f280 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f850c009a50 tx=0x7f850c0c5220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5839372547c3826f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f85027fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f85027fc640 1 -- 172.21.15.159:0/249585500 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c0da060 con 0x5648485323a0 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f85027fc640 1 -- 172.21.15.159:0/249585500 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f850c003c80 con 0x5648485323a0 2024-09-19T06:52:11.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f8523433740 1 -- 172.21.15.159:0/249585500 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f850c0c0960 con 0x5648485323a0 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f85027fc640 1 -- 172.21.15.159:0/249585500 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f850c0ef050 con 0x5648485323a0 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f8523433740 10 client.16650 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f8523433740 1 -- 172.21.15.159:0/249585500 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564848542280 con 0x5648485323a0 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f85027fc640 1 -- 172.21.15.159:0/249585500 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850c0c0960 con 0x5648485323a0 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f85027fc640 1 -- 172.21.15.159:0/249585500 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f850c0c4d90 con 0x5648485323a0 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f8523433740 10 client.16650 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f8523433740 10 client.16650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f8523433740 20 client.16650 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f8523433740 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56484854eea0 0x5648485512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f8523433740 4 client.16650 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.843+0000 7f8523433740 1 -- 172.21.15.159:0/249585500 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648484a5850 con 0x56484854eea0 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.844+0000 7f8513fff640 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56484854eea0 0x5648485512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.844+0000 7f8513fff640 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56484854eea0 0x5648485512c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69e4063bcb1bf48f server_cookie=bd5f0762de429b0e in_seq=0 out_seq=0 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.844+0000 7f85027fc640 10 client.16650 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f85027fc640 1 -- 172.21.15.159:0/249585500 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648484a5850 con 0x56484854eea0 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f85027fc640 10 client.16650 handle_command_reply: tid=0 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 client.16650 shutdown 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 -- 172.21.15.159:0/249585500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 msgr2=0x56484853f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853f280 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f850c009a50 tx=0x7f850c0c5220 comp rx=0 tx=0).stop 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 -- 172.21.15.159:0/249585500 shutdown_connections 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56484854eea0 0x5648485512c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56484853f890 0x56484853cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564848532cc0 0x56484853c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 --2- 172.21.15.159:0/249585500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853f280 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 -- 172.21.15.159:0/249585500 >> 172.21.15.159:0/249585500 conn(0x56484852ea30 msgr2=0x564848534790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:11.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f85027fc640 0 client.16650 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:11.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 -- 172.21.15.159:0/249585500 shutdown_connections 2024-09-19T06:52:11.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 1 -- 172.21.15.159:0/249585500 wait complete. 2024-09-19T06:52:11.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.845+0000 7f8523433740 20 client.16650 trim_cache size 0 max 16384 2024-09-19T06:52:11.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.862+0000 7f8523433740 1 Processor -- start 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.862+0000 7f8523433740 1 -- start start 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.862+0000 7f8523433740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.862+0000 7f8523433740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x56484854b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f8523433740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56484853f890 0x564848556b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f8523433740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1a9680 con 0x5648485323a0 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f8523433740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1abf00 con 0x564848532cc0 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f8523433740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1a9cf0 con 0x56484853f890 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33422/0 (socket says 172.21.15.159:33422) 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f851ad9d640 1 -- 172.21.15.159:0/1155839761 learned_addr learned my addr 172.21.15.159:0/1155839761 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f8513fff640 1 --2- 172.21.15.159:0/1155839761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x56484854b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f851ad9d640 1 -- 172.21.15.159:0/1155839761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56484853f890 msgr2=0x564848556b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f851ad9d640 1 --2- 172.21.15.159:0/1155839761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56484853f890 0x564848556b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f851ad9d640 1 -- 172.21.15.159:0/1155839761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 msgr2=0x56484854b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f851ad9d640 1 --2- 172.21.15.159:0/1155839761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x56484854b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f851ad9d640 1 -- 172.21.15.159:0/1155839761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484853aa80 con 0x5648485323a0 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f851ad9d640 1 --2- 172.21.15.159:0/1155839761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853c500 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f850c0b8f30 tx=0x7f850c0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e8f7600bf10da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f8510ff9640 1 -- 172.21.15.159:0/1155839761 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c0da070 con 0x5648485323a0 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f8510ff9640 1 -- 172.21.15.159:0/1155839761 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850c0c0960 con 0x5648485323a0 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.863+0000 7f8510ff9640 1 -- 172.21.15.159:0/1155839761 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c049070 con 0x5648485323a0 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 -- 172.21.15.159:0/1155839761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 msgr2=0x56484853c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 --2- 172.21.15.159:0/1155839761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853c500 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f850c0b8f30 tx=0x7f850c0045f0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 -- 172.21.15.159:0/1155839761 shutdown_connections 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 --2- 172.21.15.159:0/1155839761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56484853f890 0x564848556b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 --2- 172.21.15.159:0/1155839761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x56484854b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 --2- 172.21.15.159:0/1155839761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5648485323a0 0x56484853c500 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 -- 172.21.15.159:0/1155839761 >> 172.21.15.159:0/1155839761 conn(0x56484852ea30 msgr2=0x56484853bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 -- 172.21.15.159:0/1155839761 shutdown_connections 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 -- 172.21.15.159:0/1155839761 wait complete. 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 -- start start 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.864+0000 7f8523433740 1 Processor -- start 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f8523433740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648485323a0 0x5648485b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f8523433740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x5648485b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f8523433740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56484853f890 0x564848547680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f8523433740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1aa3c0 con 0x56484853f890 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f8523433740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1ab830 con 0x564848532cc0 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f8523433740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1aaa90 con 0x5648485323a0 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f8523433740 10 client.0 _ll_register_callbacks cb 0x7f850c0bc0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56484853f890 0x564848547680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56484853f890 0x564848547680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33424/0 (socket says 172.21.15.159:33424) 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851b59e640 1 -- 172.21.15.159:0/1464917510 learned_addr learned my addr 172.21.15.159:0/1464917510 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851ad9d640 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648485323a0 0x5648485b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f8513fff640 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x5648485b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851b59e640 1 -- 172.21.15.159:0/1464917510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648485323a0 msgr2=0x5648485b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851b59e640 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648485323a0 0x5648485b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851b59e640 1 -- 172.21.15.159:0/1464917510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 msgr2=0x5648485b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851b59e640 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x5648485b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851b59e640 1 -- 172.21.15.159:0/1464917510 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564848547eb0 con 0x56484853f890 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f8513fff640 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x5648485b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f851b59e640 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56484853f890 0x564848547680 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8514009b50 tx=0x7f8514011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad618718065513f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.865+0000 7f85027fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:11.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f85027fc640 1 -- 172.21.15.159:0/1464917510 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514022070 con 0x56484853f890 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f85027fc640 1 -- 172.21.15.159:0/1464917510 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f8514010aa0 con 0x56484853f890 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f8523433740 1 -- 172.21.15.159:0/1464917510 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f850c0c0960 con 0x56484853f890 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f85027fc640 1 -- 172.21.15.159:0/1464917510 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8514010ca0 con 0x56484853f890 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f8523433740 10 client.16656 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f8523433740 1 -- 172.21.15.159:0/1464917510 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564848537590 con 0x56484853f890 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f85027fc640 1 -- 172.21.15.159:0/1464917510 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850c0c0960 con 0x56484853f890 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f85027fc640 1 -- 172.21.15.159:0/1464917510 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f851402e070 con 0x56484853f890 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f8523433740 10 client.16656 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f8523433740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f8523433740 20 client.16656 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f8523433740 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5648485bc4c0 0x5648485be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f8523433740 4 client.16656 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:52:11.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f8523433740 1 -- 172.21.15.159:0/1464917510 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56484849fd60 con 0x5648485bc4c0 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.866+0000 7f851ad9d640 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5648485bc4c0 0x5648485be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f851ad9d640 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5648485bc4c0 0x5648485be8e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1b390c6212301 server_cookie=183e7d71fc41f379 in_seq=0 out_seq=0 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f85027fc640 10 client.16656 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f85027fc640 1 -- 172.21.15.159:0/1464917510 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56484849fd60 con 0x5648485bc4c0 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f85027fc640 10 client.16656 handle_command_reply: tid=0 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 client.16656 shutdown 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 -- 172.21.15.159:0/1464917510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56484853f890 msgr2=0x564848547680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56484853f890 0x564848547680 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8514009b50 tx=0x7f8514011b70 comp rx=0 tx=0).stop 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 -- 172.21.15.159:0/1464917510 shutdown_connections 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5648485bc4c0 0x5648485be8e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56484853f890 0x564848547680 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564848532cc0 0x5648485b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 --2- 172.21.15.159:0/1464917510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648485323a0 0x5648485b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f85027fc640 0 client.16656 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:11.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 -- 172.21.15.159:0/1464917510 >> 172.21.15.159:0/1464917510 conn(0x56484852ea30 msgr2=0x564848534790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:11.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 -- 172.21.15.159:0/1464917510 shutdown_connections 2024-09-19T06:52:11.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 1 -- 172.21.15.159:0/1464917510 wait complete. 2024-09-19T06:52:11.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.867+0000 7f8523433740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T06:52:11.876 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:52:11.876 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:52:11.876 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:52:11.876 INFO:teuthology.orchestra.run.smithi159.stdout: "c6ff7e16-4130-4ac6-9185-365b120835ef": { 2024-09-19T06:52:11.876 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:52:11.877 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "c6ff7e16-4130-4ac6-9185-365b120835ef", 2024-09-19T06:52:11.877 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:52:11.877 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:52:11.877 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:52:11.877 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:52:11.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 -- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f85080a33b0 msgr2=0x7f85080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f85080a33b0 0x7f85080a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8514005fd0 tx=0x7f85140093c0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 -- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c100a80 msgr2=0x7f851c197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c100a80 0x7f851c197300 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f850c009230 tx=0x7f850c004270 comp rx=0 tx=0).stop 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 -- 172.21.15.159:0/1503338662 shutdown_connections 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f85080a33b0 0x7f85080a5870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851c106a80 0x7f851c19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f851c101420 0x7f851c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 --2- 172.21.15.159:0/1503338662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f851c100a80 0x7f851c197300 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 -- 172.21.15.159:0/1503338662 >> 172.21.15.159:0/1503338662 conn(0x7f851c0fc7a0 msgr2=0x7f851c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 -- 172.21.15.159:0/1503338662 shutdown_connections 2024-09-19T06:52:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:11.868+0000 7f852105a640 1 -- 172.21.15.159:0/1503338662 wait complete. 2024-09-19T06:52:11.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:11 smithi189 ceph-mon[34880]: pgmap v160: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:52:11.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:11 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:12.699 INFO:tasks.cephfs.filesystem:scrub status for tag:c6ff7e16-4130-4ac6-9185-365b120835ef - {'path': '/', 'tag': 'c6ff7e16-4130-4ac6-9185-365b120835ef', 'options': 'recursive,force'} 2024-09-19T06:52:12.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:12 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:52:12.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:12 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:52:12.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:12 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:52:13.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:13 smithi203 ceph-mon[35473]: pgmap v161: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 37 KiB/s wr, 406 op/s 2024-09-19T06:52:13.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:13 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:52:13.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:13 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:52:13.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:13 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:52:13.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:13 smithi189 ceph-mon[34880]: pgmap v161: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 37 KiB/s wr, 406 op/s 2024-09-19T06:52:13.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:13 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:52:13.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:13 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:52:13.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:13 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:52:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:13 smithi159 ceph-mon[30935]: pgmap v161: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 37 KiB/s wr, 406 op/s 2024-09-19T06:52:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:13 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:52:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:13 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:52:13.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:13 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:52:14.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:14 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:52:14.842 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:14 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:52:14.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:14 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:52:15.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:15 smithi203 ceph-mon[35473]: pgmap v162: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 15 KiB/s wr, 390 op/s 2024-09-19T06:52:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:15 smithi189 ceph-mon[34880]: pgmap v162: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 15 KiB/s wr, 390 op/s 2024-09-19T06:52:15.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:15 smithi159 ceph-mon[30935]: pgmap v162: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 15 KiB/s wr, 390 op/s 2024-09-19T06:52:16.823 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:52:17.082 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:16 smithi203 ceph-mon[35473]: pgmap v163: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 15 KiB/s wr, 391 op/s 2024-09-19T06:52:17.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:16 smithi189 ceph-mon[34880]: pgmap v163: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 15 KiB/s wr, 391 op/s 2024-09-19T06:52:17.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:16 smithi159 ceph-mon[30935]: pgmap v163: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 15 KiB/s wr, 391 op/s 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.581+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3185380857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102570 msgr2=0x7f3e9c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.581+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3185380857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102570 0x7f3e9c1029b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009900 tx=0x7f3e8802a480 comp rx=0 tx=0).stop 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.581+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3185380857 shutdown_connections 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.581+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3185380857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.581+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3185380857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102570 0x7f3e9c1029b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.581+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3185380857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e9c100e20 0x7f3e9c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.581+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3185380857 >> 172.21.15.159:0/3185380857 conn(0x7f3e9c0fc7d0 msgr2=0x7f3e9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.581+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3185380857 shutdown_connections 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.581+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3185380857 wait complete. 2024-09-19T06:52:17.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea2a66640 1 Processor -- start 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea2a66640 1 -- start start 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea2a66640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e9c100e20 0x7f3e9c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea2a66640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e9c102570 0x7f3e9c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea2a66640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c1a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea2a66640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c110f50 con 0x7f3e9c102ef0 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea2a66640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c110dd0 con 0x7f3e9c102570 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea2a66640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1110d0 con 0x7f3e9c100e20 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea1003640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c1a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea1003640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c1a4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33434/0 (socket says 172.21.15.159:33434) 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea1003640 1 -- 172.21.15.159:0/3174278922 learned_addr learned my addr 172.21.15.159:0/3174278922 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3e9bfff640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e9c102570 0x7f3e9c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:17.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea0802640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e9c100e20 0x7f3e9c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea1003640 1 -- 172.21.15.159:0/3174278922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e9c100e20 msgr2=0x7f3e9c1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea1003640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e9c100e20 0x7f3e9c1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea1003640 1 -- 172.21.15.159:0/3174278922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e9c102570 msgr2=0x7f3e9c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea1003640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e9c102570 0x7f3e9c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea1003640 1 -- 172.21.15.159:0/3174278922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c1a47b0 con 0x7f3e9c102ef0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.582+0000 7f3ea1003640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c1a4270 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400cce0 tx=0x7f3e9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.583+0000 7f3e99ffb640 1 -- 172.21.15.159:0/3174278922 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9400f450 con 0x7f3e9c102ef0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.583+0000 7f3e99ffb640 1 -- 172.21.15.159:0/3174278922 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9400fad0 con 0x7f3e9c102ef0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.583+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c1a4980 con 0x7f3e9c102ef0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.583+0000 7f3e99ffb640 1 -- 172.21.15.159:0/3174278922 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94018c10 con 0x7f3e9c102ef0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.583+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c1a4e70 con 0x7f3e9c102ef0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.584+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e9c101200 con 0x7f3e9c102ef0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.585+0000 7f3e99ffb640 1 -- 172.21.15.159:0/3174278922 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3e9400f5f0 con 0x7f3e9c102ef0 2024-09-19T06:52:17.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.586+0000 7f3e99ffb640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3e8c0a33b0 0x7f3e8c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:17.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.586+0000 7f3ea0802640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3e8c0a33b0 0x7f3e8c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:17.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.586+0000 7f3e99ffb640 1 -- 172.21.15.159:0/3174278922 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f3e940d04a0 con 0x7f3e9c102ef0 2024-09-19T06:52:17.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.586+0000 7f3ea0802640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3e8c0a33b0 0x7f3e8c0a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005e10 tx=0x7f3e90005da0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:17.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.590+0000 7f3e99ffb640 1 -- 172.21.15.159:0/3174278922 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e94014030 con 0x7f3e9c102ef0 2024-09-19T06:52:17.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.796+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e9c1a5160 con 0x7f3e9c102ef0 2024-09-19T06:52:17.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.796+0000 7f3e99ffb640 1 -- 172.21.15.159:0/3174278922 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f3e9409cdf0 con 0x7f3e9c102ef0 2024-09-19T06:52:17.798 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:52:17.799 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:52:17.799 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:52:17.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3e8c0a33b0 msgr2=0x7f3e8c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:17.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3e8c0a33b0 0x7f3e8c0a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005e10 tx=0x7f3e90005da0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102ef0 msgr2=0x7f3e9c1a4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:17.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c1a4270 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400cce0 tx=0x7f3e9400a620 comp rx=0 tx=0).stop 2024-09-19T06:52:17.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 shutdown_connections 2024-09-19T06:52:17.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3e8c0a33b0 0x7f3e8c0a5870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c1a4270 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e9c102570 0x7f3e9c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 --2- 172.21.15.159:0/3174278922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e9c100e20 0x7f3e9c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:17.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 >> 172.21.15.159:0/3174278922 conn(0x7f3e9c0fc7d0 msgr2=0x7f3e9c106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:17.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 shutdown_connections 2024-09-19T06:52:17.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:17.799+0000 7f3ea2a66640 1 -- 172.21.15.159:0/3174278922 wait complete. 2024-09-19T06:52:18.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:17 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3174278922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:17 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3174278922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:18.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:17 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3174278922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.522+0000 7f67ec65e640 1 -- 172.21.15.159:0/2227818599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e410e310 msgr2=0x7f67e4110760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.522+0000 7f67ec65e640 1 --2- 172.21.15.159:0/2227818599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e410e310 0x7f67e4110760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009ca0 tx=0x7f67dc02a950 comp rx=0 tx=0).stop 2024-09-19T06:52:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.522+0000 7f67ec65e640 1 -- 172.21.15.159:0/2227818599 shutdown_connections 2024-09-19T06:52:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.522+0000 7f67ec65e640 1 --2- 172.21.15.159:0/2227818599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e410e310 0x7f67e4110760 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.522+0000 7f67ec65e640 1 --2- 172.21.15.159:0/2227818599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67e4074f40 0x7f67e410ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.522+0000 7f67ec65e640 1 --2- 172.21.15.159:0/2227818599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67e4074620 0x7f67e4074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.522+0000 7f67ec65e640 1 -- 172.21.15.159:0/2227818599 >> 172.21.15.159:0/2227818599 conn(0x7f67e40fd7d0 msgr2=0x7f67e40ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.522+0000 7f67ec65e640 1 -- 172.21.15.159:0/2227818599 shutdown_connections 2024-09-19T06:52:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.522+0000 7f67ec65e640 1 -- 172.21.15.159:0/2227818599 wait complete. 2024-09-19T06:52:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ec65e640 1 Processor -- start 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ec65e640 1 -- start start 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ec65e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e4074620 0x7f67e419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ec65e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67e4074f40 0x7f67e419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ec65e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67e410e310 0x7f67e419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ec65e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4114100 con 0x7f67e4074620 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ec65e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4113f80 con 0x7f67e4074f40 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ec65e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4114280 con 0x7f67e410e310 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ea3fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e4074620 0x7f67e419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ea3fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e4074620 0x7f67e419a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33450/0 (socket says 172.21.15.159:33450) 2024-09-19T06:52:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ea3fa640 1 -- 172.21.15.159:0/4247344679 learned_addr learned my addr 172.21.15.159:0/4247344679 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67e4074f40 0x7f67e419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67eabfb640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67e410e310 0x7f67e419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ea3fa640 1 -- 172.21.15.159:0/4247344679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67e410e310 msgr2=0x7f67e419edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67e410e310 0x7f67e419edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ea3fa640 1 -- 172.21.15.159:0/4247344679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67e4074f40 msgr2=0x7f67e419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67e4074f40 0x7f67e419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.523+0000 7f67ea3fa640 1 -- 172.21.15.159:0/4247344679 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e419f500 con 0x7f67e4074620 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.524+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e4074620 0x7f67e419a510 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f67e000d770 tx=0x7f67e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.524+0000 7f67db7fe640 1 -- 172.21.15.159:0/4247344679 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0017070 con 0x7f67e4074620 2024-09-19T06:52:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.524+0000 7f67ec65e640 1 -- 172.21.15.159:0/4247344679 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e419f7f0 con 0x7f67e4074620 2024-09-19T06:52:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.524+0000 7f67db7fe640 1 -- 172.21.15.159:0/4247344679 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67e0005500 con 0x7f67e4074620 2024-09-19T06:52:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.524+0000 7f67db7fe640 1 -- 172.21.15.159:0/4247344679 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0004e00 con 0x7f67e4074620 2024-09-19T06:52:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.524+0000 7f67ec65e640 1 -- 172.21.15.159:0/4247344679 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e41a7080 con 0x7f67e4074620 2024-09-19T06:52:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.526+0000 7f67db7fe640 1 -- 172.21.15.159:0/4247344679 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f67e0004fa0 con 0x7f67e4074620 2024-09-19T06:52:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.527+0000 7f67db7fe640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67d00a3460 0x7f67d00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.527+0000 7f67ef3f8740 1 Processor -- start 2024-09-19T06:52:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67d00a3460 0x7f67d00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67db7fe640 1 -- 172.21.15.159:0/4247344679 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f67e00cf830 con 0x7f67e4074620 2024-09-19T06:52:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ef3f8740 1 -- start start 2024-09-19T06:52:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 0x564d2b2e2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564d2b23c2f0 con 0x564d2b2d7af0 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564d2b1e4270 con 0x564d2b2d8410 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564d2b2382b0 con 0x564d2b2e2cb0 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ea3fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67d00a3460 0x7f67d00a5920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f67e4101380 tx=0x7f67d4005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ea3fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2d7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33460/0 (socket says 172.21.15.159:33460) 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ea3fa640 1 -- 172.21.15.159:0/3222206497 learned_addr learned my addr 172.21.15.159:0/3222206497 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/3222206497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 0x564d2b2e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ea3fa640 1 -- 172.21.15.159:0/3222206497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 msgr2=0x564d2b2e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/3222206497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ea3fa640 1 -- 172.21.15.159:0/3222206497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 msgr2=0x564d2b2e2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.528+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/3222206497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 0x564d2b2e2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.529+0000 7f67ea3fa640 1 -- 172.21.15.159:0/3222206497 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2b1e3340 con 0x564d2b2d7af0 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.529+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/3222206497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2d7ed0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f67e000d740 tx=0x7f67e0004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e276efd753201394 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.529+0000 7f67d8bfe640 1 -- 172.21.15.159:0/3222206497 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0020070 con 0x564d2b2d7af0 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.529+0000 7f67d8bfe640 1 -- 172.21.15.159:0/3222206497 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67e009fe90 con 0x564d2b2d7af0 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.529+0000 7f67d8bfe640 1 -- 172.21.15.159:0/3222206497 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0098150 con 0x564d2b2d7af0 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 -- 172.21.15.159:0/3222206497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 msgr2=0x564d2b2d7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/3222206497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2d7ed0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f67e000d740 tx=0x7f67e0004800 comp rx=0 tx=0).stop 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 -- 172.21.15.159:0/3222206497 shutdown_connections 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/3222206497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/3222206497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 0x564d2b2e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/3222206497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2d7ed0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 -- 172.21.15.159:0/3222206497 >> 172.21.15.159:0/3222206497 conn(0x564d2b2d4060 msgr2=0x564d2b2d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 -- 172.21.15.159:0/3222206497 shutdown_connections 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 -- 172.21.15.159:0/3222206497 wait complete. 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 -- start start 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.530+0000 7f67ef3f8740 1 Processor -- start 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2dfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 0x564d2b2e0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2e0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564d2b2e5880 con 0x564d2b2d7af0 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564d2b1c5290 con 0x564d2b2d8410 2024-09-19T06:52:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564d2b2e5a00 con 0x564d2b2e2cb0 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ef3f8740 10 client.0 _ll_register_callbacks cb 0x564d2b1f6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ea3fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2dfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ea3fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2dfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33464/0 (socket says 172.21.15.159:33464) 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ea3fa640 1 -- 172.21.15.159:0/2218255750 learned_addr learned my addr 172.21.15.159:0/2218255750 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 0x564d2b2e0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ea3fa640 1 -- 172.21.15.159:0/2218255750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 msgr2=0x564d2b2e0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2e0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ea3fa640 1 -- 172.21.15.159:0/2218255750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 msgr2=0x564d2b2e0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 0x564d2b2e0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ea3fa640 1 -- 172.21.15.159:0/2218255750 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d2af4f210 con 0x564d2b2d7af0 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2dfc10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f67e00cfb20 tx=0x7f67e009b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6c60e076ea5602 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.531+0000 7f67cdffb640 1 -- 172.21.15.159:0/2218255750 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0020070 con 0x564d2b2d7af0 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67cdffb640 1 -- 172.21.15.159:0/2218255750 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f67e0009cc0 con 0x564d2b2d7af0 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67ef3f8740 1 -- 172.21.15.159:0/2218255750 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67e009fe90 con 0x564d2b2d7af0 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67cdffb640 1 -- 172.21.15.159:0/2218255750 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f67e00a4750 con 0x564d2b2d7af0 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67ef3f8740 10 client.16674 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67ef3f8740 1 -- 172.21.15.159:0/2218255750 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564d2b01b620 con 0x564d2b2d7af0 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67cdffb640 1 -- 172.21.15.159:0/2218255750 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67e009fe90 con 0x564d2b2d7af0 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67cdffb640 1 -- 172.21.15.159:0/2218255750 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f67e00b4ce0 con 0x564d2b2d7af0 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67ef3f8740 10 client.16674 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67ef3f8740 10 client.16674 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67ef3f8740 20 client.16674 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564d2b2f2b00 0x564d2b2f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67ef3f8740 4 client.16674 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67ef3f8740 1 -- 172.21.15.159:0/2218255750 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d2b249a20 con 0x564d2b2f2b00 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.532+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564d2b2f2b00 0x564d2b2f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.533+0000 7f67cdffb640 10 client.16674 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.533+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564d2b2f2b00 0x564d2b2f4ef0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0d85f34574a3fb server_cookie=386c6c374ab86bb8 in_seq=0 out_seq=0 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67cdffb640 1 -- 172.21.15.159:0/2218255750 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d2b249a20 con 0x564d2b2f2b00 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67cdffb640 10 client.16674 handle_command_reply: tid=0 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 client.16674 shutdown 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 -- 172.21.15.159:0/2218255750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 msgr2=0x564d2b2dfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2dfc10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f67e00cfb20 tx=0x7f67e009b9e0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 -- 172.21.15.159:0/2218255750 shutdown_connections 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564d2b2f2b00 0x564d2b2f4ef0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2e0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d8410 0x564d2b2e0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/2218255750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d7af0 0x564d2b2dfc10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 -- 172.21.15.159:0/2218255750 >> 172.21.15.159:0/2218255750 conn(0x564d2b2d4060 msgr2=0x564d2b2d9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67cdffb640 0 client.16674 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 -- 172.21.15.159:0/2218255750 shutdown_connections 2024-09-19T06:52:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 1 -- 172.21.15.159:0/2218255750 wait complete. 2024-09-19T06:52:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.534+0000 7f67ef3f8740 20 client.16674 trim_cache size 0 max 16384 2024-09-19T06:52:18.549 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id f9db16ee --release --await' 2024-09-19T06:52:18.549 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id f9db16ee --release --await 2024-09-19T06:52:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67ef3f8740 1 Processor -- start 2024-09-19T06:52:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67ef3f8740 1 -- start start 2024-09-19T06:52:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 0x564d2b2de4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2d8410 0x564d2b2e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2e2cb0 0x564d2b2fa520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41adad0 con 0x564d2b2e2cb0 2024-09-19T06:52:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41b0350 con 0x564d2b2d7af0 2024-09-19T06:52:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41ae140 con 0x564d2b2d8410 2024-09-19T06:52:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67eabfb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2e2cb0 0x564d2b2fa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67eabfb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2e2cb0 0x564d2b2fa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33468/0 (socket says 172.21.15.159:33468) 2024-09-19T06:52:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67eabfb640 1 -- 172.21.15.159:0/1543305958 learned_addr learned my addr 172.21.15.159:0/1543305958 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/1543305958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2d8410 0x564d2b2e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/1543305958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 0x564d2b2de4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67eabfb640 1 -- 172.21.15.159:0/1543305958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2d8410 msgr2=0x564d2b2e04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67eabfb640 1 --2- 172.21.15.159:0/1543305958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2d8410 0x564d2b2e04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67eabfb640 1 -- 172.21.15.159:0/1543305958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 msgr2=0x564d2b2de4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67eabfb640 1 --2- 172.21.15.159:0/1543305958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 0x564d2b2de4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.550+0000 7f67eabfb640 1 -- 172.21.15.159:0/1543305958 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2b2deba0 con 0x564d2b2e2cb0 2024-09-19T06:52:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.551+0000 7f67eabfb640 1 --2- 172.21.15.159:0/1543305958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2e2cb0 0x564d2b2fa520 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f67dc02ae70 tx=0x7f67dc009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b8c2fe1f32aa14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.551+0000 7f67cffff640 1 -- 172.21.15.159:0/1543305958 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc034040 con 0x564d2b2e2cb0 2024-09-19T06:52:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.551+0000 7f67cffff640 1 -- 172.21.15.159:0/1543305958 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67dc003e50 con 0x564d2b2e2cb0 2024-09-19T06:52:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.551+0000 7f67cffff640 1 -- 172.21.15.159:0/1543305958 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc004330 con 0x564d2b2e2cb0 2024-09-19T06:52:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.552+0000 7f67ef3f8740 1 -- 172.21.15.159:0/1543305958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2e2cb0 msgr2=0x564d2b2fa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.552+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/1543305958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2e2cb0 0x564d2b2fa520 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f67dc02ae70 tx=0x7f67dc009a20 comp rx=0 tx=0).stop 2024-09-19T06:52:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.552+0000 7f67ef3f8740 1 -- 172.21.15.159:0/1543305958 shutdown_connections 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.552+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/1543305958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2e2cb0 0x564d2b2fa520 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.552+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/1543305958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2d8410 0x564d2b2e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.552+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/1543305958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 0x564d2b2de4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.552+0000 7f67ef3f8740 1 -- 172.21.15.159:0/1543305958 >> 172.21.15.159:0/1543305958 conn(0x564d2b2d4060 msgr2=0x564d2b2e1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 -- 172.21.15.159:0/1543305958 shutdown_connections 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 -- 172.21.15.159:0/1543305958 wait complete. 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 -- start start 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 Processor -- start 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 0x564d2b2eb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d8410 0x564d2b2dcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2dd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41ae810 con 0x564d2b2d8410 2024-09-19T06:52:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41afc80 con 0x564d2b2d7af0 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41aeee0 con 0x564d2b2e2cb0 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ef3f8740 10 client.0 _ll_register_callbacks cb 0x7f67e009f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67e9bf9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d8410 0x564d2b2dcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67e9bf9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d8410 0x564d2b2dcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33472/0 (socket says 172.21.15.159:33472) 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67e9bf9640 1 -- 172.21.15.159:0/4046930993 learned_addr learned my addr 172.21.15.159:0/4046930993 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67eabfb640 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.553+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 0x564d2b2eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67e9bf9640 1 -- 172.21.15.159:0/4046930993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 msgr2=0x564d2b2dd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2dd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67e9bf9640 1 -- 172.21.15.159:0/4046930993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 msgr2=0x564d2b2eb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 0x564d2b2eb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67e9bf9640 1 -- 172.21.15.159:0/4046930993 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d2b35c4f0 con 0x564d2b2d8410 2024-09-19T06:52:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67e9bf9640 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d8410 0x564d2b2dcaa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x564d2b2d4ec0 tx=0x7f67d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344e3e6b288f84e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67cdffb640 1 -- 172.21.15.159:0/4046930993 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d4004230 con 0x564d2b2d8410 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67cdffb640 1 -- 172.21.15.159:0/4046930993 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f67d40043d0 con 0x564d2b2d8410 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67ef3f8740 1 -- 172.21.15.159:0/4046930993 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67dc003e50 con 0x564d2b2d8410 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67cdffb640 1 -- 172.21.15.159:0/4046930993 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f67d403b050 con 0x564d2b2d8410 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67ef3f8740 10 client.16680 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67ef3f8740 1 -- 172.21.15.159:0/4046930993 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564d2b35d6e0 con 0x564d2b2d8410 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.554+0000 7f67cdffb640 1 -- 172.21.15.159:0/4046930993 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67dc003e50 con 0x564d2b2d8410 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67cdffb640 1 -- 172.21.15.159:0/4046930993 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f67d402b5c0 con 0x564d2b2d8410 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67ef3f8740 10 client.16680 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67ef3f8740 10 client.16680 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:18.560 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67ef3f8740 20 client.16680 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564d2b35de40 0x564d2b360260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67ef3f8740 4 client.16680 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:52:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67ef3f8740 1 -- 172.21.15.159:0/4046930993 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d2b243d70 con 0x564d2b35de40 2024-09-19T06:52:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564d2b35de40 0x564d2b360260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67ea3fa640 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564d2b35de40 0x564d2b360260 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8055fefd1a80344 server_cookie=3f4b5c135be75c5c in_seq=0 out_seq=0 2024-09-19T06:52:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.555+0000 7f67cdffb640 10 client.16680 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67cdffb640 1 -- 172.21.15.159:0/4046930993 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d2b243d70 con 0x564d2b35de40 2024-09-19T06:52:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67cdffb640 10 client.16680 handle_command_reply: tid=0 2024-09-19T06:52:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 client.16680 shutdown 2024-09-19T06:52:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 -- 172.21.15.159:0/4046930993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d8410 msgr2=0x564d2b2dcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d8410 0x564d2b2dcaa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x564d2b2d4ec0 tx=0x7f67d4004730 comp rx=0 tx=0).stop 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 -- 172.21.15.159:0/4046930993 shutdown_connections 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564d2b35de40 0x564d2b360260 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564d2b2e2cb0 0x564d2b2dd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67cdffb640 0 client.16680 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564d2b2d8410 0x564d2b2dcaa0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 --2- 172.21.15.159:0/4046930993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d2b2d7af0 0x564d2b2eb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 -- 172.21.15.159:0/4046930993 >> 172.21.15.159:0/4046930993 conn(0x564d2b2d4060 msgr2=0x564d2b2d29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 -- 172.21.15.159:0/4046930993 shutdown_connections 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 1 -- 172.21.15.159:0/4046930993 wait complete. 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.560+0000 7f67ef3f8740 20 client.16680 trim_cache size 0 max 16384 2024-09-19T06:52:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:52:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:52:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:52:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:52:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 -- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67d00a3460 msgr2=0x7f67d00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67d00a3460 0x7f67d00a5920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f67e4101380 tx=0x7f67d4005f90 comp rx=0 tx=0).stop 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 -- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e4074620 msgr2=0x7f67e419a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e4074620 0x7f67e419a510 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f67e000d770 tx=0x7f67e000dc30 comp rx=0 tx=0).stop 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 -- 172.21.15.159:0/4247344679 shutdown_connections 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67d00a3460 0x7f67d00a5920 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67e410e310 0x7f67e419edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67e4074f40 0x7f67e419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 --2- 172.21.15.159:0/4247344679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67e4074620 0x7f67e419a510 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 -- 172.21.15.159:0/4247344679 >> 172.21.15.159:0/4247344679 conn(0x7f67e40fd7d0 msgr2=0x7f67e40fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 -- 172.21.15.159:0/4247344679 shutdown_connections 2024-09-19T06:52:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:18.561+0000 7f67ec65e640 1 -- 172.21.15.159:0/4247344679 wait complete. 2024-09-19T06:52:18.806 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:19.067 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:18 smithi159 ceph-mon[30935]: pgmap v164: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 13 KiB/s wr, 388 op/s 2024-09-19T06:52:19.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:18 smithi189 ceph-mon[34880]: pgmap v164: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 13 KiB/s wr, 388 op/s 2024-09-19T06:52:19.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.280+0000 7f305fc3a640 1 -- 172.21.15.159:0/1825960864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058100e20 msgr2=0x7f3058101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:19.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.280+0000 7f305fc3a640 1 --2- 172.21.15.159:0/1825960864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058100e20 0x7f3058101200 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3054009900 tx=0x7f305402a480 comp rx=0 tx=0).stop 2024-09-19T06:52:19.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.280+0000 7f305fc3a640 1 -- 172.21.15.159:0/1825960864 shutdown_connections 2024-09-19T06:52:19.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.280+0000 7f305fc3a640 1 --2- 172.21.15.159:0/1825960864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3058102ef0 0x7f305810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.280+0000 7f305fc3a640 1 --2- 172.21.15.159:0/1825960864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3058102570 0x7f30581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.280+0000 7f305fc3a640 1 --2- 172.21.15.159:0/1825960864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058100e20 0x7f3058101200 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.280+0000 7f305fc3a640 1 -- 172.21.15.159:0/1825960864 >> 172.21.15.159:0/1825960864 conn(0x7f30580fc7d0 msgr2=0x7f30580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:19.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 -- 172.21.15.159:0/1825960864 shutdown_connections 2024-09-19T06:52:19.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 -- 172.21.15.159:0/1825960864 wait complete. 2024-09-19T06:52:19.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 Processor -- start 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 -- start start 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3058100e20 0x7f3058198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058102570 0x7f3058198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3058102ef0 0x7f305819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3058110f80 con 0x7f3058102570 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3058110e00 con 0x7f3058102ef0 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.281+0000 7f305fc3a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3058111100 con 0x7f3058100e20 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d1d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058102570 0x7f3058198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d1d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058102570 0x7f3058198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51274/0 (socket says 172.21.15.159:51274) 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d1d5640 1 -- 172.21.15.159:0/2963026521 learned_addr learned my addr 172.21.15.159:0/2963026521 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d9d6640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3058100e20 0x7f3058198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305e1d7640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3058102ef0 0x7f305819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d1d5640 1 -- 172.21.15.159:0/2963026521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3058100e20 msgr2=0x7f3058198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:19.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d1d5640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3058100e20 0x7f3058198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d1d5640 1 -- 172.21.15.159:0/2963026521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3058102ef0 msgr2=0x7f305819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d1d5640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3058102ef0 0x7f305819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d1d5640 1 -- 172.21.15.159:0/2963026521 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305819d4d0 con 0x7f3058102570 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d9d6640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3058100e20 0x7f3058198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305d1d5640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058102570 0x7f3058198a60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f304800e9f0 tx=0x7f304800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f304effd640 1 -- 172.21.15.159:0/2963026521 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304800cd80 con 0x7f3058102570 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305fc3a640 1 -- 172.21.15.159:0/2963026521 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305819d7c0 con 0x7f3058102570 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f304effd640 1 -- 172.21.15.159:0/2963026521 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3048005500 con 0x7f3058102570 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f304effd640 1 -- 172.21.15.159:0/2963026521 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048010690 con 0x7f3058102570 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.282+0000 7f305fc3a640 1 -- 172.21.15.159:0/2963026521 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30581a50a0 con 0x7f3058102570 2024-09-19T06:52:19.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.284+0000 7f304effd640 1 -- 172.21.15.159:0/2963026521 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f30480046c0 con 0x7f3058102570 2024-09-19T06:52:19.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.285+0000 7f3062013740 1 Processor -- start 2024-09-19T06:52:19.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.285+0000 7f3062013740 1 -- start start 2024-09-19T06:52:19.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.285+0000 7f304effd640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f30440a33b0 0x7f30440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.285+0000 7f3062013740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47060 0x563b14a47440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.285+0000 7f3062013740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47980 0x563b14a51d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.285+0000 7f3062013740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14a54630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.285+0000 7f3062013740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563b149ac620 con 0x563b14a47060 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.285+0000 7f3062013740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563b14953e50 con 0x563b14a52240 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.285+0000 7f3062013740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563b149a85e0 con 0x563b14a47980 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305e1d7640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f30440a33b0 0x7f30440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d9d6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47060 0x563b14a47440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f304effd640 1 -- 172.21.15.159:0/2963026521 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f30480d02b0 con 0x7f3058102570 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d9d6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47060 0x563b14a47440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51278/0 (socket says 172.21.15.159:51278) 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d9d6640 1 -- 172.21.15.159:0/4217967770 learned_addr learned my addr 172.21.15.159:0/4217967770 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305e1d7640 1 --2- 172.21.15.159:0/4217967770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14a54630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d1d5640 1 --2- 172.21.15.159:0/4217967770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47980 0x563b14a51d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d9d6640 1 -- 172.21.15.159:0/4217967770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47980 msgr2=0x563b14a51d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d9d6640 1 --2- 172.21.15.159:0/4217967770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47980 0x563b14a51d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d9d6640 1 -- 172.21.15.159:0/4217967770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 msgr2=0x563b14a54630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d9d6640 1 --2- 172.21.15.159:0/4217967770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14a54630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d9d6640 1 -- 172.21.15.159:0/4217967770 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b14944d40 con 0x563b14a47060 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305e1d7640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f30440a33b0 0x7f30440a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3050009370 tx=0x7f3050013b40 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f305d9d6640 1 --2- 172.21.15.159:0/4217967770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47060 0x563b14a47440 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3054033000 tx=0x7f3054004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e84d6c60c7ac98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f3043fff640 1 -- 172.21.15.159:0/4217967770 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054035030 con 0x563b14a47060 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f3043fff640 1 -- 172.21.15.159:0/4217967770 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3054005520 con 0x563b14a47060 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.286+0000 7f3043fff640 1 -- 172.21.15.159:0/4217967770 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30540035f0 con 0x563b14a47060 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.287+0000 7f3062013740 1 -- 172.21.15.159:0/4217967770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47060 msgr2=0x563b14a47440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.287+0000 7f3062013740 1 --2- 172.21.15.159:0/4217967770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47060 0x563b14a47440 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3054033000 tx=0x7f3054004040 comp rx=0 tx=0).stop 2024-09-19T06:52:19.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.287+0000 7f3062013740 1 -- 172.21.15.159:0/4217967770 shutdown_connections 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.287+0000 7f3062013740 1 --2- 172.21.15.159:0/4217967770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14a54630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.287+0000 7f3062013740 1 --2- 172.21.15.159:0/4217967770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47980 0x563b14a51d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.287+0000 7f3062013740 1 --2- 172.21.15.159:0/4217967770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47060 0x563b14a47440 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.287+0000 7f3062013740 1 -- 172.21.15.159:0/4217967770 >> 172.21.15.159:0/4217967770 conn(0x563b14a435f0 msgr2=0x563b14a439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.287+0000 7f3062013740 1 -- 172.21.15.159:0/4217967770 shutdown_connections 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.287+0000 7f3062013740 1 -- 172.21.15.159:0/4217967770 wait complete. 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f3062013740 1 -- start start 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f3062013740 1 Processor -- start 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f3062013740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14a4f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f3062013740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14a4f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f3062013740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14a4fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f3062013740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563b14a54e10 con 0x563b14a47980 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f3062013740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563b14934f10 con 0x563b14a52240 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f3062013740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563b14a54f90 con 0x563b14a47060 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f3062013740 10 client.0 _ll_register_callbacks cb 0x563b14958db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f305d1d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14a4f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f305d1d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14a4f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51286/0 (socket says 172.21.15.159:51286) 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f305d1d5640 1 -- 172.21.15.159:0/1223804870 learned_addr learned my addr 172.21.15.159:0/1223804870 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.288+0000 7f305d9d6640 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14a4f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f305e1d7640 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14a4fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f305d1d5640 1 -- 172.21.15.159:0/1223804870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 msgr2=0x563b14a4f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:19.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f305d1d5640 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14a4f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f305d1d5640 1 -- 172.21.15.159:0/1223804870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 msgr2=0x563b14a4fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f305d1d5640 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14a4fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f305d1d5640 1 -- 172.21.15.159:0/1223804870 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b146bb580 con 0x563b14a47980 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f305d1d5640 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14a4f6b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f304809c260 tx=0x7f304809bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f668655fa610fafe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f30417fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f30417fa640 1 -- 172.21.15.159:0/1223804870 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30480cde50 con 0x563b14a47980 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f30417fa640 1 -- 172.21.15.159:0/1223804870 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f30480a4d40 con 0x563b14a47980 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f3062013740 1 -- 172.21.15.159:0/1223804870 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3054005520 con 0x563b14a47980 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f30417fa640 1 -- 172.21.15.159:0/1223804870 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f30480a51d0 con 0x563b14a47980 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f3062013740 10 client.16692 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:19.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f3062013740 1 -- 172.21.15.159:0/1223804870 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563b14785960 con 0x563b14a47980 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.289+0000 7f30417fa640 1 -- 172.21.15.159:0/1223804870 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3054005520 con 0x563b14a47980 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f30417fa640 1 -- 172.21.15.159:0/1223804870 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f30480982b0 con 0x563b14a47980 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f3062013740 10 client.16692 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f3062013740 10 client.16692 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f3062013740 20 client.16692 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f3062013740 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563b14a61e50 0x563b14a64290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f3062013740 4 client.16692 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f3062013740 1 -- 172.21.15.159:0/1223804870 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b149b9b90 con 0x563b14a61e50 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f305d9d6640 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563b14a61e50 0x563b14a64290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f30417fa640 10 client.16692 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.290+0000 7f305d9d6640 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563b14a61e50 0x563b14a64290 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75fa49c9ae1d73a7 server_cookie=fb39ab9ea181cccb in_seq=0 out_seq=0 2024-09-19T06:52:19.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f30417fa640 1 -- 172.21.15.159:0/1223804870 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b149b9b90 con 0x563b14a61e50 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f30417fa640 10 client.16692 handle_command_reply: tid=0 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 client.16692 shutdown 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 -- 172.21.15.159:0/1223804870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 msgr2=0x563b14a4f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14a4f6b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f304809c260 tx=0x7f304809bf80 comp rx=0 tx=0).stop 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 -- 172.21.15.159:0/1223804870 shutdown_connections 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563b14a61e50 0x563b14a64290 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14a4fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14a4f6b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 --2- 172.21.15.159:0/1223804870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14a4f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f30417fa640 0 client.16692 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 -- 172.21.15.159:0/1223804870 >> 172.21.15.159:0/1223804870 conn(0x563b14a435f0 msgr2=0x563b14a492d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 -- 172.21.15.159:0/1223804870 shutdown_connections 2024-09-19T06:52:19.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.291+0000 7f3062013740 1 -- 172.21.15.159:0/1223804870 wait complete. 2024-09-19T06:52:19.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.292+0000 7f3062013740 20 client.16692 trim_cache size 0 max 16384 2024-09-19T06:52:19.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.308+0000 7f3062013740 1 Processor -- start 2024-09-19T06:52:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.308+0000 7f3062013740 1 -- start start 2024-09-19T06:52:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.308+0000 7f3062013740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14a42640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.308+0000 7f3062013740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a47980 0x563b14a5a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.308+0000 7f3062013740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a52240 0x563b14a5ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.308+0000 7f3062013740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f30581ab790 con 0x563b14a52240 2024-09-19T06:52:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.308+0000 7f3062013740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30581ae010 con 0x563b14a47980 2024-09-19T06:52:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.308+0000 7f3062013740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f30581abe00 con 0x563b14a47060 2024-09-19T06:52:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305e1d7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a52240 0x563b14a5ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305e1d7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a52240 0x563b14a5ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51300/0 (socket says 172.21.15.159:51300) 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305e1d7640 1 -- 172.21.15.159:0/2887496707 learned_addr learned my addr 172.21.15.159:0/2887496707 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305d9d6640 1 --2- 172.21.15.159:0/2887496707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14a42640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305d1d5640 1 --2- 172.21.15.159:0/2887496707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a47980 0x563b14a5a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305e1d7640 1 -- 172.21.15.159:0/2887496707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 msgr2=0x563b14a42640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305e1d7640 1 --2- 172.21.15.159:0/2887496707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14a42640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305e1d7640 1 -- 172.21.15.159:0/2887496707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a47980 msgr2=0x563b14a5a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305e1d7640 1 --2- 172.21.15.159:0/2887496707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a47980 0x563b14a5a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305e1d7640 1 -- 172.21.15.159:0/2887496707 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b14a46de0 con 0x563b14a52240 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f305e1d7640 1 --2- 172.21.15.159:0/2887496707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a52240 0x563b14a5ab00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3050011c50 tx=0x7f305001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546c5b1ad9f28400 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f30437fe640 1 -- 172.21.15.159:0/2887496707 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305002a3f0 con 0x563b14a52240 2024-09-19T06:52:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f30437fe640 1 -- 172.21.15.159:0/2887496707 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3050013e50 con 0x563b14a52240 2024-09-19T06:52:19.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.309+0000 7f30437fe640 1 -- 172.21.15.159:0/2887496707 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3050029940 con 0x563b14a52240 2024-09-19T06:52:19.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 -- 172.21.15.159:0/2887496707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a52240 msgr2=0x563b14a5ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:19.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 --2- 172.21.15.159:0/2887496707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a52240 0x563b14a5ab00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3050011c50 tx=0x7f305001d000 comp rx=0 tx=0).stop 2024-09-19T06:52:19.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 -- 172.21.15.159:0/2887496707 shutdown_connections 2024-09-19T06:52:19.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 --2- 172.21.15.159:0/2887496707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a52240 0x563b14a5ab00 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 --2- 172.21.15.159:0/2887496707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a47980 0x563b14a5a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 --2- 172.21.15.159:0/2887496707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14a42640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 -- 172.21.15.159:0/2887496707 >> 172.21.15.159:0/2887496707 conn(0x563b14a435f0 msgr2=0x563b14a41f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 -- 172.21.15.159:0/2887496707 shutdown_connections 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 -- 172.21.15.159:0/2887496707 wait complete. 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 -- start start 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.310+0000 7f3062013740 1 Processor -- start 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f3062013740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14ac9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f3062013740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14ac9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f3062013740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14ac4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f3062013740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f30581ac4d0 con 0x563b14a47980 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f3062013740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30581ad940 con 0x563b14a52240 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f3062013740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f30581acba0 con 0x563b14a47060 2024-09-19T06:52:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f3062013740 10 client.0 _ll_register_callbacks cb 0x7f304809c0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d1d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14ac9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d1d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14ac9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51306/0 (socket says 172.21.15.159:51306) 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d1d5640 1 -- 172.21.15.159:0/1923619569 learned_addr learned my addr 172.21.15.159:0/1923619569 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305e1d7640 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14ac4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d9d6640 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14ac9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d1d5640 1 -- 172.21.15.159:0/1923619569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 msgr2=0x563b14ac9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d1d5640 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14ac9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d1d5640 1 -- 172.21.15.159:0/1923619569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 msgr2=0x563b14ac4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d1d5640 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14ac4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d1d5640 1 -- 172.21.15.159:0/1923619569 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b14ac5300 con 0x563b14a47980 2024-09-19T06:52:19.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d9d6640 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14ac9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f305d1d5640 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14ac9660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f304809c4f0 tx=0x7f3048004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a394125c0e3517a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f30417fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.311+0000 7f30417fa640 1 -- 172.21.15.159:0/1923619569 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30480cde60 con 0x563b14a47980 2024-09-19T06:52:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f30417fa640 1 -- 172.21.15.159:0/1923619569 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f3048067340 con 0x563b14a47980 2024-09-19T06:52:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f3062013740 1 -- 172.21.15.159:0/1923619569 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3050013e50 con 0x563b14a47980 2024-09-19T06:52:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f30417fa640 1 -- 172.21.15.159:0/1923619569 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f304809b420 con 0x563b14a47980 2024-09-19T06:52:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f3062013740 10 client.16698 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f3062013740 1 -- 172.21.15.159:0/1923619569 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563b14ac5300 con 0x563b14a47980 2024-09-19T06:52:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f30417fa640 1 -- 172.21.15.159:0/1923619569 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3050013e50 con 0x563b14a47980 2024-09-19T06:52:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f30417fa640 1 -- 172.21.15.159:0/1923619569 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f304809b9b0 con 0x563b14a47980 2024-09-19T06:52:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f3062013740 10 client.16698 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f3062013740 10 client.16698 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:52:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f3062013740 20 client.16698 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f3062013740 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563b14ad1e40 0x563b14ad4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f3062013740 4 client.16698 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f9db16ee", "release": true, "await": true}] 2024-09-19T06:52:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f3062013740 1 -- 172.21.15.159:0/1923619569 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f9db16ee", "release": true, "await": true}) -- 0x563b149b40a0 con 0x563b14ad1e40 2024-09-19T06:52:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.312+0000 7f305d9d6640 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563b14ad1e40 0x563b14ad4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.313+0000 7f30417fa640 10 client.16698 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:19.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.313+0000 7f305d9d6640 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563b14ad1e40 0x563b14ad4260 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=101de4abf4aa3b8 server_cookie=b6e62e6ea84f01e3 in_seq=0 out_seq=0 2024-09-19T06:52:19.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:18 smithi203 ceph-mon[35473]: pgmap v164: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 13 KiB/s wr, 388 op/s 2024-09-19T06:52:19.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f30417fa640 1 -- 172.21.15.159:0/1923619569 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563b149b40a0 con 0x563b14ad1e40 2024-09-19T06:52:19.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f30417fa640 10 client.16698 handle_command_reply: tid=0 2024-09-19T06:52:19.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 client.16698 shutdown 2024-09-19T06:52:19.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 -- 172.21.15.159:0/1923619569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 msgr2=0x563b14ac9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:19.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14ac9660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f304809c4f0 tx=0x7f3048004a40 comp rx=0 tx=0).stop 2024-09-19T06:52:19.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 -- 172.21.15.159:0/1923619569 shutdown_connections 2024-09-19T06:52:19.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563b14ad1e40 0x563b14ad4260 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563b14a52240 0x563b14ac4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563b14a47980 0x563b14ac9660 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 --2- 172.21.15.159:0/1923619569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b14a47060 0x563b14ac9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f30417fa640 0 client.16698 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:19.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 -- 172.21.15.159:0/1923619569 >> 172.21.15.159:0/1923619569 conn(0x563b14a435f0 msgr2=0x563b14a42750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:19.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 -- 172.21.15.159:0/1923619569 shutdown_connections 2024-09-19T06:52:19.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 1 -- 172.21.15.159:0/1923619569 wait complete. 2024-09-19T06:52:19.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.495+0000 7f3062013740 20 client.16698 trim_cache size 0 max 16384 2024-09-19T06:52:19.498 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:52:19.498 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 24, 2024-09-19T06:52:19.498 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:52:19.499 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 24, 2024-09-19T06:52:19.499 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": { 2024-09-19T06:52:19.499 INFO:teuthology.orchestra.run.smithi159.stdout: "f9db16ee": { 2024-09-19T06:52:19.499 INFO:teuthology.orchestra.run.smithi159.stdout: "version": 24, 2024-09-19T06:52:19.499 INFO:teuthology.orchestra.run.smithi159.stdout: "age_ref": 0.0, 2024-09-19T06:52:19.499 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "timeout": 90.0, 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "expiration": 149.8, 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "members": { 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "file:/": { 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "excluded": false, 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "state": { 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RELEASED", 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.0 2024-09-19T06:52:19.500 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:52:19.501 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:52:19.501 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:52:19.501 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:52:19.501 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:52:19.501 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:52:19.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 -- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f30440a33b0 msgr2=0x7f30440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:19.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f30440a33b0 0x7f30440a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3050009370 tx=0x7f3050013b40 comp rx=0 tx=0).stop 2024-09-19T06:52:19.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 -- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058102570 msgr2=0x7f3058198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:19.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058102570 0x7f3058198a60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f304800e9f0 tx=0x7f304800edf0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 -- 172.21.15.159:0/2963026521 shutdown_connections 2024-09-19T06:52:19.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f30440a33b0 0x7f30440a5870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3058102ef0 0x7f305819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3058102570 0x7f3058198a60 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 --2- 172.21.15.159:0/2963026521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3058100e20 0x7f3058198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:19.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 -- 172.21.15.159:0/2963026521 >> 172.21.15.159:0/2963026521 conn(0x7f30580fc7d0 msgr2=0x7f305806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:19.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 -- 172.21.15.159:0/2963026521 shutdown_connections 2024-09-19T06:52:19.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:19.496+0000 7f305fc3a640 1 -- 172.21.15.159:0/2963026521 wait complete. 2024-09-19T06:52:20.280 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f9db16ee', total seconds elapsed: 33.3 2024-09-19T06:52:20.658 INFO:tasks.workunit.client.0.smithi159.stdout:50000 write 0x5304f4 thru 0x53fa11 (0xf51e bytes) 2024-09-19T06:52:20.658 INFO:tasks.workunit.client.0.smithi159.stdout:All 50000 operations completed A-OK! 2024-09-19T06:52:20.661 INFO:tasks.workunit.client.0.smithi159.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-09-19T06:52:20.663 INFO:tasks.workunit.client.0.smithi159.stdout:Seed set to 1 2024-09-19T06:52:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:20 smithi203 ceph-mon[35473]: pgmap v165: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 13 KiB/s wr, 388 op/s 2024-09-19T06:52:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:20 smithi189 ceph-mon[34880]: pgmap v165: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 13 KiB/s wr, 388 op/s 2024-09-19T06:52:21.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:20 smithi159 ceph-mon[30935]: pgmap v165: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 13 KiB/s wr, 388 op/s 2024-09-19T06:52:21.758 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-19T06:52:21.759 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-19T06:52:21.761 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T06:52:21.761 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T06:52:21.761 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T06:52:21.763 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T06:52:21.766 INFO:tasks.workunit.client.0.smithi159.stderr:main: filesystem does not support exchange range, disabling! 2024-09-19T06:52:21.766 INFO:tasks.workunit.client.0.smithi159.stdout:skipping zero size read 2024-09-19T06:52:21.777 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0x1c37b90 2024-09-19T06:52:21.785 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0x5bd330d 2024-09-19T06:52:21.799 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0x637bf99 2024-09-19T06:52:21.968 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0x63d9b9c 2024-09-19T06:52:23.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:22 smithi203 ceph-mon[35473]: pgmap v166: 97 pgs: 97 active+clean; 55 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 399 KiB/s wr, 454 op/s 2024-09-19T06:52:23.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:22 smithi189 ceph-mon[34880]: pgmap v166: 97 pgs: 97 active+clean; 55 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 399 KiB/s wr, 454 op/s 2024-09-19T06:52:23.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:22 smithi159 ceph-mon[30935]: pgmap v166: 97 pgs: 97 active+clean; 55 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 399 KiB/s wr, 454 op/s 2024-09-19T06:52:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:24 smithi203 ceph-mon[35473]: pgmap v167: 97 pgs: 97 active+clean; 55 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 386 KiB/s wr, 67 op/s 2024-09-19T06:52:25.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:24 smithi189 ceph-mon[34880]: pgmap v167: 97 pgs: 97 active+clean; 55 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 386 KiB/s wr, 67 op/s 2024-09-19T06:52:25.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:24 smithi159 ceph-mon[30935]: pgmap v167: 97 pgs: 97 active+clean; 55 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 386 KiB/s wr, 67 op/s 2024-09-19T06:52:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:26 smithi203 ceph-mon[35473]: pgmap v168: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 507 op/s 2024-09-19T06:52:27.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:26 smithi189 ceph-mon[34880]: pgmap v168: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 507 op/s 2024-09-19T06:52:27.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:26 smithi159 ceph-mon[30935]: pgmap v168: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 507 op/s 2024-09-19T06:52:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:28 smithi203 ceph-mon[35473]: pgmap v169: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 506 op/s 2024-09-19T06:52:29.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:28 smithi189 ceph-mon[34880]: pgmap v169: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 506 op/s 2024-09-19T06:52:29.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:28 smithi159 ceph-mon[30935]: pgmap v169: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 506 op/s 2024-09-19T06:52:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:30 smithi203 ceph-mon[35473]: pgmap v170: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 506 op/s 2024-09-19T06:52:31.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:30 smithi189 ceph-mon[34880]: pgmap v170: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 506 op/s 2024-09-19T06:52:31.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:30 smithi159 ceph-mon[30935]: pgmap v170: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 506 op/s 2024-09-19T06:52:31.632 INFO:tasks.workunit.client.0.smithi159.stdout:10000 mapread 0x33cc4e3 thru 0x33cec16 (0x2734 bytes) 2024-09-19T06:52:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.664+0000 7fe33cd11640 1 -- 172.21.15.159:0/1093665125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe338101370 msgr2=0x7fe33810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.664+0000 7fe33cd11640 1 --2- 172.21.15.159:0/1093665125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe338101370 0x7fe33810d8a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe330009cd0 tx=0x7fe33002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.665+0000 7fe33cd11640 1 -- 172.21.15.159:0/1093665125 shutdown_connections 2024-09-19T06:52:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.665+0000 7fe33cd11640 1 --2- 172.21.15.159:0/1093665125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe338101370 0x7fe33810d8a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.665+0000 7fe33cd11640 1 --2- 172.21.15.159:0/1093665125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3381009d0 0x7fe338100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.665+0000 7fe33cd11640 1 --2- 172.21.15.159:0/1093665125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3381069e0 0x7fe338106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.665+0000 7fe33cd11640 1 -- 172.21.15.159:0/1093665125 >> 172.21.15.159:0/1093665125 conn(0x7fe3380fc6b0 msgr2=0x7fe3380fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.665+0000 7fe33cd11640 1 -- 172.21.15.159:0/1093665125 shutdown_connections 2024-09-19T06:52:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.665+0000 7fe33cd11640 1 -- 172.21.15.159:0/1093665125 wait complete. 2024-09-19T06:52:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33cd11640 1 Processor -- start 2024-09-19T06:52:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33cd11640 1 -- start start 2024-09-19T06:52:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33cd11640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3381009d0 0x7fe338196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33cd11640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe338101370 0x7fe3381974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33cd11640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3381069e0 0x7fe338197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33cd11640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe338110e20 con 0x7fe3381009d0 2024-09-19T06:52:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33cd11640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe338110ca0 con 0x7fe338101370 2024-09-19T06:52:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33cd11640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe338110fa0 con 0x7fe3381069e0 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3381009d0 0x7fe338196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3381009d0 0x7fe338196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48954/0 (socket says 172.21.15.159:48954) 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33659c640 1 -- 172.21.15.159:0/3994016867 learned_addr learned my addr 172.21.15.159:0/3994016867 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe336d9d640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3381069e0 0x7fe338197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe335d9b640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe338101370 0x7fe3381974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33659c640 1 -- 172.21.15.159:0/3994016867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3381069e0 msgr2=0x7fe338197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33659c640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3381069e0 0x7fe338197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33659c640 1 -- 172.21.15.159:0/3994016867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe338101370 msgr2=0x7fe3381974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33659c640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe338101370 0x7fe3381974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33659c640 1 -- 172.21.15.159:0/3994016867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3381a67f0 con 0x7fe3381009d0 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe336d9d640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3381069e0 0x7fe338197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.666+0000 7fe33659c640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3381009d0 0x7fe338196f80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe32800ea60 tx=0x7fe32800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.667+0000 7fe3277fe640 1 -- 172.21.15.159:0/3994016867 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32800cde0 con 0x7fe3381009d0 2024-09-19T06:52:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.667+0000 7fe33cd11640 1 -- 172.21.15.159:0/3994016867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3381a6ae0 con 0x7fe3381009d0 2024-09-19T06:52:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.667+0000 7fe3277fe640 1 -- 172.21.15.159:0/3994016867 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3280035f0 con 0x7fe3381009d0 2024-09-19T06:52:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.667+0000 7fe3277fe640 1 -- 172.21.15.159:0/3994016867 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328010670 con 0x7fe3381009d0 2024-09-19T06:52:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.667+0000 7fe33cd11640 1 -- 172.21.15.159:0/3994016867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3381a7030 con 0x7fe3381009d0 2024-09-19T06:52:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.669+0000 7fe33faa6740 1 Processor -- start 2024-09-19T06:52:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.669+0000 7fe33faa6740 1 -- start start 2024-09-19T06:52:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.669+0000 7fe3277fe640 1 -- 172.21.15.159:0/3994016867 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe3280037a0 con 0x7fe3381009d0 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1a3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1a4410 0x56148d1ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1aecb0 0x56148d1b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe33faa6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56148d1082f0 con 0x56148d1a3af0 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe33faa6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56148d0b0270 con 0x56148d1aecb0 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe33faa6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56148d1042b0 con 0x56148d1a4410 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe336d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1a3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe33659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1a4410 0x56148d1ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe336d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1a3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48964/0 (socket says 172.21.15.159:48964) 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe335d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1aecb0 0x56148d1b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe336d9d640 1 -- 172.21.15.159:0/3387429953 learned_addr learned my addr 172.21.15.159:0/3387429953 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe336d9d640 1 -- 172.21.15.159:0/3387429953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1a4410 msgr2=0x56148d1ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe336d9d640 1 --2- 172.21.15.159:0/3387429953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1a4410 0x56148d1ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe336d9d640 1 -- 172.21.15.159:0/3387429953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1aecb0 msgr2=0x56148d1b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe336d9d640 1 --2- 172.21.15.159:0/3387429953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1aecb0 0x56148d1b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe336d9d640 1 -- 172.21.15.159:0/3387429953 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56148d0af340 con 0x56148d1a3af0 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe335d9b640 1 --2- 172.21.15.159:0/3387429953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1aecb0 0x56148d1b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe3277fe640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe3200a3460 0x7fe3200a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.670+0000 7fe336d9d640 1 --2- 172.21.15.159:0/3387429953 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1a3ed0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe330004ad0 tx=0x7fe330009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44da36a8910d536e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.671+0000 7fe324ff9640 1 -- 172.21.15.159:0/3387429953 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330048070 con 0x56148d1a3af0 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.671+0000 7fe33659c640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe3200a3460 0x7fe3200a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.671+0000 7fe324ff9640 1 -- 172.21.15.159:0/3387429953 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe330036070 con 0x56148d1a3af0 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.671+0000 7fe324ff9640 1 -- 172.21.15.159:0/3387429953 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3300046f0 con 0x56148d1a3af0 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.671+0000 7fe3277fe640 1 -- 172.21.15.159:0/3994016867 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe3280cffc0 con 0x7fe3381009d0 2024-09-19T06:52:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33faa6740 1 -- 172.21.15.159:0/3387429953 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 msgr2=0x56148d1a3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3387429953 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1a3ed0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe330004ad0 tx=0x7fe330009a20 comp rx=0 tx=0).stop 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33659c640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe3200a3460 0x7fe3200a5920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe3280cd790 tx=0x7fe3280d5040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33faa6740 1 -- 172.21.15.159:0/3387429953 shutdown_connections 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3387429953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1aecb0 0x56148d1b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3387429953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1a4410 0x56148d1ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3387429953 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1a3ed0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33faa6740 1 -- 172.21.15.159:0/3387429953 >> 172.21.15.159:0/3387429953 conn(0x56148d1a0060 msgr2=0x56148d1a0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33faa6740 1 -- 172.21.15.159:0/3387429953 shutdown_connections 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.672+0000 7fe33faa6740 1 -- 172.21.15.159:0/3387429953 wait complete. 2024-09-19T06:52:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe33faa6740 1 -- start start 2024-09-19T06:52:31.679 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe33faa6740 1 Processor -- start 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe33faa6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56148d1b1880 con 0x56148d1a3af0 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe33faa6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56148d091290 con 0x56148d1a4410 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe33faa6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56148d1b1a00 con 0x56148d1aecb0 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe33faa6740 10 client.0 _ll_register_callbacks cb 0x56148d0c2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe336d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe335d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe336d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1abc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48972/0 (socket says 172.21.15.159:48972) 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe336d9d640 1 -- 172.21.15.159:0/3684204544 learned_addr learned my addr 172.21.15.159:0/3684204544 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe336d9d640 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe335d9b640 1 -- 172.21.15.159:0/3684204544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 msgr2=0x56148d1ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe335d9b640 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe335d9b640 1 -- 172.21.15.159:0/3684204544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 msgr2=0x56148d1abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe335d9b640 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.673+0000 7fe335d9b640 1 -- 172.21.15.159:0/3684204544 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56148ce1b210 con 0x56148d1a4410 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe336d9d640 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe335d9b640 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1ac1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x56148d1a6690 tx=0x7fe32c012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97ac9e1cacd0f282 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe31dffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe31dffb640 1 -- 172.21.15.159:0/3684204544 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c004030 con 0x56148d1a4410 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe31dffb640 1 -- 172.21.15.159:0/3684204544 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe32c0041d0 con 0x56148d1a4410 2024-09-19T06:52:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe33faa6740 1 -- 172.21.15.159:0/3684204544 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe330036070 con 0x56148d1a4410 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe31dffb640 1 -- 172.21.15.159:0/3684204544 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe32c0043d0 con 0x56148d1a4410 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe33faa6740 10 client.25988 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe33faa6740 1 -- 172.21.15.159:0/3684204544 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56148cee7620 con 0x56148d1a4410 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.674+0000 7fe31dffb640 1 -- 172.21.15.159:0/3684204544 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe330036070 con 0x56148d1a4410 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe31dffb640 1 -- 172.21.15.159:0/3684204544 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe32c023070 con 0x56148d1a4410 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe33faa6740 10 client.25988 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe33faa6740 10 client.25988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe33faa6740 20 client.25988 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56148d1bed10 0x56148d1c1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe33faa6740 4 client.25988 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe33faa6740 1 -- 172.21.15.159:0/3684204544 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56148d115a20 con 0x56148d1bed10 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe336d9d640 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56148d1bed10 0x56148d1c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe31dffb640 10 client.25988 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.675+0000 7fe336d9d640 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56148d1bed10 0x56148d1c1100 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec28887101a45e1 server_cookie=cebaba5d4f5b1c12 in_seq=0 out_seq=0 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe31dffb640 1 -- 172.21.15.159:0/3684204544 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56148d115a20 con 0x56148d1bed10 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe31dffb640 10 client.25988 handle_command_reply: tid=0 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 client.25988 shutdown 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 -- 172.21.15.159:0/3684204544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 msgr2=0x56148d1ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1ac1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x56148d1a6690 tx=0x7fe32c012b60 comp rx=0 tx=0).stop 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 -- 172.21.15.159:0/3684204544 shutdown_connections 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56148d1bed10 0x56148d1c1100 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1ac1a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe31dffb640 0 client.25988 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 --2- 172.21.15.159:0/3684204544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 -- 172.21.15.159:0/3684204544 >> 172.21.15.159:0/3684204544 conn(0x56148d1a0060 msgr2=0x56148d1a5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 -- 172.21.15.159:0/3684204544 shutdown_connections 2024-09-19T06:52:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 1 -- 172.21.15.159:0/3684204544 wait complete. 2024-09-19T06:52:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.676+0000 7fe33faa6740 20 client.25988 trim_cache size 0 max 16384 2024-09-19T06:52:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe33faa6740 1 Processor -- start 2024-09-19T06:52:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe33faa6740 1 -- start start 2024-09-19T06:52:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1ac510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe33faa6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe3381adac0 con 0x56148d1a3af0 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe33faa6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3381b0340 con 0x56148d1a4410 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe33faa6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3381ae130 con 0x56148d1aecb0 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe335d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.693+0000 7fe336d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe335d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1adbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:47762/0 (socket says 172.21.15.159:47762) 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe335d9b640 1 -- 172.21.15.159:0/4226019204 learned_addr learned my addr 172.21.15.159:0/4226019204 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe336d9d640 1 --2- 172.21.15.159:0/4226019204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe335d9b640 1 -- 172.21.15.159:0/4226019204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 msgr2=0x56148d1c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe335d9b640 1 --2- 172.21.15.159:0/4226019204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe335d9b640 1 -- 172.21.15.159:0/4226019204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 msgr2=0x56148d1ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe335d9b640 1 --2- 172.21.15.159:0/4226019204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe335d9b640 1 -- 172.21.15.159:0/4226019204 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56148d19a2f0 con 0x56148d1a4410 2024-09-19T06:52:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe335d9b640 1 --2- 172.21.15.159:0/4226019204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1adbd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe32c003e20 tx=0x7fe32c00f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a17c184cae50de72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe31ffff640 1 -- 172.21.15.159:0/4226019204 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c029030 con 0x56148d1a4410 2024-09-19T06:52:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe31ffff640 1 -- 172.21.15.159:0/4226019204 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe32c0035f0 con 0x56148d1a4410 2024-09-19T06:52:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.694+0000 7fe31ffff640 1 -- 172.21.15.159:0/4226019204 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c005030 con 0x56148d1a4410 2024-09-19T06:52:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.695+0000 7fe33faa6740 1 -- 172.21.15.159:0/4226019204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 msgr2=0x56148d1adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.695+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4226019204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1adbd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe32c003e20 tx=0x7fe32c00f810 comp rx=0 tx=0).stop 2024-09-19T06:52:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.695+0000 7fe33faa6740 1 -- 172.21.15.159:0/4226019204 shutdown_connections 2024-09-19T06:52:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.695+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4226019204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.695+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4226019204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1adbd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.695+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4226019204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.695+0000 7fe33faa6740 1 -- 172.21.15.159:0/4226019204 >> 172.21.15.159:0/4226019204 conn(0x56148d1a0060 msgr2=0x56148d1ad4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.695+0000 7fe33faa6740 1 -- 172.21.15.159:0/4226019204 shutdown_connections 2024-09-19T06:52:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.695+0000 7fe33faa6740 1 -- 172.21.15.159:0/4226019204 wait complete. 2024-09-19T06:52:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe33faa6740 1 -- start start 2024-09-19T06:52:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe33faa6740 1 Processor -- start 2024-09-19T06:52:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe33faa6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe33faa6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe3381ae800 con 0x56148d1a3af0 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe33faa6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3381afc70 con 0x56148d1a4410 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe33faa6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3381aeed0 con 0x56148d1aecb0 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe33faa6740 10 client.0 _ll_register_callbacks cb 0x7fe32c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1b6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48986/0 (socket says 172.21.15.159:48986) 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 -- 172.21.15.159:0/4094688726 learned_addr learned my addr 172.21.15.159:0/4094688726 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe335d9b640 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 -- 172.21.15.159:0/4094688726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 msgr2=0x56148d1a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 -- 172.21.15.159:0/4094688726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 msgr2=0x56148d1b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 -- 172.21.15.159:0/4094688726 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56148d1a8860 con 0x56148d1a3af0 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe335d9b640 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe336d9d640 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1b6c90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe3300042a0 tx=0x7fe330009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72530281064879cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.696+0000 7fe31dffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe31dffb640 1 -- 172.21.15.159:0/4094688726 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330048040 con 0x56148d1a3af0 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe33faa6740 1 -- 172.21.15.159:0/4094688726 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe32c0035f0 con 0x56148d1a3af0 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe31dffb640 1 -- 172.21.15.159:0/4094688726 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe330003e70 con 0x56148d1a3af0 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe31dffb640 1 -- 172.21.15.159:0/4094688726 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe330063050 con 0x56148d1a3af0 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe33faa6740 10 client.16716 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe33faa6740 1 -- 172.21.15.159:0/4094688726 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56148d229240 con 0x56148d1a3af0 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe31dffb640 1 -- 172.21.15.159:0/4094688726 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe32c0035f0 con 0x56148d1a3af0 2024-09-19T06:52:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe31dffb640 1 -- 172.21.15.159:0/4094688726 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe330042030 con 0x56148d1a3af0 2024-09-19T06:52:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe33faa6740 10 client.16716 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe33faa6740 10 client.16716 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe33faa6740 20 client.16716 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56148d229530 0x56148d22b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe33faa6740 4 client.16716 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:52:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe33faa6740 1 -- 172.21.15.159:0/4094688726 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56148d10fd70 con 0x56148d229530 2024-09-19T06:52:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.697+0000 7fe335d9b640 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56148d229530 0x56148d22b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.698+0000 7fe31dffb640 10 client.16716 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.698+0000 7fe335d9b640 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56148d229530 0x56148d22b920 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e65708111fa219 server_cookie=bb0d0e60c0249819 in_seq=0 out_seq=0 2024-09-19T06:52:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe31dffb640 1 -- 172.21.15.159:0/4094688726 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56148d10fd70 con 0x56148d229530 2024-09-19T06:52:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe31dffb640 10 client.16716 handle_command_reply: tid=0 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 client.16716 shutdown 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 -- 172.21.15.159:0/4094688726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 msgr2=0x56148d1b6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1b6c90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe3300042a0 tx=0x7fe330009a20 comp rx=0 tx=0).stop 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 -- 172.21.15.159:0/4094688726 shutdown_connections 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56148d229530 0x56148d22b920 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56148d1aecb0 0x56148d1a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56148d1a4410 0x56148d1b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 --2- 172.21.15.159:0/4094688726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56148d1a3af0 0x56148d1b6c90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 -- 172.21.15.159:0/4094688726 >> 172.21.15.159:0/4094688726 conn(0x56148d1a0060 msgr2=0x56148d1aa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe31dffb640 0 client.16716 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 -- 172.21.15.159:0/4094688726 shutdown_connections 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 1 -- 172.21.15.159:0/4094688726 wait complete. 2024-09-19T06:52:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.710+0000 7fe33faa6740 20 client.16716 trim_cache size 0 max 16384 2024-09-19T06:52:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:52:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:52:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:52:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:52:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 -- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe3200a3460 msgr2=0x7fe3200a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe3200a3460 0x7fe3200a5920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe3280cd790 tx=0x7fe3280d5040 comp rx=0 tx=0).stop 2024-09-19T06:52:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 -- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3381009d0 msgr2=0x7fe338196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3381009d0 0x7fe338196f80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe32800ea60 tx=0x7fe32800ef20 comp rx=0 tx=0).stop 2024-09-19T06:52:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 -- 172.21.15.159:0/3994016867 shutdown_connections 2024-09-19T06:52:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe3200a3460 0x7fe3200a5920 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3381069e0 0x7fe338197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe338101370 0x7fe3381974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 --2- 172.21.15.159:0/3994016867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3381009d0 0x7fe338196f80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 -- 172.21.15.159:0/3994016867 >> 172.21.15.159:0/3994016867 conn(0x7fe3380fc6b0 msgr2=0x7fe3380fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 -- 172.21.15.159:0/3994016867 shutdown_connections 2024-09-19T06:52:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:31.711+0000 7fe33cd11640 1 -- 172.21.15.159:0/3994016867 wait complete. 2024-09-19T06:52:32.949 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:32 smithi159 ceph-mon[30935]: pgmap v171: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 3.0 MiB/s wr, 990 op/s 2024-09-19T06:52:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:32 smithi203 ceph-mon[35473]: pgmap v171: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 3.0 MiB/s wr, 990 op/s 2024-09-19T06:52:33.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:32 smithi189 ceph-mon[34880]: pgmap v171: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 3.0 MiB/s wr, 990 op/s 2024-09-19T06:52:34.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:34 smithi159 ceph-mon[30935]: pgmap v172: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 923 op/s 2024-09-19T06:52:35.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:34 smithi203 ceph-mon[35473]: pgmap v172: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 923 op/s 2024-09-19T06:52:35.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:34 smithi189 ceph-mon[34880]: pgmap v172: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 923 op/s 2024-09-19T06:52:37.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:36 smithi203 ceph-mon[35473]: pgmap v173: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 3.9 MiB/s wr, 1.40k op/s 2024-09-19T06:52:37.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:36 smithi189 ceph-mon[34880]: pgmap v173: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 3.9 MiB/s wr, 1.40k op/s 2024-09-19T06:52:37.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:36 smithi159 ceph-mon[30935]: pgmap v173: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 3.9 MiB/s wr, 1.40k op/s 2024-09-19T06:52:37.638 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0x63e5d2a 2024-09-19T06:52:39.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:38 smithi203 ceph-mon[35473]: pgmap v174: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 957 op/s 2024-09-19T06:52:39.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:38 smithi189 ceph-mon[34880]: pgmap v174: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 957 op/s 2024-09-19T06:52:39.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:38 smithi159 ceph-mon[30935]: pgmap v174: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 957 op/s 2024-09-19T06:52:40.015 INFO:tasks.workunit.client.0.smithi159.stdout:truncating to largest ever: 0x63e9b52 2024-09-19T06:52:41.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:40 smithi203 ceph-mon[35473]: pgmap v175: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 957 op/s 2024-09-19T06:52:41.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:40 smithi189 ceph-mon[34880]: pgmap v175: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 957 op/s 2024-09-19T06:52:41.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:40 smithi159 ceph-mon[30935]: pgmap v175: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 957 op/s 2024-09-19T06:52:41.830 INFO:tasks.workunit.client.0.smithi159.stdout:20000 read 0xa6cbf1 thru 0xa6e358 (0x1768 bytes) 2024-09-19T06:52:42.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:52:43.015 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:43.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:42 smithi203 ceph-mon[35473]: pgmap v176: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 MiB/s rd, 4.1 MiB/s wr, 1.41k op/s 2024-09-19T06:52:43.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:42 smithi189 ceph-mon[34880]: pgmap v176: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 MiB/s rd, 4.1 MiB/s wr, 1.41k op/s 2024-09-19T06:52:43.141 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:42 smithi159 ceph-mon[30935]: pgmap v176: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 MiB/s rd, 4.1 MiB/s wr, 1.41k op/s 2024-09-19T06:52:43.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.528+0000 7fb29419f640 1 -- 172.21.15.159:0/1691165533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb28c102d30 msgr2=0x7fb28c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:43.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.528+0000 7fb29419f640 1 --2- 172.21.15.159:0/1691165533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb28c102d30 0x7fb28c103110 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb288009930 tx=0x7fb28802a420 comp rx=0 tx=0).stop 2024-09-19T06:52:43.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.528+0000 7fb29419f640 1 -- 172.21.15.159:0/1691165533 shutdown_connections 2024-09-19T06:52:43.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.528+0000 7fb29419f640 1 --2- 172.21.15.159:0/1691165533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb28c1082a0 0x7fb28c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.528+0000 7fb29419f640 1 --2- 172.21.15.159:0/1691165533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c1036e0 0x7fb28c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.528+0000 7fb29419f640 1 --2- 172.21.15.159:0/1691165533 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb28c102d30 0x7fb28c103110 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.528+0000 7fb29419f640 1 -- 172.21.15.159:0/1691165533 >> 172.21.15.159:0/1691165533 conn(0x7fb28c0fc7d0 msgr2=0x7fb28c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.528+0000 7fb29419f640 1 -- 172.21.15.159:0/1691165533 shutdown_connections 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.528+0000 7fb29419f640 1 -- 172.21.15.159:0/1691165533 wait complete. 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29419f640 1 Processor -- start 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29419f640 1 -- start start 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29419f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb28c102d30 0x7fb28c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29419f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c1036e0 0x7fb28c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29419f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb28c1082a0 0x7fb28c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29419f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1120a0 con 0x7fb28c102d30 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29419f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c111f20 con 0x7fb28c1082a0 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29419f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c112220 con 0x7fb28c1036e0 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29173a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c1036e0 0x7fb28c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29273c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb28c1082a0 0x7fb28c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb291f3b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb28c102d30 0x7fb28c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29173a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c1036e0 0x7fb28c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:37676/0 (socket says 172.21.15.159:37676) 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29273c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb28c1082a0 0x7fb28c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:37356/0 (socket says 172.21.15.159:37356) 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29173a640 1 -- 172.21.15.159:0/2439415925 learned_addr learned my addr 172.21.15.159:0/2439415925 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.529+0000 7fb29173a640 1 -- 172.21.15.159:0/2439415925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb28c1082a0 msgr2=0x7fb28c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb29173a640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb28c1082a0 0x7fb28c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb29173a640 1 -- 172.21.15.159:0/2439415925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb28c102d30 msgr2=0x7fb28c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb29173a640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb28c102d30 0x7fb28c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb29173a640 1 -- 172.21.15.159:0/2439415925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c1a6aa0 con 0x7fb28c1036e0 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb29273c640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb28c1082a0 0x7fb28c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb29173a640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c1036e0 0x7fb28c100ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00e9c0 tx=0x7fb27c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb282ffd640 1 -- 172.21.15.159:0/2439415925 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00ccc0 con 0x7fb28c1036e0 2024-09-19T06:52:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb29419f640 1 -- 172.21.15.159:0/2439415925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28c1a6d90 con 0x7fb28c1036e0 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb282ffd640 1 -- 172.21.15.159:0/2439415925 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb27c005500 con 0x7fb28c1036e0 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb282ffd640 1 -- 172.21.15.159:0/2439415925 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c010690 con 0x7fb28c1036e0 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.530+0000 7fb29419f640 1 -- 172.21.15.159:0/2439415925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28c1a7220 con 0x7fb28c1036e0 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.532+0000 7fb282ffd640 1 -- 172.21.15.159:0/2439415925 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb27c004e80 con 0x7fb28c1036e0 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.533+0000 7fb296578740 1 Processor -- start 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.533+0000 7fb296578740 1 -- start start 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.533+0000 7fb296578740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 0x55f92de7f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb296578740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de7fdc0 0x55f92de8a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb296578740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de8a680 0x55f92de8ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb296578740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f92dde52e0 con 0x55f92de8a680 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb296578740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f92dd8cce0 con 0x55f92de7fdc0 2024-09-19T06:52:43.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb296578740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f92dde12a0 con 0x55f92de7f4a0 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb282ffd640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2780a33b0 0x7fb2780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb291f3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de7fdc0 0x55f92de8a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb29173a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de8a680 0x55f92de8ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb291f3b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de7fdc0 0x55f92de8a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:37362/0 (socket says 172.21.15.159:37362) 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb291f3b640 1 -- 172.21.15.159:0/2406131493 learned_addr learned my addr 172.21.15.159:0/2406131493 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb29273c640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2780a33b0 0x7fb2780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb29273c640 1 --2- 172.21.15.159:0/2406131493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 0x55f92de7f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb282ffd640 1 -- 172.21.15.159:0/2439415925 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb27c0d0100 con 0x7fb28c1036e0 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb291f3b640 1 -- 172.21.15.159:0/2406131493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 msgr2=0x55f92de7f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb291f3b640 1 --2- 172.21.15.159:0/2406131493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 0x55f92de7f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb291f3b640 1 -- 172.21.15.159:0/2406131493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de8a680 msgr2=0x55f92de8ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb291f3b640 1 --2- 172.21.15.159:0/2406131493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de8a680 0x55f92de8ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb291f3b640 1 -- 172.21.15.159:0/2406131493 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92dd71440 con 0x55f92de7fdc0 2024-09-19T06:52:43.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb29273c640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2780a33b0 0x7fb2780a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb284009fd0 tx=0x7fb284009f60 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.534+0000 7fb291f3b640 1 --2- 172.21.15.159:0/2406131493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de7fdc0 0x55f92de8a140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb28802a940 tx=0x7fb288005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1701c08f8c0b713b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb277fff640 1 -- 172.21.15.159:0/2406131493 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288040070 con 0x55f92de7fdc0 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb277fff640 1 -- 172.21.15.159:0/2406131493 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2880317b0 con 0x55f92de7fdc0 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb277fff640 1 -- 172.21.15.159:0/2406131493 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288035040 con 0x55f92de7fdc0 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb296578740 1 -- 172.21.15.159:0/2406131493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de7fdc0 msgr2=0x55f92de8a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb296578740 1 --2- 172.21.15.159:0/2406131493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de7fdc0 0x55f92de8a140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb28802a940 tx=0x7fb288005bd0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb296578740 1 -- 172.21.15.159:0/2406131493 shutdown_connections 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb296578740 1 --2- 172.21.15.159:0/2406131493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de8a680 0x55f92de8ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb296578740 1 --2- 172.21.15.159:0/2406131493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de7fdc0 0x55f92de8a140 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb296578740 1 --2- 172.21.15.159:0/2406131493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 0x55f92de7f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.535+0000 7fb296578740 1 -- 172.21.15.159:0/2406131493 >> 172.21.15.159:0/2406131493 conn(0x55f92de7ba30 msgr2=0x55f92de7be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.536+0000 7fb296578740 1 -- 172.21.15.159:0/2406131493 shutdown_connections 2024-09-19T06:52:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.536+0000 7fb296578740 1 -- 172.21.15.159:0/2406131493 wait complete. 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.536+0000 7fb296578740 1 -- start start 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.536+0000 7fb296578740 1 Processor -- start 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.536+0000 7fb296578740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de89f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.536+0000 7fb296578740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de871f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.536+0000 7fb296578740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de87730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb296578740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f92de8d250 con 0x55f92de7f4a0 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb296578740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f92dda0050 con 0x55f92de8a680 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb296578740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f92de8d3d0 con 0x55f92de7fdc0 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb291f3b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de89f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb291f3b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de89f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49600/0 (socket says 172.21.15.159:49600) 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb291f3b640 1 -- 172.21.15.159:0/385102561 learned_addr learned my addr 172.21.15.159:0/385102561 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb29173a640 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de871f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb29273c640 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de87730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb296578740 10 client.0 _ll_register_callbacks cb 0x55f92dde0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb291f3b640 1 -- 172.21.15.159:0/385102561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 msgr2=0x55f92de871f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb291f3b640 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de871f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb291f3b640 1 -- 172.21.15.159:0/385102561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 msgr2=0x55f92de87730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb291f3b640 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de87730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb291f3b640 1 -- 172.21.15.159:0/385102561 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92db563c0 con 0x55f92de7f4a0 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb296578740 1 -- 172.21.15.159:0/385102561 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2880317b0 con 0x55f92de7f4a0 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb29173a640 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de871f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb29273c640 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de87730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb291f3b640 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de89f40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb288009670 tx=0x7fb28802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc2ae038d542474 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:43.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.537+0000 7fb2757fa640 10 client.16728 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb2757fa640 1 -- 172.21.15.159:0/385102561 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288040030 con 0x55f92de7f4a0 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb2757fa640 1 -- 172.21.15.159:0/385102561 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb288004250 con 0x55f92de7f4a0 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb2757fa640 1 -- 172.21.15.159:0/385102561 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb288035040 con 0x55f92de7f4a0 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb296578740 10 client.16728 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb296578740 1 -- 172.21.15.159:0/385102561 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55f92de98a40 con 0x55f92de7f4a0 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb2757fa640 1 -- 172.21.15.159:0/385102561 <== mon.0 v2:172.21.15.159:3300/0 4 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb288004770 con 0x55f92de7f4a0 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb296578740 10 client.16728 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb296578740 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb296578740 20 client.16728 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb296578740 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f92de99d90 0x55f92de9c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb296578740 4 client.16728 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb296578740 1 -- 172.21.15.159:0/385102561 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f92ddf2850 con 0x55f92de99d90 2024-09-19T06:52:43.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.538+0000 7fb29173a640 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f92de99d90 0x55f92de9c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.539+0000 7fb29173a640 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f92de99d90 0x55f92de9c180 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce561ff037406f83 server_cookie=cae81913ebefdc67 in_seq=0 out_seq=0 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.539+0000 7fb2757fa640 10 client.16728 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb2757fa640 1 -- 172.21.15.159:0/385102561 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f92ddf2850 con 0x55f92de99d90 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb2757fa640 10 client.16728 handle_command_reply: tid=0 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 client.16728 shutdown 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 -- 172.21.15.159:0/385102561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 msgr2=0x55f92de89f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de89f40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb288009670 tx=0x7fb28802a420 comp rx=0 tx=0).stop 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 -- 172.21.15.159:0/385102561 shutdown_connections 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f92de99d90 0x55f92de9c180 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb2757fa640 0 client.16728 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de87730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de871f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 --2- 172.21.15.159:0/385102561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de89f40 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 -- 172.21.15.159:0/385102561 >> 172.21.15.159:0/385102561 conn(0x55f92de7ba30 msgr2=0x55f92de81710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:43.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 -- 172.21.15.159:0/385102561 shutdown_connections 2024-09-19T06:52:43.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 1 -- 172.21.15.159:0/385102561 wait complete. 2024-09-19T06:52:43.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.540+0000 7fb296578740 20 client.16728 trim_cache size 0 max 16384 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.564+0000 7fb296578740 1 Processor -- start 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.564+0000 7fb296578740 1 -- start start 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb296578740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 0x55f92de964b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb296578740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7fdc0 0x55f92de82900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb296578740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de861d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb296578740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1adb60 con 0x55f92de7fdc0 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb296578740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1b03e0 con 0x55f92de8a680 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb296578740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1ae1d0 con 0x55f92de7f4a0 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb29173a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7fdc0 0x55f92de82900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb291f3b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 0x55f92de964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb29173a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7fdc0 0x55f92de82900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49616/0 (socket says 172.21.15.159:49616) 2024-09-19T06:52:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.565+0000 7fb29173a640 1 -- 172.21.15.159:0/1846123516 learned_addr learned my addr 172.21.15.159:0/1846123516 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.566+0000 7fb29173a640 1 -- 172.21.15.159:0/1846123516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 msgr2=0x55f92de964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.566+0000 7fb29173a640 1 --2- 172.21.15.159:0/1846123516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 0x55f92de964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.566+0000 7fb29173a640 1 -- 172.21.15.159:0/1846123516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 msgr2=0x55f92de861d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.566+0000 7fb29173a640 1 --2- 172.21.15.159:0/1846123516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de861d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.566+0000 7fb29173a640 1 -- 172.21.15.159:0/1846123516 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92de7fbf0 con 0x55f92de7fdc0 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.566+0000 7fb29173a640 1 --2- 172.21.15.159:0/1846123516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7fdc0 0x55f92de82900 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb27c098d80 tx=0x7fb27c0d2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cf65bebd04db94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.567+0000 7fb2777fe640 1 -- 172.21.15.159:0/1846123516 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c09c3b0 con 0x55f92de7fdc0 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.567+0000 7fb2777fe640 1 -- 172.21.15.159:0/1846123516 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb27c0a0760 con 0x55f92de7fdc0 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.567+0000 7fb2777fe640 1 -- 172.21.15.159:0/1846123516 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0cdaa0 con 0x55f92de7fdc0 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.569+0000 7fb296578740 1 -- 172.21.15.159:0/1846123516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7fdc0 msgr2=0x55f92de82900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.569+0000 7fb296578740 1 --2- 172.21.15.159:0/1846123516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7fdc0 0x55f92de82900 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb27c098d80 tx=0x7fb27c0d2040 comp rx=0 tx=0).stop 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.570+0000 7fb296578740 1 -- 172.21.15.159:0/1846123516 shutdown_connections 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.570+0000 7fb296578740 1 --2- 172.21.15.159:0/1846123516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de861d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.570+0000 7fb296578740 1 --2- 172.21.15.159:0/1846123516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7fdc0 0x55f92de82900 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.570+0000 7fb296578740 1 --2- 172.21.15.159:0/1846123516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7f4a0 0x55f92de964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.570+0000 7fb296578740 1 -- 172.21.15.159:0/1846123516 >> 172.21.15.159:0/1846123516 conn(0x55f92de7ba30 msgr2=0x55f92de85ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.570+0000 7fb296578740 1 -- 172.21.15.159:0/1846123516 shutdown_connections 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.570+0000 7fb296578740 1 -- 172.21.15.159:0/1846123516 wait complete. 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.571+0000 7fb296578740 1 -- start start 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.571+0000 7fb296578740 1 Processor -- start 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.571+0000 7fb296578740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de928f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.571+0000 7fb296578740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de92e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.571+0000 7fb296578740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de8dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29173a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de92e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb291f3b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29173a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de92e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:37722/0 (socket says 172.21.15.159:37722) 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb291f3b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de928f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49630/0 (socket says 172.21.15.159:49630) 2024-09-19T06:52:43.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb296578740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1ae8a0 con 0x55f92de7f4a0 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb296578740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1afd10 con 0x55f92de8a680 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb296578740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1aef70 con 0x55f92de7fdc0 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb296578740 10 client.0 _ll_register_callbacks cb 0x7fb284011b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29273c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de8dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29273c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de8dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:37396/0 (socket says 172.21.15.159:37396) 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29273c640 1 -- 172.21.15.159:0/3356418927 learned_addr learned my addr 172.21.15.159:0/3356418927 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29273c640 1 -- 172.21.15.159:0/3356418927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 msgr2=0x55f92de92e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29273c640 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de92e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29273c640 1 -- 172.21.15.159:0/3356418927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 msgr2=0x55f92de928f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29273c640 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de928f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.572+0000 7fb29273c640 1 -- 172.21.15.159:0/3356418927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92de8e4b0 con 0x55f92de8a680 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.573+0000 7fb29273c640 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de8dc80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb28401fc10 tx=0x7fb284004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f116171bfe49702 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:43.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.573+0000 7fb2757fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:52:43.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.573+0000 7fb2757fa640 1 -- 172.21.15.159:0/3356418927 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28400fe40 con 0x55f92de8a680 2024-09-19T06:52:43.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.573+0000 7fb2757fa640 1 -- 172.21.15.159:0/3356418927 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb28401a040 con 0x55f92de8a680 2024-09-19T06:52:43.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.573+0000 7fb296578740 1 -- 172.21.15.159:0/3356418927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb27c0a0760 con 0x55f92de8a680 2024-09-19T06:52:43.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.573+0000 7fb2757fa640 1 -- 172.21.15.159:0/3356418927 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb28401fc40 con 0x55f92de8a680 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.573+0000 7fb296578740 10 client.26009 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.573+0000 7fb296578740 1 -- 172.21.15.159:0/3356418927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f92df04280 con 0x55f92de8a680 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb2757fa640 1 -- 172.21.15.159:0/3356418927 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb27c0a0760 con 0x55f92de8a680 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb2757fa640 1 -- 172.21.15.159:0/3356418927 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb28401d040 con 0x55f92de8a680 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb296578740 10 client.26009 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb296578740 10 client.26009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb296578740 20 client.26009 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb296578740 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f92de99d90 0x55f92df06a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb296578740 4 client.26009 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb296578740 1 -- 172.21.15.159:0/3356418927 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f92ddecd60 con 0x55f92de99d90 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb291f3b640 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f92de99d90 0x55f92df06a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:43.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.574+0000 7fb2757fa640 10 client.26009 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb291f3b640 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f92de99d90 0x55f92df06a90 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e69eba13e338b19 server_cookie=d1b0bac10caa265e in_seq=0 out_seq=0 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb2757fa640 1 -- 172.21.15.159:0/3356418927 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f92ddecd60 con 0x55f92de99d90 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb2757fa640 10 client.26009 handle_command_reply: tid=0 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 client.26009 shutdown 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 -- 172.21.15.159:0/3356418927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 msgr2=0x55f92de8dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de8dc80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb28401fc10 tx=0x7fb284004a40 comp rx=0 tx=0).stop 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 -- 172.21.15.159:0/3356418927 shutdown_connections 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f92de99d90 0x55f92df06a90 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb2757fa640 0 client.26009 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f92de8a680 0x55f92de8dc80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f92de7fdc0 0x55f92de92e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 --2- 172.21.15.159:0/3356418927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f92de7f4a0 0x55f92de928f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 -- 172.21.15.159:0/3356418927 >> 172.21.15.159:0/3356418927 conn(0x55f92de7ba30 msgr2=0x55f92de88a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:43.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.575+0000 7fb296578740 1 -- 172.21.15.159:0/3356418927 shutdown_connections 2024-09-19T06:52:43.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb296578740 1 -- 172.21.15.159:0/3356418927 wait complete. 2024-09-19T06:52:43.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb296578740 20 client.26009 trim_cache size 0 max 16384 2024-09-19T06:52:43.582 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:52:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:52:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:52:43.582 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 -- 172.21.15.159:0/2439415925 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2780a33b0 msgr2=0x7fb2780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2780a33b0 0x7fb2780a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb284009fd0 tx=0x7fb284009f60 comp rx=0 tx=0).stop 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 -- 172.21.15.159:0/2439415925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c1036e0 msgr2=0x7fb28c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c1036e0 0x7fb28c100ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00e9c0 tx=0x7fb27c00ee80 comp rx=0 tx=0).stop 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 -- 172.21.15.159:0/2439415925 shutdown_connections 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb2780a33b0 0x7fb2780a5870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb28c1082a0 0x7fb28c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c1036e0 0x7fb28c100ed0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 --2- 172.21.15.159:0/2439415925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb28c102d30 0x7fb28c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:43.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.576+0000 7fb29419f640 1 -- 172.21.15.159:0/2439415925 >> 172.21.15.159:0/2439415925 conn(0x7fb28c0fc7d0 msgr2=0x7fb28c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:43.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.577+0000 7fb29419f640 1 -- 172.21.15.159:0/2439415925 shutdown_connections 2024-09-19T06:52:43.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:43.577+0000 7fb29419f640 1 -- 172.21.15.159:0/2439415925 wait complete. 2024-09-19T06:52:43.668 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0x63ed6b9 2024-09-19T06:52:44.471 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:52:44.471 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:52:44.793 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.833+0000 7ff9da1c0640 1 -- 172.21.15.159:0/3796012654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9d41080f0 msgr2=0x7ff9d410ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.833+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/3796012654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9d41080f0 0x7ff9d410ea40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009ca0 tx=0x7ff9cc02a950 comp rx=0 tx=0).stop 2024-09-19T06:52:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.833+0000 7ff9da1c0640 1 -- 172.21.15.159:0/3796012654 shutdown_connections 2024-09-19T06:52:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.833+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/3796012654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9d41080f0 0x7ff9d410ea40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.833+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/3796012654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d4101150 0x7ff9d4107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.833+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/3796012654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9d4100830 0x7ff9d4100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.833+0000 7ff9da1c0640 1 -- 172.21.15.159:0/3796012654 >> 172.21.15.159:0/3796012654 conn(0x7ff9d4075f20 msgr2=0x7ff9d4076330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.833+0000 7ff9da1c0640 1 -- 172.21.15.159:0/3796012654 shutdown_connections 2024-09-19T06:52:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.833+0000 7ff9da1c0640 1 -- 172.21.15.159:0/3796012654 wait complete. 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.834+0000 7ff9da1c0640 1 Processor -- start 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.834+0000 7ff9da1c0640 1 -- start start 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9da1c0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9d4100830 0x7ff9d41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9da1c0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9d4101150 0x7ff9d4198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9da1c0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d41080f0 0x7ff9d419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9da1c0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4111f20 con 0x7ff9d41080f0 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9da1c0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4111da0 con 0x7ff9d4100830 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9da1c0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41120a0 con 0x7ff9d4101150 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d41080f0 0x7ff9d419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9d4101150 0x7ff9d4198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d37fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9d4100830 0x7ff9d41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d41080f0 0x7ff9d419cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49646/0 (socket says 172.21.15.159:49646) 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d3fff640 1 -- 172.21.15.159:0/2465339913 learned_addr learned my addr 172.21.15.159:0/2465339913 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9d4101150 0x7ff9d4198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:37742/0 (socket says 172.21.15.159:37742) 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d37fe640 1 -- 172.21.15.159:0/2465339913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9d4101150 msgr2=0x7ff9d4198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d37fe640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9d4101150 0x7ff9d4198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d37fe640 1 -- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d41080f0 msgr2=0x7ff9d419cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d37fe640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d41080f0 0x7ff9d419cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d37fe640 1 -- 172.21.15.159:0/2465339913 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d419d2e0 con 0x7ff9d4100830 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9d4101150 0x7ff9d4198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.835+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d41080f0 0x7ff9d419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.836+0000 7ff9d37fe640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9d4100830 0x7ff9d41982f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400e9f0 tx=0x7ff9c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.836+0000 7ff9d0ff9640 1 -- 172.21.15.159:0/2465339913 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400ccc0 con 0x7ff9d4100830 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.836+0000 7ff9d0ff9640 1 -- 172.21.15.159:0/2465339913 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c4005020 con 0x7ff9d4100830 2024-09-19T06:52:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.836+0000 7ff9da1c0640 1 -- 172.21.15.159:0/2465339913 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d419d5d0 con 0x7ff9d4100830 2024-09-19T06:52:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.836+0000 7ff9d0ff9640 1 -- 172.21.15.159:0/2465339913 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40049e0 con 0x7ff9d4100830 2024-09-19T06:52:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.836+0000 7ff9da1c0640 1 -- 172.21.15.159:0/2465339913 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d41016d0 con 0x7ff9d4100830 2024-09-19T06:52:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.838+0000 7ff9d0ff9640 1 -- 172.21.15.159:0/2465339913 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ff9c4005560 con 0x7ff9d4100830 2024-09-19T06:52:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.838+0000 7ff9dd02e740 1 Processor -- start 2024-09-19T06:52:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.838+0000 7ff9dd02e740 1 -- start start 2024-09-19T06:52:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d0ff9640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9bc0a34e0 0x7ff9bc0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 0x5585dabe00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5585dab372f0 con 0x5585dabd2af0 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5585daadf270 con 0x5585dabddcb0 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5585dab332b0 con 0x5585dabd3410 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d37fe640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9bc0a34e0 0x7ff9bc0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:37754/0 (socket says 172.21.15.159:37754) 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d2ffd640 1 -- 172.21.15.159:0/2642104711 learned_addr learned my addr 172.21.15.159:0/2642104711 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49652/0 (socket says 172.21.15.159:49652) 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d0ff9640 1 -- 172.21.15.159:0/2465339913 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7ff9c40cfc20 con 0x7ff9d4100830 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/2642104711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 0x5585dabe00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d2ffd640 1 -- 172.21.15.159:0/2642104711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 msgr2=0x5585dabe00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/2642104711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 0x5585dabe00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d2ffd640 1 -- 172.21.15.159:0/2642104711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 msgr2=0x5585dabd2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/2642104711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d2ffd640 1 -- 172.21.15.159:0/2642104711 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585daade340 con 0x5585dabd3410 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/2642104711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 0x5585dabe00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d37fe640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9bc0a34e0 0x7ff9bc0a59a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40cd940 tx=0x7ff9c40bc040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/2642104711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdd770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009fd0 tx=0x7ff9c80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c2e7f01506fcfad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.839+0000 7ff9b9ffb640 1 -- 172.21.15.159:0/2642104711 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8005020 con 0x5585dabd3410 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9b9ffb640 1 -- 172.21.15.159:0/2642104711 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c80047a0 con 0x5585dabd3410 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9b9ffb640 1 -- 172.21.15.159:0/2642104711 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c800f8b0 con 0x5585dabd3410 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9dd02e740 1 -- 172.21.15.159:0/2642104711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 msgr2=0x5585dabdd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/2642104711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdd770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009fd0 tx=0x7ff9c80118d0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9dd02e740 1 -- 172.21.15.159:0/2642104711 shutdown_connections 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/2642104711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 0x5585dabe00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/2642104711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdd770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/2642104711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9dd02e740 1 -- 172.21.15.159:0/2642104711 >> 172.21.15.159:0/2642104711 conn(0x5585dabcf060 msgr2=0x5585dabcf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9dd02e740 1 -- 172.21.15.159:0/2642104711 shutdown_connections 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.840+0000 7ff9dd02e740 1 -- 172.21.15.159:0/2642104711 wait complete. 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.841+0000 7ff9dd02e740 1 -- start start 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.841+0000 7ff9dd02e740 1 Processor -- start 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.841+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd2af0 0x5585dabdab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.841+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.841+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabddcb0 0x5585dabdb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.841+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5585dabe0880 con 0x5585dabddcb0 2024-09-19T06:52:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.841+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5585daac0290 con 0x5585dabd2af0 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.841+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5585dabe0a00 con 0x5585dabd3410 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.841+0000 7ff9dd02e740 10 client.0 _ll_register_callbacks cb 0x5585daaf1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabddcb0 0x5585dabdb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabddcb0 0x5585dabdb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49666/0 (socket says 172.21.15.159:49666) 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 -- 172.21.15.159:0/1085500106 learned_addr learned my addr 172.21.15.159:0/1085500106 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd2af0 0x5585dabdab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 -- 172.21.15.159:0/1085500106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 msgr2=0x5585dabdb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 -- 172.21.15.159:0/1085500106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd2af0 msgr2=0x5585dabdab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd2af0 0x5585dabdab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 -- 172.21.15.159:0/1085500106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585da84a210 con 0x5585dabddcb0 2024-09-19T06:52:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabddcb0 0x5585dabdb600 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc006010 tx=0x7ff9cc005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f5161c992aa98a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/1085500106 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc034040 con 0x5585dabddcb0 2024-09-19T06:52:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/1085500106 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7ff9cc004250 con 0x5585dabddcb0 2024-09-19T06:52:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9dd02e740 1 -- 172.21.15.159:0/1085500106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9c80047a0 con 0x5585dabddcb0 2024-09-19T06:52:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.842+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/1085500106 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff9cc004450 con 0x5585dabddcb0 2024-09-19T06:52:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9dd02e740 10 client.16746 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9dd02e740 1 -- 172.21.15.159:0/1085500106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5585da916620 con 0x5585dabddcb0 2024-09-19T06:52:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/1085500106 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c80047a0 con 0x5585dabddcb0 2024-09-19T06:52:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/1085500106 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7ff9cc052070 con 0x5585dabddcb0 2024-09-19T06:52:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9dd02e740 10 client.16746 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9dd02e740 10 client.16746 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9dd02e740 20 client.16746 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5585dabf6370 0x5585dabf8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9dd02e740 4 client.16746 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9dd02e740 1 -- 172.21.15.159:0/1085500106 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585dab44a20 con 0x5585dabf6370 2024-09-19T06:52:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.843+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5585dabf6370 0x5585dabf8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.844+0000 7ff9b2ffd640 10 client.16746 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.844+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5585dabf6370 0x5585dabf8760 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=493f75e6a5ae59dc server_cookie=5e46cbbcfaba02ef in_seq=0 out_seq=0 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.845+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/1085500106 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585dab44a20 con 0x5585dabf6370 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.846+0000 7ff9b2ffd640 10 client.16746 handle_command_reply: tid=0 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.846+0000 7ff9dd02e740 1 client.16746 shutdown 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 -- 172.21.15.159:0/1085500106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabddcb0 msgr2=0x5585dabdb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabddcb0 0x5585dabdb600 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc006010 tx=0x7ff9cc005f10 comp rx=0 tx=0).stop 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 -- 172.21.15.159:0/1085500106 shutdown_connections 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5585dabf6370 0x5585dabf8760 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9b2ffd640 0 client.16746 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabddcb0 0x5585dabdb600 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabdb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/1085500106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd2af0 0x5585dabdab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 -- 172.21.15.159:0/1085500106 >> 172.21.15.159:0/1085500106 conn(0x5585dabcf060 msgr2=0x5585dabd4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 -- 172.21.15.159:0/1085500106 shutdown_connections 2024-09-19T06:52:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 1 -- 172.21.15.159:0/1085500106 wait complete. 2024-09-19T06:52:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.847+0000 7ff9dd02e740 20 client.16746 trim_cache size 0 max 16384 2024-09-19T06:52:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.867+0000 7ff9dd02e740 1 Processor -- start 2024-09-19T06:52:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.867+0000 7ff9dd02e740 1 -- start start 2024-09-19T06:52:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.867+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.867+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabfdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.867+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 0x5585dabfe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.867+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41a9710 con 0x5585dabd2af0 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.867+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41abf90 con 0x5585dabddcb0 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.867+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41a9d80 con 0x5585dabd3410 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.867+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49674/0 (socket says 172.21.15.159:49674) 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d3fff640 1 -- 172.21.15.159:0/3824280767 learned_addr learned my addr 172.21.15.159:0/3824280767 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabfdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/3824280767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 0x5585dabfe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d3fff640 1 -- 172.21.15.159:0/3824280767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 msgr2=0x5585dabfdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/3824280767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabfdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d3fff640 1 -- 172.21.15.159:0/3824280767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 msgr2=0x5585dabfe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/3824280767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 0x5585dabfe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d3fff640 1 -- 172.21.15.159:0/3824280767 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dabdd6d0 con 0x5585dabd2af0 2024-09-19T06:52:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/3824280767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd5560 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc02ae70 tx=0x7ff9cc005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9324b3165042aa7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9b97fa640 1 -- 172.21.15.159:0/3824280767 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc034030 con 0x5585dabd2af0 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9b97fa640 1 -- 172.21.15.159:0/3824280767 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9cc004250 con 0x5585dabd2af0 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.868+0000 7ff9b97fa640 1 -- 172.21.15.159:0/3824280767 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0045f0 con 0x5585dabd2af0 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3824280767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 msgr2=0x5585dabd5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3824280767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd5560 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc02ae70 tx=0x7ff9cc005cf0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3824280767 shutdown_connections 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3824280767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabddcb0 0x5585dabfe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3824280767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabd3410 0x5585dabfdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3824280767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabd5560 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3824280767 >> 172.21.15.159:0/3824280767 conn(0x5585dabcf060 msgr2=0x5585dabdcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3824280767 shutdown_connections 2024-09-19T06:52:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3824280767 wait complete. 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.869+0000 7ff9dd02e740 1 -- start start 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9dd02e740 1 Processor -- start 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabea940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd3410 0x5585dabeae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9dd02e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabddcb0 0x5585dac5ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41aa450 con 0x5585dabd2af0 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41ab8c0 con 0x5585dabd3410 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9dd02e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41aab20 con 0x5585dabddcb0 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9dd02e740 10 client.0 _ll_register_callbacks cb 0x7ff9cc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabea940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49676/0 (socket says 172.21.15.159:49676) 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 -- 172.21.15.159:0/3820854376 learned_addr learned my addr 172.21.15.159:0/3820854376 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabddcb0 0x5585dac5ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd3410 0x5585dabeae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 -- 172.21.15.159:0/3820854376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabddcb0 msgr2=0x5585dac5ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabddcb0 0x5585dac5ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 -- 172.21.15.159:0/3820854376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd3410 msgr2=0x5585dabeae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd3410 0x5585dabeae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 -- 172.21.15.159:0/3820854376 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585dac604e0 con 0x5585dabd2af0 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd3410 0x5585dabeae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9d3fff640 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabea940 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc054ab0 tx=0x7ff9cc02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e003f8afc96b6926 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/3820854376 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc043040 con 0x5585dabd2af0 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.870+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/3820854376 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7ff9cc0047f0 con 0x5585dabd2af0 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3820854376 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9cc004250 con 0x5585dabd2af0 2024-09-19T06:52:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/3820854376 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff9cc034040 con 0x5585dabd2af0 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9dd02e740 10 client.16752 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3820854376 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5585dac61760 con 0x5585dabd2af0 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/3820854376 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9cc004250 con 0x5585dabd2af0 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/3820854376 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7ff9cc067070 con 0x5585dabd2af0 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9dd02e740 10 client.16752 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9dd02e740 10 client.16752 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9dd02e740 20 client.16752 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5585dac61d70 0x5585dac64190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9dd02e740 4 client.16752 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.871+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3820854376 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5585dab3ed70 con 0x5585dac61d70 2024-09-19T06:52:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.872+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5585dac61d70 0x5585dac64190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:44.879 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.873+0000 7ff9b2ffd640 10 client.16752 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:44.879 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.873+0000 7ff9d2ffd640 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5585dac61d70 0x5585dac64190 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dd05da6de283991 server_cookie=47ac6a3a7233f487 in_seq=0 out_seq=0 2024-09-19T06:52:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.888+0000 7ff9b2ffd640 1 -- 172.21.15.159:0/3820854376 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5585dab3ed70 con 0x5585dac61d70 2024-09-19T06:52:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.888+0000 7ff9b2ffd640 10 client.16752 handle_command_reply: tid=0 2024-09-19T06:52:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.888+0000 7ff9dd02e740 1 client.16752 shutdown 2024-09-19T06:52:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3820854376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 msgr2=0x5585dabea940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabea940 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc054ab0 tx=0x7ff9cc02f450 comp rx=0 tx=0).stop 2024-09-19T06:52:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3820854376 shutdown_connections 2024-09-19T06:52:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5585dac61d70 0x5585dac64190 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5585dabddcb0 0x5585dac5ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585dabd3410 0x5585dabeae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9b2ffd640 0 client.16752 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 --2- 172.21.15.159:0/3820854376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5585dabd2af0 0x5585dabea940 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3820854376 >> 172.21.15.159:0/3820854376 conn(0x5585dabcf060 msgr2=0x5585dabcd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3820854376 shutdown_connections 2024-09-19T06:52:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 1 -- 172.21.15.159:0/3820854376 wait complete. 2024-09-19T06:52:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.889+0000 7ff9dd02e740 20 client.16752 trim_cache size 0 max 16384 2024-09-19T06:52:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:52:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:52:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:52:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:52:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 -- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9bc0a34e0 msgr2=0x7ff9bc0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9bc0a34e0 0x7ff9bc0a59a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40cd940 tx=0x7ff9c40bc040 comp rx=0 tx=0).stop 2024-09-19T06:52:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 -- 172.21.15.159:0/2465339913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9d4100830 msgr2=0x7ff9d41982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9d4100830 0x7ff9d41982f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400e9f0 tx=0x7ff9c400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 -- 172.21.15.159:0/2465339913 shutdown_connections 2024-09-19T06:52:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff9bc0a34e0 0x7ff9bc0a59a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d41080f0 0x7ff9d419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9d4101150 0x7ff9d4198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 --2- 172.21.15.159:0/2465339913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9d4100830 0x7ff9d41982f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.890+0000 7ff9da1c0640 1 -- 172.21.15.159:0/2465339913 >> 172.21.15.159:0/2465339913 conn(0x7ff9d4075f20 msgr2=0x7ff9d40ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.895+0000 7ff9da1c0640 1 -- 172.21.15.159:0/2465339913 shutdown_connections 2024-09-19T06:52:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:44.896+0000 7ff9da1c0640 1 -- 172.21.15.159:0/2465339913 wait complete. 2024-09-19T06:52:45.052 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:44 smithi159 ceph-mon[30935]: pgmap v177: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.6 MiB/s wr, 926 op/s 2024-09-19T06:52:45.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:44 smithi203 ceph-mon[35473]: pgmap v177: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.6 MiB/s wr, 926 op/s 2024-09-19T06:52:45.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:44 smithi189 ceph-mon[34880]: pgmap v177: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.6 MiB/s wr, 926 op/s 2024-09-19T06:52:45.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.298+0000 7f173535a640 1 -- 172.21.15.159:0/2842186213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1730103660 msgr2=0x7f173010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:45.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.298+0000 7f173535a640 1 --2- 172.21.15.159:0/2842186213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1730103660 0x7f173010bb50 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1718009900 tx=0x7f171802a480 comp rx=0 tx=0).stop 2024-09-19T06:52:45.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.298+0000 7f173535a640 1 -- 172.21.15.159:0/2842186213 shutdown_connections 2024-09-19T06:52:45.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.298+0000 7f173535a640 1 --2- 172.21.15.159:0/2842186213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f173010c170 0x7f173010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.298+0000 7f173535a640 1 --2- 172.21.15.159:0/2842186213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1730103660 0x7f173010bb50 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.298+0000 7f173535a640 1 --2- 172.21.15.159:0/2842186213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1730102d40 0x7f1730103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.298+0000 7f173535a640 1 -- 172.21.15.159:0/2842186213 >> 172.21.15.159:0/2842186213 conn(0x7f17300fc7a0 msgr2=0x7f17300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:45.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.298+0000 7f173535a640 1 -- 172.21.15.159:0/2842186213 shutdown_connections 2024-09-19T06:52:45.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.298+0000 7f173535a640 1 -- 172.21.15.159:0/2842186213 wait complete. 2024-09-19T06:52:45.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.302+0000 7f173535a640 1 Processor -- start 2024-09-19T06:52:45.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.302+0000 7f173535a640 1 -- start start 2024-09-19T06:52:45.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.302+0000 7f173535a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1730102d40 0x7f17301009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:45.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.302+0000 7f173535a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1730103660 0x7f1730100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:45.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.302+0000 7f173535a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f173010c170 0x7f1730101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:45.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f173535a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1730111f70 con 0x7f1730102d40 2024-09-19T06:52:45.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f173535a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1730111df0 con 0x7f1730103660 2024-09-19T06:52:45.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f173535a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17301120f0 con 0x7f173010c170 2024-09-19T06:52:45.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f172f7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f173010c170 0x7f1730101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:45.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f172f7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f173010c170 0x7f1730101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:37786/0 (socket says 172.21.15.159:37786) 2024-09-19T06:52:45.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f172f7fe640 1 -- 172.21.15.159:0/3681563793 learned_addr learned my addr 172.21.15.159:0/3681563793 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:45.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f172effd640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1730102d40 0x7f17301009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:45.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f172f7fe640 1 -- 172.21.15.159:0/3681563793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1730103660 msgr2=0x7f1730100ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:52:45.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f172f7fe640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1730103660 0x7f1730100ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f172f7fe640 1 -- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1730102d40 msgr2=0x7f17301009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:45.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.303+0000 7f172f7fe640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1730102d40 0x7f17301009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.304+0000 7f172f7fe640 1 -- 172.21.15.159:0/3681563793 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17301a6980 con 0x7f173010c170 2024-09-19T06:52:45.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.304+0000 7f172effd640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1730102d40 0x7f17301009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:45.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.305+0000 7f172f7fe640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f173010c170 0x7f1730101420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f172800eb10 tx=0x7f172800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:45.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.305+0000 7f1727fff640 1 -- 172.21.15.159:0/3681563793 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728004b20 con 0x7f173010c170 2024-09-19T06:52:45.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.305+0000 7f1727fff640 1 -- 172.21.15.159:0/3681563793 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1728004cc0 con 0x7f173010c170 2024-09-19T06:52:45.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.305+0000 7f1727fff640 1 -- 172.21.15.159:0/3681563793 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728010760 con 0x7f173010c170 2024-09-19T06:52:45.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.305+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17301a6c70 con 0x7f173010c170 2024-09-19T06:52:45.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.305+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17301a7100 con 0x7f173010c170 2024-09-19T06:52:45.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.306+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1730103120 con 0x7f173010c170 2024-09-19T06:52:45.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.307+0000 7f1727fff640 1 -- 172.21.15.159:0/3681563793 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1728005020 con 0x7f173010c170 2024-09-19T06:52:45.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.308+0000 7f1727fff640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f171c0a3430 0x7f171c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:45.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.309+0000 7f172effd640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f171c0a3430 0x7f171c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:45.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.309+0000 7f1727fff640 1 -- 172.21.15.159:0/3681563793 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f17280d0290 con 0x7f173010c170 2024-09-19T06:52:45.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.309+0000 7f172effd640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f171c0a3430 0x7f171c0a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17200095f0 tx=0x7f1720005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:45.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.313+0000 7f1727fff640 1 -- 172.21.15.159:0/3681563793 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f172809cc40 con 0x7f173010c170 2024-09-19T06:52:45.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.558+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f173002d7c0 con 0x7f173010c170 2024-09-19T06:52:45.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.559+0000 7f1727fff640 1 -- 172.21.15.159:0/3681563793 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f172809c540 con 0x7f173010c170 2024-09-19T06:52:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:52:45.561 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:52:45.561 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:52:45.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f171c0a3430 msgr2=0x7f171c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:45.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f171c0a3430 0x7f171c0a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17200095f0 tx=0x7f1720005f90 comp rx=0 tx=0).stop 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f173010c170 msgr2=0x7f1730101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f173010c170 0x7f1730101420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f172800eb10 tx=0x7f172800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 shutdown_connections 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f171c0a3430 0x7f171c0a58f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f173010c170 0x7f1730101420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1730103660 0x7f1730100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 --2- 172.21.15.159:0/3681563793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1730102d40 0x7f17301009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 >> 172.21.15.159:0/3681563793 conn(0x7f17300fc7a0 msgr2=0x7f17300fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 shutdown_connections 2024-09-19T06:52:45.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:45.562+0000 7f173535a640 1 -- 172.21.15.159:0/3681563793 wait complete. 2024-09-19T06:52:45.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:45 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3681563793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:45 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3681563793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:46.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:45 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3681563793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:46.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:52:46.679 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:47.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:46 smithi203 ceph-mon[35473]: pgmap v178: 97 pgs: 97 active+clean; 76 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 4.0 MiB/s wr, 1.34k op/s 2024-09-19T06:52:47.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:46 smithi189 ceph-mon[34880]: pgmap v178: 97 pgs: 97 active+clean; 76 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 4.0 MiB/s wr, 1.34k op/s 2024-09-19T06:52:47.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:46 smithi159 ceph-mon[30935]: pgmap v178: 97 pgs: 97 active+clean; 76 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 4.0 MiB/s wr, 1.34k op/s 2024-09-19T06:52:47.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.545+0000 7f7fef297640 1 -- 172.21.15.159:0/2381996101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe8102d50 msgr2=0x7f7fe8103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:47.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.545+0000 7f7fef297640 1 --2- 172.21.15.159:0/2381996101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe8102d50 0x7f7fe8103130 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009900 tx=0x7f7fe402a480 comp rx=0 tx=0).stop 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.545+0000 7f7fef297640 1 -- 172.21.15.159:0/2381996101 shutdown_connections 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.545+0000 7f7fef297640 1 --2- 172.21.15.159:0/2381996101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fe810c180 0x7f7fe810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.545+0000 7f7fef297640 1 --2- 172.21.15.159:0/2381996101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fe8103670 0x7f7fe810bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.545+0000 7f7fef297640 1 --2- 172.21.15.159:0/2381996101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe8102d50 0x7f7fe8103130 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.545+0000 7f7fef297640 1 -- 172.21.15.159:0/2381996101 >> 172.21.15.159:0/2381996101 conn(0x7f7fe80fc7d0 msgr2=0x7f7fe80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.545+0000 7f7fef297640 1 -- 172.21.15.159:0/2381996101 shutdown_connections 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.545+0000 7f7fef297640 1 -- 172.21.15.159:0/2381996101 wait complete. 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.546+0000 7f7fef297640 1 Processor -- start 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.546+0000 7f7fef297640 1 -- start start 2024-09-19T06:52:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.546+0000 7f7fef297640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fe8102d50 0x7f7fe81009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.546+0000 7f7fef297640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fe8103670 0x7f7fe8100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.546+0000 7f7fef297640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe810c180 0x7f7fe8101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.546+0000 7f7fef297640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8111f80 con 0x7f7fe810c180 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.546+0000 7f7fef297640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8111e00 con 0x7f7fe8103670 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.546+0000 7f7fef297640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8112100 con 0x7f7fe8102d50 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fed834640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe810c180 0x7f7fe8101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fec832640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fe8103670 0x7f7fe8100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fec832640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fe8103670 0x7f7fe8100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:37496/0 (socket says 172.21.15.159:37496) 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fed834640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe810c180 0x7f7fe8101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49708/0 (socket says 172.21.15.159:49708) 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fec832640 1 -- 172.21.15.159:0/1685653114 learned_addr learned my addr 172.21.15.159:0/1685653114 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fed033640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fe8102d50 0x7f7fe81009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fec832640 1 -- 172.21.15.159:0/1685653114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fe8102d50 msgr2=0x7f7fe81009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fec832640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fe8102d50 0x7f7fe81009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fec832640 1 -- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe810c180 msgr2=0x7f7fe8101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fec832640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe810c180 0x7f7fe8101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fec832640 1 -- 172.21.15.159:0/1685653114 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe81aae70 con 0x7f7fe8103670 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fed834640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe810c180 0x7f7fe8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fec832640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fe8103670 0x7f7fe8100ef0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800e9f0 tx=0x7f7fd800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fde7fc640 1 -- 172.21.15.159:0/1685653114 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800cd80 con 0x7f7fe8103670 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.547+0000 7f7fde7fc640 1 -- 172.21.15.159:0/1685653114 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd80035f0 con 0x7f7fe8103670 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.548+0000 7f7fde7fc640 1 -- 172.21.15.159:0/1685653114 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8010670 con 0x7f7fe8103670 2024-09-19T06:52:47.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.548+0000 7f7fef297640 1 -- 172.21.15.159:0/1685653114 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe81ab0a0 con 0x7f7fe8103670 2024-09-19T06:52:47.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.548+0000 7f7fef297640 1 -- 172.21.15.159:0/1685653114 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe81ab630 con 0x7f7fe8103670 2024-09-19T06:52:47.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.550+0000 7f7fde7fc640 1 -- 172.21.15.159:0/1685653114 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7fd80037a0 con 0x7f7fe8103670 2024-09-19T06:52:47.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7ff1670740 1 Processor -- start 2024-09-19T06:52:47.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7ff1670740 1 -- start start 2024-09-19T06:52:47.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a03090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a035d0 0x558b05a03a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a0e370 0x558b05a10760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7ff1670740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558b059692f0 con 0x558b05a035d0 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7ff1670740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558b05910cf0 con 0x558b05a0e370 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7ff1670740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558b059652b0 con 0x558b05a04b40 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7fde7fc640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7fd40a3430 0x7f7fd40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.551+0000 7f7fed834640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a03090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a03090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:37810/0 (socket says 172.21.15.159:37810) 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 -- 172.21.15.159:0/2773297444 learned_addr learned my addr 172.21.15.159:0/2773297444 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7fd40a3430 0x7f7fd40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fec832640 1 --2- 172.21.15.159:0/2773297444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a0e370 0x558b05a10760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed033640 1 --2- 172.21.15.159:0/2773297444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a035d0 0x558b05a03a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 -- 172.21.15.159:0/2773297444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a0e370 msgr2=0x558b05a10760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 --2- 172.21.15.159:0/2773297444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a0e370 0x558b05a10760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 -- 172.21.15.159:0/2773297444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a035d0 msgr2=0x558b05a03a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 --2- 172.21.15.159:0/2773297444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a035d0 0x558b05a03a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 -- 172.21.15.159:0/2773297444 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b058f53a0 con 0x558b05a04b40 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fde7fc640 1 -- 172.21.15.159:0/1685653114 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f7fd80cffa0 con 0x7f7fe8103670 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 --2- 172.21.15.159:0/2773297444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a03090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0011c60 tx=0x7f7fe000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba88fff80698b237 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fed834640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7fd40a3430 0x7f7fd40a58f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7fe001d000 tx=0x7f7fe001f000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.552+0000 7f7fd37fe640 1 -- 172.21.15.159:0/2773297444 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe001ece0 con 0x558b05a04b40 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7fd37fe640 1 -- 172.21.15.159:0/2773297444 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fe0022070 con 0x558b05a04b40 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7fd37fe640 1 -- 172.21.15.159:0/2773297444 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe001d640 con 0x558b05a04b40 2024-09-19T06:52:47.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7ff1670740 1 -- 172.21.15.159:0/2773297444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 msgr2=0x558b05a03090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7ff1670740 1 --2- 172.21.15.159:0/2773297444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a03090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0011c60 tx=0x7f7fe000f790 comp rx=0 tx=0).stop 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7ff1670740 1 -- 172.21.15.159:0/2773297444 shutdown_connections 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7ff1670740 1 --2- 172.21.15.159:0/2773297444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a0e370 0x558b05a10760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7ff1670740 1 --2- 172.21.15.159:0/2773297444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a035d0 0x558b05a03a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7ff1670740 1 --2- 172.21.15.159:0/2773297444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a03090 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7ff1670740 1 -- 172.21.15.159:0/2773297444 >> 172.21.15.159:0/2773297444 conn(0x558b059cc310 msgr2=0x558b059ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7ff1670740 1 -- 172.21.15.159:0/2773297444 shutdown_connections 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.553+0000 7f7ff1670740 1 -- 172.21.15.159:0/2773297444 wait complete. 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.554+0000 7f7ff1670740 1 -- start start 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.554+0000 7f7ff1670740 1 Processor -- start 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a0dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a0b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a0b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7ff1670740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558b05a11010 con 0x558b05a0e370 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7ff1670740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558b05924060 con 0x558b05a035d0 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7ff1670740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558b05a11190 con 0x558b05a04b40 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7ff1670740 10 client.0 _ll_register_callbacks cb 0x558b056778c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed033640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a0dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed834640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a0b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed033640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a0dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:37514/0 (socket says 172.21.15.159:37514) 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed834640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a0b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49736/0 (socket says 172.21.15.159:49736) 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed033640 1 -- 172.21.15.159:0/295939590 learned_addr learned my addr 172.21.15.159:0/295939590 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:47.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fec832640 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a0b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed033640 1 -- 172.21.15.159:0/295939590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 msgr2=0x558b05a0b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed033640 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a0b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed033640 1 -- 172.21.15.159:0/295939590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 msgr2=0x558b05a0b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed033640 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a0b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed033640 1 -- 172.21.15.159:0/295939590 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b056da3c0 con 0x558b05a035d0 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fec832640 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a0b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.555+0000 7f7fed834640 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a0b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7fed033640 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a0dd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7fe402a9a0 tx=0x7f7fe40317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b3a6b94c3f2c2d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7fd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/295939590 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4035040 con 0x558b05a035d0 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7ff1670740 1 -- 172.21.15.159:0/295939590 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fe0022070 con 0x558b05a035d0 2024-09-19T06:52:47.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/295939590 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f7fe4004240 con 0x558b05a035d0 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/295939590 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fe4004440 con 0x558b05a035d0 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7ff1670740 10 client.26039 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7ff1670740 1 -- 172.21.15.159:0/295939590 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558b05a1cae0 con 0x558b05a035d0 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/295939590 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fe4005500 con 0x558b05a035d0 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.556+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/295939590 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f7fe40035f0 con 0x558b05a035d0 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.557+0000 7f7ff1670740 10 client.26039 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.557+0000 7f7ff1670740 10 client.26039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.557+0000 7f7ff1670740 20 client.26039 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.557+0000 7f7ff1670740 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558b05a1e380 0x558b05a207c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.557+0000 7f7ff1670740 4 client.26039 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.557+0000 7f7ff1670740 1 -- 172.21.15.159:0/295939590 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7fe0022070 con 0x558b05a1e380 2024-09-19T06:52:47.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.557+0000 7f7fec832640 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558b05a1e380 0x558b05a207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.557+0000 7f7fd0ff9640 10 client.26039 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.557+0000 7f7fec832640 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558b05a1e380 0x558b05a207c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bc9aac0faacdf6a server_cookie=efee5c37d41b186f in_seq=0 out_seq=0 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.558+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/295939590 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7fe0022070 con 0x558b05a1e380 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.558+0000 7f7fd0ff9640 10 client.26039 handle_command_reply: tid=0 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.558+0000 7f7ff1670740 1 client.26039 shutdown 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 -- 172.21.15.159:0/295939590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 msgr2=0x558b05a0dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a0dd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7fe402a9a0 tx=0x7f7fe40317e0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 -- 172.21.15.159:0/295939590 shutdown_connections 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558b05a1e380 0x558b05a207c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a0b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a0b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7fd0ff9640 0 client.26039 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:47.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 --2- 172.21.15.159:0/295939590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a0dd80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 -- 172.21.15.159:0/295939590 >> 172.21.15.159:0/295939590 conn(0x558b059cc310 msgr2=0x558b05a05960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:47.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 -- 172.21.15.159:0/295939590 shutdown_connections 2024-09-19T06:52:47.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 1 -- 172.21.15.159:0/295939590 wait complete. 2024-09-19T06:52:47.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.559+0000 7f7ff1670740 20 client.26039 trim_cache size 0 max 16384 2024-09-19T06:52:47.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7ff1670740 1 Processor -- start 2024-09-19T06:52:47.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7ff1670740 1 -- start start 2024-09-19T06:52:47.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b059fec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b059ff150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a06120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7ff1670740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81b1f80 con 0x558b05a0e370 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7ff1670740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81b4800 con 0x558b05a035d0 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7ff1670740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81b25f0 con 0x558b05a04b40 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7fed834640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a06120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7fec832640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b059ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7fec832640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b059ff150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:37832/0 (socket says 172.21.15.159:37832) 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7fed033640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b059fec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.577+0000 7f7fec832640 1 -- 172.21.15.159:0/3690631255 learned_addr learned my addr 172.21.15.159:0/3690631255 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fec832640 1 -- 172.21.15.159:0/3690631255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 msgr2=0x558b059fec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fec832640 1 --2- 172.21.15.159:0/3690631255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b059fec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fec832640 1 -- 172.21.15.159:0/3690631255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 msgr2=0x558b05a06120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:47.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fec832640 1 --2- 172.21.15.159:0/3690631255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a06120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fec832640 1 -- 172.21.15.159:0/3690631255 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b05a11180 con 0x558b05a04b40 2024-09-19T06:52:47.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fed033640 1 --2- 172.21.15.159:0/3690631255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b059fec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:47.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fec832640 1 --2- 172.21.15.159:0/3690631255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b059ff150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80986b0 tx=0x7f7fd8097e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b699ec8a0c8bc662 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:47.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fd2ffd640 1 -- 172.21.15.159:0/3690631255 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd809a550 con 0x558b05a04b40 2024-09-19T06:52:47.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fd2ffd640 1 -- 172.21.15.159:0/3690631255 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd8003b10 con 0x558b05a04b40 2024-09-19T06:52:47.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.578+0000 7f7fd2ffd640 1 -- 172.21.15.159:0/3690631255 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80bc0b0 con 0x558b05a04b40 2024-09-19T06:52:47.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 -- 172.21.15.159:0/3690631255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 msgr2=0x558b059ff150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:47.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3690631255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b059ff150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80986b0 tx=0x7f7fd8097e40 comp rx=0 tx=0).stop 2024-09-19T06:52:47.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 -- 172.21.15.159:0/3690631255 shutdown_connections 2024-09-19T06:52:47.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3690631255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a06120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3690631255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b059ff150 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3690631255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b059fec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 -- 172.21.15.159:0/3690631255 >> 172.21.15.159:0/3690631255 conn(0x558b059cc310 msgr2=0x558b059fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:47.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 -- 172.21.15.159:0/3690631255 shutdown_connections 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 -- 172.21.15.159:0/3690631255 wait complete. 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.579+0000 7f7ff1670740 1 -- start start 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7ff1670740 1 Processor -- start 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a169e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a11d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7ff1670740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a12250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7ff1670740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81b2cc0 con 0x558b05a0e370 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7ff1670740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81b4130 con 0x558b05a035d0 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7ff1670740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe81b3390 con 0x558b05a04b40 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7ff1670740 10 client.0 _ll_register_callbacks cb 0x7f7fe4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:47.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7fed834640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a12250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7fec832640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a11d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7fed033640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7fec832640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a11d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:37836/0 (socket says 172.21.15.159:37836) 2024-09-19T06:52:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7fed834640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a12250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49756/0 (socket says 172.21.15.159:49756) 2024-09-19T06:52:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.580+0000 7f7fec832640 1 -- 172.21.15.159:0/3253252076 learned_addr learned my addr 172.21.15.159:0/3253252076 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fec832640 1 -- 172.21.15.159:0/3253252076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 msgr2=0x558b05a169e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fec832640 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a169e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fec832640 1 -- 172.21.15.159:0/3253252076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 msgr2=0x558b05a12250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fec832640 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a12250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fec832640 1 -- 172.21.15.159:0/3253252076 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b05a128c0 con 0x558b05a04b40 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fed834640 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a12250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fec832640 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a11d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80cdcc0 tx=0x7f7fd80095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e105db6f8aff35af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/3253252076 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80b5250 con 0x558b05a04b40 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/3253252076 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f7fd80a01f0 con 0x558b05a04b40 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7ff1670740 1 -- 172.21.15.159:0/3253252076 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fd8003b10 con 0x558b05a04b40 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/3253252076 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fd809a610 con 0x558b05a04b40 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7ff1670740 10 client.26092 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7ff1670740 1 -- 172.21.15.159:0/3253252076 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558b05a88f10 con 0x558b05a04b40 2024-09-19T06:52:47.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.581+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/3253252076 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd8003b10 con 0x558b05a04b40 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.582+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/3253252076 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f7fd80bc1d0 con 0x558b05a04b40 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.582+0000 7f7ff1670740 10 client.26092 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.582+0000 7f7ff1670740 10 client.26092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.582+0000 7f7ff1670740 20 client.26092 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.582+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558b05a894b0 0x558b05a8b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.582+0000 7f7ff1670740 4 client.26092 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.582+0000 7f7ff1670740 1 -- 172.21.15.159:0/3253252076 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558b05976860 con 0x558b05a894b0 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.582+0000 7f7fed033640 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558b05a894b0 0x558b05a8b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.583+0000 7f7fd0ff9640 10 client.26092 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.583+0000 7f7fed033640 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558b05a894b0 0x558b05a8b8d0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=635380bc71051878 server_cookie=b8941ff0a72c5930 in_seq=0 out_seq=0 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.583+0000 7f7fd0ff9640 1 -- 172.21.15.159:0/3253252076 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558b05976860 con 0x558b05a894b0 2024-09-19T06:52:47.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.583+0000 7f7fd0ff9640 10 client.26092 handle_command_reply: tid=0 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.583+0000 7f7ff1670740 1 client.26092 shutdown 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.583+0000 7f7ff1670740 1 -- 172.21.15.159:0/3253252076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 msgr2=0x558b05a11d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.583+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a11d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80cdcc0 tx=0x7f7fd80095b0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.583+0000 7f7ff1670740 1 -- 172.21.15.159:0/3253252076 shutdown_connections 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.583+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558b05a894b0 0x558b05a8b8d0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558b05a0e370 0x558b05a12250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7fd0ff9640 0 client.26092 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558b05a04b40 0x558b05a11d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7ff1670740 1 --2- 172.21.15.159:0/3253252076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b05a035d0 0x558b05a169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7ff1670740 1 -- 172.21.15.159:0/3253252076 >> 172.21.15.159:0/3253252076 conn(0x558b059cc310 msgr2=0x558b059fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7ff1670740 1 -- 172.21.15.159:0/3253252076 shutdown_connections 2024-09-19T06:52:47.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7ff1670740 1 -- 172.21.15.159:0/3253252076 wait complete. 2024-09-19T06:52:47.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7ff1670740 20 client.26092 trim_cache size 0 max 16384 2024-09-19T06:52:47.595 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:52:47.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7fef297640 1 -- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7fd40a3430 msgr2=0x7f7fd40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7fef297640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7fd40a3430 0x7f7fd40a58f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7fe001d000 tx=0x7f7fe001f000 comp rx=0 tx=0).stop 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7fef297640 1 -- 172.21.15.159:0/1685653114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fe8103670 msgr2=0x7f7fe8100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.584+0000 7f7fef297640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fe8103670 0x7f7fe8100ef0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800e9f0 tx=0x7f7fd800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.585+0000 7f7fef297640 1 -- 172.21.15.159:0/1685653114 shutdown_connections 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.585+0000 7f7fef297640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7fd40a3430 0x7f7fd40a58f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.585+0000 7f7fef297640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe810c180 0x7f7fe8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.585+0000 7f7fef297640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fe8103670 0x7f7fe8100ef0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.585+0000 7f7fef297640 1 --2- 172.21.15.159:0/1685653114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fe8102d50 0x7f7fe81009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.585+0000 7f7fef297640 1 -- 172.21.15.159:0/1685653114 >> 172.21.15.159:0/1685653114 conn(0x7f7fe80fc7d0 msgr2=0x7f7fe80fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.585+0000 7f7fef297640 1 -- 172.21.15.159:0/1685653114 shutdown_connections 2024-09-19T06:52:47.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:47.585+0000 7f7fef297640 1 -- 172.21.15.159:0/1685653114 wait complete. 2024-09-19T06:52:49.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:48 smithi203 ceph-mon[35473]: pgmap v179: 97 pgs: 97 active+clean; 76 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 869 op/s 2024-09-19T06:52:49.105 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:48 smithi159 ceph-mon[30935]: pgmap v179: 97 pgs: 97 active+clean; 76 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 869 op/s 2024-09-19T06:52:49.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:48 smithi189 ceph-mon[34880]: pgmap v179: 97 pgs: 97 active+clean; 76 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 869 op/s 2024-09-19T06:52:49.360 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:52:49.360 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:52:49.674 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:51.053 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:50 smithi159 ceph-mon[30935]: pgmap v180: 97 pgs: 97 active+clean; 76 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 869 op/s 2024-09-19T06:52:51.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:50 smithi203 ceph-mon[35473]: pgmap v180: 97 pgs: 97 active+clean; 76 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 869 op/s 2024-09-19T06:52:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:50 smithi189 ceph-mon[34880]: pgmap v180: 97 pgs: 97 active+clean; 76 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 869 op/s 2024-09-19T06:52:51.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.159+0000 7f506ba36640 1 -- 172.21.15.159:0/3203279201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50641036e0 msgr2=0x7f5064107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:51.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.159+0000 7f506ba36640 1 --2- 172.21.15.159:0/3203279201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50641036e0 0x7f5064107b90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5054009930 tx=0x7f505402a420 comp rx=0 tx=0).stop 2024-09-19T06:52:51.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.159+0000 7f506ba36640 1 -- 172.21.15.159:0/3203279201 shutdown_connections 2024-09-19T06:52:51.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.159+0000 7f506ba36640 1 --2- 172.21.15.159:0/3203279201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50641082a0 0x7f506410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.159+0000 7f506ba36640 1 --2- 172.21.15.159:0/3203279201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50641036e0 0x7f5064107b90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.159+0000 7f506ba36640 1 --2- 172.21.15.159:0/3203279201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5064102d30 0x7f5064103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.159+0000 7f506ba36640 1 -- 172.21.15.159:0/3203279201 >> 172.21.15.159:0/3203279201 conn(0x7f50640fc7d0 msgr2=0x7f50640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:51.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.159+0000 7f506ba36640 1 -- 172.21.15.159:0/3203279201 shutdown_connections 2024-09-19T06:52:51.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.159+0000 7f506ba36640 1 -- 172.21.15.159:0/3203279201 wait complete. 2024-09-19T06:52:51.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.160+0000 7f506ba36640 1 Processor -- start 2024-09-19T06:52:51.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.160+0000 7f506ba36640 1 -- start start 2024-09-19T06:52:51.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.160+0000 7f506ba36640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5064102d30 0x7f5064198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f506ba36640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50641036e0 0x7f5064198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f506ba36640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50641082a0 0x7f506419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f506ba36640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f50641120a0 con 0x7f50641082a0 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f506ba36640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5064111f20 con 0x7f50641036e0 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f506ba36640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5064112220 con 0x7f5064102d30 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f50697d2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5064102d30 0x7f5064198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f50697d2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5064102d30 0x7f5064198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:41620/0 (socket says 172.21.15.159:41620) 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f50697d2640 1 -- 172.21.15.159:0/3685492362 learned_addr learned my addr 172.21.15.159:0/3685492362 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f5069fd3640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50641082a0 0x7f506419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f5068fd1640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50641036e0 0x7f5064198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f50697d2640 1 -- 172.21.15.159:0/3685492362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50641036e0 msgr2=0x7f5064198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f50697d2640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50641036e0 0x7f5064198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f50697d2640 1 -- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50641082a0 msgr2=0x7f506419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f50697d2640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50641082a0 0x7f506419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f50697d2640 1 -- 172.21.15.159:0/3685492362 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506419d5b0 con 0x7f5064102d30 2024-09-19T06:52:51.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f5068fd1640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50641036e0 0x7f5064198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:51.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.161+0000 7f50697d2640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5064102d30 0x7f5064198600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f506000e9f0 tx=0x7f506000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:51.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.162+0000 7f505a7fc640 1 -- 172.21.15.159:0/3685492362 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506000cd80 con 0x7f5064102d30 2024-09-19T06:52:51.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.162+0000 7f505a7fc640 1 -- 172.21.15.159:0/3685492362 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5060005500 con 0x7f5064102d30 2024-09-19T06:52:51.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.162+0000 7f506ba36640 1 -- 172.21.15.159:0/3685492362 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506419d8a0 con 0x7f5064102d30 2024-09-19T06:52:51.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.162+0000 7f505a7fc640 1 -- 172.21.15.159:0/3685492362 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060010690 con 0x7f5064102d30 2024-09-19T06:52:51.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.162+0000 7f506ba36640 1 -- 172.21.15.159:0/3685492362 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50641a5180 con 0x7f5064102d30 2024-09-19T06:52:51.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.164+0000 7f505a7fc640 1 -- 172.21.15.159:0/3685492362 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f50600046c0 con 0x7f5064102d30 2024-09-19T06:52:51.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f506de0f740 1 Processor -- start 2024-09-19T06:52:51.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f506de0f740 1 -- start start 2024-09-19T06:52:51.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f506de0f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547dcfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f506de0f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dd0340 0x55d547ddec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f506de0f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547de1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f506de0f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d547d35280 con 0x55d547dcfa20 2024-09-19T06:52:51.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f506de0f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d547cdcb10 con 0x55d547dd0340 2024-09-19T06:52:51.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f506de0f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d547d31240 con 0x55d547ddf150 2024-09-19T06:52:51.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f5069fd3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547dcfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f5069fd3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547dcfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36338/0 (socket says 172.21.15.159:36338) 2024-09-19T06:52:51.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f5069fd3640 1 -- 172.21.15.159:0/3372096608 learned_addr learned my addr 172.21.15.159:0/3372096608 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:51.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f5068fd1640 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547de1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.165+0000 7f505a7fc640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f50500a3430 0x7f50500a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f50697d2640 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dd0340 0x55d547ddec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f5069fd3640 1 -- 172.21.15.159:0/3372096608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 msgr2=0x55d547de1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:51.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f5069fd3640 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547de1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f505a7fc640 1 -- 172.21.15.159:0/3685492362 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f50600d0180 con 0x7f5064102d30 2024-09-19T06:52:51.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f5069fd3640 1 -- 172.21.15.159:0/3372096608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dd0340 msgr2=0x55d547ddec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:51.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f5069fd3640 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dd0340 0x55d547ddec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f5069fd3640 1 -- 172.21.15.159:0/3372096608 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d547ce91f0 con 0x55d547dcfa20 2024-09-19T06:52:51.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f5068fd1640 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547de1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:51.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f5069fd3640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f50500a3430 0x7f50500a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f5069fd3640 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547dcfe00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f505c0124c0 tx=0x7f505c012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135e7a4771e244b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f504f7fe640 1 -- 172.21.15.159:0/3372096608 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c01aaa0 con 0x55d547dcfa20 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f504f7fe640 1 -- 172.21.15.159:0/3372096608 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f505c012110 con 0x55d547dcfa20 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f5069fd3640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f50500a3430 0x7f50500a58f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f505c021000 tx=0x7f505c01e000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.166+0000 7f504f7fe640 1 -- 172.21.15.159:0/3372096608 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c01bde0 con 0x55d547dcfa20 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.167+0000 7f506de0f740 1 -- 172.21.15.159:0/3372096608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 msgr2=0x55d547dcfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.167+0000 7f506de0f740 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547dcfe00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f505c0124c0 tx=0x7f505c012980 comp rx=0 tx=0).stop 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.167+0000 7f506de0f740 1 -- 172.21.15.159:0/3372096608 shutdown_connections 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.167+0000 7f506de0f740 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547de1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.167+0000 7f506de0f740 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dd0340 0x55d547ddec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.167+0000 7f506de0f740 1 --2- 172.21.15.159:0/3372096608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547dcfe00 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.167+0000 7f506de0f740 1 -- 172.21.15.159:0/3372096608 >> 172.21.15.159:0/3372096608 conn(0x55d547dcc0f0 msgr2=0x55d547dcc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:51.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.167+0000 7f506de0f740 1 -- 172.21.15.159:0/3372096608 shutdown_connections 2024-09-19T06:52:51.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.167+0000 7f506de0f740 1 -- 172.21.15.159:0/3372096608 wait complete. 2024-09-19T06:52:51.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.168+0000 7f506de0f740 1 -- start start 2024-09-19T06:52:51.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.168+0000 7f506de0f740 1 Processor -- start 2024-09-19T06:52:51.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.168+0000 7f506de0f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dcfa20 0x55d547ddc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.168+0000 7f506de0f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547ddc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.168+0000 7f506de0f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547ddcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.168+0000 7f506de0f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d547de1d20 con 0x55d547dd0340 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.168+0000 7f506de0f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d547ceff10 con 0x55d547dcfa20 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.168+0000 7f506de0f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d547de1ea0 con 0x55d547ddf150 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f506de0f740 10 client.0 _ll_register_callbacks cb 0x55d547cb8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5068fd1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547ddc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5068fd1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547ddc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36350/0 (socket says 172.21.15.159:36350) 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5068fd1640 1 -- 172.21.15.159:0/1584627506 learned_addr learned my addr 172.21.15.159:0/1584627506 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f50697d2640 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dcfa20 0x55d547ddc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5069fd3640 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547ddcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5068fd1640 1 -- 172.21.15.159:0/1584627506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 msgr2=0x55d547ddcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5068fd1640 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547ddcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5068fd1640 1 -- 172.21.15.159:0/1584627506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dcfa20 msgr2=0x55d547ddc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:51.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5068fd1640 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dcfa20 0x55d547ddc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5068fd1640 1 -- 172.21.15.159:0/1584627506 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d547aa66a0 con 0x55d547dd0340 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5069fd3640 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547ddcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f5068fd1640 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547ddc5f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5054009930 tx=0x7f5054031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef4a7cfe498b600 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f504cff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f504cff9640 1 -- 172.21.15.159:0/1584627506 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054035040 con 0x55d547dd0340 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f504cff9640 1 -- 172.21.15.159:0/1584627506 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f5054004460 con 0x55d547dd0340 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.169+0000 7f506de0f740 1 -- 172.21.15.159:0/1584627506 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f505c012110 con 0x55d547dd0340 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f504cff9640 1 -- 172.21.15.159:0/1584627506 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5054005030 con 0x55d547dd0340 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f506de0f740 10 client.16788 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f506de0f740 1 -- 172.21.15.159:0/1584627506 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d547ded9e0 con 0x55d547dd0340 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f504cff9640 1 -- 172.21.15.159:0/1584627506 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f505c012110 con 0x55d547dd0340 2024-09-19T06:52:51.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f504cff9640 1 -- 172.21.15.159:0/1584627506 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f505404b070 con 0x55d547dd0340 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f506de0f740 10 client.16788 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f506de0f740 10 client.16788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f506de0f740 20 client.16788 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f506de0f740 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d547deeea0 0x55d547df1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f506de0f740 4 client.16788 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f506de0f740 1 -- 172.21.15.159:0/1584627506 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d547d427f0 con 0x55d547deeea0 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.170+0000 7f50697d2640 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d547deeea0 0x55d547df1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.171+0000 7f50697d2640 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d547deeea0 0x55d547df1290 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68057dfc6110536f server_cookie=fea2a7a3d6d138bc in_seq=0 out_seq=0 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.171+0000 7f504cff9640 10 client.16788 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.171+0000 7f504cff9640 1 -- 172.21.15.159:0/1584627506 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d547d427f0 con 0x55d547deeea0 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.171+0000 7f504cff9640 10 client.16788 handle_command_reply: tid=0 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.171+0000 7f506de0f740 1 client.16788 shutdown 2024-09-19T06:52:51.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 -- 172.21.15.159:0/1584627506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 msgr2=0x55d547ddc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547ddc5f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5054009930 tx=0x7f5054031860 comp rx=0 tx=0).stop 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 -- 172.21.15.159:0/1584627506 shutdown_connections 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d547deeea0 0x55d547df1290 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547ddf150 0x55d547ddcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547ddc5f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 --2- 172.21.15.159:0/1584627506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547dcfa20 0x55d547ddc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 -- 172.21.15.159:0/1584627506 >> 172.21.15.159:0/1584627506 conn(0x55d547dcc0f0 msgr2=0x55d547dd1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f504cff9640 0 client.16788 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 -- 172.21.15.159:0/1584627506 shutdown_connections 2024-09-19T06:52:51.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 1 -- 172.21.15.159:0/1584627506 wait complete. 2024-09-19T06:52:51.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.172+0000 7f506de0f740 20 client.16788 trim_cache size 0 max 16384 2024-09-19T06:52:51.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.196+0000 7f506de0f740 1 Processor -- start 2024-09-19T06:52:51.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.196+0000 7f506de0f740 1 -- start start 2024-09-19T06:52:51.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f506de0f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dcfa20 0x55d547df6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f506de0f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547df70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f506de0f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 0x55d547dd9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f506de0f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f50641a9760 con 0x55d547dd0340 2024-09-19T06:52:51.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f506de0f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50641abfe0 con 0x55d547ddf150 2024-09-19T06:52:51.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f506de0f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f50641a9dd0 con 0x55d547dcfa20 2024-09-19T06:52:51.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5068fd1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547df70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5068fd1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547df70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36366/0 (socket says 172.21.15.159:36366) 2024-09-19T06:52:51.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5068fd1640 1 -- 172.21.15.159:0/4071977143 learned_addr learned my addr 172.21.15.159:0/4071977143 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:51.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f50697d2640 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dcfa20 0x55d547df6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5069fd3640 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 0x55d547dd9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5068fd1640 1 -- 172.21.15.159:0/4071977143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dcfa20 msgr2=0x55d547df6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:51.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5068fd1640 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dcfa20 0x55d547df6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5068fd1640 1 -- 172.21.15.159:0/4071977143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 msgr2=0x55d547dd9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5068fd1640 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 0x55d547dd9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5068fd1640 1 -- 172.21.15.159:0/4071977143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d547dda600 con 0x55d547dd0340 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5069fd3640 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 0x55d547dd9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.197+0000 7f5068fd1640 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547df70a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f505402a940 tx=0x7f505402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb9f90b8c358fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f504effd640 1 -- 172.21.15.159:0/4071977143 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054051020 con 0x55d547dd0340 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f504effd640 1 -- 172.21.15.159:0/4071977143 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5054040070 con 0x55d547dd0340 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f504effd640 1 -- 172.21.15.159:0/4071977143 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054035040 con 0x55d547dd0340 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f506de0f740 1 -- 172.21.15.159:0/4071977143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 msgr2=0x55d547df70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f506de0f740 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547df70a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f505402a940 tx=0x7f505402a420 comp rx=0 tx=0).stop 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f506de0f740 1 -- 172.21.15.159:0/4071977143 shutdown_connections 2024-09-19T06:52:51.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f506de0f740 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 0x55d547dd9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f506de0f740 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dd0340 0x55d547df70a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f506de0f740 1 --2- 172.21.15.159:0/4071977143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dcfa20 0x55d547df6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f506de0f740 1 -- 172.21.15.159:0/4071977143 >> 172.21.15.159:0/4071977143 conn(0x55d547dcc0f0 msgr2=0x55d547dde020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f506de0f740 1 -- 172.21.15.159:0/4071977143 shutdown_connections 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.198+0000 7f506de0f740 1 -- 172.21.15.159:0/4071977143 wait complete. 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f506de0f740 1 -- start start 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f506de0f740 1 Processor -- start 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f506de0f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547de35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f506de0f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dd0340 0x55d547de3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f506de0f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 0x55d547e58b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f506de0f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f50641aa4a0 con 0x55d547dcfa20 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f506de0f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50641ab910 con 0x55d547ddf150 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f506de0f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f50641aab70 con 0x55d547dd0340 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f506de0f740 10 client.0 _ll_register_callbacks cb 0x7f5054009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f50697d2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547de35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f50697d2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547de35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36376/0 (socket says 172.21.15.159:36376) 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f50697d2640 1 -- 172.21.15.159:0/2281665548 learned_addr learned my addr 172.21.15.159:0/2281665548 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f5068fd1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dd0340 0x55d547de3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.199+0000 7f5069fd3640 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 0x55d547e58b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f50697d2640 1 -- 172.21.15.159:0/2281665548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dd0340 msgr2=0x55d547de3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:51.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f50697d2640 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dd0340 0x55d547de3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f50697d2640 1 -- 172.21.15.159:0/2281665548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 msgr2=0x55d547e58b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f50697d2640 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 0x55d547e58b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f50697d2640 1 -- 172.21.15.159:0/2281665548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d547e59070 con 0x55d547dcfa20 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f50697d2640 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547de35a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f50600cd900 tx=0x7f506006b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e0ae96da4a0f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f504cff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f504cff9640 1 -- 172.21.15.159:0/2281665548 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506009cb30 con 0x55d547dcfa20 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f504cff9640 1 -- 172.21.15.159:0/2281665548 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f50600cdb20 con 0x55d547dcfa20 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f506de0f740 1 -- 172.21.15.159:0/2281665548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5054040070 con 0x55d547dcfa20 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f504cff9640 1 -- 172.21.15.159:0/2281665548 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f50600cdd20 con 0x55d547dcfa20 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f506de0f740 10 client.16794 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:51.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f506de0f740 1 -- 172.21.15.159:0/2281665548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d547e5a380 con 0x55d547dcfa20 2024-09-19T06:52:51.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.200+0000 7f504cff9640 1 -- 172.21.15.159:0/2281665548 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5054040070 con 0x55d547dcfa20 2024-09-19T06:52:51.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f504cff9640 1 -- 172.21.15.159:0/2281665548 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f50600b5100 con 0x55d547dcfa20 2024-09-19T06:52:51.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f506de0f740 10 client.16794 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:51.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f506de0f740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:51.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f506de0f740 20 client.16794 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:51.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f506de0f740 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d547e5aaa0 0x55d547e5ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:51.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f506de0f740 4 client.16794 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:52:51.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f506de0f740 1 -- 172.21.15.159:0/2281665548 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d547d3cd00 con 0x55d547e5aaa0 2024-09-19T06:52:51.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f5068fd1640 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d547e5aaa0 0x55d547e5ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f504cff9640 10 client.16794 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.201+0000 7f5068fd1640 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d547e5aaa0 0x55d547e5ce90 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca7ff59583abddeb server_cookie=cb17e2cd6dfa18b7 in_seq=0 out_seq=0 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.202+0000 7f504cff9640 1 -- 172.21.15.159:0/2281665548 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d547d3cd00 con 0x55d547e5aaa0 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.202+0000 7f504cff9640 10 client.16794 handle_command_reply: tid=0 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.202+0000 7f506de0f740 1 client.16794 shutdown 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.202+0000 7f506de0f740 1 -- 172.21.15.159:0/2281665548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 msgr2=0x55d547de35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.202+0000 7f506de0f740 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547de35a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f50600cd900 tx=0x7f506006b1e0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.202+0000 7f506de0f740 1 -- 172.21.15.159:0/2281665548 shutdown_connections 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.202+0000 7f506de0f740 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d547e5aaa0 0x55d547e5ce90 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506de0f740 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d547ddf150 0x55d547e58b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506de0f740 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d547dd0340 0x55d547de3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506de0f740 1 --2- 172.21.15.159:0/2281665548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d547dcfa20 0x55d547de35a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506de0f740 1 -- 172.21.15.159:0/2281665548 >> 172.21.15.159:0/2281665548 conn(0x55d547dcc0f0 msgr2=0x55d547ddc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:51.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f504cff9640 0 client.16794 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:51.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506de0f740 1 -- 172.21.15.159:0/2281665548 shutdown_connections 2024-09-19T06:52:51.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506de0f740 1 -- 172.21.15.159:0/2281665548 wait complete. 2024-09-19T06:52:51.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506de0f740 20 client.16794 trim_cache size 0 max 16384 2024-09-19T06:52:51.213 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:52:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:52:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "6240e867-5c9d-4ddb-a08d-22eff47ecbe1", 2024-09-19T06:52:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:52:51.214 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:52:51.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506ba36640 1 -- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f50500a3430 msgr2=0x7f50500a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:51.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506ba36640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f50500a3430 0x7f50500a58f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f505c021000 tx=0x7f505c01e000 comp rx=0 tx=0).stop 2024-09-19T06:52:51.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506ba36640 1 -- 172.21.15.159:0/3685492362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5064102d30 msgr2=0x7f5064198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:51.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.203+0000 7f506ba36640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5064102d30 0x7f5064198600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f506000e9f0 tx=0x7f506000edf0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.204+0000 7f506ba36640 1 -- 172.21.15.159:0/3685492362 shutdown_connections 2024-09-19T06:52:51.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.204+0000 7f506ba36640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f50500a3430 0x7f50500a58f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.204+0000 7f506ba36640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50641082a0 0x7f506419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.204+0000 7f506ba36640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50641036e0 0x7f5064198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.204+0000 7f506ba36640 1 --2- 172.21.15.159:0/3685492362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5064102d30 0x7f5064198600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:51.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.204+0000 7f506ba36640 1 -- 172.21.15.159:0/3685492362 >> 172.21.15.159:0/3685492362 conn(0x7f50640fc7d0 msgr2=0x7f5064105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:51.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.204+0000 7f506ba36640 1 -- 172.21.15.159:0/3685492362 shutdown_connections 2024-09-19T06:52:51.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:51.204+0000 7f506ba36640 1 -- 172.21.15.159:0/3685492362 wait complete. 2024-09-19T06:52:52.035 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:51 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:52:52.035 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:51 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:52.035 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:51 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:52:52.071 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:52:52.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:51 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:52:52.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:51 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:52.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:51 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:52:52.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:51 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:52:52.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:51 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:52.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:51 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:52:52.370 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:52.819 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:52 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:52.820 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:52 smithi159 ceph-mon[30935]: pgmap v181: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.8 MiB/s wr, 1.50k op/s 2024-09-19T06:52:52.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.921+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2995913541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2d0101430 msgr2=0x7fe2d010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:52.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.921+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2995913541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2d0101430 0x7fe2d010d960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009c10 tx=0x7fe2c802a6e0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.921+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2995913541 shutdown_connections 2024-09-19T06:52:52.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.921+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2995913541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2d0101430 0x7fe2d010d960 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.921+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2995913541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2d0100a90 0x7fe2d0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.921+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2995913541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2d0106a90 0x7fe2d0106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.921+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2995913541 >> 172.21.15.159:0/2995913541 conn(0x7fe2d00fc7d0 msgr2=0x7fe2d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:52.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.921+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2995913541 shutdown_connections 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.921+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2995913541 wait complete. 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.922+0000 7fe2d50c2640 1 Processor -- start 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.922+0000 7fe2d50c2640 1 -- start start 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.922+0000 7fe2d50c2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2d0100a90 0x7fe2d0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.922+0000 7fe2d50c2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2d0101430 0x7fe2d0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.922+0000 7fe2d50c2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2d0106a90 0x7fe2d019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.922+0000 7fe2d50c2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d0110e90 con 0x7fe2d0106a90 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.922+0000 7fe2d50c2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d0110d10 con 0x7fe2d0101430 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.922+0000 7fe2d50c2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d0111010 con 0x7fe2d0100a90 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ce59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2d0101430 0x7fe2d0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2cf59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2d0106a90 0x7fe2d019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ced9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2d0100a90 0x7fe2d0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ce59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2d0101430 0x7fe2d0198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:59058/0 (socket says 172.21.15.159:59058) 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ce59c640 1 -- 172.21.15.159:0/2322907421 learned_addr learned my addr 172.21.15.159:0/2322907421 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ce59c640 1 -- 172.21.15.159:0/2322907421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2d0100a90 msgr2=0x7fe2d0198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2d0100a90 0x7fe2d0198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ce59c640 1 -- 172.21.15.159:0/2322907421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2d0106a90 msgr2=0x7fe2d019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2d0106a90 0x7fe2d019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ce59c640 1 -- 172.21.15.159:0/2322907421 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d019d3d0 con 0x7fe2d0101430 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2d0101430 0x7fe2d0198960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400e9c0 tx=0x7fe2c400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2b7fff640 1 -- 172.21.15.159:0/2322907421 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400cde0 con 0x7fe2d0101430 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2322907421 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d019d6c0 con 0x7fe2d0101430 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2b7fff640 1 -- 172.21.15.159:0/2322907421 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c40035f0 con 0x7fe2d0101430 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2b7fff640 1 -- 172.21.15.159:0/2322907421 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4010690 con 0x7fe2d0101430 2024-09-19T06:52:52.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.923+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2322907421 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d01a4fa0 con 0x7fe2d0101430 2024-09-19T06:52:52.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.926+0000 7fe2b7fff640 1 -- 172.21.15.159:0/2322907421 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe2c4010830 con 0x7fe2d0101430 2024-09-19T06:52:52.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.926+0000 7fe2d749b740 1 Processor -- start 2024-09-19T06:52:52.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.926+0000 7fe2d749b740 1 -- start start 2024-09-19T06:52:52.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.926+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622161213a0 0x562216121780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.926+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x562216130550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.926+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562216130a90 0x562216132e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.926+0000 7fe2d749b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5622160872e0 con 0x5622161213a0 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.926+0000 7fe2d749b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56221602ece0 con 0x562216130a90 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.926+0000 7fe2d749b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5622160832a0 con 0x562216121cc0 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2cf59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622161213a0 0x562216121780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2cf59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622161213a0 0x562216121780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36406/0 (socket says 172.21.15.159:36406) 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2cf59e640 1 -- 172.21.15.159:0/504125628 learned_addr learned my addr 172.21.15.159:0/504125628 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562216130a90 0x562216132e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2b7fff640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2b80a33b0 0x7fe2b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x562216130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2ce59c640 1 -- 172.21.15.159:0/504125628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 msgr2=0x562216130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x562216130550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2ce59c640 1 -- 172.21.15.159:0/504125628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622161213a0 msgr2=0x562216121780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2b7fff640 1 -- 172.21.15.159:0/2322907421 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe2c40d00e0 con 0x7fe2d0101430 2024-09-19T06:52:52.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622161213a0 0x562216121780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2ce59c640 1 -- 172.21.15.159:0/504125628 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562216013440 con 0x562216130a90 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x562216130550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2cf59e640 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622161213a0 0x562216121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2cf59e640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2b80a33b0 0x7fe2b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.927+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562216130a90 0x562216132e80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40cd7a0 tx=0x7fe2c4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cd03150fd6b65ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.928+0000 7fe2b57fa640 1 -- 172.21.15.159:0/504125628 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c409c100 con 0x562216130a90 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.928+0000 7fe2b57fa640 1 -- 172.21.15.159:0/504125628 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c409ca30 con 0x562216130a90 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.928+0000 7fe2b57fa640 1 -- 172.21.15.159:0/504125628 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c409bc90 con 0x562216130a90 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.928+0000 7fe2d749b740 1 -- 172.21.15.159:0/504125628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562216130a90 msgr2=0x562216132e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.928+0000 7fe2cf59e640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2b80a33b0 0x7fe2b80a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8004af0 tx=0x7fe2c8009500 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.928+0000 7fe2d749b740 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562216130a90 0x562216132e80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40cd7a0 tx=0x7fe2c4017000 comp rx=0 tx=0).stop 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.929+0000 7fe2d749b740 1 -- 172.21.15.159:0/504125628 shutdown_connections 2024-09-19T06:52:52.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.929+0000 7fe2d749b740 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562216130a90 0x562216132e80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.929+0000 7fe2d749b740 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x562216130550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.929+0000 7fe2d749b740 1 --2- 172.21.15.159:0/504125628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622161213a0 0x562216121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.929+0000 7fe2d749b740 1 -- 172.21.15.159:0/504125628 >> 172.21.15.159:0/504125628 conn(0x56221611da30 msgr2=0x56221611de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.929+0000 7fe2d749b740 1 -- 172.21.15.159:0/504125628 shutdown_connections 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.929+0000 7fe2d749b740 1 -- 172.21.15.159:0/504125628 wait complete. 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.929+0000 7fe2d749b740 1 -- start start 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.929+0000 7fe2d749b740 1 Processor -- start 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x56221612d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x56221612dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x56221613cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2d749b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562216133600 con 0x56221612e2d0 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2d749b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562216042050 con 0x5622161213a0 2024-09-19T06:52:52.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2ced9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x56221612d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2cf59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x56221613cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2ced9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x56221612d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:59068/0 (socket says 172.21.15.159:59068) 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2ced9d640 1 -- 172.21.15.159:0/2229263119 learned_addr learned my addr 172.21.15.159:0/2229263119 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x56221612dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2d749b740 1 -- 172.21.15.159:0/2229263119 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562216133780 con 0x562216121cc0 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2d749b740 10 client.0 _ll_register_callbacks cb 0x562216082160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2ced9d640 1 -- 172.21.15.159:0/2229263119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 msgr2=0x56221612dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x56221612dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2ced9d640 1 -- 172.21.15.159:0/2229263119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 msgr2=0x56221613cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x56221613cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.930+0000 7fe2ced9d640 1 -- 172.21.15.159:0/2229263119 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562215df83c0 con 0x5622161213a0 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x56221612d850 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00126e0 tx=0x7fe2c0012ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8de96b7f77b17b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:52:52.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/2229263119 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0012190 con 0x5622161213a0 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/2229263119 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe2c0004020 con 0x5622161213a0 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2d749b740 1 -- 172.21.15.159:0/2229263119 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2c409ca30 con 0x5622161213a0 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/2229263119 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe2c0004220 con 0x5622161213a0 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2d749b740 10 client.26075 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2d749b740 1 -- 172.21.15.159:0/2229263119 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562216125b70 con 0x5622161213a0 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/2229263119 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c409ca30 con 0x5622161213a0 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.931+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/2229263119 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe2c0003980 con 0x5622161213a0 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.932+0000 7fe2d749b740 10 client.26075 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.932+0000 7fe2d749b740 10 client.26075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.932+0000 7fe2d749b740 20 client.26075 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.932+0000 7fe2d749b740 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562216127030 0x5622161274e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.932+0000 7fe2d749b740 4 client.26075 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:52.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.932+0000 7fe2d749b740 1 -- 172.21.15.159:0/2229263119 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562216094850 con 0x562216127030 2024-09-19T06:52:52.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.932+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562216127030 0x5622161274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.932+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562216127030 0x5622161274e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d112e27099586cf7 server_cookie=b5c3bb2f336031de in_seq=0 out_seq=0 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.932+0000 7fe2b2ff5640 10 client.26075 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.933+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/2229263119 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562216094850 con 0x562216127030 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.933+0000 7fe2b2ff5640 10 client.26075 handle_command_reply: tid=0 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.933+0000 7fe2d749b740 1 client.26075 shutdown 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 -- 172.21.15.159:0/2229263119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 msgr2=0x56221612d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x56221612d850 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00126e0 tx=0x7fe2c0012ba0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 -- 172.21.15.159:0/2229263119 shutdown_connections 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562216127030 0x5622161274e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x56221613cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x56221612dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2b2ff5640 0 client.26075 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:52.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 --2- 172.21.15.159:0/2229263119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x56221612d850 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 -- 172.21.15.159:0/2229263119 >> 172.21.15.159:0/2229263119 conn(0x56221611da30 msgr2=0x562216123790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:52.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 -- 172.21.15.159:0/2229263119 shutdown_connections 2024-09-19T06:52:52.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 1 -- 172.21.15.159:0/2229263119 wait complete. 2024-09-19T06:52:52.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.934+0000 7fe2d749b740 20 client.26075 trim_cache size 0 max 16384 2024-09-19T06:52:52.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2d749b740 1 Processor -- start 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2d749b740 1 -- start start 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5622161213a0 0x56221612c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562216121cc0 0x562216128d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56221612e2d0 0x56221613ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2d749b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d01a9840 con 0x562216121cc0 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2d749b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d01ac0c0 con 0x56221612e2d0 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2d749b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d01a9eb0 con 0x5622161213a0 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2ce59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562216121cc0 0x562216128d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2ce59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562216121cc0 0x562216128d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36432/0 (socket says 172.21.15.159:36432) 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2ced9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5622161213a0 0x56221612c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2ce59c640 1 -- 172.21.15.159:0/1385331372 learned_addr learned my addr 172.21.15.159:0/1385331372 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:52.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.958+0000 7fe2cf59e640 1 --2- 172.21.15.159:0/1385331372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56221612e2d0 0x56221613ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2ced9d640 1 -- 172.21.15.159:0/1385331372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56221612e2d0 msgr2=0x56221613ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:52.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/1385331372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56221612e2d0 0x56221613ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2ced9d640 1 -- 172.21.15.159:0/1385331372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562216121cc0 msgr2=0x562216128d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:52.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/1385331372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562216121cc0 0x562216128d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2ced9d640 1 -- 172.21.15.159:0/1385331372 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562216130640 con 0x5622161213a0 2024-09-19T06:52:52.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/1385331372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562216121cc0 0x562216128d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:52.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/1385331372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5622161213a0 0x56221612c120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0003f10 tx=0x7fe2c000f810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd942fb0213fea2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2b4ff9640 1 -- 172.21.15.159:0/1385331372 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0028070 con 0x5622161213a0 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2b4ff9640 1 -- 172.21.15.159:0/1385331372 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c0003ad0 con 0x5622161213a0 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.959+0000 7fe2b4ff9640 1 -- 172.21.15.159:0/1385331372 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000fca0 con 0x5622161213a0 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.960+0000 7fe2d749b740 1 -- 172.21.15.159:0/1385331372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5622161213a0 msgr2=0x56221612c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.960+0000 7fe2d749b740 1 --2- 172.21.15.159:0/1385331372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5622161213a0 0x56221612c120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0003f10 tx=0x7fe2c000f810 comp rx=0 tx=0).stop 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.960+0000 7fe2d749b740 1 -- 172.21.15.159:0/1385331372 shutdown_connections 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.960+0000 7fe2d749b740 1 --2- 172.21.15.159:0/1385331372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56221612e2d0 0x56221613ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.960+0000 7fe2d749b740 1 --2- 172.21.15.159:0/1385331372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562216121cc0 0x562216128d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.960+0000 7fe2d749b740 1 --2- 172.21.15.159:0/1385331372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5622161213a0 0x56221612c120 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.960+0000 7fe2d749b740 1 -- 172.21.15.159:0/1385331372 >> 172.21.15.159:0/1385331372 conn(0x56221611da30 msgr2=0x5622161236f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.960+0000 7fe2d749b740 1 -- 172.21.15.159:0/1385331372 shutdown_connections 2024-09-19T06:52:52.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.960+0000 7fe2d749b740 1 -- 172.21.15.159:0/1385331372 wait complete. 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2d749b740 1 -- start start 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2d749b740 1 Processor -- start 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x562216148170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x5622161486b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2d749b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x562216148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2d749b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d01aa580 con 0x56221612e2d0 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2d749b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d01ab9f0 con 0x5622161213a0 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2d749b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d01aac50 con 0x562216121cc0 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2d749b740 10 client.0 _ll_register_callbacks cb 0x7fe2c0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2cf59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x562216148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2cf59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x562216148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36434/0 (socket says 172.21.15.159:36434) 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2ced9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x562216148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2cf59e640 1 -- 172.21.15.159:0/757777406 learned_addr learned my addr 172.21.15.159:0/757777406 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x5622161486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2ced9d640 1 -- 172.21.15.159:0/757777406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 msgr2=0x5622161486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x5622161486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2ced9d640 1 -- 172.21.15.159:0/757777406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 msgr2=0x562216148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x562216148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2ced9d640 1 -- 172.21.15.159:0/757777406 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622161ae3d0 con 0x5622161213a0 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.961+0000 7fe2cf59e640 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x562216148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2ced9d640 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x562216148170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0003f60 tx=0x7fe2c00123a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2228b67eb55ec19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/757777406 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0028030 con 0x5622161213a0 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/757777406 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe2c0018040 con 0x5622161213a0 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2d749b740 1 -- 172.21.15.159:0/757777406 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2c0003ad0 con 0x5622161213a0 2024-09-19T06:52:52.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/757777406 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe2c003d050 con 0x5622161213a0 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2d749b740 10 client.26081 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2d749b740 1 -- 172.21.15.159:0/757777406 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5622161af6e0 con 0x5622161213a0 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/757777406 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c0003ad0 con 0x5622161213a0 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.962+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/757777406 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe2c001c9d0 con 0x5622161213a0 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2d749b740 10 client.26081 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2d749b740 10 client.26081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2d749b740 20 client.26081 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2d749b740 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5622161afc40 0x5622161b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2d749b740 4 client.26081 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2d749b740 1 -- 172.21.15.159:0/757777406 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56221612e120 con 0x5622161afc40 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5622161afc40 0x5622161b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2b2ff5640 10 client.26081 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:52.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2ce59c640 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5622161afc40 0x5622161b2030 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d735cee0be9557e server_cookie=3fd8685631f3314b in_seq=0 out_seq=0 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2b2ff5640 1 -- 172.21.15.159:0/757777406 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56221612e120 con 0x5622161afc40 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2b2ff5640 10 client.26081 handle_command_reply: tid=0 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.963+0000 7fe2d749b740 1 client.26081 shutdown 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 -- 172.21.15.159:0/757777406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 msgr2=0x562216148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x562216148170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0003f60 tx=0x7fe2c00123a0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 -- 172.21.15.159:0/757777406 shutdown_connections 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5622161afc40 0x5622161b2030 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56221612e2d0 0x562216148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562216121cc0 0x5622161486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 --2- 172.21.15.159:0/757777406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622161213a0 0x562216148170 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 -- 172.21.15.159:0/757777406 >> 172.21.15.159:0/757777406 conn(0x56221611da30 msgr2=0x562216122ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2b2ff5640 0 client.26081 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 -- 172.21.15.159:0/757777406 shutdown_connections 2024-09-19T06:52:52.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 1 -- 172.21.15.159:0/757777406 wait complete. 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.964+0000 7fe2d749b740 20 client.26081 trim_cache size 0 max 16384 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stdout: "6240e867-5c9d-4ddb-a08d-22eff47ecbe1": { 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "6240e867-5c9d-4ddb-a08d-22eff47ecbe1", 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:52:52.971 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2322907421 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2b80a33b0 msgr2=0x7fe2b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2b80a33b0 0x7fe2b80a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8004af0 tx=0x7fe2c8009500 comp rx=0 tx=0).stop 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2322907421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2d0101430 msgr2=0x7fe2d0198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2d0101430 0x7fe2d0198960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400e9c0 tx=0x7fe2c400ee80 comp rx=0 tx=0).stop 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2322907421 shutdown_connections 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2b80a33b0 0x7fe2b80a5870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2d0106a90 0x7fe2d019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2d0101430 0x7fe2d0198960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 --2- 172.21.15.159:0/2322907421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2d0100a90 0x7fe2d0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:52.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2322907421 >> 172.21.15.159:0/2322907421 conn(0x7fe2d00fc7d0 msgr2=0x7fe2d0104840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:52.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2322907421 shutdown_connections 2024-09-19T06:52:52.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:52:52.965+0000 7fe2d50c2640 1 -- 172.21.15.159:0/2322907421 wait complete. 2024-09-19T06:52:53.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:52 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:53.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:52 smithi203 ceph-mon[35473]: pgmap v181: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.8 MiB/s wr, 1.50k op/s 2024-09-19T06:52:53.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:52 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:53.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:52 smithi189 ceph-mon[34880]: pgmap v181: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.8 MiB/s wr, 1.50k op/s 2024-09-19T06:52:53.715 INFO:tasks.cephfs.filesystem:scrub status for tag:6240e867-5c9d-4ddb-a08d-22eff47ecbe1 - {'path': '/', 'tag': '6240e867-5c9d-4ddb-a08d-22eff47ecbe1', 'options': 'recursive,force'} 2024-09-19T06:52:53.882 INFO:tasks.workunit.client.0.smithi159.stdout:copying to largest ever: 0x63ef9ee 2024-09-19T06:52:55.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:54 smithi203 ceph-mon[35473]: pgmap v182: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.5 MiB/s wr, 1.05k op/s 2024-09-19T06:52:55.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:54 smithi189 ceph-mon[34880]: pgmap v182: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.5 MiB/s wr, 1.05k op/s 2024-09-19T06:52:55.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:54 smithi159 ceph-mon[30935]: pgmap v182: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.5 MiB/s wr, 1.05k op/s 2024-09-19T06:52:56.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:55 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:52:56.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:55 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:52:56.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:55 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:52:57.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:56 smithi203 ceph-mon[35473]: pgmap v183: 97 pgs: 97 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.8 MiB/s wr, 1.65k op/s 2024-09-19T06:52:57.144 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:56 smithi189 ceph-mon[34880]: pgmap v183: 97 pgs: 97 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.8 MiB/s wr, 1.65k op/s 2024-09-19T06:52:57.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:56 smithi159 ceph-mon[30935]: pgmap v183: 97 pgs: 97 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.8 MiB/s wr, 1.65k op/s 2024-09-19T06:52:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.004+0000 7f04218e6640 1 -- 172.21.15.159:0/2821680060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 msgr2=0x7f041c10ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.004+0000 7f04218e6640 1 --2- 172.21.15.159:0/2821680060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 0x7f041c10ea40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0414009890 tx=0x7f041402a410 comp rx=0 tx=0).stop 2024-09-19T06:52:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.004+0000 7f04218e6640 1 -- 172.21.15.159:0/2821680060 shutdown_connections 2024-09-19T06:52:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.004+0000 7f04218e6640 1 --2- 172.21.15.159:0/2821680060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 0x7f041c10ea40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.004+0000 7f04218e6640 1 --2- 172.21.15.159:0/2821680060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f041c101150 0x7f041c107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.004+0000 7f04218e6640 1 --2- 172.21.15.159:0/2821680060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f041c100830 0x7f041c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.004+0000 7f04218e6640 1 -- 172.21.15.159:0/2821680060 >> 172.21.15.159:0/2821680060 conn(0x7f041c075ec0 msgr2=0x7f041c0762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.004+0000 7f04218e6640 1 -- 172.21.15.159:0/2821680060 shutdown_connections 2024-09-19T06:52:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.004+0000 7f04218e6640 1 -- 172.21.15.159:0/2821680060 wait complete. 2024-09-19T06:52:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.005+0000 7f04218e6640 1 Processor -- start 2024-09-19T06:52:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.005+0000 7f04218e6640 1 -- start start 2024-09-19T06:52:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.006+0000 7f04218e6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f041c100830 0x7f041c1017a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.006+0000 7f04218e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f041c101150 0x7f041c101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.006+0000 7f04218e6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 0x7f041c102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.006+0000 7f04218e6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f041c111f20 con 0x7f041c1080f0 2024-09-19T06:52:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.006+0000 7f04218e6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f041c111da0 con 0x7f041c100830 2024-09-19T06:52:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.006+0000 7f04218e6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f041c1120a0 con 0x7f041c101150 2024-09-19T06:52:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 0x7f041c102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 0x7f041c102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36456/0 (socket says 172.21.15.159:36456) 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041b7fe640 1 -- 172.21.15.159:0/3341360326 learned_addr learned my addr 172.21.15.159:0/3341360326 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041affd640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f041c100830 0x7f041c1017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041a7fc640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f041c101150 0x7f041c101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041b7fe640 1 -- 172.21.15.159:0/3341360326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f041c101150 msgr2=0x7f041c101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041b7fe640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f041c101150 0x7f041c101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041b7fe640 1 -- 172.21.15.159:0/3341360326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f041c100830 msgr2=0x7f041c1017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041b7fe640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f041c100830 0x7f041c1017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041b7fe640 1 -- 172.21.15.159:0/3341360326 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c1aac70 con 0x7f041c1080f0 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.007+0000 7f041a7fc640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f041c101150 0x7f041c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.008+0000 7f041b7fe640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 0x7f041c102220 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0414005940 tx=0x7f04140305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.008+0000 7f04208e4640 1 -- 172.21.15.159:0/3341360326 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414040070 con 0x7f041c1080f0 2024-09-19T06:52:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.008+0000 7f04218e6640 1 -- 172.21.15.159:0/3341360326 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041c1aae40 con 0x7f041c1080f0 2024-09-19T06:52:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.008+0000 7f04208e4640 1 -- 172.21.15.159:0/3341360326 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0414005530 con 0x7f041c1080f0 2024-09-19T06:52:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.008+0000 7f04208e4640 1 -- 172.21.15.159:0/3341360326 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414031a30 con 0x7f041c1080f0 2024-09-19T06:52:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.008+0000 7f04218e6640 1 -- 172.21.15.159:0/3341360326 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041c1ab350 con 0x7f041c1080f0 2024-09-19T06:52:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.011+0000 7f04208e4640 1 -- 172.21.15.159:0/3341360326 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0414043070 con 0x7f041c1080f0 2024-09-19T06:52:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.011+0000 7f042467e740 1 Processor -- start 2024-09-19T06:52:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.011+0000 7f042467e740 1 -- start start 2024-09-19T06:52:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.011+0000 7f04208e4640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f04040a34e0 0x7f04040a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f042467e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac134ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f042467e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 0x558fac13f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f042467e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac1420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f042467e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558fac0992f0 con 0x558fac134af0 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f042467e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558fac041270 con 0x558fac135410 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f042467e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558fac0952b0 con 0x558fac13fcb0 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f04208e4640 1 -- 172.21.15.159:0/3341360326 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f04140f07d0 con 0x7f041c1080f0 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041a7fc640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f04040a34e0 0x7f04040a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac134ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac134ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36458/0 (socket says 172.21.15.159:36458) 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041affd640 1 -- 172.21.15.159:0/1710147054 learned_addr learned my addr 172.21.15.159:0/1710147054 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041a7fc640 1 --2- 172.21.15.159:0/1710147054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 0x558fac13f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041b7fe640 1 --2- 172.21.15.159:0/1710147054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac1420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041affd640 1 -- 172.21.15.159:0/1710147054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 msgr2=0x558fac1420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041affd640 1 --2- 172.21.15.159:0/1710147054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac1420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041affd640 1 -- 172.21.15.159:0/1710147054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 msgr2=0x558fac13f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041affd640 1 --2- 172.21.15.159:0/1710147054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 0x558fac13f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041affd640 1 -- 172.21.15.159:0/1710147054 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fac040340 con 0x558fac134af0 2024-09-19T06:52:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041a7fc640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f04040a34e0 0x7f04040a59a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0410005ab0 tx=0x7f04100128d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f041affd640 1 --2- 172.21.15.159:0/1710147054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac134ed0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f040c0114f0 tx=0x7f040c0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f69d7b13dfc26d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.012+0000 7f0401ffb640 1 -- 172.21.15.159:0/1710147054 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c01e070 con 0x558fac134af0 2024-09-19T06:52:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.013+0000 7f0401ffb640 1 -- 172.21.15.159:0/1710147054 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f040c00fa80 con 0x558fac134af0 2024-09-19T06:52:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.013+0000 7f0401ffb640 1 -- 172.21.15.159:0/1710147054 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c019b20 con 0x558fac134af0 2024-09-19T06:52:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.013+0000 7f042467e740 1 -- 172.21.15.159:0/1710147054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 msgr2=0x558fac134ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.013+0000 7f042467e740 1 --2- 172.21.15.159:0/1710147054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac134ed0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f040c0114f0 tx=0x7f040c0119b0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.014+0000 7f042467e740 1 -- 172.21.15.159:0/1710147054 shutdown_connections 2024-09-19T06:52:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.014+0000 7f042467e740 1 --2- 172.21.15.159:0/1710147054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac1420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.014+0000 7f042467e740 1 --2- 172.21.15.159:0/1710147054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 0x558fac13f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.014+0000 7f042467e740 1 --2- 172.21.15.159:0/1710147054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac134ed0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.014+0000 7f042467e740 1 -- 172.21.15.159:0/1710147054 >> 172.21.15.159:0/1710147054 conn(0x558fac131060 msgr2=0x558fac131440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.014+0000 7f042467e740 1 -- 172.21.15.159:0/1710147054 shutdown_connections 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.014+0000 7f042467e740 1 -- 172.21.15.159:0/1710147054 wait complete. 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.014+0000 7f042467e740 1 -- start start 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.014+0000 7f042467e740 1 Processor -- start 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f042467e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac13cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f042467e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 0x558fac13d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f042467e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac13d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f042467e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558fac142880 con 0x558fac134af0 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f042467e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558fac022290 con 0x558fac135410 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f042467e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558fac142a00 con 0x558fac13fcb0 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac13cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac13cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36464/0 (socket says 172.21.15.159:36464) 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041affd640 1 -- 172.21.15.159:0/2491257939 learned_addr learned my addr 172.21.15.159:0/2491257939 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041a7fc640 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 0x558fac13d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041b7fe640 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac13d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f042467e740 10 client.0 _ll_register_callbacks cb 0x558fac053140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041affd640 1 -- 172.21.15.159:0/2491257939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 msgr2=0x558fac13d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041affd640 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac13d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041affd640 1 -- 172.21.15.159:0/2491257939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 msgr2=0x558fac13d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041affd640 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 0x558fac13d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041affd640 1 -- 172.21.15.159:0/2491257939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fabdac210 con 0x558fac134af0 2024-09-19T06:52:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041a7fc640 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 0x558fac13d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041b7fe640 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac13d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f041affd640 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac13cbd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f040c0049d0 tx=0x7f040c00f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd9ae82593b049c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.015+0000 7f03faffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f03faffd640 1 -- 172.21.15.159:0/2491257939 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c01e040 con 0x558fac134af0 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f03faffd640 1 -- 172.21.15.159:0/2491257939 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f040c004a40 con 0x558fac134af0 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f042467e740 1 -- 172.21.15.159:0/2491257939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f040c00fa80 con 0x558fac134af0 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f03faffd640 1 -- 172.21.15.159:0/2491257939 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f040c031050 con 0x558fac134af0 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f042467e740 10 client.16824 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f042467e740 1 -- 172.21.15.159:0/2491257939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558fabe78620 con 0x558fac134af0 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f03faffd640 1 -- 172.21.15.159:0/2491257939 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f040c00fa80 con 0x558fac134af0 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f03faffd640 1 -- 172.21.15.159:0/2491257939 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f040c02c030 con 0x558fac134af0 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f042467e740 10 client.16824 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f042467e740 10 client.16824 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f042467e740 20 client.16824 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f042467e740 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558fac14fc20 0x558fac152010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f042467e740 4 client.16824 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f042467e740 1 -- 172.21.15.159:0/2491257939 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fac0a6a20 con 0x558fac14fc20 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.016+0000 7f041a7fc640 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558fac14fc20 0x558fac152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.017+0000 7f041a7fc640 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558fac14fc20 0x558fac152010 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d13c24f4424f334a server_cookie=9b55a804bbbf8b53 in_seq=0 out_seq=0 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.017+0000 7f03faffd640 10 client.16824 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f03faffd640 1 -- 172.21.15.159:0/2491257939 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558fac0a6a20 con 0x558fac14fc20 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f03faffd640 10 client.16824 handle_command_reply: tid=0 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 client.16824 shutdown 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 -- 172.21.15.159:0/2491257939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 msgr2=0x558fac13cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac13cbd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f040c0049d0 tx=0x7f040c00f850 comp rx=0 tx=0).stop 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 -- 172.21.15.159:0/2491257939 shutdown_connections 2024-09-19T06:52:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558fac14fc20 0x558fac152010 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac13d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac135410 0x558fac13d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f03faffd640 0 client.16824 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 --2- 172.21.15.159:0/2491257939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac134af0 0x558fac13cbd0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 -- 172.21.15.159:0/2491257939 >> 172.21.15.159:0/2491257939 conn(0x558fac131060 msgr2=0x558fac136dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 -- 172.21.15.159:0/2491257939 shutdown_connections 2024-09-19T06:52:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 1 -- 172.21.15.159:0/2491257939 wait complete. 2024-09-19T06:52:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.018+0000 7f042467e740 20 client.16824 trim_cache size 0 max 16384 2024-09-19T06:52:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.035+0000 7f042467e740 1 Processor -- start 2024-09-19T06:52:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.035+0000 7f042467e740 1 -- start start 2024-09-19T06:52:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f042467e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac134af0 0x558fac13eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f042467e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac13d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f042467e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac13fcb0 0x558fac13d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f042467e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f041c1b1e40 con 0x558fac135410 2024-09-19T06:52:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f042467e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f041c1b46c0 con 0x558fac13fcb0 2024-09-19T06:52:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f042467e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f041c1b24b0 con 0x558fac134af0 2024-09-19T06:52:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac13d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac13d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36480/0 (socket says 172.21.15.159:36480) 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041a7fc640 1 -- 172.21.15.159:0/815597498 learned_addr learned my addr 172.21.15.159:0/815597498 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041affd640 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac134af0 0x558fac13eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041b7fe640 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac13fcb0 0x558fac13d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041a7fc640 1 -- 172.21.15.159:0/815597498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac134af0 msgr2=0x558fac13eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041a7fc640 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac134af0 0x558fac13eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041a7fc640 1 -- 172.21.15.159:0/815597498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac13fcb0 msgr2=0x558fac13d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041a7fc640 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac13fcb0 0x558fac13d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041a7fc640 1 -- 172.21.15.159:0/815597498 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fac13b100 con 0x558fac135410 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041b7fe640 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac13fcb0 0x558fac13d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f041a7fc640 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac13d100 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f041c077240 tx=0x7f0410009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2933c3d3e62cc4d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f04017fa640 1 -- 172.21.15.159:0/815597498 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410010890 con 0x558fac135410 2024-09-19T06:52:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f04017fa640 1 -- 172.21.15.159:0/815597498 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f041002d030 con 0x558fac135410 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.036+0000 7f04017fa640 1 -- 172.21.15.159:0/815597498 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041001f400 con 0x558fac135410 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 -- 172.21.15.159:0/815597498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 msgr2=0x558fac13d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac13d100 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f041c077240 tx=0x7f0410009260 comp rx=0 tx=0).stop 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 -- 172.21.15.159:0/815597498 shutdown_connections 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac13fcb0 0x558fac13d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac13d100 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 --2- 172.21.15.159:0/815597498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac134af0 0x558fac13eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 -- 172.21.15.159:0/815597498 >> 172.21.15.159:0/815597498 conn(0x558fac131060 msgr2=0x558fac13e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 -- 172.21.15.159:0/815597498 shutdown_connections 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 -- 172.21.15.159:0/815597498 wait complete. 2024-09-19T06:52:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.037+0000 7f042467e740 1 -- start start 2024-09-19T06:52:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f042467e740 1 Processor -- start 2024-09-19T06:52:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f042467e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac134af0 0x558fac142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f042467e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac143230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f042467e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac1b8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f042467e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f041c1b2b80 con 0x558fac135410 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f042467e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f041c1b3ff0 con 0x558fac134af0 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f042467e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f041c1b3250 con 0x558fac13fcb0 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f042467e740 10 client.0 _ll_register_callbacks cb 0x7f040c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac143230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36486/0 (socket says 172.21.15.159:36486) 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041affd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac134af0 0x558fac142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041a7fc640 1 -- 172.21.15.159:0/1555038083 learned_addr learned my addr 172.21.15.159:0/1555038083 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041b7fe640 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac1b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041affd640 1 -- 172.21.15.159:0/1555038083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 msgr2=0x558fac1b8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041affd640 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac1b8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041affd640 1 -- 172.21.15.159:0/1555038083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 msgr2=0x558fac143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041affd640 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041affd640 1 -- 172.21.15.159:0/1555038083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fac143ac0 con 0x558fac134af0 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.038+0000 7f041a7fc640 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f041affd640 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac134af0 0x558fac142cf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f040c005c40 tx=0x7f040c009ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a1b3f827d628cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f03faffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f03faffd640 1 -- 172.21.15.159:0/1555038083 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c01e070 con 0x558fac134af0 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f042467e740 1 -- 172.21.15.159:0/1555038083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f041002d030 con 0x558fac134af0 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f03faffd640 1 -- 172.21.15.159:0/1555038083 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f040c0058a0 con 0x558fac134af0 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f03faffd640 1 -- 172.21.15.159:0/1555038083 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f040c005440 con 0x558fac134af0 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f042467e740 10 client.26096 fetch_fsmap learned FSMap version 24 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f042467e740 1 -- 172.21.15.159:0/1555038083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558fac1b9cd0 con 0x558fac134af0 2024-09-19T06:52:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f03faffd640 1 -- 172.21.15.159:0/1555038083 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f041002d030 con 0x558fac134af0 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f03faffd640 1 -- 172.21.15.159:0/1555038083 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f040c02c040 con 0x558fac134af0 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f042467e740 10 client.26096 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f042467e740 10 client.26096 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f042467e740 20 client.26096 populate_metadata read hostname 'smithi159' 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f042467e740 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558fac14fc20 0x558fac1bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f042467e740 4 client.26096 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.039+0000 7f042467e740 1 -- 172.21.15.159:0/1555038083 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558fac0a0d70 con 0x558fac14fc20 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.040+0000 7f041a7fc640 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558fac14fc20 0x558fac1bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.040+0000 7f03faffd640 10 client.26096 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.040+0000 7f041a7fc640 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558fac14fc20 0x558fac1bc3a0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7137e814d5ed9173 server_cookie=1affbe91ac72298d in_seq=0 out_seq=0 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f03faffd640 1 -- 172.21.15.159:0/1555038083 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558fac0a0d70 con 0x558fac14fc20 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f03faffd640 10 client.26096 handle_command_reply: tid=0 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 client.26096 shutdown 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 -- 172.21.15.159:0/1555038083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac134af0 msgr2=0x558fac142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac134af0 0x558fac142cf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f040c005c40 tx=0x7f040c009ea0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 -- 172.21.15.159:0/1555038083 shutdown_connections 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558fac14fc20 0x558fac1bc3a0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558fac13fcb0 0x558fac1b8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558fac135410 0x558fac143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f03faffd640 0 client.26096 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:52:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 --2- 172.21.15.159:0/1555038083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558fac134af0 0x558fac142cf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 -- 172.21.15.159:0/1555038083 >> 172.21.15.159:0/1555038083 conn(0x558fac131060 msgr2=0x558fac1301c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 -- 172.21.15.159:0/1555038083 shutdown_connections 2024-09-19T06:52:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 1 -- 172.21.15.159:0/1555038083 wait complete. 2024-09-19T06:52:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.054+0000 7f042467e740 20 client.26096 trim_cache size 0 max 16384 2024-09-19T06:52:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:52:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:52:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:52:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:52:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 -- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f04040a34e0 msgr2=0x7f04040a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f04040a34e0 0x7f04040a59a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0410005ab0 tx=0x7f04100128d0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 -- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 msgr2=0x7f041c102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 0x7f041c102220 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0414005940 tx=0x7f04140305d0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 -- 172.21.15.159:0/3341360326 shutdown_connections 2024-09-19T06:52:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f04040a34e0 0x7f04040a59a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f041c1080f0 0x7f041c102220 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f041c101150 0x7f041c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 --2- 172.21.15.159:0/3341360326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f041c100830 0x7f041c1017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 -- 172.21.15.159:0/3341360326 >> 172.21.15.159:0/3341360326 conn(0x7f041c075ec0 msgr2=0x7f041c0ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 -- 172.21.15.159:0/3341360326 shutdown_connections 2024-09-19T06:52:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:52:58.055+0000 7f04218e6640 1 -- 172.21.15.159:0/3341360326 wait complete. 2024-09-19T06:52:58.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:52:58 smithi159 ceph-mon[30935]: pgmap v184: 97 pgs: 97 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 1.24k op/s 2024-09-19T06:52:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:52:58 smithi203 ceph-mon[35473]: pgmap v184: 97 pgs: 97 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 1.24k op/s 2024-09-19T06:52:59.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:52:58 smithi189 ceph-mon[34880]: pgmap v184: 97 pgs: 97 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 1.24k op/s 2024-09-19T06:53:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:00 smithi203 ceph-mon[35473]: pgmap v185: 97 pgs: 97 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 1.24k op/s 2024-09-19T06:53:01.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:00 smithi189 ceph-mon[34880]: pgmap v185: 97 pgs: 97 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 1.24k op/s 2024-09-19T06:53:01.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:00 smithi159 ceph-mon[30935]: pgmap v185: 97 pgs: 97 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 1.24k op/s 2024-09-19T06:53:02.948 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:02 smithi159 ceph-mon[30935]: pgmap v186: 97 pgs: 97 active+clean; 92 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 1.69k op/s 2024-09-19T06:53:03.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:02 smithi203 ceph-mon[35473]: pgmap v186: 97 pgs: 97 active+clean; 92 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 1.69k op/s 2024-09-19T06:53:03.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:02 smithi189 ceph-mon[34880]: pgmap v186: 97 pgs: 97 active+clean; 92 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 1.69k op/s 2024-09-19T06:53:05.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:04 smithi203 ceph-mon[35473]: pgmap v187: 97 pgs: 97 active+clean; 92 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 1.06k op/s 2024-09-19T06:53:05.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:04 smithi189 ceph-mon[34880]: pgmap v187: 97 pgs: 97 active+clean; 92 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 1.06k op/s 2024-09-19T06:53:05.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:04 smithi159 ceph-mon[30935]: pgmap v187: 97 pgs: 97 active+clean; 92 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 1.06k op/s 2024-09-19T06:53:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:06 smithi203 ceph-mon[35473]: pgmap v188: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.8 MiB/s wr, 1.49k op/s 2024-09-19T06:53:07.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:06 smithi189 ceph-mon[34880]: pgmap v188: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.8 MiB/s wr, 1.49k op/s 2024-09-19T06:53:07.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:06 smithi159 ceph-mon[30935]: pgmap v188: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.8 MiB/s wr, 1.49k op/s 2024-09-19T06:53:09.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:08 smithi203 ceph-mon[35473]: pgmap v189: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.5 MiB/s wr, 891 op/s 2024-09-19T06:53:09.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:08 smithi189 ceph-mon[34880]: pgmap v189: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.5 MiB/s wr, 891 op/s 2024-09-19T06:53:09.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:08 smithi159 ceph-mon[30935]: pgmap v189: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.5 MiB/s wr, 891 op/s 2024-09-19T06:53:11.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:10 smithi203 ceph-mon[35473]: pgmap v190: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.5 MiB/s wr, 891 op/s 2024-09-19T06:53:11.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:10 smithi189 ceph-mon[34880]: pgmap v190: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.5 MiB/s wr, 891 op/s 2024-09-19T06:53:11.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:10 smithi159 ceph-mon[30935]: pgmap v190: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.5 MiB/s wr, 891 op/s 2024-09-19T06:53:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.164+0000 7f73a1e47640 1 -- 172.21.15.159:0/4136256420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c100960 msgr2=0x7f739c10ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.164+0000 7f73a1e47640 1 --2- 172.21.15.159:0/4136256420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c100960 0x7f739c10ea30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7394009ca0 tx=0x7f739402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.164+0000 7f73a1e47640 1 -- 172.21.15.159:0/4136256420 shutdown_connections 2024-09-19T06:53:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.164+0000 7f73a1e47640 1 --2- 172.21.15.159:0/4136256420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c100960 0x7f739c10ea30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.164+0000 7f73a1e47640 1 --2- 172.21.15.159:0/4136256420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f739c0fffe0 0x7f739c100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.164+0000 7f73a1e47640 1 --2- 172.21.15.159:0/4136256420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f739c103a90 0x7f739c103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.164+0000 7f73a1e47640 1 -- 172.21.15.159:0/4136256420 >> 172.21.15.159:0/4136256420 conn(0x7f739c0770f0 msgr2=0x7f739c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.164+0000 7f73a1e47640 1 -- 172.21.15.159:0/4136256420 shutdown_connections 2024-09-19T06:53:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.164+0000 7f73a1e47640 1 -- 172.21.15.159:0/4136256420 wait complete. 2024-09-19T06:53:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f73a1e47640 1 Processor -- start 2024-09-19T06:53:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f73a1e47640 1 -- start start 2024-09-19T06:53:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f73a1e47640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c0fffe0 0x7f739c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f73a1e47640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f739c100960 0x7f739c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f73a1e47640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f739c103a90 0x7f739c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f73a1e47640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f739c112040 con 0x7f739c103a90 2024-09-19T06:53:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f73a1e47640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f739c111ec0 con 0x7f739c100960 2024-09-19T06:53:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f73a1e47640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f739c1121c0 con 0x7f739c0fffe0 2024-09-19T06:53:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f739bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f739c103a90 0x7f739c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f739b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c0fffe0 0x7f739c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f739affd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f739c100960 0x7f739c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f739affd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f739c100960 0x7f739c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:55156/0 (socket says 172.21.15.159:55156) 2024-09-19T06:53:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f739b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c0fffe0 0x7f739c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:53178/0 (socket says 172.21.15.159:53178) 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f739bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f739c103a90 0x7f739c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45916/0 (socket says 172.21.15.159:45916) 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.165+0000 7f739affd640 1 -- 172.21.15.159:0/1821304113 learned_addr learned my addr 172.21.15.159:0/1821304113 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f739bfff640 1 -- 172.21.15.159:0/1821304113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c0fffe0 msgr2=0x7f739c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f739bfff640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c0fffe0 0x7f739c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f739bfff640 1 -- 172.21.15.159:0/1821304113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f739c100960 msgr2=0x7f739c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f739bfff640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f739c100960 0x7f739c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f739bfff640 1 -- 172.21.15.159:0/1821304113 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739c19d460 con 0x7f739c103a90 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f739b7fe640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c0fffe0 0x7f739c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f739affd640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f739c100960 0x7f739c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f739bfff640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f739c103a90 0x7f739c19cd30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7394005e30 tx=0x7f7394030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f7398ff9640 1 -- 172.21.15.159:0/1821304113 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739402f380 con 0x7f739c103a90 2024-09-19T06:53:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f7398ff9640 1 -- 172.21.15.159:0/1821304113 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7394003e50 con 0x7f739c103a90 2024-09-19T06:53:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f7398ff9640 1 -- 172.21.15.159:0/1821304113 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394004440 con 0x7f739c103a90 2024-09-19T06:53:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f73a1e47640 1 -- 172.21.15.159:0/1821304113 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739c19d6f0 con 0x7f739c103a90 2024-09-19T06:53:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.166+0000 7f73a1e47640 1 -- 172.21.15.159:0/1821304113 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f739c19db30 con 0x7f739c103a90 2024-09-19T06:53:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.169+0000 7f7398ff9640 1 -- 172.21.15.159:0/1821304113 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f73940316e0 con 0x7f739c103a90 2024-09-19T06:53:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.169+0000 7f73a4bde740 1 Processor -- start 2024-09-19T06:53:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f73a4bde740 1 -- start start 2024-09-19T06:53:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a8aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a95770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 0x565176a980a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f73a4bde740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5651769ef2f0 con 0x565176a8aaf0 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f73a4bde740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x565176997270 con 0x565176a95cb0 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f73a4bde740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5651769eb2b0 con 0x565176a8b410 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a8aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a8aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45928/0 (socket says 172.21.15.159:45928) 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739affd640 1 -- 172.21.15.159:0/1510877385 learned_addr learned my addr 172.21.15.159:0/1510877385 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739affd640 1 --2- 172.21.15.159:0/1510877385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 0x565176a980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f7398ff9640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73840a34e0 0x7f73840a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739b7fe640 1 --2- 172.21.15.159:0/1510877385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a95770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739bfff640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73840a34e0 0x7f73840a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739affd640 1 -- 172.21.15.159:0/1510877385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 msgr2=0x565176a95770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739affd640 1 --2- 172.21.15.159:0/1510877385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a95770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739affd640 1 -- 172.21.15.159:0/1510877385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 msgr2=0x565176a8aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739affd640 1 --2- 172.21.15.159:0/1510877385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a8aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f739affd640 1 -- 172.21.15.159:0/1510877385 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565176996340 con 0x565176a95cb0 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.170+0000 7f7398ff9640 1 -- 172.21.15.159:0/1821304113 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f73940f0de0 con 0x7f739c103a90 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.171+0000 7f739affd640 1 --2- 172.21.15.159:0/1510877385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 0x565176a980a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7390013cd0 tx=0x7f7390004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=784a940def53b9ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.171+0000 7f739bfff640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73840a34e0 0x7f73840a59a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73940eeb00 tx=0x7f739408ef20 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.171+0000 7f7381ffb640 1 -- 172.21.15.159:0/1510877385 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739000ec40 con 0x565176a95cb0 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.171+0000 7f7381ffb640 1 -- 172.21.15.159:0/1510877385 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f739000ede0 con 0x565176a95cb0 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.171+0000 7f7381ffb640 1 -- 172.21.15.159:0/1510877385 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739001f690 con 0x565176a95cb0 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 -- 172.21.15.159:0/1510877385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 msgr2=0x565176a980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 --2- 172.21.15.159:0/1510877385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 0x565176a980a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7390013cd0 tx=0x7f7390004730 comp rx=0 tx=0).stop 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 -- 172.21.15.159:0/1510877385 shutdown_connections 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 --2- 172.21.15.159:0/1510877385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 0x565176a980a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 --2- 172.21.15.159:0/1510877385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a95770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 --2- 172.21.15.159:0/1510877385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a8aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 -- 172.21.15.159:0/1510877385 >> 172.21.15.159:0/1510877385 conn(0x565176a87060 msgr2=0x565176a87440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 -- 172.21.15.159:0/1510877385 shutdown_connections 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 -- 172.21.15.159:0/1510877385 wait complete. 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 -- start start 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.172+0000 7f73a4bde740 1 Processor -- start 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a92b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a930b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 0x565176a935f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f73a4bde740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x565176a98880 con 0x565176a8aaf0 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f73a4bde740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x565176978290 con 0x565176a95cb0 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f73a4bde740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x565176a98a00 con 0x565176a8b410 2024-09-19T06:53:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f73a4bde740 10 client.0 _ll_register_callbacks cb 0x5651769a9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a92b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a92b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45938/0 (socket says 172.21.15.159:45938) 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739affd640 1 -- 172.21.15.159:0/2149367019 learned_addr learned my addr 172.21.15.159:0/2149367019 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739b7fe640 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a930b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739affd640 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 0x565176a935f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739b7fe640 1 -- 172.21.15.159:0/2149367019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 msgr2=0x565176a935f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739b7fe640 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 0x565176a935f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739b7fe640 1 -- 172.21.15.159:0/2149367019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 msgr2=0x565176a92b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739b7fe640 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a92b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739b7fe640 1 -- 172.21.15.159:0/2149367019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565176702210 con 0x565176a8b410 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739affd640 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a92b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f739b7fe640 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a930b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f738c0116c0 tx=0x7f738c011b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16f98a5fd5f178f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f737affd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f737affd640 1 -- 172.21.15.159:0/2149367019 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c010c60 con 0x565176a8b410 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f737affd640 1 -- 172.21.15.159:0/2149367019 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f738c010e00 con 0x565176a8b410 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.173+0000 7f73a4bde740 1 -- 172.21.15.159:0/2149367019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f739000ede0 con 0x565176a8b410 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f737affd640 1 -- 172.21.15.159:0/2149367019 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f738c004020 con 0x565176a8b410 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f73a4bde740 10 client.26158 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f73a4bde740 1 -- 172.21.15.159:0/2149367019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5651767ce620 con 0x565176a8b410 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f737affd640 1 -- 172.21.15.159:0/2149367019 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f739000ede0 con 0x565176a8b410 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f737affd640 1 -- 172.21.15.159:0/2149367019 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f738c020020 con 0x565176a8b410 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f73a4bde740 10 client.26158 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f73a4bde740 10 client.26158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f73a4bde740 20 client.26158 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f73a4bde740 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x565176aa5c00 0x565176aa8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f73a4bde740 4 client.26158 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f73a4bde740 1 -- 172.21.15.159:0/2149367019 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651769fca20 con 0x565176aa5c00 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.174+0000 7f739affd640 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x565176aa5c00 0x565176aa8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.175+0000 7f737affd640 10 client.26158 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.175+0000 7f739affd640 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x565176aa5c00 0x565176aa8030 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1513ed4bca30d33e server_cookie=75f30530f3e95465 in_seq=0 out_seq=0 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.175+0000 7f737affd640 1 -- 172.21.15.159:0/2149367019 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651769fca20 con 0x565176aa5c00 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.175+0000 7f737affd640 10 client.26158 handle_command_reply: tid=0 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.175+0000 7f73a4bde740 1 client.26158 shutdown 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 -- 172.21.15.159:0/2149367019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 msgr2=0x565176a930b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a930b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f738c0116c0 tx=0x7f738c011b80 comp rx=0 tx=0).stop 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 -- 172.21.15.159:0/2149367019 shutdown_connections 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x565176aa5c00 0x565176aa8030 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a95cb0 0x565176a935f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a930b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 --2- 172.21.15.159:0/2149367019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a8aaf0 0x565176a92b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 -- 172.21.15.159:0/2149367019 >> 172.21.15.159:0/2149367019 conn(0x565176a87060 msgr2=0x565176a8cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f737affd640 0 client.26158 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 -- 172.21.15.159:0/2149367019 shutdown_connections 2024-09-19T06:53:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 1 -- 172.21.15.159:0/2149367019 wait complete. 2024-09-19T06:53:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.176+0000 7f73a4bde740 20 client.26158 trim_cache size 0 max 16384 2024-09-19T06:53:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f73a4bde740 1 Processor -- start 2024-09-19T06:53:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f73a4bde740 1 -- start start 2024-09-19T06:53:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8aaf0 0x565176a8d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a93420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176aad940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f73a4bde740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f739c1ab870 con 0x565176a95cb0 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f73a4bde740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f739c1ae0f0 con 0x565176a8aaf0 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f73a4bde740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f739c1abee0 con 0x565176a8b410 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f739b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a93420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f739affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176aad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f739affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176aad940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45942/0 (socket says 172.21.15.159:45942) 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f739b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a93420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:53200/0 (socket says 172.21.15.159:53200) 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.193+0000 7f739affd640 1 -- 172.21.15.159:0/942139968 learned_addr learned my addr 172.21.15.159:0/942139968 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f739affd640 1 --2- 172.21.15.159:0/942139968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8aaf0 0x565176a8d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f739affd640 1 -- 172.21.15.159:0/942139968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 msgr2=0x565176a93420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f739affd640 1 --2- 172.21.15.159:0/942139968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a93420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f739affd640 1 -- 172.21.15.159:0/942139968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8aaf0 msgr2=0x565176a8d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f739affd640 1 --2- 172.21.15.159:0/942139968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8aaf0 0x565176a8d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f739affd640 1 -- 172.21.15.159:0/942139968 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565176a86e90 con 0x565176a95cb0 2024-09-19T06:53:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f739b7fe640 1 --2- 172.21.15.159:0/942139968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a93420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f739affd640 1 --2- 172.21.15.159:0/942139968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176aad940 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7390011f30 tx=0x7f7390013510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dabd214c03369d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f73817fa640 1 -- 172.21.15.159:0/942139968 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390017030 con 0x565176a95cb0 2024-09-19T06:53:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f73817fa640 1 -- 172.21.15.159:0/942139968 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7390034020 con 0x565176a95cb0 2024-09-19T06:53:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.194+0000 7f73817fa640 1 -- 172.21.15.159:0/942139968 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73900047a0 con 0x565176a95cb0 2024-09-19T06:53:11.205 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 -- 172.21.15.159:0/942139968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 msgr2=0x565176aad940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:11.205 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 --2- 172.21.15.159:0/942139968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176aad940 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7390011f30 tx=0x7f7390013510 comp rx=0 tx=0).stop 2024-09-19T06:53:11.205 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 -- 172.21.15.159:0/942139968 shutdown_connections 2024-09-19T06:53:11.205 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 --2- 172.21.15.159:0/942139968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176aad940 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.205 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 --2- 172.21.15.159:0/942139968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8b410 0x565176a93420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 --2- 172.21.15.159:0/942139968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8aaf0 0x565176a8d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 -- 172.21.15.159:0/942139968 >> 172.21.15.159:0/942139968 conn(0x565176a87060 msgr2=0x565176a8de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 -- 172.21.15.159:0/942139968 shutdown_connections 2024-09-19T06:53:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 -- 172.21.15.159:0/942139968 wait complete. 2024-09-19T06:53:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.195+0000 7f73a4bde740 1 -- start start 2024-09-19T06:53:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f73a4bde740 1 Processor -- start 2024-09-19T06:53:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8aaf0 0x565176a90650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8b410 0x565176a9dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f73a4bde740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176a9e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f73a4bde740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f739c1ac5b0 con 0x565176a95cb0 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f73a4bde740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f739c1ada20 con 0x565176a8b410 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f73a4bde740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f739c1acc80 con 0x565176a8aaf0 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f73a4bde740 10 client.0 _ll_register_callbacks cb 0x7f738c00bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f739affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8aaf0 0x565176a90650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f739affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8aaf0 0x565176a90650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:53206/0 (socket says 172.21.15.159:53206) 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f739b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8b410 0x565176a9dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f739affd640 1 -- 172.21.15.159:0/634434722 learned_addr learned my addr 172.21.15.159:0/634434722 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.196+0000 7f739affd640 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176a9e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f739b7fe640 1 -- 172.21.15.159:0/634434722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8aaf0 msgr2=0x565176a90650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f739b7fe640 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8aaf0 0x565176a90650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f739b7fe640 1 -- 172.21.15.159:0/634434722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 msgr2=0x565176a9e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f739b7fe640 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176a9e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f739b7fe640 1 -- 172.21.15.159:0/634434722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565176a8edc0 con 0x565176a8b410 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f739affd640 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8aaf0 0x565176a90650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f739b7fe640 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8b410 0x565176a9dcc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f738c0049e0 tx=0x7f738c010c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3ee0a86d234e5c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f737affd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f737affd640 1 -- 172.21.15.159:0/634434722 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c030060 con 0x565176a8b410 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f737affd640 1 -- 172.21.15.159:0/634434722 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f738c0043d0 con 0x565176a8b410 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f73a4bde740 1 -- 172.21.15.159:0/634434722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7390034020 con 0x565176a8b410 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f737affd640 1 -- 172.21.15.159:0/634434722 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f738c010e50 con 0x565176a8b410 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f73a4bde740 10 client.26114 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f73a4bde740 1 -- 172.21.15.159:0/634434722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x565176b0fa30 con 0x565176a8b410 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.197+0000 7f737affd640 1 -- 172.21.15.159:0/634434722 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7390034020 con 0x565176a8b410 2024-09-19T06:53:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f737affd640 1 -- 172.21.15.159:0/634434722 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f738c034710 con 0x565176a8b410 2024-09-19T06:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f73a4bde740 10 client.26114 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f73a4bde740 10 client.26114 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f73a4bde740 20 client.26114 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f73a4bde740 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x565176b101e0 0x565176b12600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f73a4bde740 4 client.26114 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f73a4bde740 1 -- 172.21.15.159:0/634434722 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5651769f6d70 con 0x565176b101e0 2024-09-19T06:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f739affd640 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x565176b101e0 0x565176b12600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f739affd640 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x565176b101e0 0x565176b12600 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ad88cea52b6818a server_cookie=9d2df8bbf594c8d in_seq=0 out_seq=0 2024-09-19T06:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.198+0000 7f737affd640 10 client.26114 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f737affd640 1 -- 172.21.15.159:0/634434722 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5651769f6d70 con 0x565176b101e0 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f737affd640 10 client.26114 handle_command_reply: tid=0 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 client.26114 shutdown 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 -- 172.21.15.159:0/634434722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8b410 msgr2=0x565176a9dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8b410 0x565176a9dcc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f738c0049e0 tx=0x7f738c010c60 comp rx=0 tx=0).stop 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 -- 172.21.15.159:0/634434722 shutdown_connections 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x565176b101e0 0x565176b12600 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565176a95cb0 0x565176a9e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x565176a8b410 0x565176a9dcc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f737affd640 0 client.26114 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 --2- 172.21.15.159:0/634434722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565176a8aaf0 0x565176a90650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 -- 172.21.15.159:0/634434722 >> 172.21.15.159:0/634434722 conn(0x565176a87060 msgr2=0x565176a943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 -- 172.21.15.159:0/634434722 shutdown_connections 2024-09-19T06:53:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 1 -- 172.21.15.159:0/634434722 wait complete. 2024-09-19T06:53:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.268+0000 7f73a4bde740 20 client.26114 trim_cache size 0 max 16384 2024-09-19T06:53:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:53:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:53:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:53:11.272 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:53:11.272 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 -- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73840a34e0 msgr2=0x7f73840a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:11.272 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73840a34e0 0x7f73840a59a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73940eeb00 tx=0x7f739408ef20 comp rx=0 tx=0).stop 2024-09-19T06:53:11.272 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 -- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f739c103a90 msgr2=0x7f739c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f739c103a90 0x7f739c19cd30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7394005e30 tx=0x7f7394030c30 comp rx=0 tx=0).stop 2024-09-19T06:53:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 -- 172.21.15.159:0/1821304113 shutdown_connections 2024-09-19T06:53:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f73840a34e0 0x7f73840a59a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f739c103a90 0x7f739c19cd30 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f739c100960 0x7f739c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 --2- 172.21.15.159:0/1821304113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f739c0fffe0 0x7f739c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 -- 172.21.15.159:0/1821304113 >> 172.21.15.159:0/1821304113 conn(0x7f739c0770f0 msgr2=0x7f739c105970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 -- 172.21.15.159:0/1821304113 shutdown_connections 2024-09-19T06:53:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:11.269+0000 7f73a1e47640 1 -- 172.21.15.159:0/1821304113 wait complete. 2024-09-19T06:53:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:12 smithi203 ceph-mon[35473]: pgmap v191: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 1.26k op/s 2024-09-19T06:53:13.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:12 smithi189 ceph-mon[34880]: pgmap v191: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 1.26k op/s 2024-09-19T06:53:13.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:12 smithi159 ceph-mon[30935]: pgmap v191: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 1.26k op/s 2024-09-19T06:53:14.040 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:13 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:53:14.041 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:13 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:53:14.041 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:13 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:53:14.041 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:13 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:53:14.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:13 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:53:14.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:13 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:53:14.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:13 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:53:14.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:13 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:53:14.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:13 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:53:14.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:13 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:53:14.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:13 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:53:14.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:13 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:53:14.992 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:14 smithi203 ceph-mon[35473]: pgmap v192: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.3 MiB/s wr, 802 op/s 2024-09-19T06:53:15.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:14 smithi189 ceph-mon[34880]: pgmap v192: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.3 MiB/s wr, 802 op/s 2024-09-19T06:53:15.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:14 smithi159 ceph-mon[30935]: pgmap v192: 97 pgs: 97 active+clean; 100 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.3 MiB/s wr, 802 op/s 2024-09-19T06:53:15.511 INFO:tasks.workunit.client.0.smithi159.stdout:All 50000 operations completed A-OK! 2024-09-19T06:53:15.513 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T06:53:15.513 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T06:53:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:16 smithi203 ceph-mon[35473]: pgmap v193: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.4 MiB/s wr, 1.14k op/s 2024-09-19T06:53:17.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:16 smithi189 ceph-mon[34880]: pgmap v193: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.4 MiB/s wr, 1.14k op/s 2024-09-19T06:53:17.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:16 smithi159 ceph-mon[30935]: pgmap v193: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.4 MiB/s wr, 1.14k op/s 2024-09-19T06:53:19.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:18 smithi203 ceph-mon[35473]: pgmap v194: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 700 op/s 2024-09-19T06:53:19.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:18 smithi189 ceph-mon[34880]: pgmap v194: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 700 op/s 2024-09-19T06:53:19.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:18 smithi159 ceph-mon[30935]: pgmap v194: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 700 op/s 2024-09-19T06:53:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:20 smithi203 ceph-mon[35473]: pgmap v195: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 700 op/s 2024-09-19T06:53:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:20 smithi189 ceph-mon[34880]: pgmap v195: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 700 op/s 2024-09-19T06:53:21.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:20 smithi159 ceph-mon[30935]: pgmap v195: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 700 op/s 2024-09-19T06:53:23.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:22 smithi203 ceph-mon[35473]: pgmap v196: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.2 MiB/s wr, 861 op/s 2024-09-19T06:53:23.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:22 smithi189 ceph-mon[34880]: pgmap v196: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.2 MiB/s wr, 861 op/s 2024-09-19T06:53:23.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:22 smithi159 ceph-mon[30935]: pgmap v196: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.2 MiB/s wr, 861 op/s 2024-09-19T06:53:23.716 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:53:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:24.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 -- 172.21.15.159:0/3701377921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c10c0c0 msgr2=0x7fef7c10e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 --2- 172.21.15.159:0/3701377921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c10c0c0 0x7fef7c10e580 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fef74009ca0 tx=0x7fef7402a950 comp rx=0 tx=0).stop 2024-09-19T06:53:24.367 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 -- 172.21.15.159:0/3701377921 shutdown_connections 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 --2- 172.21.15.159:0/3701377921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c10c0c0 0x7fef7c10e580 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 --2- 172.21.15.159:0/3701377921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c1035c0 0x7fef7c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 --2- 172.21.15.159:0/3701377921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c102ca0 0x7fef7c103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 -- 172.21.15.159:0/3701377921 >> 172.21.15.159:0/3701377921 conn(0x7fef7c0fc6f0 msgr2=0x7fef7c0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 -- 172.21.15.159:0/3701377921 shutdown_connections 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 -- 172.21.15.159:0/3701377921 wait complete. 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 Processor -- start 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.364+0000 7fef81f13640 1 -- start start 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef81f13640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c102ca0 0x7fef7c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef81f13640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c1035c0 0x7fef7c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef81f13640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c10c0c0 0x7fef7c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef81f13640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c111ea0 con 0x7fef7c1035c0 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef81f13640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c111d20 con 0x7fef7c10c0c0 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef81f13640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c112020 con 0x7fef7c102ca0 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef73fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c1035c0 0x7fef7c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef73fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c1035c0 0x7fef7c1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52178/0 (socket says 172.21.15.159:52178) 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef73fff640 1 -- 172.21.15.159:0/2686778437 learned_addr learned my addr 172.21.15.159:0/2686778437 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef7b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c102ca0 0x7fef7c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef7bfff640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c10c0c0 0x7fef7c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef73fff640 1 -- 172.21.15.159:0/2686778437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c102ca0 msgr2=0x7fef7c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef73fff640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c102ca0 0x7fef7c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef73fff640 1 -- 172.21.15.159:0/2686778437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c10c0c0 msgr2=0x7fef7c19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef73fff640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c10c0c0 0x7fef7c19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef73fff640 1 -- 172.21.15.159:0/2686778437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c19d2a0 con 0x7fef7c1035c0 2024-09-19T06:53:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef7bfff640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c10c0c0 0x7fef7c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c102ca0 0x7fef7c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef73fff640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c1035c0 0x7fef7c1987f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d950 tx=0x7fef6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef797fa640 1 -- 172.21.15.159:0/2686778437 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64017070 con 0x7fef7c1035c0 2024-09-19T06:53:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef797fa640 1 -- 172.21.15.159:0/2686778437 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef64009c30 con 0x7fef7c1035c0 2024-09-19T06:53:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.365+0000 7fef81f13640 1 -- 172.21.15.159:0/2686778437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c19d590 con 0x7fef7c1035c0 2024-09-19T06:53:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.366+0000 7fef797fa640 1 -- 172.21.15.159:0/2686778437 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6400f6b0 con 0x7fef7c1035c0 2024-09-19T06:53:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.366+0000 7fef81f13640 1 -- 172.21.15.159:0/2686778437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c1a4e20 con 0x7fef7c1035c0 2024-09-19T06:53:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef797fa640 1 -- 172.21.15.159:0/2686778437 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fef640109d0 con 0x7fef7c1035c0 2024-09-19T06:53:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef84ca3740 1 Processor -- start 2024-09-19T06:53:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef84ca3740 1 -- start start 2024-09-19T06:53:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 0x558af5df0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dfb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5dfe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef84ca3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558af5d552f0 con 0x558af5dfbcb0 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef84ca3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558af5cfd270 con 0x558af5df0af0 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef84ca3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558af5d512b0 con 0x558af5df1410 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef73fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5dfe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef7b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dfb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef7b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dfb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:43594/0 (socket says 172.21.15.159:43594) 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef73fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5dfe0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52182/0 (socket says 172.21.15.159:52182) 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef7b7fe640 1 -- 172.21.15.159:0/665358467 learned_addr learned my addr 172.21.15.159:0/665358467 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.368+0000 7fef7bfff640 1 --2- 172.21.15.159:0/665358467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 0x558af5df0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef797fa640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fef680a34e0 0x7fef680a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef7b7fe640 1 -- 172.21.15.159:0/665358467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 msgr2=0x558af5df0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/665358467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 0x558af5df0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef7b7fe640 1 -- 172.21.15.159:0/665358467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 msgr2=0x558af5dfe0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/665358467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5dfe0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef7b7fe640 1 -- 172.21.15.159:0/665358467 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af5cfc340 con 0x558af5df1410 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef7bfff640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fef680a34e0 0x7fef680a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef797fa640 1 -- 172.21.15.159:0/2686778437 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fef640cf8d0 con 0x7fef7c1035c0 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/665358467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dfb770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0115f0 tx=0x7fef6c011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1f98a3aa3e0a828 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef71ffb640 1 -- 172.21.15.159:0/665358467 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c01e070 con 0x558af5df1410 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef71ffb640 1 -- 172.21.15.159:0/665358467 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef6c00fb20 con 0x558af5df1410 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef71ffb640 1 -- 172.21.15.159:0/665358467 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c019bf0 con 0x558af5df1410 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.369+0000 7fef7bfff640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fef680a34e0 0x7fef680a59a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef74005e30 tx=0x7fef7403e040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 -- 172.21.15.159:0/665358467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 msgr2=0x558af5dfb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 --2- 172.21.15.159:0/665358467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dfb770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0115f0 tx=0x7fef6c011ab0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 -- 172.21.15.159:0/665358467 shutdown_connections 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 --2- 172.21.15.159:0/665358467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5dfe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 --2- 172.21.15.159:0/665358467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dfb770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 --2- 172.21.15.159:0/665358467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 0x558af5df0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 -- 172.21.15.159:0/665358467 >> 172.21.15.159:0/665358467 conn(0x558af5ded060 msgr2=0x558af5ded440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 -- 172.21.15.159:0/665358467 shutdown_connections 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 -- 172.21.15.159:0/665358467 wait complete. 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 -- start start 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.370+0000 7fef84ca3740 1 Processor -- start 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5df0af0 0x558af5df8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 0x558af5df9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5dfbcb0 0x558af5df96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef84ca3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558af5dfe880 con 0x558af5df0af0 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef84ca3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558af5cde290 con 0x558af5df1410 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef84ca3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558af5dfea00 con 0x558af5dfbcb0 2024-09-19T06:53:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef84ca3740 10 client.0 _ll_register_callbacks cb 0x558af5d0f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5df0af0 0x558af5df8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5df0af0 0x558af5df8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52196/0 (socket says 172.21.15.159:52196) 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7b7fe640 1 -- 172.21.15.159:0/2741639045 learned_addr learned my addr 172.21.15.159:0/2741639045 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7bfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5dfbcb0 0x558af5df96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef73fff640 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 0x558af5df9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7b7fe640 1 -- 172.21.15.159:0/2741639045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5dfbcb0 msgr2=0x558af5df96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5dfbcb0 0x558af5df96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7b7fe640 1 -- 172.21.15.159:0/2741639045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 msgr2=0x558af5df9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 0x558af5df9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7b7fe640 1 -- 172.21.15.159:0/2741639045 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af5a68210 con 0x558af5df0af0 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef73fff640 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 0x558af5df9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5df0af0 0x558af5df8c30 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fef6c005e00 tx=0x7fef6c00f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51c57f0fb351957 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.380 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef5affd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef5affd640 1 -- 172.21.15.159:0/2741639045 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c01e040 con 0x558af5df0af0 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef5affd640 1 -- 172.21.15.159:0/2741639045 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fef6c004040 con 0x558af5df0af0 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.371+0000 7fef84ca3740 1 -- 172.21.15.159:0/2741639045 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef6c00fb20 con 0x558af5df0af0 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef5affd640 1 -- 172.21.15.159:0/2741639045 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef6c02f050 con 0x558af5df0af0 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef84ca3740 10 client.16860 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef84ca3740 1 -- 172.21.15.159:0/2741639045 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558af5b34620 con 0x558af5df0af0 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef5affd640 1 -- 172.21.15.159:0/2741639045 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef6c00fb20 con 0x558af5df0af0 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef5affd640 1 -- 172.21.15.159:0/2741639045 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fef6c02a030 con 0x558af5df0af0 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef84ca3740 10 client.16860 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef84ca3740 10 client.16860 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef84ca3740 20 client.16860 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef84ca3740 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558af5e0bcf0 0x558af5e0e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.381 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef84ca3740 4 client.16860 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef84ca3740 1 -- 172.21.15.159:0/2741639045 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558af5d62a20 con 0x558af5e0bcf0 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.372+0000 7fef73fff640 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558af5e0bcf0 0x558af5e0e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.373+0000 7fef5affd640 10 client.16860 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.373+0000 7fef73fff640 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558af5e0bcf0 0x558af5e0e0e0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8374ec40d4b39e87 server_cookie=d671ce0db95a2681 in_seq=0 out_seq=0 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.373+0000 7fef5affd640 1 -- 172.21.15.159:0/2741639045 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558af5d62a20 con 0x558af5e0bcf0 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.373+0000 7fef5affd640 10 client.16860 handle_command_reply: tid=0 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.373+0000 7fef84ca3740 1 client.16860 shutdown 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 -- 172.21.15.159:0/2741639045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5df0af0 msgr2=0x558af5df8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5df0af0 0x558af5df8c30 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fef6c005e00 tx=0x7fef6c00f8d0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 -- 172.21.15.159:0/2741639045 shutdown_connections 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558af5e0bcf0 0x558af5e0e0e0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5dfbcb0 0x558af5df96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 0x558af5df9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.382 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef5affd640 0 client.16860 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 --2- 172.21.15.159:0/2741639045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5df0af0 0x558af5df8c30 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 -- 172.21.15.159:0/2741639045 >> 172.21.15.159:0/2741639045 conn(0x558af5ded060 msgr2=0x558af5df2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 -- 172.21.15.159:0/2741639045 shutdown_connections 2024-09-19T06:53:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 1 -- 172.21.15.159:0/2741639045 wait complete. 2024-09-19T06:53:24.383 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.374+0000 7fef84ca3740 20 client.16860 trim_cache size 0 max 16384 2024-09-19T06:53:24.393 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef84ca3740 1 Processor -- start 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef84ca3740 1 -- start start 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df0af0 0x558af5dfaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 0x558af5df94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e137d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef84ca3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1ab850 con 0x558af5dfbcb0 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef84ca3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1ae0d0 con 0x558af5df1410 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef84ca3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1abec0 con 0x558af5df0af0 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef7bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef7b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df0af0 0x558af5dfaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef7bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52206/0 (socket says 172.21.15.159:52206) 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef7bfff640 1 -- 172.21.15.159:0/775743443 learned_addr learned my addr 172.21.15.159:0/775743443 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.388+0000 7fef73fff640 1 --2- 172.21.15.159:0/775743443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 0x558af5df94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef7b7fe640 1 -- 172.21.15.159:0/775743443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 msgr2=0x558af5df94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/775743443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 0x558af5df94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef7b7fe640 1 -- 172.21.15.159:0/775743443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 msgr2=0x558af5e137d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/775743443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e137d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef7b7fe640 1 -- 172.21.15.159:0/775743443 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af5df2000 con 0x558af5df0af0 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef7bfff640 1 --2- 172.21.15.159:0/775743443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e137d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/775743443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df0af0 0x558af5dfaba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0197a0 tx=0x7fef6c005050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a14ab43bd9ec111 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef717fa640 1 -- 172.21.15.159:0/775743443 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c015020 con 0x558af5df0af0 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef717fa640 1 -- 172.21.15.159:0/775743443 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef6c00f940 con 0x558af5df0af0 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef717fa640 1 -- 172.21.15.159:0/775743443 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c019bc0 con 0x558af5df0af0 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef84ca3740 1 -- 172.21.15.159:0/775743443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df0af0 msgr2=0x558af5dfaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef84ca3740 1 --2- 172.21.15.159:0/775743443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df0af0 0x558af5dfaba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0197a0 tx=0x7fef6c005050 comp rx=0 tx=0).stop 2024-09-19T06:53:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef84ca3740 1 -- 172.21.15.159:0/775743443 shutdown_connections 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef84ca3740 1 --2- 172.21.15.159:0/775743443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e137d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef84ca3740 1 --2- 172.21.15.159:0/775743443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df1410 0x558af5df94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.389+0000 7fef84ca3740 1 --2- 172.21.15.159:0/775743443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df0af0 0x558af5dfaba0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 -- 172.21.15.159:0/775743443 >> 172.21.15.159:0/775743443 conn(0x558af5ded060 msgr2=0x558af5dfa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 -- 172.21.15.159:0/775743443 shutdown_connections 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 -- 172.21.15.159:0/775743443 wait complete. 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 -- start start 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 Processor -- start 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 0x558af5dff230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e74790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1ac590 con 0x558af5dfbcb0 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1ada00 con 0x558af5df0af0 2024-09-19T06:53:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1acc60 con 0x558af5df1410 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef84ca3740 10 client.0 _ll_register_callbacks cb 0x7fef6c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef7bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e74790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef7bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e74790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52218/0 (socket says 172.21.15.159:52218) 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef7bfff640 1 -- 172.21.15.159:0/930062437 learned_addr learned my addr 172.21.15.159:0/930062437 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.390+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 0x558af5dff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef73fff640 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef7bfff640 1 -- 172.21.15.159:0/930062437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 msgr2=0x558af5dff770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef7bfff640 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dff770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef7bfff640 1 -- 172.21.15.159:0/930062437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 msgr2=0x558af5dff230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef7bfff640 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 0x558af5dff230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef7bfff640 1 -- 172.21.15.159:0/930062437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af5e74cd0 con 0x558af5dfbcb0 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef7bfff640 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e74790 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fef74009a60 tx=0x7fef74005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8fd487af55cac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.397 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef5affd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef5affd640 1 -- 172.21.15.159:0/930062437 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74034040 con 0x558af5dfbcb0 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef5affd640 1 -- 172.21.15.159:0/930062437 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fef74003c40 con 0x558af5dfbcb0 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef84ca3740 1 -- 172.21.15.159:0/930062437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef6c00f940 con 0x558af5dfbcb0 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef5affd640 1 -- 172.21.15.159:0/930062437 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef74003e40 con 0x558af5dfbcb0 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef84ca3740 10 client.16866 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef84ca3740 1 -- 172.21.15.159:0/930062437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558af5e75fe0 con 0x558af5dfbcb0 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef5affd640 1 -- 172.21.15.159:0/930062437 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef6c00f940 con 0x558af5dfbcb0 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.391+0000 7fef5affd640 1 -- 172.21.15.159:0/930062437 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fef74058020 con 0x558af5dfbcb0 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.392+0000 7fef84ca3740 10 client.16866 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.392+0000 7fef84ca3740 10 client.16866 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.392+0000 7fef84ca3740 20 client.16866 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.392+0000 7fef84ca3740 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558af5e76730 0x558af5e78b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.392+0000 7fef84ca3740 4 client.16866 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:53:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.392+0000 7fef84ca3740 1 -- 172.21.15.159:0/930062437 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558af5d5cd70 con 0x558af5e76730 2024-09-19T06:53:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.392+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558af5e76730 0x558af5e78b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.392+0000 7fef5affd640 10 client.16866 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.392+0000 7fef7b7fe640 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558af5e76730 0x558af5e78b50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e3c14e8dc4c502 server_cookie=effcfb1ad3a32f1c in_seq=0 out_seq=0 2024-09-19T06:53:24.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.703+0000 7f0bc540b640 1 -- 172.21.15.159:0/1596698375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc0109450 msgr2=0x7f0bc0109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.703+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1596698375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc0109450 0x7f0bc0109830 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009980 tx=0x7f0bb002c670 comp rx=0 tx=0).stop 2024-09-19T06:53:24.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.704+0000 7f0bc540b640 1 -- 172.21.15.159:0/1596698375 shutdown_connections 2024-09-19T06:53:24.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.704+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1596698375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bc0074990 0x7f0bc007b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.704+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1596698375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bc0109e00 0x7f0bc00742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.704+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1596698375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc0109450 0x7f0bc0109830 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.704+0000 7f0bc540b640 1 -- 172.21.15.159:0/1596698375 >> 172.21.15.159:0/1596698375 conn(0x7f0bc006e140 msgr2=0x7f0bc006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.706+0000 7f0bc540b640 1 -- 172.21.15.159:0/1596698375 shutdown_connections 2024-09-19T06:53:24.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.706+0000 7f0bc540b640 1 -- 172.21.15.159:0/1596698375 wait complete. 2024-09-19T06:53:24.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.707+0000 7f0bc540b640 1 Processor -- start 2024-09-19T06:53:24.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.707+0000 7f0bc540b640 1 -- start start 2024-09-19T06:53:24.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.708+0000 7f0bc540b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bc0074990 0x7f0bc007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.708+0000 7f0bc540b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bc0109450 0x7f0bc0076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.708+0000 7f0bc540b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc0109e00 0x7f0bc00767d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.708+0000 7f0bc540b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc007e820 con 0x7f0bc0109e00 2024-09-19T06:53:24.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.708+0000 7f0bc540b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc007e6a0 con 0x7f0bc0074990 2024-09-19T06:53:24.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.708+0000 7f0bc540b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc007e9a0 con 0x7f0bc0109450 2024-09-19T06:53:24.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.708+0000 7f0bbe7fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bc0109450 0x7f0bc0076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.708+0000 7f0bbe7fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bc0109450 0x7f0bc0076290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:43648/0 (socket says 172.21.15.159:43648) 2024-09-19T06:53:24.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.708+0000 7f0bbe7fc640 1 -- 172.21.15.159:0/1768119976 learned_addr learned my addr 172.21.15.159:0/1768119976 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.712+0000 7f0bbe7fc640 1 -- 172.21.15.159:0/1768119976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bc0074990 msgr2=0x7f0bc007b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.712+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bc0074990 0x7f0bc007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.712+0000 7f0bbe7fc640 1 -- 172.21.15.159:0/1768119976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc0109e00 msgr2=0x7f0bc00767d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.712+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc0109e00 0x7f0bc00767d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.712+0000 7f0bbe7fc640 1 -- 172.21.15.159:0/1768119976 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc0077040 con 0x7f0bc0109450 2024-09-19T06:53:24.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.714+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bc0109450 0x7f0bc0076290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800ae40 tx=0x7f0bb800af30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.718+0000 7f0ba7fff640 1 -- 172.21.15.159:0/1768119976 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb800d930 con 0x7f0bc0109450 2024-09-19T06:53:24.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.718+0000 7f0ba7fff640 1 -- 172.21.15.159:0/1768119976 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bb8018070 con 0x7f0bc0109450 2024-09-19T06:53:24.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.718+0000 7f0ba7fff640 1 -- 172.21.15.159:0/1768119976 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8013400 con 0x7f0bc0109450 2024-09-19T06:53:24.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.718+0000 7f0bc540b640 1 -- 172.21.15.159:0/1768119976 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc01cd010 con 0x7f0bc0109450 2024-09-19T06:53:24.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.718+0000 7f0bc540b640 1 -- 172.21.15.159:0/1768119976 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc01cd550 con 0x7f0bc0109450 2024-09-19T06:53:24.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.722+0000 7f0bc77e4740 1 Processor -- start 2024-09-19T06:53:24.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.725+0000 7f0ba7fff640 1 -- 172.21.15.159:0/1768119976 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0bb8012070 con 0x7f0bc0109450 2024-09-19T06:53:24.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.725+0000 7f0bc77e4740 1 -- start start 2024-09-19T06:53:24.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.726+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c935214a0 0x556c93521880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.726+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c9352c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.726+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c9352c680 0x556c9352ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.726+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x556c934872e0 con 0x556c9352c680 2024-09-19T06:53:24.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.726+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556c9342ece0 con 0x556c93521dc0 2024-09-19T06:53:24.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.726+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556c934832a0 con 0x556c935214a0 2024-09-19T06:53:24.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.726+0000 7f0bbe7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c9352c680 0x556c9352ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbeffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c9352c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbe7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c9352c680 0x556c9352ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52240/0 (socket says 172.21.15.159:52240) 2024-09-19T06:53:24.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbe7fc640 1 -- 172.21.15.159:0/860223600 learned_addr learned my addr 172.21.15.159:0/860223600 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbe7fc640 1 -- 172.21.15.159:0/860223600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c935214a0 msgr2=0x556c93521880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbf7fe640 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c935214a0 0x556c93521880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c935214a0 0x556c93521880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbe7fc640 1 -- 172.21.15.159:0/860223600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 msgr2=0x556c9352c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c9352c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbe7fc640 1 -- 172.21.15.159:0/860223600 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c93413440 con 0x556c9352c680 2024-09-19T06:53:24.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c9352c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.727+0000 7f0bbf7fe640 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c935214a0 0x556c93521880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.728+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c9352c680 0x556c9352ea70 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80cc740 tx=0x7f0bb80d7640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4355aa0eccc9df5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.728+0000 7f0ba57fa640 1 -- 172.21.15.159:0/860223600 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80e2070 con 0x556c9352c680 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.728+0000 7f0ba57fa640 1 -- 172.21.15.159:0/860223600 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bb80cfa10 con 0x556c9352c680 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.728+0000 7f0ba7fff640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0ba80a3560 0x7f0ba80a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.728+0000 7f0ba57fa640 1 -- 172.21.15.159:0/860223600 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80dd9f0 con 0x556c9352c680 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.728+0000 7f0ba7fff640 1 -- 172.21.15.159:0/1768119976 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f0bb80cf140 con 0x7f0bc0109450 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.729+0000 7f0bbf7fe640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0ba80a3560 0x7f0ba80a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.729+0000 7f0bc77e4740 1 -- 172.21.15.159:0/860223600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c9352c680 msgr2=0x556c9352ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.729+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c9352c680 0x556c9352ea70 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80cc740 tx=0x7f0bb80d7640 comp rx=0 tx=0).stop 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.730+0000 7f0bc77e4740 1 -- 172.21.15.159:0/860223600 shutdown_connections 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.730+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c9352c680 0x556c9352ea70 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.730+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c9352c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.730+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/860223600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c935214a0 0x556c93521880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.730+0000 7f0bbf7fe640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0ba80a3560 0x7f0ba80a5a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0bc006e6b0 tx=0x7f0bb4008040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.730+0000 7f0bc77e4740 1 -- 172.21.15.159:0/860223600 >> 172.21.15.159:0/860223600 conn(0x556c9351da30 msgr2=0x556c9351de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.730+0000 7f0bc77e4740 1 -- 172.21.15.159:0/860223600 shutdown_connections 2024-09-19T06:53:24.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.730+0000 7f0bc77e4740 1 -- 172.21.15.159:0/860223600 wait complete. 2024-09-19T06:53:24.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.730+0000 7f0bc77e4740 1 -- start start 2024-09-19T06:53:24.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bc77e4740 1 Processor -- start 2024-09-19T06:53:24.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c9352c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c935292f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c935298e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x556c9352f250 con 0x556c935214a0 2024-09-19T06:53:24.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556c93442050 con 0x556c93521dc0 2024-09-19T06:53:24.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556c9352f3d0 con 0x556c9352c680 2024-09-19T06:53:24.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bbe7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c935292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bbe7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c935292f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:48978/0 (socket says 172.21.15.159:48978) 2024-09-19T06:53:24.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bbe7fc640 1 -- 172.21.15.159:0/3156821509 learned_addr learned my addr 172.21.15.159:0/3156821509 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bc77e4740 10 client.0 _ll_register_callbacks cb 0x556c93482160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:24.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.731+0000 7f0bbf7fe640 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c935298e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.732+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c9352c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.732+0000 7f0bbeffd640 1 -- 172.21.15.159:0/3156821509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 msgr2=0x556c935298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.732+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c935298e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.732+0000 7f0bbeffd640 1 -- 172.21.15.159:0/3156821509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 msgr2=0x556c935292f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.732+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c935292f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.732+0000 7f0bbeffd640 1 -- 172.21.15.159:0/3156821509 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c931f83c0 con 0x556c935214a0 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.732+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c9352c040 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005ab0 tx=0x7f0bb00042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780035eacba89a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.732+0000 7f0ba2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.732+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/3156821509 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00323a0 con 0x556c935214a0 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/3156821509 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f0bb0032540 con 0x556c935214a0 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0bc77e4740 1 -- 172.21.15.159:0/3156821509 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bb80cfa10 con 0x556c935214a0 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/3156821509 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0bb0032740 con 0x556c935214a0 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0bc77e4740 10 client.16875 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0bc77e4740 1 -- 172.21.15.159:0/3156821509 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556c9353abc0 con 0x556c935214a0 2024-09-19T06:53:24.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/3156821509 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bb80cfa10 con 0x556c935214a0 2024-09-19T06:53:24.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/3156821509 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f0bb0004bf0 con 0x556c935214a0 2024-09-19T06:53:24.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0bc77e4740 10 client.16875 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:24.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0bc77e4740 10 client.16875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:24.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0bc77e4740 20 client.16875 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:24.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556c9353c020 0x556c9353e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0bc77e4740 4 client.16875 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:24.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.733+0000 7f0bc77e4740 1 -- 172.21.15.159:0/3156821509 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c93494850 con 0x556c9353c020 2024-09-19T06:53:24.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.740+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556c9353c020 0x556c9353e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.741+0000 7f0ba2ff5640 10 client.16875 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:24.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.741+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556c9353c020 0x556c9353e470 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26e042317eb321fc server_cookie=35f2dfb560af459a in_seq=0 out_seq=0 2024-09-19T06:53:24.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.747+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/3156821509 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c93494850 con 0x556c9353c020 2024-09-19T06:53:24.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.747+0000 7f0ba2ff5640 10 client.16875 handle_command_reply: tid=0 2024-09-19T06:53:24.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.747+0000 7f0bc77e4740 1 client.16875 shutdown 2024-09-19T06:53:24.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.747+0000 7f0bc77e4740 1 -- 172.21.15.159:0/3156821509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 msgr2=0x556c9352c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.747+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c9352c040 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005ab0 tx=0x7f0bb00042e0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0bc77e4740 1 -- 172.21.15.159:0/3156821509 shutdown_connections 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556c9353c020 0x556c9353e470 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0ba2ff5640 0 client.16875 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c935298e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c935292f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/3156821509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c9352c040 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0bc77e4740 1 -- 172.21.15.159:0/3156821509 >> 172.21.15.159:0/3156821509 conn(0x556c9351da30 msgr2=0x556c93523710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0bc77e4740 1 -- 172.21.15.159:0/3156821509 shutdown_connections 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0bc77e4740 1 -- 172.21.15.159:0/3156821509 wait complete. 2024-09-19T06:53:24.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.748+0000 7f0bc77e4740 20 client.16875 trim_cache size 0 max 16384 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.765+0000 7f0bc77e4740 1 Processor -- start 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.765+0000 7f0bc77e4740 1 -- start start 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935384b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c93528bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c935247f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc01d41e0 con 0x556c935214a0 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc01d6a60 con 0x556c93521dc0 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc01d4850 con 0x556c9352c680 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935384b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52244/0 (socket says 172.21.15.159:52244) 2024-09-19T06:53:24.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbeffd640 1 -- 172.21.15.159:0/2476778839 learned_addr learned my addr 172.21.15.159:0/2476778839 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbf7fe640 1 --2- 172.21.15.159:0/2476778839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c935247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/2476778839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c93528bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbeffd640 1 -- 172.21.15.159:0/2476778839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 msgr2=0x556c935247f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/2476778839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c935247f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbeffd640 1 -- 172.21.15.159:0/2476778839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 msgr2=0x556c93528bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/2476778839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c93528bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbeffd640 1 -- 172.21.15.159:0/2476778839 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9351e6c0 con 0x556c935214a0 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/2476778839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935384b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00059d0 tx=0x7f0bb0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a05391ed1bdccb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0ba4ff9640 1 -- 172.21.15.159:0/2476778839 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00328e0 con 0x556c935214a0 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0ba4ff9640 1 -- 172.21.15.159:0/2476778839 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bb0005510 con 0x556c935214a0 2024-09-19T06:53:24.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.766+0000 7f0ba4ff9640 1 -- 172.21.15.159:0/2476778839 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00046c0 con 0x556c935214a0 2024-09-19T06:53:24.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.767+0000 7f0bc77e4740 1 -- 172.21.15.159:0/2476778839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 msgr2=0x556c935384b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.767+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/2476778839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935384b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00059d0 tx=0x7f0bb0005fd0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.767+0000 7f0bc77e4740 1 -- 172.21.15.159:0/2476778839 shutdown_connections 2024-09-19T06:53:24.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.767+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/2476778839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c935247f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.767+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/2476778839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c93528bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.767+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/2476778839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935384b0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.767+0000 7f0bc77e4740 1 -- 172.21.15.159:0/2476778839 >> 172.21.15.159:0/2476778839 conn(0x556c9351da30 msgr2=0x556c935240e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.767+0000 7f0bc77e4740 1 -- 172.21.15.159:0/2476778839 shutdown_connections 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.767+0000 7f0bc77e4740 1 -- 172.21.15.159:0/2476778839 wait complete. 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bc77e4740 1 -- start start 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bc77e4740 1 Processor -- start 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935261f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c93526730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bc77e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c93526c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc01d4f20 con 0x556c935214a0 2024-09-19T06:53:24.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc01d6390 con 0x556c93521dc0 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bc77e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc01d55f0 con 0x556c9352c680 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bc77e4740 10 client.0 _ll_register_callbacks cb 0x7f0bb0005df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935261f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935261f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52250/0 (socket says 172.21.15.159:52250) 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbeffd640 1 -- 172.21.15.159:0/723222647 learned_addr learned my addr 172.21.15.159:0/723222647 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c93526730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbf7fe640 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c93526c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbeffd640 1 -- 172.21.15.159:0/723222647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 msgr2=0x556c93526c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c93526c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbeffd640 1 -- 172.21.15.159:0/723222647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 msgr2=0x556c93526730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c93526730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.768+0000 7f0bbeffd640 1 -- 172.21.15.159:0/723222647 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c935a5d00 con 0x556c935214a0 2024-09-19T06:53:24.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bbeffd640 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935261f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005ab0 tx=0x7f0bb0032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6b5faaa900946c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0ba2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/723222647 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb004e630 con 0x556c935214a0 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/723222647 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f0bb004e7d0 con 0x556c935214a0 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bc77e4740 1 -- 172.21.15.159:0/723222647 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bb0005510 con 0x556c935214a0 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/723222647 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0bb00044d0 con 0x556c935214a0 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bc77e4740 10 client.16881 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bc77e4740 1 -- 172.21.15.159:0/723222647 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556c935a6ef0 con 0x556c935214a0 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/723222647 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bb0005510 con 0x556c935214a0 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/723222647 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f0bb0063600 con 0x556c935214a0 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bc77e4740 10 client.16881 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bc77e4740 10 client.16881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bc77e4740 20 client.16881 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:24.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556c9353c020 0x556c935a9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bc77e4740 4 client.16881 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.769+0000 7f0bc77e4740 1 -- 172.21.15.159:0/723222647 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c9348ed60 con 0x556c9353c020 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.770+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556c9353c020 0x556c935a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.770+0000 7f0ba2ff5640 10 client.16881 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.770+0000 7f0bbe7fc640 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556c9353c020 0x556c935a9460 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd66314c8ac87d52 server_cookie=2d67518ffe9af57f in_seq=0 out_seq=0 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0ba2ff5640 1 -- 172.21.15.159:0/723222647 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556c9348ed60 con 0x556c9353c020 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0ba2ff5640 10 client.16881 handle_command_reply: tid=0 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 client.16881 shutdown 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 -- 172.21.15.159:0/723222647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 msgr2=0x556c935261f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935261f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005ab0 tx=0x7f0bb0032fc0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 -- 172.21.15.159:0/723222647 shutdown_connections 2024-09-19T06:53:24.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556c9353c020 0x556c935a9460 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9352c680 0x556c93526c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c93521dc0 0x556c93526730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0ba2ff5640 0 client.16881 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:24.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 --2- 172.21.15.159:0/723222647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556c935214a0 0x556c935261f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 -- 172.21.15.159:0/723222647 >> 172.21.15.159:0/723222647 conn(0x556c9351da30 msgr2=0x556c93524900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 -- 172.21.15.159:0/723222647 shutdown_connections 2024-09-19T06:53:24.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 1 -- 172.21.15.159:0/723222647 wait complete. 2024-09-19T06:53:24.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.771+0000 7f0bc77e4740 20 client.16881 trim_cache size 0 max 16384 2024-09-19T06:53:24.780 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:53:24.780 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:53:24.780 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:53:24.780 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 -- 172.21.15.159:0/1768119976 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0ba80a3560 msgr2=0x7f0ba80a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0ba80a3560 0x7f0ba80a5a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0bc006e6b0 tx=0x7f0bb4008040 comp rx=0 tx=0).stop 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 -- 172.21.15.159:0/1768119976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bc0109450 msgr2=0x7f0bc0076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bc0109450 0x7f0bc0076290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800ae40 tx=0x7f0bb800af30 comp rx=0 tx=0).stop 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 -- 172.21.15.159:0/1768119976 shutdown_connections 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f0ba80a3560 0x7f0ba80a5a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc0109e00 0x7f0bc00767d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bc0109450 0x7f0bc0076290 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 --2- 172.21.15.159:0/1768119976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bc0074990 0x7f0bc007b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 -- 172.21.15.159:0/1768119976 >> 172.21.15.159:0/1768119976 conn(0x7f0bc006e140 msgr2=0x7f0bc0072530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 -- 172.21.15.159:0/1768119976 shutdown_connections 2024-09-19T06:53:24.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:24.772+0000 7f0bc540b640 1 -- 172.21.15.159:0/1768119976 wait complete. 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.810+0000 7fef5affd640 1 -- 172.21.15.159:0/930062437 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558af5d5cd70 con 0x558af5e76730 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.810+0000 7fef5affd640 10 client.16866 handle_command_reply: tid=0 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.810+0000 7fef84ca3740 1 client.16866 shutdown 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.810+0000 7fef84ca3740 1 -- 172.21.15.159:0/930062437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 msgr2=0x558af5e74790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.810+0000 7fef84ca3740 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e74790 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fef74009a60 tx=0x7fef74005d80 comp rx=0 tx=0).stop 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef84ca3740 1 -- 172.21.15.159:0/930062437 shutdown_connections 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef84ca3740 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558af5e76730 0x558af5e78b50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef5affd640 0 client.16866 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef84ca3740 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558af5dfbcb0 0x558af5e74790 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef84ca3740 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558af5df1410 0x558af5dff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef84ca3740 1 --2- 172.21.15.159:0/930062437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558af5df0af0 0x558af5dff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef84ca3740 1 -- 172.21.15.159:0/930062437 >> 172.21.15.159:0/930062437 conn(0x558af5ded060 msgr2=0x558af5dec1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef84ca3740 1 -- 172.21.15.159:0/930062437 shutdown_connections 2024-09-19T06:53:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef84ca3740 1 -- 172.21.15.159:0/930062437 wait complete. 2024-09-19T06:53:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.811+0000 7fef84ca3740 20 client.16866 trim_cache size 0 max 16384 2024-09-19T06:53:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:{ 2024-09-19T06:53:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "message": "", 2024-09-19T06:53:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout: "return_code": 0 2024-09-19T06:53:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stdout:} 2024-09-19T06:53:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 -- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fef680a34e0 msgr2=0x7fef680a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fef680a34e0 0x7fef680a59a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef74005e30 tx=0x7fef7403e040 comp rx=0 tx=0).stop 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 -- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c1035c0 msgr2=0x7fef7c1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c1035c0 0x7fef7c1987f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d950 tx=0x7fef6400de10 comp rx=0 tx=0).stop 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 -- 172.21.15.159:0/2686778437 shutdown_connections 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fef680a34e0 0x7fef680a59a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c10c0c0 0x7fef7c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef7c1035c0 0x7fef7c1987f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 --2- 172.21.15.159:0/2686778437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c102ca0 0x7fef7c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 -- 172.21.15.159:0/2686778437 >> 172.21.15.159:0/2686778437 conn(0x7fef7c0fc6f0 msgr2=0x7fef7c0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 -- 172.21.15.159:0/2686778437 shutdown_connections 2024-09-19T06:53:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi159.front.sepia.ceph.com.smithi159.stderr:2024-09-19T06:53:24.812+0000 7fef81f13640 1 -- 172.21.15.159:0/2686778437 wait complete. 2024-09-19T06:53:25.063 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:24 smithi159 ceph-mon[30935]: pgmap v197: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.1 MiB/s wr, 494 op/s 2024-09-19T06:53:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:24 smithi203 ceph-mon[35473]: pgmap v197: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.1 MiB/s wr, 494 op/s 2024-09-19T06:53:25.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:24 smithi189 ceph-mon[34880]: pgmap v197: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.1 MiB/s wr, 494 op/s 2024-09-19T06:53:25.616 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:53:25.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:53:25.955 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:26.319 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-09-19T06:53:26.319 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T06:53:26.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.543+0000 7f9e033b0640 1 -- 172.21.15.159:0/1355427595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc102ef0 msgr2=0x7f9dfc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:26.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.543+0000 7f9e033b0640 1 --2- 172.21.15.159:0/1355427595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc10da40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009ca0 tx=0x7f9df402a950 comp rx=0 tx=0).stop 2024-09-19T06:53:26.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.544+0000 7f9e033b0640 1 -- 172.21.15.159:0/1355427595 shutdown_connections 2024-09-19T06:53:26.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.544+0000 7f9e033b0640 1 --2- 172.21.15.159:0/1355427595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc10da40 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:26.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.544+0000 7f9e033b0640 1 --2- 172.21.15.159:0/1355427595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dfc102570 0x7f9dfc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:26.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.544+0000 7f9e033b0640 1 --2- 172.21.15.159:0/1355427595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dfc100e20 0x7f9dfc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:26.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.544+0000 7f9e033b0640 1 -- 172.21.15.159:0/1355427595 >> 172.21.15.159:0/1355427595 conn(0x7f9dfc0fc7d0 msgr2=0x7f9dfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:26.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.544+0000 7f9e033b0640 1 -- 172.21.15.159:0/1355427595 shutdown_connections 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.544+0000 7f9e033b0640 1 -- 172.21.15.159:0/1355427595 wait complete. 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.544+0000 7f9e033b0640 1 Processor -- start 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.544+0000 7f9e033b0640 1 -- start start 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e033b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc100e20 0x7f9dfc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e033b0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dfc102570 0x7f9dfc199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e033b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e033b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc110fa0 con 0x7f9dfc100e20 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e033b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc110e20 con 0x7f9dfc102ef0 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e033b0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc111120 con 0x7f9dfc102570 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0114c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc100e20 0x7f9dfc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0114c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc100e20 0x7f9dfc199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52278/0 (socket says 172.21.15.159:52278) 2024-09-19T06:53:26.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0114c640 1 -- 172.21.15.159:0/736107485 learned_addr learned my addr 172.21.15.159:0/736107485 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:26.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0194d640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:26.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0094b640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dfc102570 0x7f9dfc199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:26.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0114c640 1 -- 172.21.15.159:0/736107485 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dfc102570 msgr2=0x7f9dfc199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:26.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0114c640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dfc102570 0x7f9dfc199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:26.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0114c640 1 -- 172.21.15.159:0/736107485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dfc102ef0 msgr2=0x7f9dfc1a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:26.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0114c640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc1a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:26.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0114c640 1 -- 172.21.15.159:0/736107485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc1a4910 con 0x7f9dfc100e20 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0194d640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc1a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9e0114c640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc100e20 0x7f9dfc199350 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9df800d950 tx=0x7f9df800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.545+0000 7f9df27fc640 1 -- 172.21.15.159:0/736107485 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8017070 con 0x7f9dfc100e20 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.546+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc1a4ae0 con 0x7f9dfc100e20 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.546+0000 7f9df27fc640 1 -- 172.21.15.159:0/736107485 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df8009c30 con 0x7f9dfc100e20 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.546+0000 7f9df27fc640 1 -- 172.21.15.159:0/736107485 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df800f6b0 con 0x7f9dfc100e20 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.546+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc1a4ff0 con 0x7f9dfc100e20 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.547+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc1021b0 con 0x7f9dfc100e20 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.549+0000 7f9df27fc640 1 -- 172.21.15.159:0/736107485 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9df80109d0 con 0x7f9dfc100e20 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.549+0000 7f9df27fc640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9de80a33b0 0x7f9de80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.550+0000 7f9e0094b640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9de80a33b0 0x7f9de80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:26.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.550+0000 7f9df27fc640 1 -- 172.21.15.159:0/736107485 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f9df80cfa20 con 0x7f9dfc100e20 2024-09-19T06:53:26.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.550+0000 7f9e0094b640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9de80a33b0 0x7f9de80a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc06aac0 tx=0x7f9dec008040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:26.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.552+0000 7f9df27fc640 1 -- 172.21.15.159:0/736107485 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9df8009de0 con 0x7f9dfc100e20 2024-09-19T06:53:26.637 DEBUG:teuthology.parallel:result is None 2024-09-19T06:53:26.637 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:53:26.669 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:53:26.669 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T06:53:26.844 INFO:tasks.quiescer:joining Quiescers 2024-09-19T06:53:26.844 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T06:53:26.844 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:53:26.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.794+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dfc101200 con 0x7f9dfc100e20 2024-09-19T06:53:26.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.795+0000 7f9df27fc640 1 -- 172.21.15.159:0/736107485 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f9dfc101200 con 0x7f9dfc100e20 2024-09-19T06:53:26.846 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:53:26.846 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:53:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:53:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9de80a33b0 msgr2=0x7f9de80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9de80a33b0 0x7f9de80a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc06aac0 tx=0x7f9dec008040 comp rx=0 tx=0).stop 2024-09-19T06:53:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc100e20 msgr2=0x7f9dfc199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc100e20 0x7f9dfc199350 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9df800d950 tx=0x7f9df800de10 comp rx=0 tx=0).stop 2024-09-19T06:53:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 shutdown_connections 2024-09-19T06:53:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9de80a33b0 0x7f9de80a5870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:26.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc1a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:26.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dfc102570 0x7f9dfc199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:26.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 --2- 172.21.15.159:0/736107485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dfc100e20 0x7f9dfc199350 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:26.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 >> 172.21.15.159:0/736107485 conn(0x7f9dfc0fc7d0 msgr2=0x7f9dfc106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:26.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.797+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 shutdown_connections 2024-09-19T06:53:26.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:26.798+0000 7f9e033b0640 1 -- 172.21.15.159:0/736107485 wait complete. 2024-09-19T06:53:26.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:26 smithi159 ceph-mon[30935]: pgmap v198: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 3.5 MiB/s wr, 888 op/s 2024-09-19T06:53:27.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:26 smithi203 ceph-mon[35473]: pgmap v198: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 3.5 MiB/s wr, 888 op/s 2024-09-19T06:53:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:26 smithi189 ceph-mon[34880]: pgmap v198: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 3.5 MiB/s wr, 888 op/s 2024-09-19T06:53:27.713 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:53:27.716 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:27.997 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:27 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/736107485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:27 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/736107485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:28.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:27 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/736107485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:28.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 -- 172.21.15.159:0/173102428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 msgr2=0x7f2a301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:28.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 --2- 172.21.15.159:0/173102428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 0x7f2a301067e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009900 tx=0x7f2a2402a410 comp rx=0 tx=0).stop 2024-09-19T06:53:28.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 -- 172.21.15.159:0/173102428 shutdown_connections 2024-09-19T06:53:28.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 --2- 172.21.15.159:0/173102428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a30106f10 0x7f2a3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 --2- 172.21.15.159:0/173102428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 0x7f2a301067e0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 --2- 172.21.15.159:0/173102428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a30101de0 0x7f2a301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 -- 172.21.15.159:0/173102428 >> 172.21.15.159:0/173102428 conn(0x7f2a300fd8c0 msgr2=0x7f2a300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 -- 172.21.15.159:0/173102428 shutdown_connections 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 -- 172.21.15.159:0/173102428 wait complete. 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 Processor -- start 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.338+0000 7f2a37c93640 1 -- start start 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a37c93640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a30101de0 0x7f2a301985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a37c93640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 0x7f2a30198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a37c93640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a30106f10 0x7f2a3019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a37c93640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30112010 con 0x7f2a30102790 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a37c93640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30111e90 con 0x7f2a30101de0 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a37c93640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30112190 con 0x7f2a30106f10 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a3522e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 0x7f2a30198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:28.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a3522e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 0x7f2a30198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52298/0 (socket says 172.21.15.159:52298) 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a3522e640 1 -- 172.21.15.159:0/747432995 learned_addr learned my addr 172.21.15.159:0/747432995 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a36230640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a30106f10 0x7f2a3019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a35a2f640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a30101de0 0x7f2a301985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a3522e640 1 -- 172.21.15.159:0/747432995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a30106f10 msgr2=0x7f2a3019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a3522e640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a30106f10 0x7f2a3019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a3522e640 1 -- 172.21.15.159:0/747432995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a30101de0 msgr2=0x7f2a301985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a3522e640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a30101de0 0x7f2a301985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a3522e640 1 -- 172.21.15.159:0/747432995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3019d560 con 0x7f2a30102790 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a35a2f640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a30101de0 0x7f2a301985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a3522e640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 0x7f2a30198af0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2a24005ab0 tx=0x7f2a240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.339+0000 7f2a2effd640 1 -- 172.21.15.159:0/747432995 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2403f030 con 0x7f2a30102790 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.340+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3019d7f0 con 0x7f2a30102790 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.340+0000 7f2a2effd640 1 -- 172.21.15.159:0/747432995 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a24003ce0 con 0x7f2a30102790 2024-09-19T06:53:28.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.340+0000 7f2a2effd640 1 -- 172.21.15.159:0/747432995 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24035070 con 0x7f2a30102790 2024-09-19T06:53:28.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.340+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a301a5130 con 0x7f2a30102790 2024-09-19T06:53:28.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.340+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a301032c0 con 0x7f2a30102790 2024-09-19T06:53:28.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.342+0000 7f2a2effd640 1 -- 172.21.15.159:0/747432995 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2a24042030 con 0x7f2a30102790 2024-09-19T06:53:28.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.342+0000 7f2a2effd640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2a180a33b0 0x7f2a180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:28.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.342+0000 7f2a35a2f640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2a180a33b0 0x7f2a180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:28.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.342+0000 7f2a2effd640 1 -- 172.21.15.159:0/747432995 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f2a240f0890 con 0x7f2a30102790 2024-09-19T06:53:28.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.343+0000 7f2a35a2f640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2a180a33b0 0x7f2a180a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2a28006fd0 tx=0x7f2a28008040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:28.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.345+0000 7f2a2effd640 1 -- 172.21.15.159:0/747432995 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a240bd240 con 0x7f2a30102790 2024-09-19T06:53:28.415 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:28.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.569+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a3010a0f0 con 0x7f2a30102790 2024-09-19T06:53:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.570+0000 7f2a2effd640 1 -- 172.21.15.159:0/747432995 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f2a240bcb40 con 0x7f2a30102790 2024-09-19T06:53:28.572 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:53:28.572 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:53:28.573 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:53:28.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2a180a33b0 msgr2=0x7f2a180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:28.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2a180a33b0 0x7f2a180a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2a28006fd0 tx=0x7f2a28008040 comp rx=0 tx=0).stop 2024-09-19T06:53:28.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 msgr2=0x7f2a30198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:28.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 0x7f2a30198af0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2a24005ab0 tx=0x7f2a240042f0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 shutdown_connections 2024-09-19T06:53:28.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2a180a33b0 0x7f2a180a5870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a30106f10 0x7f2a3019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a30102790 0x7f2a30198af0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 --2- 172.21.15.159:0/747432995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a30101de0 0x7f2a301985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:28.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 >> 172.21.15.159:0/747432995 conn(0x7f2a300fd8c0 msgr2=0x7f2a300fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:28.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 shutdown_connections 2024-09-19T06:53:28.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:28.573+0000 7f2a37c93640 1 -- 172.21.15.159:0/747432995 wait complete. 2024-09-19T06:53:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:28 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/747432995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:28.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:28 smithi159 ceph-mon[30935]: pgmap v199: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 555 op/s 2024-09-19T06:53:29.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:28 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/747432995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:29.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:28 smithi203 ceph-mon[35473]: pgmap v199: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 555 op/s 2024-09-19T06:53:29.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:28 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/747432995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:29.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:28 smithi189 ceph-mon[34880]: pgmap v199: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 555 op/s 2024-09-19T06:53:29.280 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --cancel --all' 2024-09-19T06:53:29.280 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --cancel --all 2024-09-19T06:53:29.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.442+0000 7fe94fe0a640 1 -- 172.21.15.159:0/1098834252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948101df0 msgr2=0x7fe9481021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.442+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/1098834252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948101df0 0x7fe9481021d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe944009900 tx=0x7fe94402a410 comp rx=0 tx=0).stop 2024-09-19T06:53:29.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.442+0000 7fe94fe0a640 1 -- 172.21.15.159:0/1098834252 shutdown_connections 2024-09-19T06:53:29.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.442+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/1098834252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe948106f20 0x7fe94810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.442+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/1098834252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9481027a0 0x7fe9481067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.442+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/1098834252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948101df0 0x7fe9481021d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.442+0000 7fe94fe0a640 1 -- 172.21.15.159:0/1098834252 >> 172.21.15.159:0/1098834252 conn(0x7fe9480fd8f0 msgr2=0x7fe9480ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.442+0000 7fe94fe0a640 1 -- 172.21.15.159:0/1098834252 shutdown_connections 2024-09-19T06:53:29.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.442+0000 7fe94fe0a640 1 -- 172.21.15.159:0/1098834252 wait complete. 2024-09-19T06:53:29.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.443+0000 7fe94fe0a640 1 Processor -- start 2024-09-19T06:53:29.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.443+0000 7fe94fe0a640 1 -- start start 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.443+0000 7fe94fe0a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe948101df0 0x7fe948198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.443+0000 7fe94fe0a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9481027a0 0x7fe9481989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.443+0000 7fe94fe0a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948106f20 0x7fe94819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.443+0000 7fe94fe0a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe948111f80 con 0x7fe948106f20 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.443+0000 7fe94fe0a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe948111e00 con 0x7fe9481027a0 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.443+0000 7fe94fe0a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe948112100 con 0x7fe948101df0 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.443+0000 7fe94e3a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948106f20 0x7fe94819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94e3a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948106f20 0x7fe94819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60036/0 (socket says 172.21.15.159:60036) 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94e3a7640 1 -- 172.21.15.159:0/3671638247 learned_addr learned my addr 172.21.15.159:0/3671638247 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe948101df0 0x7fe948198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94d3a5640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9481027a0 0x7fe9481989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94e3a7640 1 -- 172.21.15.159:0/3671638247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe948101df0 msgr2=0x7fe948198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94e3a7640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe948101df0 0x7fe948198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94e3a7640 1 -- 172.21.15.159:0/3671638247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9481027a0 msgr2=0x7fe9481989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94e3a7640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9481027a0 0x7fe9481989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94e3a7640 1 -- 172.21.15.159:0/3671638247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94819d410 con 0x7fe948106f20 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe948101df0 0x7fe948198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94e3a7640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948106f20 0x7fe94819cd30 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe94000eb10 tx=0x7fe94000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe93effd640 1 -- 172.21.15.159:0/3671638247 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940004b20 con 0x7fe948106f20 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94fe0a640 1 -- 172.21.15.159:0/3671638247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94819d700 con 0x7fe948106f20 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe93effd640 1 -- 172.21.15.159:0/3671638247 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe940004cc0 con 0x7fe948106f20 2024-09-19T06:53:29.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe93effd640 1 -- 172.21.15.159:0/3671638247 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940010760 con 0x7fe948106f20 2024-09-19T06:53:29.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.444+0000 7fe94fe0a640 1 -- 172.21.15.159:0/3671638247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9481a4fe0 con 0x7fe948106f20 2024-09-19T06:53:29.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.447+0000 7fe93effd640 1 -- 172.21.15.159:0/3671638247 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe940005020 con 0x7fe948106f20 2024-09-19T06:53:29.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.448+0000 7fe93effd640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9340a33b0 0x7fe9340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.448+0000 7fe9521e3740 1 Processor -- start 2024-09-19T06:53:29.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.448+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9340a33b0 0x7fe9340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.448+0000 7fe9521e3740 1 -- start start 2024-09-19T06:53:29.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.448+0000 7fe93effd640 1 -- 172.21.15.159:0/3671638247 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe9400d03d0 con 0x7fe948106f20 2024-09-19T06:53:29.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.448+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704fb40 0x56210704e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.448+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704e5d0 0x56210704ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.448+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x56210705b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe9521e3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562106fb42f0 con 0x562107059370 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe9521e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562106f5bcf0 con 0x56210704e5d0 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe9521e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562106fb02b0 con 0x56210704fb40 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9340a33b0 0x7fe9340a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe944005ab0 tx=0x7fe944005a20 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94e3a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x56210705b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94e3a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x56210705b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60052/0 (socket says 172.21.15.159:60052) 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94e3a7640 1 -- 172.21.15.159:0/2504697041 learned_addr learned my addr 172.21.15.159:0/2504697041 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94d3a5640 1 --2- 172.21.15.159:0/2504697041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704e5d0 0x56210704ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94dba6640 1 --2- 172.21.15.159:0/2504697041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704fb40 0x56210704e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94e3a7640 1 -- 172.21.15.159:0/2504697041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704fb40 msgr2=0x56210704e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94e3a7640 1 --2- 172.21.15.159:0/2504697041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704fb40 0x56210704e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94e3a7640 1 -- 172.21.15.159:0/2504697041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704e5d0 msgr2=0x56210704ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94e3a7640 1 --2- 172.21.15.159:0/2504697041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704e5d0 0x56210704ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94e3a7640 1 -- 172.21.15.159:0/2504697041 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562106f403a0 con 0x562107059370 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe94e3a7640 1 --2- 172.21.15.159:0/2504697041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x56210705b760 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe940099050 tx=0x7fe9400989a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35583d7a12f7ed48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe933fff640 1 -- 172.21.15.159:0/2504697041 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400b4020 con 0x562107059370 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe933fff640 1 -- 172.21.15.159:0/2504697041 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe94009cd80 con 0x562107059370 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.449+0000 7fe933fff640 1 -- 172.21.15.159:0/2504697041 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400cdd70 con 0x562107059370 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.450+0000 7fe9521e3740 1 -- 172.21.15.159:0/2504697041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 msgr2=0x56210705b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.450+0000 7fe9521e3740 1 --2- 172.21.15.159:0/2504697041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x56210705b760 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe940099050 tx=0x7fe9400989a0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.450+0000 7fe9521e3740 1 -- 172.21.15.159:0/2504697041 shutdown_connections 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.450+0000 7fe9521e3740 1 --2- 172.21.15.159:0/2504697041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x56210705b760 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.450+0000 7fe9521e3740 1 --2- 172.21.15.159:0/2504697041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704e5d0 0x56210704ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.450+0000 7fe9521e3740 1 --2- 172.21.15.159:0/2504697041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704fb40 0x56210704e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.450+0000 7fe9521e3740 1 -- 172.21.15.159:0/2504697041 >> 172.21.15.159:0/2504697041 conn(0x562107017310 msgr2=0x56210704ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.450+0000 7fe9521e3740 1 -- 172.21.15.159:0/2504697041 shutdown_connections 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.450+0000 7fe9521e3740 1 -- 172.21.15.159:0/2504697041 wait complete. 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe9521e3740 1 -- start start 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe9521e3740 1 Processor -- start 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 0x562107058ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704fb40 0x562107055f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562107059370 0x562107056490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe9521e3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56210705c010 con 0x56210704fb40 2024-09-19T06:53:29.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe9521e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562106f6f060 con 0x562107059370 2024-09-19T06:53:29.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe9521e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56210705c190 con 0x56210704e5d0 2024-09-19T06:53:29.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe9521e3740 10 client.0 _ll_register_callbacks cb 0x562106cc28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:29.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe94d3a5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704fb40 0x562107055f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe94d3a5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704fb40 0x562107055f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60062/0 (socket says 172.21.15.159:60062) 2024-09-19T06:53:29.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe94d3a5640 1 -- 172.21.15.159:0/3358082342 learned_addr learned my addr 172.21.15.159:0/3358082342 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:29.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.451+0000 7fe94e3a7640 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562107059370 0x562107056490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 0x562107058ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe94d3a5640 1 -- 172.21.15.159:0/3358082342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 msgr2=0x562107058ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe94d3a5640 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 0x562107058ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe94d3a5640 1 -- 172.21.15.159:0/3358082342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562107059370 msgr2=0x562107056490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe94d3a5640 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562107059370 0x562107056490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe94d3a5640 1 -- 172.21.15.159:0/3358082342 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562106d253c0 con 0x56210704fb40 2024-09-19T06:53:29.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 0x562107058ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:29.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe94d3a5640 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704fb40 0x562107055f50 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe938013710 tx=0x7fe938013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3139abb53d8a38c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe9317fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:29.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe9317fa640 1 -- 172.21.15.159:0/3358082342 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938020060 con 0x56210704fb40 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe9317fa640 1 -- 172.21.15.159:0/3358082342 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe938011dd0 con 0x56210704fb40 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe9521e3740 1 -- 172.21.15.159:0/3358082342 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe94009cd80 con 0x56210704fb40 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe9317fa640 1 -- 172.21.15.159:0/3358082342 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe938005020 con 0x56210704fb40 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe9521e3740 10 client.16905 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.452+0000 7fe9521e3740 1 -- 172.21.15.159:0/3358082342 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562107067a60 con 0x56210704fb40 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.453+0000 7fe9317fa640 1 -- 172.21.15.159:0/3358082342 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe94009cd80 con 0x56210704fb40 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.453+0000 7fe9317fa640 1 -- 172.21.15.159:0/3358082342 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe93801a030 con 0x56210704fb40 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.453+0000 7fe9521e3740 10 client.16905 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.453+0000 7fe9521e3740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:29.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.453+0000 7fe9521e3740 20 client.16905 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.453+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562107068f20 0x56210706b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.453+0000 7fe9521e3740 4 client.16905 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.453+0000 7fe9521e3740 1 -- 172.21.15.159:0/3358082342 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562106fc1860 con 0x562107068f20 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.453+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562107068f20 0x56210706b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.454+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562107068f20 0x56210706b370 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74a3dc7a91322acc server_cookie=4fbc50a569b558ba in_seq=0 out_seq=0 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.454+0000 7fe9317fa640 10 client.16905 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.454+0000 7fe9317fa640 1 -- 172.21.15.159:0/3358082342 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562106fc1860 con 0x562107068f20 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.454+0000 7fe9317fa640 10 client.16905 handle_command_reply: tid=0 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.454+0000 7fe9521e3740 1 client.16905 shutdown 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 -- 172.21.15.159:0/3358082342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704fb40 msgr2=0x562107055f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704fb40 0x562107055f50 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe938013710 tx=0x7fe938013bd0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 -- 172.21.15.159:0/3358082342 shutdown_connections 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562107068f20 0x56210706b370 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562107059370 0x562107056490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704fb40 0x562107055f50 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3358082342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 0x562107058ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 -- 172.21.15.159:0/3358082342 >> 172.21.15.159:0/3358082342 conn(0x562107017310 msgr2=0x562107050990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9317fa640 0 client.16905 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 -- 172.21.15.159:0/3358082342 shutdown_connections 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 1 -- 172.21.15.159:0/3358082342 wait complete. 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.455+0000 7fe9521e3740 20 client.16905 trim_cache size 0 max 16384 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe9521e3740 1 Processor -- start 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe9521e3740 1 -- start start 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704e5d0 0x5621070652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 0x562107070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562107059370 0x562107071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe9521e3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481ab9a0 con 0x56210704e5d0 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe9521e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481ae220 con 0x56210704fb40 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe9521e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481ac010 con 0x562107059370 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe94dba6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704e5d0 0x5621070652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.468+0000 7fe94dba6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704e5d0 0x5621070652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60068/0 (socket says 172.21.15.159:60068) 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe94dba6640 1 -- 172.21.15.159:0/3688401516 learned_addr learned my addr 172.21.15.159:0/3688401516 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe94d3a5640 1 --2- 172.21.15.159:0/3688401516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 0x562107070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe94e3a7640 1 --2- 172.21.15.159:0/3688401516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562107059370 0x562107071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe94dba6640 1 -- 172.21.15.159:0/3688401516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562107059370 msgr2=0x562107071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3688401516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562107059370 0x562107071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe94dba6640 1 -- 172.21.15.159:0/3688401516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 msgr2=0x562107070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3688401516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 0x562107070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe94dba6640 1 -- 172.21.15.159:0/3688401516 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621070588c0 con 0x56210704e5d0 2024-09-19T06:53:29.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3688401516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704e5d0 0x5621070652b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe944031550 tx=0x7fe94403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3ecaee37ff1104 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe9337fe640 1 -- 172.21.15.159:0/3688401516 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944035050 con 0x56210704e5d0 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe9337fe640 1 -- 172.21.15.159:0/3688401516 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe944055070 con 0x56210704e5d0 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.469+0000 7fe9337fe640 1 -- 172.21.15.159:0/3688401516 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9440049b0 con 0x56210704e5d0 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.470+0000 7fe9521e3740 1 -- 172.21.15.159:0/3688401516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704e5d0 msgr2=0x5621070652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.470+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3688401516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704e5d0 0x5621070652b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe944031550 tx=0x7fe94403f000 comp rx=0 tx=0).stop 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.470+0000 7fe9521e3740 1 -- 172.21.15.159:0/3688401516 shutdown_connections 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.470+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3688401516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562107059370 0x562107071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.470+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3688401516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 0x562107070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.470+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3688401516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56210704e5d0 0x5621070652b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.470+0000 7fe9521e3740 1 -- 172.21.15.159:0/3688401516 >> 172.21.15.159:0/3688401516 conn(0x562107017310 msgr2=0x562107055040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.470+0000 7fe9521e3740 1 -- 172.21.15.159:0/3688401516 shutdown_connections 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.470+0000 7fe9521e3740 1 -- 172.21.15.159:0/3688401516 wait complete. 2024-09-19T06:53:29.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.471+0000 7fe9521e3740 1 -- start start 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.471+0000 7fe9521e3740 1 Processor -- start 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.471+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 0x562107052f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.471+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 0x5621070534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.471+0000 7fe9521e3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x5621070539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.471+0000 7fe9521e3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481ac6e0 con 0x562107059370 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.471+0000 7fe9521e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481adb50 con 0x56210704fb40 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.471+0000 7fe9521e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481acdb0 con 0x56210704e5d0 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe9521e3740 10 client.0 _ll_register_callbacks cb 0x7fe938009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94e3a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x5621070539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94d3a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 0x5621070534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94e3a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x5621070539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60070/0 (socket says 172.21.15.159:60070) 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94e3a7640 1 -- 172.21.15.159:0/3371915387 learned_addr learned my addr 172.21.15.159:0/3371915387 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:29.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 0x562107052f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94d3a5640 1 -- 172.21.15.159:0/3371915387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 msgr2=0x562107052f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94d3a5640 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 0x562107052f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94d3a5640 1 -- 172.21.15.159:0/3371915387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 msgr2=0x5621070539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94d3a5640 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x5621070539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94d3a5640 1 -- 172.21.15.159:0/3371915387 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621070d7020 con 0x56210704fb40 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94e3a7640 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x5621070539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe94d3a5640 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 0x5621070534a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe938012010 tx=0x7fe938005470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74a374455bf8509 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.472+0000 7fe9317fa640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.473+0000 7fe9317fa640 1 -- 172.21.15.159:0/3371915387 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938031060 con 0x56210704fb40 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.473+0000 7fe9317fa640 1 -- 172.21.15.159:0/3371915387 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fe93800f9d0 con 0x56210704fb40 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.473+0000 7fe9521e3740 1 -- 172.21.15.159:0/3371915387 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe944055070 con 0x56210704fb40 2024-09-19T06:53:29.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.473+0000 7fe9317fa640 1 -- 172.21.15.159:0/3371915387 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe9380117b0 con 0x56210704fb40 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.473+0000 7fe9521e3740 10 client.26168 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.473+0000 7fe9521e3740 1 -- 172.21.15.159:0/3371915387 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5621070d82e0 con 0x56210704fb40 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.473+0000 7fe9317fa640 1 -- 172.21.15.159:0/3371915387 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe944055070 con 0x56210704fb40 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe9317fa640 1 -- 172.21.15.159:0/3371915387 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe93801a040 con 0x56210704fb40 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe9521e3740 10 client.26168 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe9521e3740 10 client.26168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe9521e3740 20 client.26168 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5621070d89b0 0x5621070dadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe9521e3740 4 client.26168 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe9521e3740 1 -- 172.21.15.159:0/3371915387 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562106fbbd70 con 0x5621070d89b0 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5621070d89b0 0x5621070dadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe94dba6640 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5621070d89b0 0x5621070dadd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34405a0008a8bce5 server_cookie=d0cd0f5a4a252654 in_seq=0 out_seq=0 2024-09-19T06:53:29.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.474+0000 7fe9317fa640 10 client.26168 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9317fa640 1 -- 172.21.15.159:0/3371915387 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562106fbbd70 con 0x5621070d89b0 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9317fa640 10 client.26168 handle_command_reply: tid=0 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 client.26168 shutdown 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 -- 172.21.15.159:0/3371915387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 msgr2=0x5621070534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 0x5621070534a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe938012010 tx=0x7fe938005470 comp rx=0 tx=0).stop 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 -- 172.21.15.159:0/3371915387 shutdown_connections 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5621070d89b0 0x5621070dadd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562107059370 0x5621070539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56210704fb40 0x5621070534a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 --2- 172.21.15.159:0/3371915387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56210704e5d0 0x562107052f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9317fa640 0 client.26168 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 -- 172.21.15.159:0/3371915387 >> 172.21.15.159:0/3371915387 conn(0x562107017310 msgr2=0x5621070494e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 -- 172.21.15.159:0/3371915387 shutdown_connections 2024-09-19T06:53:29.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 1 -- 172.21.15.159:0/3371915387 wait complete. 2024-09-19T06:53:29.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.475+0000 7fe9521e3740 20 client.26168 trim_cache size 0 max 16384 2024-09-19T06:53:29.500 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:53:29.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 -- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9340a33b0 msgr2=0x7fe9340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9340a33b0 0x7fe9340a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe944005ab0 tx=0x7fe944005a20 comp rx=0 tx=0).stop 2024-09-19T06:53:29.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 -- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948106f20 msgr2=0x7fe94819cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948106f20 0x7fe94819cd30 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe94000eb10 tx=0x7fe94000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 -- 172.21.15.159:0/3671638247 shutdown_connections 2024-09-19T06:53:29.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe9340a33b0 0x7fe9340a5870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe948106f20 0x7fe94819cd30 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9481027a0 0x7fe9481989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 --2- 172.21.15.159:0/3671638247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe948101df0 0x7fe948198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 -- 172.21.15.159:0/3671638247 >> 172.21.15.159:0/3671638247 conn(0x7fe9480fd8f0 msgr2=0x7fe9480fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 -- 172.21.15.159:0/3671638247 shutdown_connections 2024-09-19T06:53:29.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:29.476+0000 7fe94fe0a640 1 -- 172.21.15.159:0/3671638247 wait complete. 2024-09-19T06:53:30.205 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:30.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.678+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/3831392104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec106f10 msgr2=0x7fb4ec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.678+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/3831392104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec106f10 0x7fb4ec10ea90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009ca0 tx=0x7fb4e402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.678+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/3831392104 shutdown_connections 2024-09-19T06:53:30.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.678+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/3831392104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec106f10 0x7fb4ec10ea90 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.678+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/3831392104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4ec102790 0x7fb4ec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.678+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/3831392104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4ec101de0 0x7fb4ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.678+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/3831392104 >> 172.21.15.159:0/3831392104 conn(0x7fb4ec0fd8c0 msgr2=0x7fb4ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.678+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/3831392104 shutdown_connections 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.678+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/3831392104 wait complete. 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.679+0000 7fb4f0e1f640 1 Processor -- start 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.679+0000 7fb4f0e1f640 1 -- start start 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.679+0000 7fb4f0e1f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec101de0 0x7fb4ec1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4f0e1f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4ec102790 0x7fb4ec198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4f0e1f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4ec106f10 0x7fb4ec19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4f0e1f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec111f70 con 0x7fb4ec101de0 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4f0e1f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec111df0 con 0x7fb4ec102790 2024-09-19T06:53:30.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4f0e1f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1120f0 con 0x7fb4ec106f10 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ea59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec101de0 0x7fb4ec1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ea59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec101de0 0x7fb4ec1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60086/0 (socket says 172.21.15.159:60086) 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ea59c640 1 -- 172.21.15.159:0/4003653465 learned_addr learned my addr 172.21.15.159:0/4003653465 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4ec102790 0x7fb4ec198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ead9d640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4ec106f10 0x7fb4ec19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ea59c640 1 -- 172.21.15.159:0/4003653465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4ec106f10 msgr2=0x7fb4ec19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4ec106f10 0x7fb4ec19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ea59c640 1 -- 172.21.15.159:0/4003653465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4ec102790 msgr2=0x7fb4ec198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4ec102790 0x7fb4ec198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ea59c640 1 -- 172.21.15.159:0/4003653465 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec19d3a0 con 0x7fb4ec101de0 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4ec102790 0x7fb4ec198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec101de0 0x7fb4ec1983f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00d770 tx=0x7fb4dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4db7fe640 1 -- 172.21.15.159:0/4003653465 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc017070 con 0x7fb4ec101de0 2024-09-19T06:53:30.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/4003653465 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ec19d690 con 0x7fb4ec101de0 2024-09-19T06:53:30.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4db7fe640 1 -- 172.21.15.159:0/4003653465 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4dc005500 con 0x7fb4ec101de0 2024-09-19T06:53:30.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4db7fe640 1 -- 172.21.15.159:0/4003653465 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc020060 con 0x7fb4ec101de0 2024-09-19T06:53:30.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.680+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/4003653465 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ec1a4f70 con 0x7fb4ec101de0 2024-09-19T06:53:30.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.682+0000 7fb4db7fe640 1 -- 172.21.15.159:0/4003653465 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb4dc004da0 con 0x7fb4ec101de0 2024-09-19T06:53:30.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4f31f8740 1 Processor -- start 2024-09-19T06:53:30.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4f31f8740 1 -- start start 2024-09-19T06:53:30.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4db7fe640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb4d40a33b0 0x7fb4d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d489de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d48a320 0x56259d4946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d496fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56259d3ee200 con 0x56259d489a00 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56259d394dc0 con 0x56259d494be0 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56259d3ea1c0 con 0x56259d48a320 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.683+0000 7fb4db7fe640 1 -- 172.21.15.159:0/4003653465 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb4dc0cf8d0 con 0x7fb4ec101de0 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ead9d640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb4d40a33b0 0x7fb4d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ea59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d489de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ea59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d489de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60088/0 (socket says 172.21.15.159:60088) 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ea59c640 1 -- 172.21.15.159:0/2657303090 learned_addr learned my addr 172.21.15.159:0/2657303090 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ead9d640 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d496fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d48a320 0x56259d4946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ea59c640 1 -- 172.21.15.159:0/2657303090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d48a320 msgr2=0x56259d4946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d48a320 0x56259d4946a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ea59c640 1 -- 172.21.15.159:0/2657303090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 msgr2=0x56259d496fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d496fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ea59c640 1 -- 172.21.15.159:0/2657303090 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56259d15f620 con 0x56259d489a00 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d48a320 0x56259d4946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ead9d640 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d496fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ead9d640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb4d40a33b0 0x7fb4d40a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009bf0 tx=0x7fb4e4005ef0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d489de0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0cd5f0 tx=0x7fb4dc004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db0804746aabfcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4d8ff9640 1 -- 172.21.15.159:0/2657303090 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc09ff30 con 0x56259d489a00 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4d8ff9640 1 -- 172.21.15.159:0/2657303090 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4dc0a47f0 con 0x56259d489a00 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.684+0000 7fb4d8ff9640 1 -- 172.21.15.159:0/2657303090 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc086310 con 0x56259d489a00 2024-09-19T06:53:30.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.685+0000 7fb4f31f8740 1 -- 172.21.15.159:0/2657303090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 msgr2=0x56259d489de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.685+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d489de0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0cd5f0 tx=0x7fb4dc004800 comp rx=0 tx=0).stop 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.685+0000 7fb4f31f8740 1 -- 172.21.15.159:0/2657303090 shutdown_connections 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.685+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d496fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.685+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d48a320 0x56259d4946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.685+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/2657303090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d489de0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.685+0000 7fb4f31f8740 1 -- 172.21.15.159:0/2657303090 >> 172.21.15.159:0/2657303090 conn(0x56259d485f90 msgr2=0x56259d486370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.685+0000 7fb4f31f8740 1 -- 172.21.15.159:0/2657303090 shutdown_connections 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.685+0000 7fb4f31f8740 1 -- 172.21.15.159:0/2657303090 wait complete. 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4f31f8740 1 -- start start 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4f31f8740 1 Processor -- start 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d4944c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 0x56259d491770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d494be0 0x56259d491cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56259d4977b0 con 0x56259d489a00 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56259d388c50 con 0x56259d48a320 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56259d497930 con 0x56259d494be0 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4f31f8740 10 client.0 _ll_register_callbacks cb 0x56259d39aba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4ea59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d4944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4ea59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d4944c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60092/0 (socket says 172.21.15.159:60092) 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4ea59c640 1 -- 172.21.15.159:0/954480895 learned_addr learned my addr 172.21.15.159:0/954480895 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4ead9d640 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d494be0 0x56259d491cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4ea59c640 1 -- 172.21.15.159:0/954480895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d494be0 msgr2=0x56259d491cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d494be0 0x56259d491cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4ea59c640 1 -- 172.21.15.159:0/954480895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 msgr2=0x56259d491770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 0x56259d491770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 0x56259d491770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4ea59c640 1 -- 172.21.15.159:0/954480895 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56259d492490 con 0x56259d489a00 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.686+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 0x56259d491770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d4944c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc098550 tx=0x7fb4dc0cd010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ac736f62ee8656 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/954480895 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0860b0 con 0x56259d489a00 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/954480895 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb4dc086250 con 0x56259d489a00 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4f31f8740 1 -- 172.21.15.159:0/954480895 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4dc0a47f0 con 0x56259d489a00 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/954480895 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4dc0ba300 con 0x56259d489a00 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4f31f8740 10 client.16923 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4f31f8740 1 -- 172.21.15.159:0/954480895 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56259d4977b0 con 0x56259d489a00 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/954480895 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4dc0a47f0 con 0x56259d489a00 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/954480895 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb4dc09afd0 con 0x56259d489a00 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4f31f8740 10 client.16923 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:30.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4f31f8740 10 client.16923 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4f31f8740 20 client.16923 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56259d4a4460 0x56259d4a6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4f31f8740 4 client.16923 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4f31f8740 1 -- 172.21.15.159:0/954480895 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56259d3fb770 con 0x56259d4a4460 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.687+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56259d4a4460 0x56259d4a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.688+0000 7fb4d1ffb640 10 client.16923 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.688+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56259d4a4460 0x56259d4a6850 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad05a3ca6674b6b4 server_cookie=5fa8736ed9c82af in_seq=0 out_seq=0 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/954480895 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56259d3fb770 con 0x56259d4a4460 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4d1ffb640 10 client.16923 handle_command_reply: tid=0 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 client.16923 shutdown 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 -- 172.21.15.159:0/954480895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 msgr2=0x56259d4944c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d4944c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc098550 tx=0x7fb4dc0cd010 comp rx=0 tx=0).stop 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 -- 172.21.15.159:0/954480895 shutdown_connections 2024-09-19T06:53:30.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56259d4a4460 0x56259d4a6850 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4d1ffb640 0 client.16923 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:30.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d494be0 0x56259d491cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 0x56259d491770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/954480895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d489a00 0x56259d4944c0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 -- 172.21.15.159:0/954480895 >> 172.21.15.159:0/954480895 conn(0x56259d485f90 msgr2=0x56259d4851d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 -- 172.21.15.159:0/954480895 shutdown_connections 2024-09-19T06:53:30.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 1 -- 172.21.15.159:0/954480895 wait complete. 2024-09-19T06:53:30.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.689+0000 7fb4f31f8740 20 client.16923 trim_cache size 0 max 16384 2024-09-19T06:53:30.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.706+0000 7fb4f31f8740 1 Processor -- start 2024-09-19T06:53:30.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.706+0000 7fb4f31f8740 1 -- start start 2024-09-19T06:53:30.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.706+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 0x56259d4a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d48a320 0x56259d48cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d4abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1ab950 con 0x56259d48a320 2024-09-19T06:53:30.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1ae1d0 con 0x56259d494be0 2024-09-19T06:53:30.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1abfc0 con 0x56259d489a00 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4e9d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d48a320 0x56259d48cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4ead9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d4abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4ead9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d4abfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:51948/0 (socket says 172.21.15.159:51948) 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4ead9d640 1 -- 172.21.15.159:0/1421305066 learned_addr learned my addr 172.21.15.159:0/1421305066 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4e9d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d48a320 0x56259d48cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60106/0 (socket says 172.21.15.159:60106) 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4e9d9b640 1 -- 172.21.15.159:0/1421305066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 msgr2=0x56259d4a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/1421305066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 0x56259d4a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4e9d9b640 1 -- 172.21.15.159:0/1421305066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 msgr2=0x56259d4abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/1421305066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d4abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.707+0000 7fb4e9d9b640 1 -- 172.21.15.159:0/1421305066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56259d48fcc0 con 0x56259d48a320 2024-09-19T06:53:30.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.708+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/1421305066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d48a320 0x56259d48cc50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x56259d492db0 tx=0x7fb4e000a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa88ad03dc0ee247 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.709+0000 7fb4d3fff640 1 -- 172.21.15.159:0/1421305066 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0004220 con 0x56259d48a320 2024-09-19T06:53:30.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4d3fff640 1 -- 172.21.15.159:0/1421305066 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4e00043c0 con 0x56259d48a320 2024-09-19T06:53:30.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4d3fff640 1 -- 172.21.15.159:0/1421305066 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00035f0 con 0x56259d48a320 2024-09-19T06:53:30.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4f31f8740 1 -- 172.21.15.159:0/1421305066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d48a320 msgr2=0x56259d48cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/1421305066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d48a320 0x56259d48cc50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x56259d492db0 tx=0x7fb4e000a310 comp rx=0 tx=0).stop 2024-09-19T06:53:30.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4f31f8740 1 -- 172.21.15.159:0/1421305066 shutdown_connections 2024-09-19T06:53:30.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/1421305066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d494be0 0x56259d4abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/1421305066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d48a320 0x56259d48cc50 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/1421305066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 0x56259d4a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4f31f8740 1 -- 172.21.15.159:0/1421305066 >> 172.21.15.159:0/1421305066 conn(0x56259d485f90 msgr2=0x56259d48c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.710+0000 7fb4f31f8740 1 -- 172.21.15.159:0/1421305066 shutdown_connections 2024-09-19T06:53:30.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.711+0000 7fb4f31f8740 1 -- 172.21.15.159:0/1421305066 wait complete. 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.711+0000 7fb4f31f8740 1 -- start start 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.711+0000 7fb4f31f8740 1 Processor -- start 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.711+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 0x56259d49d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.711+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 0x56259d4987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.711+0000 7fb4f31f8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d494be0 0x56259d498f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1ac690 con 0x56259d494be0 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1adb00 con 0x56259d48a320 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4f31f8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1acd60 con 0x56259d489a00 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4f31f8740 10 client.0 _ll_register_callbacks cb 0x7fb4dc00dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ead9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d494be0 0x56259d498f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ead9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d494be0 0x56259d498f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60122/0 (socket says 172.21.15.159:60122) 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ea59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 0x56259d49d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ead9d640 1 -- 172.21.15.159:0/3150801690 learned_addr learned my addr 172.21.15.159:0/3150801690 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4e9d9b640 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 0x56259d4987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ead9d640 1 -- 172.21.15.159:0/3150801690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 msgr2=0x56259d49d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ead9d640 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 0x56259d49d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ead9d640 1 -- 172.21.15.159:0/3150801690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 msgr2=0x56259d4987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ead9d640 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 0x56259d4987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ead9d640 1 -- 172.21.15.159:0/3150801690 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56259d50dfb0 con 0x56259d494be0 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 0x56259d49d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4ead9d640 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d494be0 0x56259d498f60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4003e70 tx=0x7fb4e402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dbc372128d2e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/3150801690 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4004540 con 0x56259d494be0 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/3150801690 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fb4e40046e0 con 0x56259d494be0 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.712+0000 7fb4f31f8740 1 -- 172.21.15.159:0/3150801690 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4e00043c0 con 0x56259d494be0 2024-09-19T06:53:30.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/3150801690 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4e402f610 con 0x56259d494be0 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4f31f8740 10 client.16929 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4f31f8740 1 -- 172.21.15.159:0/3150801690 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56259d50f1b0 con 0x56259d494be0 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/3150801690 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4e00043c0 con 0x56259d494be0 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/3150801690 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb4e405c070 con 0x56259d494be0 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4f31f8740 10 client.16929 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4f31f8740 10 client.16929 resolve_mds: validated gid 24487 aka daemon mds.i 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4f31f8740 20 client.16929 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56259d4a4460 0x56259d5118f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4f31f8740 4 client.16929 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4f31f8740 1 -- 172.21.15.159:0/3150801690 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x56259d3f5c80 con 0x56259d4a4460 2024-09-19T06:53:30.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.713+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56259d4a4460 0x56259d5118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.714+0000 7fb4d1ffb640 10 client.16929 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.714+0000 7fb4ea59c640 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56259d4a4460 0x56259d5118f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c82e4d420eee78e7 server_cookie=a166e1b04d3cff9f in_seq=0 out_seq=0 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.714+0000 7fb4d1ffb640 1 -- 172.21.15.159:0/3150801690 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x56259d3f5c80 con 0x56259d4a4460 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.714+0000 7fb4d1ffb640 10 client.16929 handle_command_reply: tid=0 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.714+0000 7fb4f31f8740 1 client.16929 shutdown 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 -- 172.21.15.159:0/3150801690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d494be0 msgr2=0x56259d498f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d494be0 0x56259d498f60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4003e70 tx=0x7fb4e402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 -- 172.21.15.159:0/3150801690 shutdown_connections 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56259d4a4460 0x56259d5118f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56259d494be0 0x56259d498f60 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56259d48a320 0x56259d4987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 --2- 172.21.15.159:0/3150801690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56259d489a00 0x56259d49d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 -- 172.21.15.159:0/3150801690 >> 172.21.15.159:0/3150801690 conn(0x56259d485f90 msgr2=0x56259d48cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4d1ffb640 0 client.16929 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 -- 172.21.15.159:0/3150801690 shutdown_connections 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 1 -- 172.21.15.159:0/3150801690 wait complete. 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.715+0000 7fb4f31f8740 20 client.16929 trim_cache size 0 max 16384 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 24, 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stdout: "leader": 24487, 2024-09-19T06:53:30.720 INFO:teuthology.orchestra.run.smithi159.stdout: "set_version": 24, 2024-09-19T06:53:30.721 INFO:teuthology.orchestra.run.smithi159.stdout: "sets": {} 2024-09-19T06:53:30.721 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:53:30.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb4d40a33b0 msgr2=0x7fb4d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb4d40a33b0 0x7fb4d40a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009bf0 tx=0x7fb4e4005ef0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec101de0 msgr2=0x7fb4ec1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec101de0 0x7fb4ec1983f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00d770 tx=0x7fb4dc00dc30 comp rx=0 tx=0).stop 2024-09-19T06:53:30.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/4003653465 shutdown_connections 2024-09-19T06:53:30.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb4d40a33b0 0x7fb4d40a5870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4ec106f10 0x7fb4ec19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4ec102790 0x7fb4ec198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 --2- 172.21.15.159:0/4003653465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ec101de0 0x7fb4ec1983f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/4003653465 >> 172.21.15.159:0/4003653465 conn(0x7fb4ec0fd8c0 msgr2=0x7fb4ec0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/4003653465 shutdown_connections 2024-09-19T06:53:30.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:30.716+0000 7fb4f0e1f640 1 -- 172.21.15.159:0/4003653465 wait complete. 2024-09-19T06:53:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:30 smithi203 ceph-mon[35473]: pgmap v200: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 555 op/s 2024-09-19T06:53:31.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:30 smithi189 ceph-mon[34880]: pgmap v200: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 555 op/s 2024-09-19T06:53:31.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:30 smithi159 ceph-mon[30935]: pgmap v200: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 555 op/s 2024-09-19T06:53:31.188 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:53:31.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:53:31.427 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T06:53:31.427 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T06:53:31.439 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T06:53:31.447 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T06:53:31.458 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T06:53:31.458 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:53:31.458 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T06:53:31.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T06:53:31.462 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:31.491 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T06:53:31.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 -- 172.21.15.159:0/181091583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102570 msgr2=0x7feda41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 --2- 172.21.15.159:0/181091583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102570 0x7feda41029b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fed94009900 tx=0x7fed9402a480 comp rx=0 tx=0).stop 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 -- 172.21.15.159:0/181091583 shutdown_connections 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 --2- 172.21.15.159:0/181091583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda4102ef0 0x7feda410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 --2- 172.21.15.159:0/181091583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102570 0x7feda41029b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 --2- 172.21.15.159:0/181091583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feda4100e20 0x7feda4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 -- 172.21.15.159:0/181091583 >> 172.21.15.159:0/181091583 conn(0x7feda40fc7d0 msgr2=0x7feda40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 -- 172.21.15.159:0/181091583 shutdown_connections 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 -- 172.21.15.159:0/181091583 wait complete. 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 Processor -- start 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.946+0000 7fedaba86640 1 -- start start 2024-09-19T06:53:31.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaba86640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda4100e20 0x7feda40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaba86640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feda4102570 0x7feda40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaba86640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102ef0 0x7feda40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaba86640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feda4110fc0 con 0x7feda4102ef0 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaba86640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feda4110e40 con 0x7feda4102570 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaba86640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feda4111140 con 0x7feda4100e20 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaa023640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102ef0 0x7feda40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaa023640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102ef0 0x7feda40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60138/0 (socket says 172.21.15.159:60138) 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaa023640 1 -- 172.21.15.159:0/732397353 learned_addr learned my addr 172.21.15.159:0/732397353 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7feda9822640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda4100e20 0x7feda40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7feda9021640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feda4102570 0x7feda40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaa023640 1 -- 172.21.15.159:0/732397353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda4100e20 msgr2=0x7feda40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaa023640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda4100e20 0x7feda40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaa023640 1 -- 172.21.15.159:0/732397353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feda4102570 msgr2=0x7feda40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaa023640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feda4102570 0x7feda40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaa023640 1 -- 172.21.15.159:0/732397353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda41a6a40 con 0x7feda4102ef0 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7feda9021640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feda4102570 0x7feda40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fedaa023640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102ef0 0x7feda40fd700 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00eaa0 tx=0x7fed9c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.947+0000 7fed9affd640 1 -- 172.21.15.159:0/732397353 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c004d20 con 0x7feda4102ef0 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.948+0000 7fed9affd640 1 -- 172.21.15.159:0/732397353 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed9c005020 con 0x7feda4102ef0 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.948+0000 7fedaba86640 1 -- 172.21.15.159:0/732397353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda41a6d30 con 0x7feda4102ef0 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.948+0000 7fed9affd640 1 -- 172.21.15.159:0/732397353 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0116d0 con 0x7feda4102ef0 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.948+0000 7fedaba86640 1 -- 172.21.15.159:0/732397353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda41a7270 con 0x7feda4102ef0 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.950+0000 7fed9affd640 1 -- 172.21.15.159:0/732397353 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fed9c0051d0 con 0x7feda4102ef0 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.950+0000 7fedade5f740 1 Processor -- start 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.950+0000 7fedade5f740 1 -- start start 2024-09-19T06:53:31.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.950+0000 7fedade5f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6349b60 0x55bfb6349f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.950+0000 7fedade5f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 0x55bfb6354800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.950+0000 7fedade5f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6354d40 0x55bfb6357130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.950+0000 7fedade5f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55bfb62af280 con 0x55bfb6349b60 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.950+0000 7fedade5f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bfb6256b10 con 0x55bfb6354d40 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.950+0000 7fedade5f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bfb62ab240 con 0x55bfb634a480 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6349b60 0x55bfb6349f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7fed9affd640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fed900a33b0 0x7fed900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6349b60 0x55bfb6349f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60140/0 (socket says 172.21.15.159:60140) 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 -- 172.21.15.159:0/1500961210 learned_addr learned my addr 172.21.15.159:0/1500961210 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9822640 1 --2- 172.21.15.159:0/1500961210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 0x55bfb6354800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7fedaa023640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fed900a33b0 0x7fed900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 --2- 172.21.15.159:0/1500961210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6354d40 0x55bfb6357130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7fed9affd640 1 -- 172.21.15.159:0/732397353 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fed9c0cff80 con 0x7feda4102ef0 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 -- 172.21.15.159:0/1500961210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 msgr2=0x55bfb6354800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 --2- 172.21.15.159:0/1500961210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 0x55bfb6354800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 -- 172.21.15.159:0/1500961210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6354d40 msgr2=0x55bfb6357130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 --2- 172.21.15.159:0/1500961210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6354d40 0x55bfb6357130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 -- 172.21.15.159:0/1500961210 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfb62631f0 con 0x55bfb6349b60 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7feda9021640 1 --2- 172.21.15.159:0/1500961210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6349b60 0x55bfb6349f40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fed94005940 tx=0x7fed94005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21124451e8784f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7fedaa023640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fed900a33b0 0x7fed900a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0cd750 tx=0x7fed9c06f060 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7fed8ffff640 1 -- 172.21.15.159:0/1500961210 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94043020 con 0x55bfb6349b60 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7fed8ffff640 1 -- 172.21.15.159:0/1500961210 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed94004ba0 con 0x55bfb6349b60 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.951+0000 7fed8ffff640 1 -- 172.21.15.159:0/1500961210 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94035070 con 0x55bfb6349b60 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 -- 172.21.15.159:0/1500961210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6349b60 msgr2=0x55bfb6349f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 --2- 172.21.15.159:0/1500961210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6349b60 0x55bfb6349f40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fed94005940 tx=0x7fed94005bd0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 -- 172.21.15.159:0/1500961210 shutdown_connections 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 --2- 172.21.15.159:0/1500961210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6354d40 0x55bfb6357130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 --2- 172.21.15.159:0/1500961210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 0x55bfb6354800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 --2- 172.21.15.159:0/1500961210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6349b60 0x55bfb6349f40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 -- 172.21.15.159:0/1500961210 >> 172.21.15.159:0/1500961210 conn(0x55bfb63460f0 msgr2=0x55bfb63464d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 -- 172.21.15.159:0/1500961210 shutdown_connections 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 -- 172.21.15.159:0/1500961210 wait complete. 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.952+0000 7fedade5f740 1 -- start start 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7fedade5f740 1 Processor -- start 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7fedade5f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 0x55bfb6351c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7fedade5f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 0x55bfb63521b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7fedade5f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6354d40 0x55bfb63526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7fedade5f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55bfb6357910 con 0x55bfb6354d40 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7fedade5f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bfb6269f10 con 0x55bfb634a480 2024-09-19T06:53:31.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7fedade5f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bfb6357a90 con 0x55bfb6349b60 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7fedade5f740 10 client.0 _ll_register_callbacks cb 0x55bfb6232a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9021640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6354d40 0x55bfb63526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9021640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6354d40 0x55bfb63526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60148/0 (socket says 172.21.15.159:60148) 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9021640 1 -- 172.21.15.159:0/834410574 learned_addr learned my addr 172.21.15.159:0/834410574 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9822640 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 0x55bfb63521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9021640 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 0x55bfb6351c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9021640 1 -- 172.21.15.159:0/834410574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 msgr2=0x55bfb6351c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9021640 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 0x55bfb6351c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9021640 1 -- 172.21.15.159:0/834410574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 msgr2=0x55bfb63521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9021640 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 0x55bfb63521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9021640 1 -- 172.21.15.159:0/834410574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfb60206a0 con 0x55bfb6354d40 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.953+0000 7feda9822640 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 0x55bfb63521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:31.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7feda9021640 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6354d40 0x55bfb63526f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fed94000c00 tx=0x7fed940035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278aa657e13387a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fed8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fed8d7fa640 1 -- 172.21.15.159:0/834410574 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94035030 con 0x55bfb6354d40 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fed8d7fa640 1 -- 172.21.15.159:0/834410574 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fed940036d0 con 0x55bfb6354d40 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fedade5f740 1 -- 172.21.15.159:0/834410574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed94004ba0 con 0x55bfb6354d40 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fed8d7fa640 1 -- 172.21.15.159:0/834410574 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed94043070 con 0x55bfb6354d40 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fedade5f740 10 client.16941 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fedade5f740 1 -- 172.21.15.159:0/834410574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bfb6363550 con 0x55bfb6354d40 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fed8d7fa640 1 -- 172.21.15.159:0/834410574 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed94004ba0 con 0x55bfb6354d40 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fed8d7fa640 1 -- 172.21.15.159:0/834410574 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fed940319b0 con 0x55bfb6354d40 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fedade5f740 10 client.16941 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fedade5f740 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fedade5f740 20 client.16941 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:31.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fedade5f740 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bfb63648a0 0x55bfb6366c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fedade5f740 4 client.16941 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.954+0000 7fedade5f740 1 -- 172.21.15.159:0/834410574 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfb62bc7f0 con 0x55bfb63648a0 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.955+0000 7feda9822640 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bfb63648a0 0x55bfb6366c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.955+0000 7fed8d7fa640 10 client.16941 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.955+0000 7feda9822640 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bfb63648a0 0x55bfb6366c90 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaad52df0785d451 server_cookie=17b05e66194a9a7 in_seq=0 out_seq=0 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fed8d7fa640 1 -- 172.21.15.159:0/834410574 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfb62bc7f0 con 0x55bfb63648a0 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fed8d7fa640 10 client.16941 handle_command_reply: tid=0 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 client.16941 shutdown 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 -- 172.21.15.159:0/834410574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6354d40 msgr2=0x55bfb63526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6354d40 0x55bfb63526f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fed94000c00 tx=0x7fed940035f0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 -- 172.21.15.159:0/834410574 shutdown_connections 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bfb63648a0 0x55bfb6366c90 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb6354d40 0x55bfb63526f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 0x55bfb63521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 --2- 172.21.15.159:0/834410574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 0x55bfb6351c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fed8d7fa640 0 client.16941 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:31.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 -- 172.21.15.159:0/834410574 >> 172.21.15.159:0/834410574 conn(0x55bfb63460f0 msgr2=0x55bfb634be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 -- 172.21.15.159:0/834410574 shutdown_connections 2024-09-19T06:53:31.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 1 -- 172.21.15.159:0/834410574 wait complete. 2024-09-19T06:53:31.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.956+0000 7fedade5f740 20 client.16941 trim_cache size 0 max 16384 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7fedade5f740 1 Processor -- start 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7fedade5f740 1 -- start start 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7fedade5f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb634c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7fedade5f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 0x55bfb6353ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7fedade5f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 0x55bfb636c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7fedade5f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feda41adab0 con 0x55bfb63460f0 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7fedade5f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feda41b0330 con 0x55bfb634a480 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7fedade5f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feda41ae120 con 0x55bfb6349b60 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9021640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb634c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9021640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb634c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60152/0 (socket says 172.21.15.159:60152) 2024-09-19T06:53:31.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9021640 1 -- 172.21.15.159:0/68157074 learned_addr learned my addr 172.21.15.159:0/68157074 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9822640 1 --2- 172.21.15.159:0/68157074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 0x55bfb6353ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9021640 1 -- 172.21.15.159:0/68157074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 msgr2=0x55bfb6353ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9021640 1 --2- 172.21.15.159:0/68157074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 0x55bfb6353ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9021640 1 -- 172.21.15.159:0/68157074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 msgr2=0x55bfb636c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9021640 1 --2- 172.21.15.159:0/68157074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 0x55bfb636c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9021640 1 -- 172.21.15.159:0/68157074 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfb63501c0 con 0x55bfb63460f0 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.974+0000 7feda9021640 1 --2- 172.21.15.159:0/68157074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb634c5c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fed9402a9a0 tx=0x7fed94005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2874fc3d0ee4cd6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fed8f7fe640 1 -- 172.21.15.159:0/68157074 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9405b020 con 0x55bfb63460f0 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fed8f7fe640 1 -- 172.21.15.159:0/68157074 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed94009780 con 0x55bfb63460f0 2024-09-19T06:53:31.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fed8f7fe640 1 -- 172.21.15.159:0/68157074 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94035070 con 0x55bfb63460f0 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fedade5f740 1 -- 172.21.15.159:0/68157074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 msgr2=0x55bfb634c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fedade5f740 1 --2- 172.21.15.159:0/68157074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb634c5c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fed9402a9a0 tx=0x7fed94005c00 comp rx=0 tx=0).stop 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fedade5f740 1 -- 172.21.15.159:0/68157074 shutdown_connections 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fedade5f740 1 --2- 172.21.15.159:0/68157074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb634a480 0x55bfb636c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fedade5f740 1 --2- 172.21.15.159:0/68157074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb6349b60 0x55bfb6353ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fedade5f740 1 --2- 172.21.15.159:0/68157074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb634c5c0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fedade5f740 1 -- 172.21.15.159:0/68157074 >> 172.21.15.159:0/68157074 conn(0x55bfb634d660 msgr2=0x55bfb63533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fedade5f740 1 -- 172.21.15.159:0/68157074 shutdown_connections 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.975+0000 7fedade5f740 1 -- 172.21.15.159:0/68157074 wait complete. 2024-09-19T06:53:31.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7fedade5f740 1 -- start start 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7fedade5f740 1 Processor -- start 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7fedade5f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb6358d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7fedade5f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6349b60 0x55bfb6359280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7fedade5f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 0x55bfb6359800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7fedade5f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feda41ae7f0 con 0x55bfb63460f0 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7fedade5f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feda41afc60 con 0x55bfb6349b60 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7fedade5f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feda41aeec0 con 0x55bfb634a480 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7fedade5f740 10 client.0 _ll_register_callbacks cb 0x7feda00093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7feda9021640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb6358d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7feda9021640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb6358d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60168/0 (socket says 172.21.15.159:60168) 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.976+0000 7feda9021640 1 -- 172.21.15.159:0/603799842 learned_addr learned my addr 172.21.15.159:0/603799842 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7feda9822640 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6349b60 0x55bfb6359280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7feda9021640 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 0x55bfb6359800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7feda9021640 1 -- 172.21.15.159:0/603799842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 msgr2=0x55bfb6359800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7feda9021640 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 0x55bfb6359800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7feda9021640 1 -- 172.21.15.159:0/603799842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6349b60 msgr2=0x55bfb6359280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7feda9021640 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6349b60 0x55bfb6359280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7feda9021640 1 -- 172.21.15.159:0/603799842 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfb63ce4f0 con 0x55bfb63460f0 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7feda9822640 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6349b60 0x55bfb6359280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7feda9021640 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb6358d40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fed94031ef0 tx=0x7fed9403da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34819e3e817272b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7fed8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7fed8d7fa640 1 -- 172.21.15.159:0/603799842 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9405b030 con 0x55bfb63460f0 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7fed8d7fa640 1 -- 172.21.15.159:0/603799842 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7fed94004ca0 con 0x55bfb63460f0 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7fedade5f740 1 -- 172.21.15.159:0/603799842 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed94009780 con 0x55bfb63460f0 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7fed8d7fa640 1 -- 172.21.15.159:0/603799842 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed94035040 con 0x55bfb63460f0 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7fedade5f740 10 client.16947 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:31.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7fedade5f740 1 -- 172.21.15.159:0/603799842 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bfb63cf830 con 0x55bfb63460f0 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.977+0000 7fed8d7fa640 1 -- 172.21.15.159:0/603799842 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed94009780 con 0x55bfb63460f0 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7fed8d7fa640 1 -- 172.21.15.159:0/603799842 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fed94069030 con 0x55bfb63460f0 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7fedade5f740 10 client.16947 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7fedade5f740 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7fedade5f740 20 client.16947 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7fedade5f740 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bfb6354d40 0x55bfb63d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7fedade5f740 4 client.16947 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7fedade5f740 1 -- 172.21.15.159:0/603799842 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bfb62b6d00 con 0x55bfb6354d40 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7feda9822640 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bfb6354d40 0x55bfb63d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7feda9822640 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bfb6354d40 0x55bfb63d1df0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8347088c4bea6eab server_cookie=9222c2ad07ad2e73 in_seq=0 out_seq=0 2024-09-19T06:53:31.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.978+0000 7fed8d7fa640 10 client.16947 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:31.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fed8d7fa640 1 -- 172.21.15.159:0/603799842 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bfb62b6d00 con 0x55bfb6354d40 2024-09-19T06:53:31.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fed8d7fa640 10 client.16947 handle_command_reply: tid=0 2024-09-19T06:53:31.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fedade5f740 1 client.16947 shutdown 2024-09-19T06:53:31.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fedade5f740 1 -- 172.21.15.159:0/603799842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 msgr2=0x55bfb6358d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fedade5f740 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb6358d40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fed94031ef0 tx=0x7fed9403da50 comp rx=0 tx=0).stop 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fedade5f740 1 -- 172.21.15.159:0/603799842 shutdown_connections 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fedade5f740 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55bfb6354d40 0x55bfb63d1df0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fedade5f740 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfb634a480 0x55bfb6359800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fedade5f740 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bfb6349b60 0x55bfb6359280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fed8d7fa640 0 client.16947 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fedade5f740 1 --2- 172.21.15.159:0/603799842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bfb63460f0 0x55bfb6358d40 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.979+0000 7fedade5f740 1 -- 172.21.15.159:0/603799842 >> 172.21.15.159:0/603799842 conn(0x55bfb634d660 msgr2=0x55bfb6345270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedade5f740 1 -- 172.21.15.159:0/603799842 shutdown_connections 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedade5f740 1 -- 172.21.15.159:0/603799842 wait complete. 2024-09-19T06:53:31.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedade5f740 20 client.16947 trim_cache size 0 max 16384 2024-09-19T06:53:31.986 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:53:31.986 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:53:31.986 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "6ad9b931-07f4-4688-950f-a1d6990cadd5", 2024-09-19T06:53:31.986 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:53:31.986 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:53:31.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 -- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fed900a33b0 msgr2=0x7fed900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fed900a33b0 0x7fed900a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0cd750 tx=0x7fed9c06f060 comp rx=0 tx=0).stop 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 -- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102ef0 msgr2=0x7feda40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102ef0 0x7feda40fd700 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00eaa0 tx=0x7fed9c00eea0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 -- 172.21.15.159:0/732397353 shutdown_connections 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fed900a33b0 0x7fed900a5870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4102ef0 0x7feda40fd700 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feda4102570 0x7feda40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 --2- 172.21.15.159:0/732397353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda4100e20 0x7feda40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 -- 172.21.15.159:0/732397353 >> 172.21.15.159:0/732397353 conn(0x7feda40fc7d0 msgr2=0x7feda406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 -- 172.21.15.159:0/732397353 shutdown_connections 2024-09-19T06:53:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:31.980+0000 7fedaba86640 1 -- 172.21.15.159:0/732397353 wait complete. 2024-09-19T06:53:32.699 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:53:32.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:32 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:53:32.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:32 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:32.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:32 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:53:32.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:32 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:32 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:53:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:32 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:32 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:53:32.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:32 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:32.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:32 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:53:32.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:32 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:32.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:32 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:53:32.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:32 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:32.949 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:33.749 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:33 smithi159 ceph-mon[30935]: pgmap v201: 97 pgs: 97 active+clean; 76 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 583 op/s 2024-09-19T06:53:33.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.833+0000 7f48e280d640 1 -- 172.21.15.159:0/1023256647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 msgr2=0x7f48dc101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:33.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.833+0000 7f48e280d640 1 --2- 172.21.15.159:0/1023256647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 0x7f48dc101600 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009900 tx=0x7f48c402a410 comp rx=0 tx=0).stop 2024-09-19T06:53:33.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 -- 172.21.15.159:0/1023256647 shutdown_connections 2024-09-19T06:53:33.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 --2- 172.21.15.159:0/1023256647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48dc101b40 0x7f48dc10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 --2- 172.21.15.159:0/1023256647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 0x7f48dc101600 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 --2- 172.21.15.159:0/1023256647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48dc106c30 0x7f48dc107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 -- 172.21.15.159:0/1023256647 >> 172.21.15.159:0/1023256647 conn(0x7f48dc077210 msgr2=0x7f48dc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:33.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 -- 172.21.15.159:0/1023256647 shutdown_connections 2024-09-19T06:53:33.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 -- 172.21.15.159:0/1023256647 wait complete. 2024-09-19T06:53:33.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 Processor -- start 2024-09-19T06:53:33.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 -- start start 2024-09-19T06:53:33.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 0x7f48dc0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48dc101b40 0x7f48dc0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48dc106c30 0x7f48dc0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc111040 con 0x7f48dc1011a0 2024-09-19T06:53:33.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc110ec0 con 0x7f48dc106c30 2024-09-19T06:53:33.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.834+0000 7f48e280d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1111c0 con 0x7f48dc101b40 2024-09-19T06:53:33.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48dbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 0x7f48dc0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48dbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 0x7f48dc0fc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60186/0 (socket says 172.21.15.159:60186) 2024-09-19T06:53:33.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48dbfff640 1 -- 172.21.15.159:0/1131912670 learned_addr learned my addr 172.21.15.159:0/1131912670 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:33.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48d3fff640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48dc101b40 0x7f48dc0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48e0daa640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48dc106c30 0x7f48dc0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48dbfff640 1 -- 172.21.15.159:0/1131912670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48dc101b40 msgr2=0x7f48dc0fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:33.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48dbfff640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48dc101b40 0x7f48dc0fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48dbfff640 1 -- 172.21.15.159:0/1131912670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48dc106c30 msgr2=0x7f48dc0fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48dbfff640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48dc106c30 0x7f48dc0fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48dbfff640 1 -- 172.21.15.159:0/1131912670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc1a6b30 con 0x7f48dc1011a0 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48d3fff640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48dc101b40 0x7f48dc0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48dbfff640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 0x7f48dc0fc690 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00b4a0 tx=0x7f48cc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48d9ffb640 1 -- 172.21.15.159:0/1131912670 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc014070 con 0x7f48dc1011a0 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48e280d640 1 -- 172.21.15.159:0/1131912670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc1a6e20 con 0x7f48dc1011a0 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48d9ffb640 1 -- 172.21.15.159:0/1131912670 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48cc010af0 con 0x7f48dc1011a0 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48d9ffb640 1 -- 172.21.15.159:0/1131912670 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc017d10 con 0x7f48dc1011a0 2024-09-19T06:53:33.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.835+0000 7f48e280d640 1 -- 172.21.15.159:0/1131912670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48dc1a7320 con 0x7f48dc1011a0 2024-09-19T06:53:33.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:33 smithi203 ceph-mon[35473]: pgmap v201: 97 pgs: 97 active+clean; 76 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 583 op/s 2024-09-19T06:53:33.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.837+0000 7f48d9ffb640 1 -- 172.21.15.159:0/1131912670 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f48cc017070 con 0x7f48dc1011a0 2024-09-19T06:53:33.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e4be6740 1 Processor -- start 2024-09-19T06:53:33.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e4be6740 1 -- start start 2024-09-19T06:53:33.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eee4a0 0x5610f1eee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1ef9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1ef9680 0x5610f1efba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e4be6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5610f1e542e0 con 0x5610f1eee4a0 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e4be6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5610f1dfbce0 con 0x5610f1ef9680 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e4be6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5610f1e502a0 con 0x5610f1eeedc0 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48d9ffb640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48c80a33b0 0x7f48c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e0daa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eee4a0 0x5610f1eee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e0daa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eee4a0 0x5610f1eee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60202/0 (socket says 172.21.15.159:60202) 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.838+0000 7f48e0daa640 1 -- 172.21.15.159:0/1573932569 learned_addr learned my addr 172.21.15.159:0/1573932569 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48e0daa640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48c80a33b0 0x7f48c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48dbfff640 1 --2- 172.21.15.159:0/1573932569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1ef9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48d3fff640 1 --2- 172.21.15.159:0/1573932569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1ef9680 0x5610f1efba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48d9ffb640 1 -- 172.21.15.159:0/1131912670 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f48cc0cf050 con 0x7f48dc1011a0 2024-09-19T06:53:33.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48e0daa640 1 -- 172.21.15.159:0/1573932569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 msgr2=0x5610f1ef9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:33.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48e0daa640 1 --2- 172.21.15.159:0/1573932569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1ef9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48e0daa640 1 -- 172.21.15.159:0/1573932569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1ef9680 msgr2=0x5610f1efba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:33.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48e0daa640 1 --2- 172.21.15.159:0/1573932569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1ef9680 0x5610f1efba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48e0daa640 1 -- 172.21.15.159:0/1573932569 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f1de0440 con 0x5610f1eee4a0 2024-09-19T06:53:33.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48e0daa640 1 --2- 172.21.15.159:0/1573932569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eee4a0 0x5610f1eee880 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f48d400af30 tx=0x7f48d4016700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae24427764811cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:33.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48e0daa640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48c80a33b0 0x7f48c80a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009fd0 tx=0x7f48d401a000 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:33.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48d27fc640 1 -- 172.21.15.159:0/1573932569 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4026070 con 0x5610f1eee4a0 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48d27fc640 1 -- 172.21.15.159:0/1573932569 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48d4009c80 con 0x5610f1eee4a0 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.839+0000 7f48d27fc640 1 -- 172.21.15.159:0/1573932569 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4013040 con 0x5610f1eee4a0 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 -- 172.21.15.159:0/1573932569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eee4a0 msgr2=0x5610f1eee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1573932569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eee4a0 0x5610f1eee880 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f48d400af30 tx=0x7f48d4016700 comp rx=0 tx=0).stop 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 -- 172.21.15.159:0/1573932569 shutdown_connections 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1573932569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1ef9680 0x5610f1efba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1573932569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1ef9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1573932569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eee4a0 0x5610f1eee880 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 -- 172.21.15.159:0/1573932569 >> 172.21.15.159:0/1573932569 conn(0x5610f1eeaa30 msgr2=0x5610f1eeae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 -- 172.21.15.159:0/1573932569 shutdown_connections 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 -- 172.21.15.159:0/1573932569 wait complete. 2024-09-19T06:53:33.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.840+0000 7f48e4be6740 1 -- start start 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48e4be6740 1 Processor -- start 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1ef8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eeedc0 0x5610f1ef6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1ef9680 0x5610f1ef6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48e4be6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5610f1efc250 con 0x5610f1eeedc0 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48e4be6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5610f1e0f050 con 0x5610f1eee4a0 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48e4be6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5610f1efc3d0 con 0x5610f1ef9680 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48e4be6740 10 client.0 _ll_register_callbacks cb 0x5610f1e4f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eeedc0 0x5610f1ef6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48d3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eeedc0 0x5610f1ef6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60210/0 (socket says 172.21.15.159:60210) 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48d3fff640 1 -- 172.21.15.159:0/1996725473 learned_addr learned my addr 172.21.15.159:0/1996725473 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48dbfff640 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1ef8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48e0daa640 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1ef9680 0x5610f1ef6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48d3fff640 1 -- 172.21.15.159:0/1996725473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1ef9680 msgr2=0x5610f1ef6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48d3fff640 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1ef9680 0x5610f1ef6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48d3fff640 1 -- 172.21.15.159:0/1996725473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 msgr2=0x5610f1ef8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48d3fff640 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1ef8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.841+0000 7f48d3fff640 1 -- 172.21.15.159:0/1996725473 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f1bc53c0 con 0x5610f1eeedc0 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48d3fff640 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eeedc0 0x5610f1ef6250 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f48c402a930 tx=0x7f48c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ac6ef1609fb952 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:33.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48bb7fe640 1 -- 172.21.15.159:0/1996725473 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4035070 con 0x5610f1eeedc0 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48bb7fe640 1 -- 172.21.15.159:0/1996725473 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f48c4005220 con 0x5610f1eeedc0 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48e4be6740 1 -- 172.21.15.159:0/1996725473 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48d4009c80 con 0x5610f1eeedc0 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48bb7fe640 1 -- 172.21.15.159:0/1996725473 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f48c4005d50 con 0x5610f1eeedc0 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48e4be6740 10 client.16959 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48e4be6740 1 -- 172.21.15.159:0/1996725473 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5610f1f07bd0 con 0x5610f1eeedc0 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48bb7fe640 1 -- 172.21.15.159:0/1996725473 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48d4009c80 con 0x5610f1eeedc0 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48bb7fe640 1 -- 172.21.15.159:0/1996725473 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f48c404b070 con 0x5610f1eeedc0 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48e4be6740 10 client.16959 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48e4be6740 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48e4be6740 20 client.16959 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610f1f09090 0x5610f1f0b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48e4be6740 4 client.16959 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.842+0000 7f48e4be6740 1 -- 172.21.15.159:0/1996725473 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610f1e61850 con 0x5610f1f09090 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.843+0000 7f48dbfff640 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610f1f09090 0x5610f1f0b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.843+0000 7f48dbfff640 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610f1f09090 0x5610f1f0b4d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47c6a6e7e6d64749 server_cookie=44dce2a7efd6c9cc in_seq=0 out_seq=0 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.843+0000 7f48bb7fe640 10 client.16959 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48bb7fe640 1 -- 172.21.15.159:0/1996725473 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610f1e61850 con 0x5610f1f09090 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48bb7fe640 10 client.16959 handle_command_reply: tid=0 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 client.16959 shutdown 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 -- 172.21.15.159:0/1996725473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eeedc0 msgr2=0x5610f1ef6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eeedc0 0x5610f1ef6250 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f48c402a930 tx=0x7f48c40042f0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 -- 172.21.15.159:0/1996725473 shutdown_connections 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610f1f09090 0x5610f1f0b4d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1ef9680 0x5610f1ef6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1eeedc0 0x5610f1ef6250 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 --2- 172.21.15.159:0/1996725473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1ef8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 -- 172.21.15.159:0/1996725473 >> 172.21.15.159:0/1996725473 conn(0x5610f1eeaa30 msgr2=0x5610f1ef0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48bb7fe640 0 client.16959 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 -- 172.21.15.159:0/1996725473 shutdown_connections 2024-09-19T06:53:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 1 -- 172.21.15.159:0/1996725473 wait complete. 2024-09-19T06:53:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.844+0000 7f48e4be6740 20 client.16959 trim_cache size 0 max 16384 2024-09-19T06:53:33.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e4be6740 1 Processor -- start 2024-09-19T06:53:33.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e4be6740 1 -- start start 2024-09-19T06:53:33.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1f054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1f10da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1f112e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e4be6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1adbe0 con 0x5610f1ef9680 2024-09-19T06:53:33.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e4be6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1b0460 con 0x5610f1eee4a0 2024-09-19T06:53:33.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e4be6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1ae250 con 0x5610f1eeedc0 2024-09-19T06:53:33.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e0daa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1f112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e0daa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1f112e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60226/0 (socket says 172.21.15.159:60226) 2024-09-19T06:53:33.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e0daa640 1 -- 172.21.15.159:0/154528349 learned_addr learned my addr 172.21.15.159:0/154528349 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:33.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48d3fff640 1 --2- 172.21.15.159:0/154528349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1f10da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48dbfff640 1 --2- 172.21.15.159:0/154528349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1f054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e0daa640 1 -- 172.21.15.159:0/154528349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 msgr2=0x5610f1f10da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:33.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e0daa640 1 --2- 172.21.15.159:0/154528349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1f10da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e0daa640 1 -- 172.21.15.159:0/154528349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 msgr2=0x5610f1f054b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:33.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e0daa640 1 --2- 172.21.15.159:0/154528349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1f054b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.861+0000 7f48e0daa640 1 -- 172.21.15.159:0/154528349 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f1ef47a0 con 0x5610f1ef9680 2024-09-19T06:53:33.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48e0daa640 1 --2- 172.21.15.159:0/154528349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1f112e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f48d400add0 tx=0x7f48d400a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a01c52a2c687c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:33.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48d1ffb640 1 -- 172.21.15.159:0/154528349 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4026040 con 0x5610f1ef9680 2024-09-19T06:53:33.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48d1ffb640 1 -- 172.21.15.159:0/154528349 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48d4019c50 con 0x5610f1ef9680 2024-09-19T06:53:33.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48d1ffb640 1 -- 172.21.15.159:0/154528349 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d402bc30 con 0x5610f1ef9680 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48e4be6740 1 -- 172.21.15.159:0/154528349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 msgr2=0x5610f1f112e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48e4be6740 1 --2- 172.21.15.159:0/154528349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1f112e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f48d400add0 tx=0x7f48d400a6e0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48e4be6740 1 -- 172.21.15.159:0/154528349 shutdown_connections 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48e4be6740 1 --2- 172.21.15.159:0/154528349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1f112e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48e4be6740 1 --2- 172.21.15.159:0/154528349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1f10da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48e4be6740 1 --2- 172.21.15.159:0/154528349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1f054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.862+0000 7f48e4be6740 1 -- 172.21.15.159:0/154528349 >> 172.21.15.159:0/154528349 conn(0x5610f1eeaa30 msgr2=0x5610f1ef5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 -- 172.21.15.159:0/154528349 shutdown_connections 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 -- 172.21.15.159:0/154528349 wait complete. 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 -- start start 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 Processor -- start 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1f01b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1efce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1efd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1ae920 con 0x5610f1ef9680 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1afd90 con 0x5610f1eee4a0 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1aeff0 con 0x5610f1eeedc0 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.863+0000 7f48e4be6740 10 client.0 _ll_register_callbacks cb 0x7f48c4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e0daa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1efd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e0daa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1efd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60240/0 (socket says 172.21.15.159:60240) 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e0daa640 1 -- 172.21.15.159:0/764368960 learned_addr learned my addr 172.21.15.159:0/764368960 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48d3fff640 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1efce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48dbfff640 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1f01b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e0daa640 1 -- 172.21.15.159:0/764368960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 msgr2=0x5610f1efce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e0daa640 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1efce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e0daa640 1 -- 172.21.15.159:0/764368960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 msgr2=0x5610f1f01b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e0daa640 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1f01b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e0daa640 1 -- 172.21.15.159:0/764368960 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f1efd9b0 con 0x5610f1ef9680 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48dbfff640 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1f01b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e0daa640 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1efd3c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f48d400a560 tx=0x7f48d4019f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8101935418dae227 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48bb7fe640 1 -- 172.21.15.159:0/764368960 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4038030 con 0x5610f1ef9680 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48bb7fe640 1 -- 172.21.15.159:0/764368960 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f48d400a880 con 0x5610f1ef9680 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e4be6740 1 -- 172.21.15.159:0/764368960 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48d4019c50 con 0x5610f1ef9680 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48bb7fe640 1 -- 172.21.15.159:0/764368960 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f48d4026040 con 0x5610f1ef9680 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e4be6740 10 client.16965 fetch_fsmap learned FSMap version 24 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.864+0000 7f48e4be6740 1 -- 172.21.15.159:0/764368960 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5610f1f73b60 con 0x5610f1ef9680 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48bb7fe640 1 -- 172.21.15.159:0/764368960 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48d4019c50 con 0x5610f1ef9680 2024-09-19T06:53:33.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48bb7fe640 1 -- 172.21.15.159:0/764368960 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f48d4021570 con 0x5610f1ef9680 2024-09-19T06:53:33.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48e4be6740 10 client.16965 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:53:33.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48e4be6740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:53:33.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48e4be6740 20 client.16965 populate_metadata read hostname 'smithi159' 2024-09-19T06:53:33.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48e4be6740 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610f1f74080 0x5610f1f76470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:33.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48e4be6740 4 client.16965 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:53:33.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48e4be6740 1 -- 172.21.15.159:0/764368960 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5610f1e5bd60 con 0x5610f1f74080 2024-09-19T06:53:33.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48dbfff640 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610f1f74080 0x5610f1f76470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:33.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48dbfff640 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610f1f74080 0x5610f1f76470 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=170ab078a165059e server_cookie=314d4e30cf5f76e in_seq=0 out_seq=0 2024-09-19T06:53:33.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.865+0000 7f48bb7fe640 10 client.16965 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48bb7fe640 1 -- 172.21.15.159:0/764368960 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5610f1e5bd60 con 0x5610f1f74080 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48bb7fe640 10 client.16965 handle_command_reply: tid=0 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 client.16965 shutdown 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 -- 172.21.15.159:0/764368960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 msgr2=0x5610f1efd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1efd3c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f48d400a560 tx=0x7f48d4019f10 comp rx=0 tx=0).stop 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 -- 172.21.15.159:0/764368960 shutdown_connections 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5610f1f74080 0x5610f1f76470 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5610f1ef9680 0x5610f1efd3c0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5610f1eeedc0 0x5610f1efce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48bb7fe640 0 client.16965 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 --2- 172.21.15.159:0/764368960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610f1eee4a0 0x5610f1f01b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 -- 172.21.15.159:0/764368960 >> 172.21.15.159:0/764368960 conn(0x5610f1eeaa30 msgr2=0x5610f1ef7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:33.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 -- 172.21.15.159:0/764368960 shutdown_connections 2024-09-19T06:53:33.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 1 -- 172.21.15.159:0/764368960 wait complete. 2024-09-19T06:53:33.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e4be6740 20 client.16965 trim_cache size 0 max 16384 2024-09-19T06:53:33.875 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:53:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:53:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:53:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "6ad9b931-07f4-4688-950f-a1d6990cadd5": { 2024-09-19T06:53:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:53:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "6ad9b931-07f4-4688-950f-a1d6990cadd5", 2024-09-19T06:53:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:53:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:53:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:53:33.876 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:53:33.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e280d640 1 -- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48c80a33b0 msgr2=0x7f48c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:33.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e280d640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48c80a33b0 0x7f48c80a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009fd0 tx=0x7f48d401a000 comp rx=0 tx=0).stop 2024-09-19T06:53:33.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e280d640 1 -- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 msgr2=0x7f48dc0fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:33.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e280d640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 0x7f48dc0fc690 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00b4a0 tx=0x7f48cc00b960 comp rx=0 tx=0).stop 2024-09-19T06:53:33.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.866+0000 7f48e280d640 1 -- 172.21.15.159:0/1131912670 shutdown_connections 2024-09-19T06:53:33.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.867+0000 7f48e280d640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f48c80a33b0 0x7f48c80a5870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.867+0000 7f48e280d640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48dc106c30 0x7f48dc0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.867+0000 7f48e280d640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48dc101b40 0x7f48dc0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.867+0000 7f48e280d640 1 --2- 172.21.15.159:0/1131912670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48dc1011a0 0x7f48dc0fc690 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:33.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.867+0000 7f48e280d640 1 -- 172.21.15.159:0/1131912670 >> 172.21.15.159:0/1131912670 conn(0x7f48dc077210 msgr2=0x7f48dc100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:33.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.867+0000 7f48e280d640 1 -- 172.21.15.159:0/1131912670 shutdown_connections 2024-09-19T06:53:33.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:53:33.867+0000 7f48e280d640 1 -- 172.21.15.159:0/1131912670 wait complete. 2024-09-19T06:53:33.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:33 smithi189 ceph-mon[34880]: pgmap v201: 97 pgs: 97 active+clean; 76 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 583 op/s 2024-09-19T06:53:34.618 INFO:tasks.cephfs.filesystem:scrub status for tag:6ad9b931-07f4-4688-950f-a1d6990cadd5 - {'path': '/', 'tag': '6ad9b931-07f4-4688-950f-a1d6990cadd5', 'options': 'recursive,force'} 2024-09-19T06:53:34.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:34 smithi159 ceph-mon[30935]: pgmap v202: 97 pgs: 97 active+clean; 76 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 421 op/s 2024-09-19T06:53:35.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:34 smithi203 ceph-mon[35473]: pgmap v202: 97 pgs: 97 active+clean; 76 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 421 op/s 2024-09-19T06:53:35.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:34 smithi189 ceph-mon[34880]: pgmap v202: 97 pgs: 97 active+clean; 76 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 421 op/s 2024-09-19T06:53:36.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:35 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:53:36.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:35 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:53:36.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:35 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:53:37.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:36 smithi203 ceph-mon[35473]: pgmap v203: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 425 op/s 2024-09-19T06:53:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:36 smithi189 ceph-mon[34880]: pgmap v203: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 425 op/s 2024-09-19T06:53:37.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:36 smithi159 ceph-mon[30935]: pgmap v203: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 425 op/s 2024-09-19T06:53:39.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:38 smithi203 ceph-mon[35473]: pgmap v204: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 26 KiB/s wr, 31 op/s 2024-09-19T06:53:39.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:38 smithi189 ceph-mon[34880]: pgmap v204: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 26 KiB/s wr, 31 op/s 2024-09-19T06:53:39.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:38 smithi159 ceph-mon[30935]: pgmap v204: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 26 KiB/s wr, 31 op/s 2024-09-19T06:53:41.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:40 smithi203 ceph-mon[35473]: pgmap v205: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 26 KiB/s wr, 31 op/s 2024-09-19T06:53:41.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:40 smithi189 ceph-mon[34880]: pgmap v205: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 26 KiB/s wr, 31 op/s 2024-09-19T06:53:41.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:40 smithi159 ceph-mon[30935]: pgmap v205: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 26 KiB/s wr, 31 op/s 2024-09-19T06:53:43.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:42 smithi203 ceph-mon[35473]: pgmap v206: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 26 KiB/s wr, 33 op/s 2024-09-19T06:53:43.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:42 smithi189 ceph-mon[34880]: pgmap v206: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 26 KiB/s wr, 33 op/s 2024-09-19T06:53:43.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:42 smithi159 ceph-mon[30935]: pgmap v206: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 26 KiB/s wr, 33 op/s 2024-09-19T06:53:45.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:44 smithi203 ceph-mon[35473]: pgmap v207: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-09-19T06:53:45.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:44 smithi189 ceph-mon[34880]: pgmap v207: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-09-19T06:53:45.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:44 smithi159 ceph-mon[30935]: pgmap v207: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-09-19T06:53:47.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:46 smithi203 ceph-mon[35473]: pgmap v208: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 7 op/s 2024-09-19T06:53:47.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:46 smithi189 ceph-mon[34880]: pgmap v208: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 7 op/s 2024-09-19T06:53:47.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:46 smithi159 ceph-mon[30935]: pgmap v208: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 7 op/s 2024-09-19T06:53:49.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:48 smithi203 ceph-mon[35473]: pgmap v209: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-09-19T06:53:49.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:48 smithi189 ceph-mon[34880]: pgmap v209: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-09-19T06:53:49.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:48 smithi159 ceph-mon[30935]: pgmap v209: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-09-19T06:53:51.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:50 smithi203 ceph-mon[35473]: pgmap v210: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-09-19T06:53:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:50 smithi189 ceph-mon[34880]: pgmap v210: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-09-19T06:53:51.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:50 smithi159 ceph-mon[30935]: pgmap v210: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-09-19T06:53:53.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:52 smithi203 ceph-mon[35473]: pgmap v211: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.4 KiB/s wr, 4 op/s 2024-09-19T06:53:53.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:52 smithi189 ceph-mon[34880]: pgmap v211: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.4 KiB/s wr, 4 op/s 2024-09-19T06:53:53.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:52 smithi159 ceph-mon[30935]: pgmap v211: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.4 KiB/s wr, 4 op/s 2024-09-19T06:53:55.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:54 smithi203 ceph-mon[35473]: pgmap v212: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.3 KiB/s wr, 2 op/s 2024-09-19T06:53:55.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:54 smithi189 ceph-mon[34880]: pgmap v212: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.3 KiB/s wr, 2 op/s 2024-09-19T06:53:55.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:54 smithi159 ceph-mon[30935]: pgmap v212: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.3 KiB/s wr, 2 op/s 2024-09-19T06:53:57.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:56 smithi203 ceph-mon[35473]: pgmap v213: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-19T06:53:57.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:56 smithi189 ceph-mon[34880]: pgmap v213: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-19T06:53:57.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:56 smithi159 ceph-mon[30935]: pgmap v213: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-19T06:53:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:53:58 smithi203 ceph-mon[35473]: pgmap v214: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:53:59.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:53:58 smithi189 ceph-mon[34880]: pgmap v214: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:53:59.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:53:58 smithi159 ceph-mon[30935]: pgmap v214: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:54:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:00 smithi203 ceph-mon[35473]: pgmap v215: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:54:01.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:00 smithi189 ceph-mon[34880]: pgmap v215: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:54:01.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:00 smithi159 ceph-mon[30935]: pgmap v215: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:54:03.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:02 smithi203 ceph-mon[35473]: pgmap v216: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:54:03.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:02 smithi189 ceph-mon[34880]: pgmap v216: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:54:03.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:02 smithi159 ceph-mon[30935]: pgmap v216: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:54:04.619 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:54:04.886 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:04.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:04 smithi159 ceph-mon[30935]: pgmap v217: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:54:05.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:04 smithi203 ceph-mon[35473]: pgmap v217: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:54:05.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:04 smithi189 ceph-mon[34880]: pgmap v217: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:54:05.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 -- 172.21.15.159:0/3256919519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4101e10 msgr2=0x7f67f41021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 --2- 172.21.15.159:0/3256919519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4101e10 0x7f67f41021f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009900 tx=0x7f67e402a410 comp rx=0 tx=0).stop 2024-09-19T06:54:05.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 -- 172.21.15.159:0/3256919519 shutdown_connections 2024-09-19T06:54:05.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 --2- 172.21.15.159:0/3256919519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f4106f40 0x7f67f410eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 --2- 172.21.15.159:0/3256919519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67f41027c0 0x7f67f4106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 --2- 172.21.15.159:0/3256919519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4101e10 0x7f67f41021f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 -- 172.21.15.159:0/3256919519 >> 172.21.15.159:0/3256919519 conn(0x7f67f40fd8d0 msgr2=0x7f67f40ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 -- 172.21.15.159:0/3256919519 shutdown_connections 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 -- 172.21.15.159:0/3256919519 wait complete. 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.517+0000 7f67f99a7640 1 Processor -- start 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f99a7640 1 -- start start 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f99a7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f4101e10 0x7f67f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f99a7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67f41027c0 0x7f67f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f99a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4106f40 0x7f67f4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f99a7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4111fa0 con 0x7f67f4106f40 2024-09-19T06:54:05.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f99a7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4111e20 con 0x7f67f4101e10 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f99a7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4112120 con 0x7f67f41027c0 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f37fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4106f40 0x7f67f4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f37fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4106f40 0x7f67f4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54128/0 (socket says 172.21.15.159:54128) 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f37fe640 1 -- 172.21.15.159:0/2175614122 learned_addr learned my addr 172.21.15.159:0/2175614122 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f27fc640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67f41027c0 0x7f67f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f4101e10 0x7f67f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f37fe640 1 -- 172.21.15.159:0/2175614122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67f41027c0 msgr2=0x7f67f4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f37fe640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67f41027c0 0x7f67f4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f37fe640 1 -- 172.21.15.159:0/2175614122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f4101e10 msgr2=0x7f67f40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f37fe640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f4101e10 0x7f67f40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.518+0000 7f67f37fe640 1 -- 172.21.15.159:0/2175614122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f41a6800 con 0x7f67f4106f40 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.519+0000 7f67f37fe640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4106f40 0x7f67f4074f70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00cce0 tx=0x7f67ec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:05.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.519+0000 7f67f89a5640 1 -- 172.21.15.159:0/2175614122 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec00f450 con 0x7f67f4106f40 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.519+0000 7f67f89a5640 1 -- 172.21.15.159:0/2175614122 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67ec00fad0 con 0x7f67f4106f40 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.519+0000 7f67f99a7640 1 -- 172.21.15.159:0/2175614122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f41a6af0 con 0x7f67f4106f40 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.519+0000 7f67f89a5640 1 -- 172.21.15.159:0/2175614122 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec018b60 con 0x7f67f4106f40 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.519+0000 7f67f99a7640 1 -- 172.21.15.159:0/2175614122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f41a7030 con 0x7f67f4106f40 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.521+0000 7f67f89a5640 1 -- 172.21.15.159:0/2175614122 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f67ec00fc80 con 0x7f67f4106f40 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.521+0000 7f67fbd80740 1 Processor -- start 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.521+0000 7f67fbd80740 1 -- start start 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 0x56073b281880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 0x56073b28c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b28c680 0x56073b28ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67fbd80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56073b1e72e0 con 0x56073b28c680 2024-09-19T06:54:05.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67fbd80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56073b18ece0 con 0x56073b2814a0 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67fbd80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56073b1e32a0 con 0x56073b281dc0 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b28c680 0x56073b28ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b28c680 0x56073b28ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54142/0 (socket says 172.21.15.159:54142) 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f27fc640 1 -- 172.21.15.159:0/2869562844 learned_addr learned my addr 172.21.15.159:0/2869562844 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f27fc640 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 0x56073b281880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 0x56073b28c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f89a5640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67e00a3430 0x7f67e00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f37fe640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67e00a3430 0x7f67e00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f27fc640 1 -- 172.21.15.159:0/2869562844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 msgr2=0x56073b28c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f27fc640 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 0x56073b28c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f27fc640 1 -- 172.21.15.159:0/2869562844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 msgr2=0x56073b281880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:05.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f27fc640 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 0x56073b281880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f27fc640 1 -- 172.21.15.159:0/2869562844 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56073b173440 con 0x56073b28c680 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f89a5640 1 -- 172.21.15.159:0/2175614122 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f67ec0d0180 con 0x7f67f4106f40 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.522+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 0x56073b28c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.523+0000 7f67f27fc640 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b28c680 0x56073b28ea70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0117e0 tx=0x7f67dc00a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcae76b71144e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.523+0000 7f67e9ffb640 1 -- 172.21.15.159:0/2869562844 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc011e20 con 0x56073b28c680 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.523+0000 7f67f37fe640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67e00a3430 0x7f67e00a58f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0cdea0 tx=0x7f67ec0918c0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.523+0000 7f67e9ffb640 1 -- 172.21.15.159:0/2869562844 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67dc005020 con 0x56073b28c680 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.523+0000 7f67e9ffb640 1 -- 172.21.15.159:0/2869562844 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc004ac0 con 0x56073b28c680 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 -- 172.21.15.159:0/2869562844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b28c680 msgr2=0x56073b28ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b28c680 0x56073b28ea70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0117e0 tx=0x7f67dc00a760 comp rx=0 tx=0).stop 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 -- 172.21.15.159:0/2869562844 shutdown_connections 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b28c680 0x56073b28ea70 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 0x56073b28c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 --2- 172.21.15.159:0/2869562844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 0x56073b281880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 -- 172.21.15.159:0/2869562844 >> 172.21.15.159:0/2869562844 conn(0x56073b27da30 msgr2=0x56073b27de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 -- 172.21.15.159:0/2869562844 shutdown_connections 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 -- 172.21.15.159:0/2869562844 wait complete. 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 -- start start 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.524+0000 7f67fbd80740 1 Processor -- start 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 0x56073b28c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b281dc0 0x56073b289310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 0x56073b2898e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67fbd80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56073b28f250 con 0x56073b281dc0 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67fbd80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56073b1a2050 con 0x56073b2814a0 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67fbd80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56073b28f3d0 con 0x56073b28c680 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67fbd80740 10 client.0 _ll_register_callbacks cb 0x56073b1e2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:05.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f2ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b281dc0 0x56073b289310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f2ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b281dc0 0x56073b289310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54148/0 (socket says 172.21.15.159:54148) 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f2ffd640 1 -- 172.21.15.159:0/4220741760 learned_addr learned my addr 172.21.15.159:0/4220741760 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f27fc640 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 0x56073b28c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f27fc640 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 0x56073b2898e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f2ffd640 1 -- 172.21.15.159:0/4220741760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 msgr2=0x56073b2898e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 0x56073b2898e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f2ffd640 1 -- 172.21.15.159:0/4220741760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 msgr2=0x56073b28c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 0x56073b28c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f2ffd640 1 -- 172.21.15.159:0/4220741760 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56073af583c0 con 0x56073b281dc0 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f27fc640 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 0x56073b2898e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b281dc0 0x56073b289310 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f67e4031550 tx=0x7f67e4031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e116e4ef47c8331b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:05.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.525+0000 7f67d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67d2ffd640 1 -- 172.21.15.159:0/4220741760 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4035070 con 0x56073b281dc0 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67d2ffd640 1 -- 172.21.15.159:0/4220741760 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f67e4005020 con 0x56073b281dc0 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67fbd80740 1 -- 172.21.15.159:0/4220741760 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67dc005020 con 0x56073b281dc0 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67d2ffd640 1 -- 172.21.15.159:0/4220741760 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f67e4005d50 con 0x56073b281dc0 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67fbd80740 10 client.16977 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67fbd80740 1 -- 172.21.15.159:0/4220741760 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56073b29acc0 con 0x56073b281dc0 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67d2ffd640 1 -- 172.21.15.159:0/4220741760 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67dc005020 con 0x56073b281dc0 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67d2ffd640 1 -- 172.21.15.159:0/4220741760 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f67e40036c0 con 0x56073b281dc0 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67fbd80740 10 client.16977 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67fbd80740 10 client.16977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67fbd80740 20 client.16977 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67fbd80740 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56073b29c180 0x56073b29e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67fbd80740 4 client.16977 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67fbd80740 1 -- 172.21.15.159:0/4220741760 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56073b1f4850 con 0x56073b29c180 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.526+0000 7f67f27fc640 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56073b29c180 0x56073b29e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.527+0000 7f67f27fc640 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56073b29c180 0x56073b29e5e0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aa1021d96a260d4 server_cookie=5ca5da70a6ba5d4c in_seq=0 out_seq=0 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.527+0000 7f67d2ffd640 10 client.16977 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.527+0000 7f67d2ffd640 1 -- 172.21.15.159:0/4220741760 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56073b1f4850 con 0x56073b29c180 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67d2ffd640 10 client.16977 handle_command_reply: tid=0 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 client.16977 shutdown 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 -- 172.21.15.159:0/4220741760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b281dc0 msgr2=0x56073b289310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b281dc0 0x56073b289310 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f67e4031550 tx=0x7f67e4031b60 comp rx=0 tx=0).stop 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 -- 172.21.15.159:0/4220741760 shutdown_connections 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56073b29c180 0x56073b29e5e0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 0x56073b2898e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b281dc0 0x56073b289310 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 --2- 172.21.15.159:0/4220741760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b2814a0 0x56073b28c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 -- 172.21.15.159:0/4220741760 >> 172.21.15.159:0/4220741760 conn(0x56073b27da30 msgr2=0x56073b283710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:05.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67d2ffd640 0 client.16977 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:05.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 -- 172.21.15.159:0/4220741760 shutdown_connections 2024-09-19T06:54:05.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 1 -- 172.21.15.159:0/4220741760 wait complete. 2024-09-19T06:54:05.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.528+0000 7f67fbd80740 20 client.16977 trim_cache size 0 max 16384 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67fbd80740 1 Processor -- start 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67fbd80740 1 -- start start 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b2984e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b281dc0 0x56073b2a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 0x56073b2a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67fbd80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41ad970 con 0x56073b2814a0 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67fbd80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41b01f0 con 0x56073b281dc0 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67fbd80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41adfe0 con 0x56073b28c680 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67f27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b2984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67f27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b2984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54162/0 (socket says 172.21.15.159:54162) 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67f27fc640 1 -- 172.21.15.159:0/955495692 learned_addr learned my addr 172.21.15.159:0/955495692 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/955495692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b281dc0 0x56073b2a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.545+0000 7f67f27fc640 1 --2- 172.21.15.159:0/955495692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 0x56073b2a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.546+0000 7f67f27fc640 1 -- 172.21.15.159:0/955495692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 msgr2=0x56073b2a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.546+0000 7f67f27fc640 1 --2- 172.21.15.159:0/955495692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 0x56073b2a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.546+0000 7f67f27fc640 1 -- 172.21.15.159:0/955495692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b281dc0 msgr2=0x56073b2a3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.546+0000 7f67f27fc640 1 --2- 172.21.15.159:0/955495692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b281dc0 0x56073b2a3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.546+0000 7f67f27fc640 1 -- 172.21.15.159:0/955495692 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56073b28c3d0 con 0x56073b2814a0 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.546+0000 7f67f27fc640 1 --2- 172.21.15.159:0/955495692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b2984e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0117b0 tx=0x7f67dc01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c3a84753adb1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.546+0000 7f67e97fa640 1 -- 172.21.15.159:0/955495692 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc011040 con 0x56073b2814a0 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.546+0000 7f67e97fa640 1 -- 172.21.15.159:0/955495692 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67dc0111e0 con 0x56073b2814a0 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.546+0000 7f67e97fa640 1 -- 172.21.15.159:0/955495692 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc004660 con 0x56073b2814a0 2024-09-19T06:54:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 -- 172.21.15.159:0/955495692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 msgr2=0x56073b2984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 --2- 172.21.15.159:0/955495692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b2984e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0117b0 tx=0x7f67dc01a040 comp rx=0 tx=0).stop 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 -- 172.21.15.159:0/955495692 shutdown_connections 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 --2- 172.21.15.159:0/955495692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b28c680 0x56073b2a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 --2- 172.21.15.159:0/955495692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b281dc0 0x56073b2a3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 --2- 172.21.15.159:0/955495692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b2984e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 -- 172.21.15.159:0/955495692 >> 172.21.15.159:0/955495692 conn(0x56073b27da30 msgr2=0x56073b284900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 -- 172.21.15.159:0/955495692 shutdown_connections 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 -- 172.21.15.159:0/955495692 wait complete. 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 -- start start 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.547+0000 7f67fbd80740 1 Processor -- start 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b294e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 0x56073b2860d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67fbd80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b28c680 0x56073b286650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67fbd80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41ae6b0 con 0x56073b2814a0 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67fbd80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41afb20 con 0x56073b28c680 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67fbd80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41aed80 con 0x56073b281dc0 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b294e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b294e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54168/0 (socket says 172.21.15.159:54168) 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 -- 172.21.15.159:0/878703791 learned_addr learned my addr 172.21.15.159:0/878703791 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67fbd80740 10 client.0 _ll_register_callbacks cb 0x7f67e4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 0x56073b2860d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b28c680 0x56073b286650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 -- 172.21.15.159:0/878703791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 msgr2=0x56073b2860d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 0x56073b2860d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 -- 172.21.15.159:0/878703791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b28c680 msgr2=0x56073b286650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b28c680 0x56073b286650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 -- 172.21.15.159:0/878703791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56073b286e80 con 0x56073b2814a0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67f27fc640 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b294e40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0111b0 tx=0x7f67dc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3071139cddb9b75f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.548+0000 7f67d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67d2ffd640 1 -- 172.21.15.159:0/878703791 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00fbd0 con 0x56073b2814a0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67d2ffd640 1 -- 172.21.15.159:0/878703791 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f67dc01e470 con 0x56073b2814a0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67fbd80740 1 -- 172.21.15.159:0/878703791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67dc0111e0 con 0x56073b2814a0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67d2ffd640 1 -- 172.21.15.159:0/878703791 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f67dc039050 con 0x56073b2814a0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67fbd80740 10 client.16983 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67fbd80740 1 -- 172.21.15.159:0/878703791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56073b306f10 con 0x56073b2814a0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67d2ffd640 1 -- 172.21.15.159:0/878703791 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67dc0111e0 con 0x56073b2814a0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67d2ffd640 1 -- 172.21.15.159:0/878703791 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f67dc0283c0 con 0x56073b2814a0 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67fbd80740 10 client.16983 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67fbd80740 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67fbd80740 20 client.16983 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67fbd80740 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56073b307340 0x56073b309730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67fbd80740 4 client.16983 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.549+0000 7f67fbd80740 1 -- 172.21.15.159:0/878703791 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56073b1eed60 con 0x56073b307340 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56073b307340 0x56073b309730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67d2ffd640 10 client.16983 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67f2ffd640 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56073b307340 0x56073b309730 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed0355deb7eb7311 server_cookie=8591c587b439c438 in_seq=0 out_seq=0 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67d2ffd640 1 -- 172.21.15.159:0/878703791 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56073b1eed60 con 0x56073b307340 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67d2ffd640 10 client.16983 handle_command_reply: tid=0 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67fbd80740 1 client.16983 shutdown 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67fbd80740 1 -- 172.21.15.159:0/878703791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 msgr2=0x56073b294e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67fbd80740 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b294e40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0111b0 tx=0x7f67dc005850 comp rx=0 tx=0).stop 2024-09-19T06:54:05.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67fbd80740 1 -- 172.21.15.159:0/878703791 shutdown_connections 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67fbd80740 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56073b307340 0x56073b309730 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67fbd80740 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56073b28c680 0x56073b286650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67d2ffd640 0 client.16983 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67fbd80740 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56073b281dc0 0x56073b2860d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67fbd80740 1 --2- 172.21.15.159:0/878703791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56073b2814a0 0x56073b294e40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.550+0000 7f67fbd80740 1 -- 172.21.15.159:0/878703791 >> 172.21.15.159:0/878703791 conn(0x56073b27da30 msgr2=0x56073b287ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67fbd80740 1 -- 172.21.15.159:0/878703791 shutdown_connections 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67fbd80740 1 -- 172.21.15.159:0/878703791 wait complete. 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67fbd80740 20 client.16983 trim_cache size 0 max 16384 2024-09-19T06:54:05.558 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:54:05.559 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:54:05.559 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:54:05.559 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:54:05.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 -- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67e00a3430 msgr2=0x7f67e00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67e00a3430 0x7f67e00a58f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0cdea0 tx=0x7f67ec0918c0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 -- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4106f40 msgr2=0x7f67f4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4106f40 0x7f67f4074f70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00cce0 tx=0x7f67ec00a620 comp rx=0 tx=0).stop 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 -- 172.21.15.159:0/2175614122 shutdown_connections 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f67e00a3430 0x7f67e00a58f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67f4106f40 0x7f67f4074f70 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67f41027c0 0x7f67f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 --2- 172.21.15.159:0/2175614122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f4101e10 0x7f67f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.551+0000 7f67f99a7640 1 -- 172.21.15.159:0/2175614122 >> 172.21.15.159:0/2175614122 conn(0x7f67f40fd8d0 msgr2=0x7f67f40ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.552+0000 7f67f99a7640 1 -- 172.21.15.159:0/2175614122 shutdown_connections 2024-09-19T06:54:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:05.552+0000 7f67f99a7640 1 -- 172.21.15.159:0/2175614122 wait complete. 2024-09-19T06:54:06.353 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:54:06.354 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:54:06.610 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:07.029 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:06 smithi159 ceph-mon[30935]: pgmap v218: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:54:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:06 smithi203 ceph-mon[35473]: pgmap v218: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:54:07.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:06 smithi189 ceph-mon[34880]: pgmap v218: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:54:07.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.107+0000 7f31d639a640 1 -- 172.21.15.159:0/564143707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 msgr2=0x7f31d010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.107+0000 7f31d639a640 1 --2- 172.21.15.159:0/564143707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 0x7f31d010ea90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009ca0 tx=0x7f31c802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.107+0000 7f31d639a640 1 -- 172.21.15.159:0/564143707 shutdown_connections 2024-09-19T06:54:07.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.107+0000 7f31d639a640 1 --2- 172.21.15.159:0/564143707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 0x7f31d010ea90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.107+0000 7f31d639a640 1 --2- 172.21.15.159:0/564143707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31d0102790 0x7f31d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.107+0000 7f31d639a640 1 --2- 172.21.15.159:0/564143707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d0101de0 0x7f31d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.107+0000 7f31d639a640 1 -- 172.21.15.159:0/564143707 >> 172.21.15.159:0/564143707 conn(0x7f31d00fd8c0 msgr2=0x7f31d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.107+0000 7f31d639a640 1 -- 172.21.15.159:0/564143707 shutdown_connections 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.107+0000 7f31d639a640 1 -- 172.21.15.159:0/564143707 wait complete. 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d639a640 1 Processor -- start 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d639a640 1 -- start start 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d639a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d0101de0 0x7f31d01985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d639a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31d0102790 0x7f31d0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d639a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 0x7f31d019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d639a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0112010 con 0x7f31d0106f10 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d639a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0111e90 con 0x7f31d0102790 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d639a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0112190 con 0x7f31d0101de0 2024-09-19T06:54:07.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d4937640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 0x7f31d019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d4937640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 0x7f31d019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54188/0 (socket says 172.21.15.159:54188) 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.108+0000 7f31d4937640 1 -- 172.21.15.159:0/4253788825 learned_addr learned my addr 172.21.15.159:0/4253788825 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31cffff640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d0101de0 0x7f31d01985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31cf7fe640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31d0102790 0x7f31d0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31d4937640 1 -- 172.21.15.159:0/4253788825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d0101de0 msgr2=0x7f31d01985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31d4937640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d0101de0 0x7f31d01985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31d4937640 1 -- 172.21.15.159:0/4253788825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31d0102790 msgr2=0x7f31d0198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31d4937640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31d0102790 0x7f31d0198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31d4937640 1 -- 172.21.15.159:0/4253788825 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d019d5a0 con 0x7f31d0106f10 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31cf7fe640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31d0102790 0x7f31d0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31d4937640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 0x7f31d019cec0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f31c8031a60 tx=0x7f31c8031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31cd7fa640 1 -- 172.21.15.159:0/4253788825 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8003b70 con 0x7f31d0106f10 2024-09-19T06:54:07.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31cd7fa640 1 -- 172.21.15.159:0/4253788825 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31c8003d10 con 0x7f31d0106f10 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d019d830 con 0x7f31d0106f10 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31cd7fa640 1 -- 172.21.15.159:0/4253788825 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8004770 con 0x7f31d0106f10 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.109+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d01a5170 con 0x7f31d0106f10 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.110+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d0102240 con 0x7f31d0106f10 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.111+0000 7f31cd7fa640 1 -- 172.21.15.159:0/4253788825 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f31c802f790 con 0x7f31d0106f10 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.112+0000 7f31cd7fa640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f31bc0a33b0 0x7f31bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.112+0000 7f31cffff640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f31bc0a33b0 0x7f31bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.112+0000 7f31cd7fa640 1 -- 172.21.15.159:0/4253788825 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f31c80f0f90 con 0x7f31d0106f10 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.113+0000 7f31cffff640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f31bc0a33b0 0x7f31bc0a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009990 tx=0x7f31c0009110 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.116+0000 7f31cd7fa640 1 -- 172.21.15.159:0/4253788825 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31c80bda50 con 0x7f31d0106f10 2024-09-19T06:54:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.316+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31d010a150 con 0x7f31d0106f10 2024-09-19T06:54:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.316+0000 7f31cd7fa640 1 -- 172.21.15.159:0/4253788825 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f31c80bd350 con 0x7f31d0106f10 2024-09-19T06:54:07.318 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:54:07.318 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:54:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f31bc0a33b0 msgr2=0x7f31bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f31bc0a33b0 0x7f31bc0a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009990 tx=0x7f31c0009110 comp rx=0 tx=0).stop 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 msgr2=0x7f31d019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 0x7f31d019cec0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f31c8031a60 tx=0x7f31c8031a90 comp rx=0 tx=0).stop 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 shutdown_connections 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f31bc0a33b0 0x7f31bc0a5870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31d0106f10 0x7f31d019cec0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31d0102790 0x7f31d0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 --2- 172.21.15.159:0/4253788825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d0101de0 0x7f31d01985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.318+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 >> 172.21.15.159:0/4253788825 conn(0x7f31d00fd8c0 msgr2=0x7f31d00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.319+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 shutdown_connections 2024-09-19T06:54:07.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:07.319+0000 7f31d639a640 1 -- 172.21.15.159:0/4253788825 wait complete. 2024-09-19T06:54:07.976 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:07 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/4253788825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:08.005 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:54:08.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:07 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/4253788825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:08.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:07 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/4253788825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:08.252 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:08.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.728+0000 7f6c34d23640 1 -- 172.21.15.159:0/2492102670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30103660 msgr2=0x7f6c3010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.728+0000 7f6c34d23640 1 --2- 172.21.15.159:0/2492102670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30103660 0x7f6c3010bb50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009900 tx=0x7f6c2402a480 comp rx=0 tx=0).stop 2024-09-19T06:54:08.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.728+0000 7f6c34d23640 1 -- 172.21.15.159:0/2492102670 shutdown_connections 2024-09-19T06:54:08.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.728+0000 7f6c34d23640 1 --2- 172.21.15.159:0/2492102670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c3010c170 0x7f6c3010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.728+0000 7f6c34d23640 1 --2- 172.21.15.159:0/2492102670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30103660 0x7f6c3010bb50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.728+0000 7f6c34d23640 1 --2- 172.21.15.159:0/2492102670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c30102d40 0x7f6c30103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.728+0000 7f6c34d23640 1 -- 172.21.15.159:0/2492102670 >> 172.21.15.159:0/2492102670 conn(0x7f6c300fc7a0 msgr2=0x7f6c300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:08.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.729+0000 7f6c34d23640 1 -- 172.21.15.159:0/2492102670 shutdown_connections 2024-09-19T06:54:08.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.729+0000 7f6c34d23640 1 -- 172.21.15.159:0/2492102670 wait complete. 2024-09-19T06:54:08.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.729+0000 7f6c34d23640 1 Processor -- start 2024-09-19T06:54:08.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.729+0000 7f6c34d23640 1 -- start start 2024-09-19T06:54:08.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.729+0000 7f6c34d23640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30102d40 0x7f6c301984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c34d23640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c30103660 0x7f6c301989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c34d23640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3010c170 0x7f6c3019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c34d23640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30111fb0 con 0x7f6c30102d40 2024-09-19T06:54:08.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c34d23640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30111e30 con 0x7f6c30103660 2024-09-19T06:54:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c34d23640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30112130 con 0x7f6c3010c170 2024-09-19T06:54:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30102d40 0x7f6c301984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30102d40 0x7f6c301984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54216/0 (socket says 172.21.15.159:54216) 2024-09-19T06:54:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2e59c640 1 -- 172.21.15.159:0/3525387764 learned_addr learned my addr 172.21.15.159:0/3525387764 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c30103660 0x7f6c301989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2ed9d640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3010c170 0x7f6c3019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2e59c640 1 -- 172.21.15.159:0/3525387764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3010c170 msgr2=0x7f6c3019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3010c170 0x7f6c3019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2e59c640 1 -- 172.21.15.159:0/3525387764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c30103660 msgr2=0x7f6c301989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c30103660 0x7f6c301989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2e59c640 1 -- 172.21.15.159:0/3525387764 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3019d460 con 0x7f6c30102d40 2024-09-19T06:54:08.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30102d40 0x7f6c301984b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000b4a0 tx=0x7f6c2000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:08.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c1f7fe640 1 -- 172.21.15.159:0/3525387764 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20014070 con 0x7f6c30102d40 2024-09-19T06:54:08.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c34d23640 1 -- 172.21.15.159:0/3525387764 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3019d750 con 0x7f6c30102d40 2024-09-19T06:54:08.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c1f7fe640 1 -- 172.21.15.159:0/3525387764 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c20010af0 con 0x7f6c30102d40 2024-09-19T06:54:08.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c1f7fe640 1 -- 172.21.15.159:0/3525387764 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20017d10 con 0x7f6c30102d40 2024-09-19T06:54:08.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.730+0000 7f6c34d23640 1 -- 172.21.15.159:0/3525387764 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c301a5030 con 0x7f6c30102d40 2024-09-19T06:54:08.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c370fc740 1 Processor -- start 2024-09-19T06:54:08.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c1f7fe640 1 -- 172.21.15.159:0/3525387764 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6c20017070 con 0x7f6c30102d40 2024-09-19T06:54:08.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c370fc740 1 -- start start 2024-09-19T06:54:08.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 0x5579f510f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f510fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f511c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c370fc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5579f50752f0 con 0x5579f511a370 2024-09-19T06:54:08.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c370fc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5579f501ccf0 con 0x5579f510f5d0 2024-09-19T06:54:08.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c370fc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5579f50712b0 con 0x5579f5110b40 2024-09-19T06:54:08.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c2dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f511c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c2dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f511c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54228/0 (socket says 172.21.15.159:54228) 2024-09-19T06:54:08.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.733+0000 7f6c2dd9b640 1 -- 172.21.15.159:0/3443725372 learned_addr learned my addr 172.21.15.159:0/3443725372 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:08.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2ed9d640 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 0x5579f510f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f510fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2dd9b640 1 -- 172.21.15.159:0/3443725372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 msgr2=0x5579f510f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:08.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 0x5579f510f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2dd9b640 1 -- 172.21.15.159:0/3443725372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 msgr2=0x5579f510fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:08.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f510fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2dd9b640 1 -- 172.21.15.159:0/3443725372 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f50013a0 con 0x5579f511a370 2024-09-19T06:54:08.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2ed9d640 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 0x5579f510f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:08.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f510fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c1f7fe640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6c180a33b0 0x7f6c180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2ed9d640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6c180a33b0 0x7f6c180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f511c760 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009900 tx=0x7f6c24005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63110093d63752ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c1f7fe640 1 -- 172.21.15.159:0/3525387764 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f6c200cf040 con 0x7f6c30102d40 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c1cff9640 1 -- 172.21.15.159:0/3443725372 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24040070 con 0x5579f511a370 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c1cff9640 1 -- 172.21.15.159:0/3443725372 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c240319f0 con 0x5579f511a370 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.734+0000 7f6c1cff9640 1 -- 172.21.15.159:0/3443725372 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24035040 con 0x5579f511a370 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c370fc740 1 -- 172.21.15.159:0/3443725372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 msgr2=0x5579f511c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c2ed9d640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6c180a33b0 0x7f6c180a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6c28005fd0 tx=0x7f6c28009580 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c370fc740 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f511c760 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009900 tx=0x7f6c24005e80 comp rx=0 tx=0).stop 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c370fc740 1 -- 172.21.15.159:0/3443725372 shutdown_connections 2024-09-19T06:54:08.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c370fc740 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f511c760 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c370fc740 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f510fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c370fc740 1 --2- 172.21.15.159:0/3443725372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 0x5579f510f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c370fc740 1 -- 172.21.15.159:0/3443725372 >> 172.21.15.159:0/3443725372 conn(0x5579f50d8310 msgr2=0x5579f510bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c370fc740 1 -- 172.21.15.159:0/3443725372 shutdown_connections 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.735+0000 7f6c370fc740 1 -- 172.21.15.159:0/3443725372 wait complete. 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c370fc740 1 -- start start 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c370fc740 1 Processor -- start 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f510f5d0 0x5579f5119ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f5110b40 0x5579f5116f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 0x5579f51174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c370fc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5579f511d010 con 0x5579f510f5d0 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c370fc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5579f5030060 con 0x5579f5110b40 2024-09-19T06:54:08.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c370fc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5579f511d190 con 0x5579f511a370 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c370fc740 10 client.0 _ll_register_callbacks cb 0x5579f4d838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f510f5d0 0x5579f5119ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f510f5d0 0x5579f5119ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54234/0 (socket says 172.21.15.159:54234) 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2e59c640 1 -- 172.21.15.159:0/4234909488 learned_addr learned my addr 172.21.15.159:0/4234909488 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2ed9d640 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 0x5579f51174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2e59c640 1 -- 172.21.15.159:0/4234909488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 msgr2=0x5579f51174f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 0x5579f51174f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2e59c640 1 -- 172.21.15.159:0/4234909488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f5110b40 msgr2=0x5579f5116f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f5110b40 0x5579f5116f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2e59c640 1 -- 172.21.15.159:0/4234909488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579f4de63c0 con 0x5579f510f5d0 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.736+0000 7f6c2ed9d640 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 0x5579f51174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f510f5d0 0x5579f5119ce0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000be60 tx=0x7f6c200977a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b0d933ac4730b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:08.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c15ffb640 1 -- 172.21.15.159:0/4234909488 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2001e070 con 0x5579f510f5d0 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c15ffb640 1 -- 172.21.15.159:0/4234909488 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f6c200cc9e0 con 0x5579f510f5d0 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c370fc740 1 -- 172.21.15.159:0/4234909488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c240319f0 con 0x5579f510f5d0 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c15ffb640 1 -- 172.21.15.159:0/4234909488 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6c2009bb00 con 0x5579f510f5d0 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c370fc740 10 client.17001 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c370fc740 1 -- 172.21.15.159:0/4234909488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5579f5128a20 con 0x5579f510f5d0 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c15ffb640 1 -- 172.21.15.159:0/4234909488 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c240319f0 con 0x5579f510f5d0 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c15ffb640 1 -- 172.21.15.159:0/4234909488 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f6c20097a70 con 0x5579f510f5d0 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c370fc740 10 client.17001 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:08.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c370fc740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c370fc740 20 client.17001 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c370fc740 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5579f5129e80 0x5579f512c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c370fc740 4 client.17001 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.737+0000 7f6c370fc740 1 -- 172.21.15.159:0/4234909488 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579f5082860 con 0x5579f5129e80 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.738+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5579f5129e80 0x5579f512c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.738+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5579f5129e80 0x5579f512c2d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1be32fabd11129fa server_cookie=e493d5bbb91e774c in_seq=0 out_seq=0 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.738+0000 7f6c15ffb640 10 client.17001 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c15ffb640 1 -- 172.21.15.159:0/4234909488 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5579f5082860 con 0x5579f5129e80 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c15ffb640 10 client.17001 handle_command_reply: tid=0 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 client.17001 shutdown 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 -- 172.21.15.159:0/4234909488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f510f5d0 msgr2=0x5579f5119ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f510f5d0 0x5579f5119ce0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000be60 tx=0x7f6c200977a0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 -- 172.21.15.159:0/4234909488 shutdown_connections 2024-09-19T06:54:08.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5579f5129e80 0x5579f512c2d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 0x5579f51174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f5110b40 0x5579f5116f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c15ffb640 0 client.17001 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:08.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 --2- 172.21.15.159:0/4234909488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f510f5d0 0x5579f5119ce0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 -- 172.21.15.159:0/4234909488 >> 172.21.15.159:0/4234909488 conn(0x5579f50d8310 msgr2=0x5579f5111960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:08.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 -- 172.21.15.159:0/4234909488 shutdown_connections 2024-09-19T06:54:08.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 1 -- 172.21.15.159:0/4234909488 wait complete. 2024-09-19T06:54:08.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.739+0000 7f6c370fc740 20 client.17001 trim_cache size 0 max 16384 2024-09-19T06:54:08.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c370fc740 1 Processor -- start 2024-09-19T06:54:08.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c370fc740 1 -- start start 2024-09-19T06:54:08.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5118f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 0x5579f5112120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f5112660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c370fc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301ab940 con 0x5579f511a370 2024-09-19T06:54:08.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c370fc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301ae1c0 con 0x5579f510f5d0 2024-09-19T06:54:08.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c370fc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301abfb0 con 0x5579f5110b40 2024-09-19T06:54:08.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c2ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f5112660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c2ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f5112660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54248/0 (socket says 172.21.15.159:54248) 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c2e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5118f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c2ed9d640 1 -- 172.21.15.159:0/3989607889 learned_addr learned my addr 172.21.15.159:0/3989607889 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.752+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/3989607889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 0x5579f5112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.753+0000 7f6c2e59c640 1 -- 172.21.15.159:0/3989607889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 msgr2=0x5579f5112120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.753+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/3989607889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 0x5579f5112120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.753+0000 7f6c2e59c640 1 -- 172.21.15.159:0/3989607889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 msgr2=0x5579f5112660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.753+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/3989607889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f5112660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.753+0000 7f6c2e59c640 1 -- 172.21.15.159:0/3989607889 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f5112ba0 con 0x5579f510f5d0 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.753+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/3989607889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5118f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c2009b100 tx=0x7f6c20097040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b1c04ef8ca14f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:08.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.753+0000 7f6c17fff640 1 -- 172.21.15.159:0/3989607889 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2001e070 con 0x5579f510f5d0 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.753+0000 7f6c17fff640 1 -- 172.21.15.159:0/3989607889 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c2009b400 con 0x5579f510f5d0 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.753+0000 7f6c17fff640 1 -- 172.21.15.159:0/3989607889 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c200cc950 con 0x5579f510f5d0 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 -- 172.21.15.159:0/3989607889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 msgr2=0x5579f5118f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 --2- 172.21.15.159:0/3989607889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5118f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c2009b100 tx=0x7f6c20097040 comp rx=0 tx=0).stop 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 -- 172.21.15.159:0/3989607889 shutdown_connections 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 --2- 172.21.15.159:0/3989607889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f511a370 0x5579f5112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 --2- 172.21.15.159:0/3989607889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5110b40 0x5579f5112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 --2- 172.21.15.159:0/3989607889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5118f00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 -- 172.21.15.159:0/3989607889 >> 172.21.15.159:0/3989607889 conn(0x5579f50d8310 msgr2=0x5579f51187f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 -- 172.21.15.159:0/3989607889 shutdown_connections 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 -- 172.21.15.159:0/3989607889 wait complete. 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 -- start start 2024-09-19T06:54:08.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 Processor -- start 2024-09-19T06:54:08.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5122420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f5110b40 0x5579f5122960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 0x5579f511f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301ac680 con 0x5579f5110b40 2024-09-19T06:54:08.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301adaf0 con 0x5579f510f5d0 2024-09-19T06:54:08.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301acd50 con 0x5579f511a370 2024-09-19T06:54:08.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.754+0000 7f6c370fc740 10 client.0 _ll_register_callbacks cb 0x7f6c2000b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:08.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f5110b40 0x5579f5122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f5110b40 0x5579f5122960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54262/0 (socket says 172.21.15.159:54262) 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2dd9b640 1 -- 172.21.15.159:0/2432831392 learned_addr learned my addr 172.21.15.159:0/2432831392 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2ed9d640 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 0x5579f511f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2dd9b640 1 -- 172.21.15.159:0/2432831392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 msgr2=0x5579f511f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 0x5579f511f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2dd9b640 1 -- 172.21.15.159:0/2432831392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 msgr2=0x5579f5122420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5122420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2dd9b640 1 -- 172.21.15.159:0/2432831392 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579f5122fa0 con 0x5579f5110b40 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5122420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c2dd9b640 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f5110b40 0x5579f5122960 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009900 tx=0x7f6c24005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423c548004af378a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:08.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c15ffb640 1 -- 172.21.15.159:0/2432831392 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24035070 con 0x5579f5110b40 2024-09-19T06:54:08.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c15ffb640 1 -- 172.21.15.159:0/2432831392 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8570+0+0 (secure 0 0 0) 0x7f6c24004240 con 0x5579f5110b40 2024-09-19T06:54:08.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c370fc740 1 -- 172.21.15.159:0/2432831392 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c2009b400 con 0x5579f5110b40 2024-09-19T06:54:08.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c15ffb640 1 -- 172.21.15.159:0/2432831392 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6c2405b050 con 0x5579f5110b40 2024-09-19T06:54:08.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c370fc740 10 client.17007 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:08.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.755+0000 7f6c370fc740 1 -- 172.21.15.159:0/2432831392 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5579f5199560 con 0x5579f5110b40 2024-09-19T06:54:08.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c15ffb640 1 -- 172.21.15.159:0/2432831392 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c2009b400 con 0x5579f5110b40 2024-09-19T06:54:08.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c15ffb640 1 -- 172.21.15.159:0/2432831392 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f6c2404c330 con 0x5579f5110b40 2024-09-19T06:54:08.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c370fc740 10 client.17007 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:08.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c370fc740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:08.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c370fc740 20 client.17007 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:08.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c370fc740 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5579f5199960 0x5579f519bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c370fc740 4 client.17007 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:54:08.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c370fc740 1 -- 172.21.15.159:0/2432831392 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579f507cd70 con 0x5579f5199960 2024-09-19T06:54:08.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5579f5199960 0x5579f519bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c2e59c640 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5579f5199960 0x5579f519bd50 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e234aa6b5671be18 server_cookie=2e9bbcefaab3ded6 in_seq=0 out_seq=0 2024-09-19T06:54:08.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.756+0000 7f6c15ffb640 10 client.17007 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:08.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c15ffb640 1 -- 172.21.15.159:0/2432831392 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579f507cd70 con 0x5579f5199960 2024-09-19T06:54:08.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c15ffb640 10 client.17007 handle_command_reply: tid=0 2024-09-19T06:54:08.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 client.17007 shutdown 2024-09-19T06:54:08.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 -- 172.21.15.159:0/2432831392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f5110b40 msgr2=0x5579f5122960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f5110b40 0x5579f5122960 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009900 tx=0x7f6c24005a20 comp rx=0 tx=0).stop 2024-09-19T06:54:08.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 -- 172.21.15.159:0/2432831392 shutdown_connections 2024-09-19T06:54:08.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5579f5199960 0x5579f519bd50 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f511a370 0x5579f511f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579f5110b40 0x5579f5122960 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 --2- 172.21.15.159:0/2432831392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579f510f5d0 0x5579f5122420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c15ffb640 0 client.17007 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:08.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 -- 172.21.15.159:0/2432831392 >> 172.21.15.159:0/2432831392 conn(0x5579f50d8310 msgr2=0x5579f5119010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:08.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 -- 172.21.15.159:0/2432831392 shutdown_connections 2024-09-19T06:54:08.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 1 -- 172.21.15.159:0/2432831392 wait complete. 2024-09-19T06:54:08.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.757+0000 7f6c370fc740 20 client.17007 trim_cache size 0 max 16384 2024-09-19T06:54:08.777 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:54:08.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 -- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6c180a33b0 msgr2=0x7f6c180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6c180a33b0 0x7f6c180a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6c28005fd0 tx=0x7f6c28009580 comp rx=0 tx=0).stop 2024-09-19T06:54:08.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 -- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30102d40 msgr2=0x7f6c301984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30102d40 0x7f6c301984b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000b4a0 tx=0x7f6c2000b960 comp rx=0 tx=0).stop 2024-09-19T06:54:08.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 -- 172.21.15.159:0/3525387764 shutdown_connections 2024-09-19T06:54:08.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f6c180a33b0 0x7f6c180a5870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3010c170 0x7f6c3019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c30103660 0x7f6c301989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 --2- 172.21.15.159:0/3525387764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c30102d40 0x7f6c301984b0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 -- 172.21.15.159:0/3525387764 >> 172.21.15.159:0/3525387764 conn(0x7f6c300fc7a0 msgr2=0x7f6c300fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:08.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 -- 172.21.15.159:0/3525387764 shutdown_connections 2024-09-19T06:54:08.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:08.758+0000 7f6c34d23640 1 -- 172.21.15.159:0/3525387764 wait complete. 2024-09-19T06:54:08.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:08 smithi159 ceph-mon[30935]: pgmap v219: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:54:09.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:08 smithi203 ceph-mon[35473]: pgmap v219: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:54:09.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:08 smithi189 ceph-mon[34880]: pgmap v219: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:54:10.458 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:54:10.459 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:54:10.706 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:10.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:10 smithi159 ceph-mon[30935]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:54:10.827 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:10 smithi159 ceph-mon[30935]: pgmap v221: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:54:11.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:10 smithi203 ceph-mon[35473]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:54:11.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:10 smithi203 ceph-mon[35473]: pgmap v221: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:54:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:10 smithi189 ceph-mon[34880]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:54:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:10 smithi189 ceph-mon[34880]: pgmap v221: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:54:11.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.190+0000 7f0879f61640 1 -- 172.21.15.159:0/1368538523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101ba0 msgr2=0x7f087410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.190+0000 7f0879f61640 1 --2- 172.21.15.159:0/1368538523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101ba0 0x7f087410d8f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f086c009900 tx=0x7f086c02a410 comp rx=0 tx=0).stop 2024-09-19T06:54:11.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.190+0000 7f0879f61640 1 -- 172.21.15.159:0/1368538523 shutdown_connections 2024-09-19T06:54:11.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.190+0000 7f0879f61640 1 --2- 172.21.15.159:0/1368538523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101ba0 0x7f087410d8f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.190+0000 7f0879f61640 1 --2- 172.21.15.159:0/1368538523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0874101220 0x7f0874101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.190+0000 7f0879f61640 1 --2- 172.21.15.159:0/1368538523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0874105a70 0x7f0874105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.190+0000 7f0879f61640 1 -- 172.21.15.159:0/1368538523 >> 172.21.15.159:0/1368538523 conn(0x7f08740fbee0 msgr2=0x7f08740fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.190+0000 7f0879f61640 1 -- 172.21.15.159:0/1368538523 shutdown_connections 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.190+0000 7f0879f61640 1 -- 172.21.15.159:0/1368538523 wait complete. 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.191+0000 7f0879f61640 1 Processor -- start 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.191+0000 7f0879f61640 1 -- start start 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.191+0000 7f0879f61640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101220 0x7f08741984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.191+0000 7f0879f61640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0874101ba0 0x7f08741989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.191+0000 7f0879f61640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0874105a70 0x7f087419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.191+0000 7f0879f61640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0874110f50 con 0x7f0874101220 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.191+0000 7f0879f61640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0874110dd0 con 0x7f0874101ba0 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.191+0000 7f0879f61640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08741110d0 con 0x7f0874105a70 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.191+0000 7f08737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101220 0x7f08741984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f08737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101220 0x7f08741984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39640/0 (socket says 172.21.15.159:39640) 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f08737fe640 1 -- 172.21.15.159:0/2210309100 learned_addr learned my addr 172.21.15.159:0/2210309100 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f0872ffd640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0874101ba0 0x7f08741989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f0873fff640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0874105a70 0x7f087419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f08737fe640 1 -- 172.21.15.159:0/2210309100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0874105a70 msgr2=0x7f087419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f08737fe640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0874105a70 0x7f087419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f08737fe640 1 -- 172.21.15.159:0/2210309100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0874101ba0 msgr2=0x7f08741989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f08737fe640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0874101ba0 0x7f08741989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f08737fe640 1 -- 172.21.15.159:0/2210309100 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087419d450 con 0x7f0874101220 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f08737fe640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101220 0x7f08741984a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f086400eb90 tx=0x7f086400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f0870ff9640 1 -- 172.21.15.159:0/2210309100 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864004d20 con 0x7f0874101220 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f0870ff9640 1 -- 172.21.15.159:0/2210309100 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f086400ee90 con 0x7f0874101220 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f0870ff9640 1 -- 172.21.15.159:0/2210309100 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864010830 con 0x7f0874101220 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f0879f61640 1 -- 172.21.15.159:0/2210309100 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087419d740 con 0x7f0874101220 2024-09-19T06:54:11.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.192+0000 7f0879f61640 1 -- 172.21.15.159:0/2210309100 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08741a5020 con 0x7f0874101220 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.194+0000 7f0870ff9640 1 -- 172.21.15.159:0/2210309100 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0864005020 con 0x7f0874101220 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f087c33a740 1 Processor -- start 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f087c33a740 1 -- start start 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f087c33a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 0x5608adaf2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f087c33a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f087c33a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adafdd40 0x5608adb00130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f087c33a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5608ada58280 con 0x5608adaf3480 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f087c33a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5608ad9ffb10 con 0x5608adafdd40 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f087c33a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5608ada54240 con 0x5608adaf2b60 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f08737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f08737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39648/0 (socket says 172.21.15.159:39648) 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f08737fe640 1 -- 172.21.15.159:0/2242612282 learned_addr learned my addr 172.21.15.159:0/2242612282 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:11.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f0873fff640 1 --2- 172.21.15.159:0/2242612282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 0x5608adaf2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f0870ff9640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f085c0a33b0 0x7f085c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f0872ffd640 1 --2- 172.21.15.159:0/2242612282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adafdd40 0x5608adb00130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.195+0000 7f08737fe640 1 -- 172.21.15.159:0/2242612282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 msgr2=0x5608adaf2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f08737fe640 1 --2- 172.21.15.159:0/2242612282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 0x5608adaf2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f08737fe640 1 -- 172.21.15.159:0/2242612282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adafdd40 msgr2=0x5608adb00130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f08737fe640 1 --2- 172.21.15.159:0/2242612282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adafdd40 0x5608adb00130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f08737fe640 1 -- 172.21.15.159:0/2242612282 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608ada0c1f0 con 0x5608adaf3480 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f0873fff640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f085c0a33b0 0x7f085c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f0870ff9640 1 -- 172.21.15.159:0/2210309100 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8658+0+0 (secure 0 0 0) 0x7f08640d0480 con 0x7f0874101220 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f08737fe640 1 --2- 172.21.15.159:0/2242612282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafd800 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f086409c370 tx=0x7f0864091b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bdf3d7cab2c6ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f0859ffb640 1 -- 172.21.15.159:0/2242612282 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08640674c0 con 0x5608adaf3480 2024-09-19T06:54:11.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f0873fff640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f085c0a33b0 0x7f085c0a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f086c006010 tx=0x7f086c009260 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f0859ffb640 1 -- 172.21.15.159:0/2242612282 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f086409cd70 con 0x5608adaf3480 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.196+0000 7f0859ffb640 1 -- 172.21.15.159:0/2242612282 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086409c670 con 0x5608adaf3480 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 -- 172.21.15.159:0/2242612282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 msgr2=0x5608adafd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 --2- 172.21.15.159:0/2242612282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafd800 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f086409c370 tx=0x7f0864091b00 comp rx=0 tx=0).stop 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 -- 172.21.15.159:0/2242612282 shutdown_connections 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 --2- 172.21.15.159:0/2242612282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adafdd40 0x5608adb00130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 --2- 172.21.15.159:0/2242612282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafd800 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 --2- 172.21.15.159:0/2242612282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 0x5608adaf2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 -- 172.21.15.159:0/2242612282 >> 172.21.15.159:0/2242612282 conn(0x5608adaef0f0 msgr2=0x5608adaef4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 -- 172.21.15.159:0/2242612282 shutdown_connections 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 -- 172.21.15.159:0/2242612282 wait complete. 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 -- start start 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.197+0000 7f087c33a740 1 Processor -- start 2024-09-19T06:54:11.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f087c33a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 0x5608adafac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f087c33a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f087c33a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adafdd40 0x5608adafb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f087c33a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5608adb00910 con 0x5608adaf3480 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f087c33a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5608ada12f10 con 0x5608adaf2b60 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f087c33a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5608adb00a90 con 0x5608adafdd40 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f087c33a740 10 client.0 _ll_register_callbacks cb 0x5608ad9dba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0872ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0872ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39658/0 (socket says 172.21.15.159:39658) 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0872ffd640 1 -- 172.21.15.159:0/784941313 learned_addr learned my addr 172.21.15.159:0/784941313 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f08737fe640 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 0x5608adafac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0872ffd640 1 -- 172.21.15.159:0/784941313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adafdd40 msgr2=0x5608adafb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0872ffd640 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adafdd40 0x5608adafb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0872ffd640 1 -- 172.21.15.159:0/784941313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 msgr2=0x5608adafac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0872ffd640 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 0x5608adafac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0872ffd640 1 -- 172.21.15.159:0/784941313 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608ad7c96a0 con 0x5608adaf3480 2024-09-19T06:54:11.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f08737fe640 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 0x5608adafac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:11.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0872ffd640 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafb190 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0868013740 tx=0x7f0868013c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5ee3258baa7ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0852ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:11.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0852ffd640 1 -- 172.21.15.159:0/784941313 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0868011960 con 0x5608adaf3480 2024-09-19T06:54:11.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0852ffd640 1 -- 172.21.15.159:0/784941313 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8658+0+0 (secure 0 0 0) 0x7f0868011b00 con 0x5608adaf3480 2024-09-19T06:54:11.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f087c33a740 1 -- 172.21.15.159:0/784941313 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f086409cd70 con 0x5608adaf3480 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.198+0000 7f0852ffd640 1 -- 172.21.15.159:0/784941313 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0868011d00 con 0x5608adaf3480 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f087c33a740 10 client.17019 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f087c33a740 1 -- 172.21.15.159:0/784941313 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5608adb0c5a0 con 0x5608adaf3480 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f0852ffd640 1 -- 172.21.15.159:0/784941313 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f086409cd70 con 0x5608adaf3480 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f0852ffd640 1 -- 172.21.15.159:0/784941313 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f086801a070 con 0x5608adaf3480 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f087c33a740 10 client.17019 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f087c33a740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f087c33a740 20 client.17019 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f087c33a740 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5608adb0da50 0x5608adb0fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f087c33a740 4 client.17019 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f087c33a740 1 -- 172.21.15.159:0/784941313 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608ada657f0 con 0x5608adb0da50 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.199+0000 7f08737fe640 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5608adb0da50 0x5608adb0fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.200+0000 7f0852ffd640 10 client.17019 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.200+0000 7f08737fe640 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5608adb0da50 0x5608adb0fef0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88ab9a9b51ba5989 server_cookie=c817ed231546d2da in_seq=0 out_seq=0 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.200+0000 7f0852ffd640 1 -- 172.21.15.159:0/784941313 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608ada657f0 con 0x5608adb0da50 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.200+0000 7f0852ffd640 10 client.17019 handle_command_reply: tid=0 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.200+0000 7f087c33a740 1 client.17019 shutdown 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 -- 172.21.15.159:0/784941313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 msgr2=0x5608adafb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafb190 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0868013740 tx=0x7f0868013c00 comp rx=0 tx=0).stop 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 -- 172.21.15.159:0/784941313 shutdown_connections 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5608adb0da50 0x5608adb0fef0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adafdd40 0x5608adafb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f0852ffd640 0 client.17019 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adaf3480 0x5608adafb190 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 --2- 172.21.15.159:0/784941313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 0x5608adafac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 -- 172.21.15.159:0/784941313 >> 172.21.15.159:0/784941313 conn(0x5608adaef0f0 msgr2=0x5608adaf4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 -- 172.21.15.159:0/784941313 shutdown_connections 2024-09-19T06:54:11.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 1 -- 172.21.15.159:0/784941313 wait complete. 2024-09-19T06:54:11.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.201+0000 7f087c33a740 20 client.17019 trim_cache size 0 max 16384 2024-09-19T06:54:11.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f087c33a740 1 Processor -- start 2024-09-19T06:54:11.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f087c33a740 1 -- start start 2024-09-19T06:54:11.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f087c33a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 0x5608adb157c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f087c33a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf3480 0x5608adb15d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f087c33a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adaf7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f087c33a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f08741aba50 con 0x5608adafdd40 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f087c33a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08741ae2b0 con 0x5608adaf3480 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f087c33a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08741ac0a0 con 0x5608adaf2b60 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f0873fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adaf7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f0873fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adaf7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39660/0 (socket says 172.21.15.159:39660) 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.218+0000 7f0873fff640 1 -- 172.21.15.159:0/2582020056 learned_addr learned my addr 172.21.15.159:0/2582020056 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f08737fe640 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 0x5608adb157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f0872ffd640 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf3480 0x5608adb15d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f0873fff640 1 -- 172.21.15.159:0/2582020056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 msgr2=0x5608adb157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f0873fff640 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 0x5608adb157c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f0873fff640 1 -- 172.21.15.159:0/2582020056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf3480 msgr2=0x5608adb15d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f0873fff640 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf3480 0x5608adb15d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f0873fff640 1 -- 172.21.15.159:0/2582020056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608adaeef20 con 0x5608adafdd40 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f08737fe640 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 0x5608adb157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f0873fff640 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adaf7eb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f086c004560 tx=0x7f086c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcbef6d387c149f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f08597fa640 1 -- 172.21.15.159:0/2582020056 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c04d070 con 0x5608adafdd40 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f08597fa640 1 -- 172.21.15.159:0/2582020056 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f086c004ba0 con 0x5608adafdd40 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.219+0000 7f08597fa640 1 -- 172.21.15.159:0/2582020056 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c035040 con 0x5608adafdd40 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 -- 172.21.15.159:0/2582020056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 msgr2=0x5608adaf7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adaf7eb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f086c004560 tx=0x7f086c02a410 comp rx=0 tx=0).stop 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 -- 172.21.15.159:0/2582020056 shutdown_connections 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adaf7eb0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf3480 0x5608adb15d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 --2- 172.21.15.159:0/2582020056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf2b60 0x5608adb157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 -- 172.21.15.159:0/2582020056 >> 172.21.15.159:0/2582020056 conn(0x5608adaef0f0 msgr2=0x5608adafcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 -- 172.21.15.159:0/2582020056 shutdown_connections 2024-09-19T06:54:11.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 -- 172.21.15.159:0/2582020056 wait complete. 2024-09-19T06:54:11.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 -- start start 2024-09-19T06:54:11.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 Processor -- start 2024-09-19T06:54:11.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.220+0000 7f087c33a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 0x5608adb065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f087c33a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf3480 0x5608adb02930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f087c33a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adb030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f087c33a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f08741ac770 con 0x5608adafdd40 2024-09-19T06:54:11.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f087c33a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08741adbe0 con 0x5608adaf2b60 2024-09-19T06:54:11.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f087c33a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08741ace40 con 0x5608adaf3480 2024-09-19T06:54:11.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f087c33a740 10 client.0 _ll_register_callbacks cb 0x7f08680097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:11.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0873fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adb030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0873fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adb030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39666/0 (socket says 172.21.15.159:39666) 2024-09-19T06:54:11.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0873fff640 1 -- 172.21.15.159:0/1657566428 learned_addr learned my addr 172.21.15.159:0/1657566428 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:11.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f08737fe640 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 0x5608adb065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0872ffd640 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf3480 0x5608adb02930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0873fff640 1 -- 172.21.15.159:0/1657566428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf3480 msgr2=0x5608adb02930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0873fff640 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf3480 0x5608adb02930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0873fff640 1 -- 172.21.15.159:0/1657566428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 msgr2=0x5608adb065a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0873fff640 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 0x5608adb065a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0873fff640 1 -- 172.21.15.159:0/1657566428 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608adb787a0 con 0x5608adafdd40 2024-09-19T06:54:11.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0873fff640 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adb030c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f086c0058f0 tx=0x7f086c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597f3391f62a009a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0852ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:11.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0852ffd640 1 -- 172.21.15.159:0/1657566428 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c04d030 con 0x5608adafdd40 2024-09-19T06:54:11.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0852ffd640 1 -- 172.21.15.159:0/1657566428 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8658+0+0 (secure 0 0 0) 0x7f086c0036c0 con 0x5608adafdd40 2024-09-19T06:54:11.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f087c33a740 1 -- 172.21.15.159:0/1657566428 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f086c004ba0 con 0x5608adafdd40 2024-09-19T06:54:11.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.221+0000 7f0852ffd640 1 -- 172.21.15.159:0/1657566428 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f086c064050 con 0x5608adafdd40 2024-09-19T06:54:11.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f087c33a740 10 client.17025 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:11.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f087c33a740 1 -- 172.21.15.159:0/1657566428 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5608adb79960 con 0x5608adafdd40 2024-09-19T06:54:11.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f0852ffd640 1 -- 172.21.15.159:0/1657566428 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f086c004ba0 con 0x5608adafdd40 2024-09-19T06:54:11.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f0852ffd640 1 -- 172.21.15.159:0/1657566428 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f086c046040 con 0x5608adafdd40 2024-09-19T06:54:11.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f087c33a740 10 client.17025 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:11.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f087c33a740 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:11.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f087c33a740 20 client.17025 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:11.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f087c33a740 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5608adb79fc0 0x5608adb7c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f087c33a740 4 client.17025 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:54:11.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f087c33a740 1 -- 172.21.15.159:0/1657566428 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5608ada5fd00 con 0x5608adb79fc0 2024-09-19T06:54:11.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f08737fe640 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5608adb79fc0 0x5608adb7c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f0852ffd640 10 client.17025 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:11.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.222+0000 7f08737fe640 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5608adb79fc0 0x5608adb7c3b0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b5fa04818ab3541 server_cookie=8e67f92ade91650c in_seq=0 out_seq=0 2024-09-19T06:54:11.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.223+0000 7f0852ffd640 1 -- 172.21.15.159:0/1657566428 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5608ada5fd00 con 0x5608adb79fc0 2024-09-19T06:54:11.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.223+0000 7f0852ffd640 10 client.17025 handle_command_reply: tid=0 2024-09-19T06:54:11.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.223+0000 7f087c33a740 1 client.17025 shutdown 2024-09-19T06:54:11.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.223+0000 7f087c33a740 1 -- 172.21.15.159:0/1657566428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 msgr2=0x5608adb030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.223+0000 7f087c33a740 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adb030c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f086c0058f0 tx=0x7f086c0042e0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.223+0000 7f087c33a740 1 -- 172.21.15.159:0/1657566428 shutdown_connections 2024-09-19T06:54:11.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f087c33a740 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5608adb79fc0 0x5608adb7c3b0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f087c33a740 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5608adafdd40 0x5608adb030c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f087c33a740 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5608adaf3480 0x5608adb02930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f087c33a740 1 --2- 172.21.15.159:0/1657566428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608adaf2b60 0x5608adb065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f087c33a740 1 -- 172.21.15.159:0/1657566428 >> 172.21.15.159:0/1657566428 conn(0x5608adaef0f0 msgr2=0x5608adafc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f0852ffd640 0 client.17025 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:11.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f087c33a740 1 -- 172.21.15.159:0/1657566428 shutdown_connections 2024-09-19T06:54:11.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f087c33a740 1 -- 172.21.15.159:0/1657566428 wait complete. 2024-09-19T06:54:11.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f087c33a740 20 client.17025 trim_cache size 0 max 16384 2024-09-19T06:54:11.245 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:54:11.245 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:54:11.245 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "7a2f10bb-1481-4624-9910-da03e14e9e50", 2024-09-19T06:54:11.245 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:54:11.246 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:54:11.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f0879f61640 1 -- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f085c0a33b0 msgr2=0x7f085c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f0879f61640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f085c0a33b0 0x7f085c0a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f086c006010 tx=0x7f086c009260 comp rx=0 tx=0).stop 2024-09-19T06:54:11.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f0879f61640 1 -- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101220 msgr2=0x7f08741984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.224+0000 7f0879f61640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101220 0x7f08741984a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f086400eb90 tx=0x7f086400c6a0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.225+0000 7f0879f61640 1 -- 172.21.15.159:0/2210309100 shutdown_connections 2024-09-19T06:54:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.225+0000 7f0879f61640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f085c0a33b0 0x7f085c0a5870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.225+0000 7f0879f61640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0874105a70 0x7f087419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.225+0000 7f0879f61640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0874101ba0 0x7f08741989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.225+0000 7f0879f61640 1 --2- 172.21.15.159:0/2210309100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0874101220 0x7f08741984a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.225+0000 7f0879f61640 1 -- 172.21.15.159:0/2210309100 >> 172.21.15.159:0/2210309100 conn(0x7f08740fbee0 msgr2=0x7f08741002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.225+0000 7f0879f61640 1 -- 172.21.15.159:0/2210309100 shutdown_connections 2024-09-19T06:54:11.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:11.225+0000 7f0879f61640 1 -- 172.21.15.159:0/2210309100 wait complete. 2024-09-19T06:54:11.926 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:54:12.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:11 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:54:12.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:11 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:12.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:11 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:54:12.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:11 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:12.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:11 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:54:12.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:11 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:12.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:11 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:54:12.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:11 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:12.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:11 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:54:12.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:11 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:12.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:11 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:54:12.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:11 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:12.174 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:12.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 -- 172.21.15.159:0/2451691329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102ef0 msgr2=0x7fe30010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2451691329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102ef0 0x7fe30010da40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009ca0 tx=0x7fe2f802a950 comp rx=0 tx=0).stop 2024-09-19T06:54:12.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 -- 172.21.15.159:0/2451691329 shutdown_connections 2024-09-19T06:54:12.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2451691329 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102ef0 0x7fe30010da40 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2451691329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe300102570 0x7fe3001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2451691329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe300100e20 0x7fe300101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 -- 172.21.15.159:0/2451691329 >> 172.21.15.159:0/2451691329 conn(0x7fe3000fc7d0 msgr2=0x7fe3000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:12.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 -- 172.21.15.159:0/2451691329 shutdown_connections 2024-09-19T06:54:12.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 -- 172.21.15.159:0/2451691329 wait complete. 2024-09-19T06:54:12.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 Processor -- start 2024-09-19T06:54:12.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.640+0000 7fe305f9c640 1 -- start start 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe305f9c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe300100e20 0x7fe300198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe305f9c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102570 0x7fe300198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe305f9c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe300102ef0 0x7fe30019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe305f9c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe300110f80 con 0x7fe300102570 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe305f9c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe300110e00 con 0x7fe300100e20 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe305f9c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe300111100 con 0x7fe300102ef0 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2f6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102570 0x7fe300198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2f6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102570 0x7fe300198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39680/0 (socket says 172.21.15.159:39680) 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2f6ffd640 1 -- 172.21.15.159:0/2181330126 learned_addr learned my addr 172.21.15.159:0/2181330126 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe300100e20 0x7fe300198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2fffff640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe300102ef0 0x7fe30019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2f6ffd640 1 -- 172.21.15.159:0/2181330126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe300102ef0 msgr2=0x7fe30019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe300102ef0 0x7fe30019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2f6ffd640 1 -- 172.21.15.159:0/2181330126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe300100e20 msgr2=0x7fe300198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe300100e20 0x7fe300198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2f6ffd640 1 -- 172.21.15.159:0/2181330126 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30019d2c0 con 0x7fe300102570 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2fffff640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe300102ef0 0x7fe30019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.641+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102570 0x7fe300198850 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c920 tx=0x7fe2e800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.642+0000 7fe2fd7fa640 1 -- 172.21.15.159:0/2181330126 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8007bb0 con 0x7fe300102570 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.642+0000 7fe2fd7fa640 1 -- 172.21.15.159:0/2181330126 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2e8007d50 con 0x7fe300102570 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.642+0000 7fe305f9c640 1 -- 172.21.15.159:0/2181330126 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30019d5b0 con 0x7fe300102570 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.642+0000 7fe2fd7fa640 1 -- 172.21.15.159:0/2181330126 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e80187d0 con 0x7fe300102570 2024-09-19T06:54:12.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.642+0000 7fe305f9c640 1 -- 172.21.15.159:0/2181330126 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3001a4e90 con 0x7fe300102570 2024-09-19T06:54:12.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.644+0000 7fe2fd7fa640 1 -- 172.21.15.159:0/2181330126 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe2e800f450 con 0x7fe300102570 2024-09-19T06:54:12.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.644+0000 7fe308375740 1 Processor -- start 2024-09-19T06:54:12.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.644+0000 7fe308375740 1 -- start start 2024-09-19T06:54:12.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.644+0000 7fe308375740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 0x55a0046b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.644+0000 7fe308375740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.644+0000 7fe308375740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.644+0000 7fe308375740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a00461a2e0 con 0x55a0046bf680 2024-09-19T06:54:12.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe308375740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a0045c1ce0 con 0x55a0046b4dc0 2024-09-19T06:54:12.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe308375740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a0046162a0 con 0x55a0046b44a0 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2f6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2f6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39692/0 (socket says 172.21.15.159:39692) 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2f6ffd640 1 -- 172.21.15.159:0/484550032 learned_addr learned my addr 172.21.15.159:0/484550032 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2fffff640 1 --2- 172.21.15.159:0/484550032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 0x55a0046b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/484550032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2f6ffd640 1 -- 172.21.15.159:0/484550032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 msgr2=0x55a0046b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/484550032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 0x55a0046b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2f6ffd640 1 -- 172.21.15.159:0/484550032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 msgr2=0x55a0046bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/484550032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2f6ffd640 1 -- 172.21.15.159:0/484550032 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0045a6440 con 0x55a0046bf680 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2fd7fa640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2ec0a33b0 0x7fe2ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2fffff640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2ec0a33b0 0x7fe2ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/484550032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046c1a70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80cd520 tx=0x7fe2e80d8220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a27de33563cacff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.645+0000 7fe2fd7fa640 1 -- 172.21.15.159:0/2181330126 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8658+0+0 (secure 0 0 0) 0x7fe2e80cfef0 con 0x7fe300102570 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe2f5ffb640 1 -- 172.21.15.159:0/484550032 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e809bf10 con 0x55a0046bf680 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe2f5ffb640 1 -- 172.21.15.159:0/484550032 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2e809c840 con 0x55a0046bf680 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe2f5ffb640 1 -- 172.21.15.159:0/484550032 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e809baa0 con 0x55a0046bf680 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe308375740 1 -- 172.21.15.159:0/484550032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 msgr2=0x55a0046c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe308375740 1 --2- 172.21.15.159:0/484550032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046c1a70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80cd520 tx=0x7fe2e80d8220 comp rx=0 tx=0).stop 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe2fffff640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2ec0a33b0 0x7fe2ec0a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009a60 tx=0x7fe2f803c040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe308375740 1 -- 172.21.15.159:0/484550032 shutdown_connections 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe308375740 1 --2- 172.21.15.159:0/484550032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046c1a70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe308375740 1 --2- 172.21.15.159:0/484550032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe308375740 1 --2- 172.21.15.159:0/484550032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 0x55a0046b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe308375740 1 -- 172.21.15.159:0/484550032 >> 172.21.15.159:0/484550032 conn(0x55a0046b0a30 msgr2=0x55a0046b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:12.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe308375740 1 -- 172.21.15.159:0/484550032 shutdown_connections 2024-09-19T06:54:12.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.646+0000 7fe308375740 1 -- 172.21.15.159:0/484550032 wait complete. 2024-09-19T06:54:12.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe308375740 1 -- start start 2024-09-19T06:54:12.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe308375740 1 Processor -- start 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe308375740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 0x55a0046befd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe308375740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046bc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe308375740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046bc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe308375740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a0046c2250 con 0x55a0046bf680 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe308375740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a0045d5050 con 0x55a0046b4dc0 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe308375740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a0046c23d0 con 0x55a0046b44a0 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe308375740 10 client.0 _ll_register_callbacks cb 0x55a004615160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe2fffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046bc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe2fffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046bc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39694/0 (socket says 172.21.15.159:39694) 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.647+0000 7fe2fffff640 1 -- 172.21.15.159:0/630003724 learned_addr learned my addr 172.21.15.159:0/630003724 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 0x55a0046befd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046bc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2fffff640 1 -- 172.21.15.159:0/630003724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 msgr2=0x55a0046befd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2fffff640 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 0x55a0046befd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2fffff640 1 -- 172.21.15.159:0/630003724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 msgr2=0x55a0046bc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2fffff640 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046bc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2fffff640 1 -- 172.21.15.159:0/630003724 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a00438b3c0 con 0x55a0046bf680 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 0x55a0046befd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046bc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2fffff640 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046bc7e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe2f802f870 tx=0x7fe2f802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db6accbb13ac783 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2deffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2deffd640 1 -- 172.21.15.159:0/630003724 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8034050 con 0x55a0046bf680 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2deffd640 1 -- 172.21.15.159:0/630003724 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8658+0+0 (secure 0 0 0) 0x7fe2f80045d0 con 0x55a0046bf680 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe308375740 1 -- 172.21.15.159:0/630003724 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2e809c840 con 0x55a0046bf680 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2deffd640 1 -- 172.21.15.159:0/630003724 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe2f80047d0 con 0x55a0046bf680 2024-09-19T06:54:12.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe308375740 10 client.17037 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe308375740 1 -- 172.21.15.159:0/630003724 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a0046cdc70 con 0x55a0046bf680 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.648+0000 7fe2deffd640 1 -- 172.21.15.159:0/630003724 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2e809c840 con 0x55a0046bf680 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe2deffd640 1 -- 172.21.15.159:0/630003724 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe2f804f070 con 0x55a0046bf680 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe308375740 10 client.17037 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe308375740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe308375740 20 client.17037 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe308375740 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a0046cf130 0x55a0046d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe308375740 4 client.17037 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe308375740 1 -- 172.21.15.159:0/630003724 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a004627850 con 0x55a0046cf130 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a0046cf130 0x55a0046d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a0046cf130 0x55a0046d15b0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65f0c3feabe593e0 server_cookie=8d654a3d34470936 in_seq=0 out_seq=0 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.649+0000 7fe2deffd640 10 client.17037 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:12.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe2deffd640 1 -- 172.21.15.159:0/630003724 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a004627850 con 0x55a0046cf130 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe2deffd640 10 client.17037 handle_command_reply: tid=0 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe308375740 1 client.17037 shutdown 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe308375740 1 -- 172.21.15.159:0/630003724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 msgr2=0x55a0046bc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe308375740 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046bc7e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe2f802f870 tx=0x7fe2f802a950 comp rx=0 tx=0).stop 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe308375740 1 -- 172.21.15.159:0/630003724 shutdown_connections 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe308375740 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a0046cf130 0x55a0046d15b0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe308375740 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046bf680 0x55a0046bc7e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe308375740 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046bc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe308375740 1 --2- 172.21.15.159:0/630003724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046b44a0 0x55a0046befd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe2deffd640 0 client.17037 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.650+0000 7fe308375740 1 -- 172.21.15.159:0/630003724 >> 172.21.15.159:0/630003724 conn(0x55a0046b0a30 msgr2=0x55a0046b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.651+0000 7fe308375740 1 -- 172.21.15.159:0/630003724 shutdown_connections 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.651+0000 7fe308375740 1 -- 172.21.15.159:0/630003724 wait complete. 2024-09-19T06:54:12.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.651+0000 7fe308375740 20 client.17037 trim_cache size 0 max 16384 2024-09-19T06:54:12.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.667+0000 7fe308375740 1 Processor -- start 2024-09-19T06:54:12.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.667+0000 7fe308375740 1 -- start start 2024-09-19T06:54:12.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.667+0000 7fe308375740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.667+0000 7fe308375740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.667+0000 7fe308375740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a0046c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.667+0000 7fe308375740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe3001ab870 con 0x55a0046b44a0 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.667+0000 7fe308375740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3001ae0d0 con 0x55a0046b4dc0 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.667+0000 7fe308375740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3001abec0 con 0x55a0046bf680 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2ff7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2ff7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39698/0 (socket says 172.21.15.159:39698) 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2ff7fe640 1 -- 172.21.15.159:0/3270641135 learned_addr learned my addr 172.21.15.159:0/3270641135 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2fffff640 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a0046c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2ff7fe640 1 -- 172.21.15.159:0/3270641135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 msgr2=0x55a0046c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a0046c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2ff7fe640 1 -- 172.21.15.159:0/3270641135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 msgr2=0x55a0046b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2ff7fe640 1 -- 172.21.15.159:0/3270641135 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0046b42d0 con 0x55a0046b44a0 2024-09-19T06:54:12.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2fffff640 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a0046c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:12.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046cb500 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0000c00 tx=0x7fe2f00108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdfae5c64e51dda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2f57fa640 1 -- 172.21.15.159:0/3270641135 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f001e6d0 con 0x55a0046b44a0 2024-09-19T06:54:12.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2f57fa640 1 -- 172.21.15.159:0/3270641135 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2f001ed50 con 0x55a0046b44a0 2024-09-19T06:54:12.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.668+0000 7fe2f57fa640 1 -- 172.21.15.159:0/3270641135 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00243a0 con 0x55a0046b44a0 2024-09-19T06:54:12.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 -- 172.21.15.159:0/3270641135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 msgr2=0x55a0046cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046cb500 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0000c00 tx=0x7fe2f00108c0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 -- 172.21.15.159:0/3270641135 shutdown_connections 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a0046c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 --2- 172.21.15.159:0/3270641135 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046cb500 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 -- 172.21.15.159:0/3270641135 >> 172.21.15.159:0/3270641135 conn(0x55a0046b0a30 msgr2=0x55a0046b7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 -- 172.21.15.159:0/3270641135 shutdown_connections 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 -- 172.21.15.159:0/3270641135 wait complete. 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.669+0000 7fe308375740 1 -- start start 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe308375740 1 Processor -- start 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe308375740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe308375740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe308375740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a004735590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe308375740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe3001ac590 con 0x55a0046b44a0 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe308375740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3001ada00 con 0x55a0046b4dc0 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe308375740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3001acc60 con 0x55a0046bf680 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2ff7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe308375740 10 client.0 _ll_register_callbacks cb 0x7fe2f8009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2ff7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39712/0 (socket says 172.21.15.159:39712) 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2ff7fe640 1 -- 172.21.15.159:0/1087311805 learned_addr learned my addr 172.21.15.159:0/1087311805 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2fffff640 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a004735590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2ff7fe640 1 -- 172.21.15.159:0/1087311805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 msgr2=0x55a004735590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a004735590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2ff7fe640 1 -- 172.21.15.159:0/1087311805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 msgr2=0x55a0046b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2ff7fe640 1 -- 172.21.15.159:0/1087311805 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a004735c30 con 0x55a0046b44a0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2fffff640 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a004735590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2ff7fe640 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046b7170 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000fe70 tx=0x7fe2f000abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2c1c3feb37aa59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.670+0000 7fe2deffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe2deffd640 1 -- 172.21.15.159:0/1087311805 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000f770 con 0x55a0046b44a0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe2deffd640 1 -- 172.21.15.159:0/1087311805 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8658+0+0 (secure 0 0 0) 0x7fe2f000f910 con 0x55a0046b44a0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe308375740 1 -- 172.21.15.159:0/1087311805 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2f001ed50 con 0x55a0046b44a0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe2deffd640 1 -- 172.21.15.159:0/1087311805 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe2f003c050 con 0x55a0046b44a0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe308375740 10 client.17043 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe308375740 1 -- 172.21.15.159:0/1087311805 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a00473e140 con 0x55a0046b44a0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe2deffd640 1 -- 172.21.15.159:0/1087311805 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2f001ed50 con 0x55a0046b44a0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe2deffd640 1 -- 172.21.15.159:0/1087311805 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fe2f00046c0 con 0x55a0046b44a0 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe308375740 10 client.17043 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe308375740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:12.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe308375740 20 client.17043 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe308375740 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a00473e820 0x55a004740c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe308375740 4 client.17043 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe308375740 1 -- 172.21.15.159:0/1087311805 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a004621d60 con 0x55a00473e820 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.671+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a00473e820 0x55a004740c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe2deffd640 10 client.17043 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe2f6ffd640 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a00473e820 0x55a004740c40 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5671a06921ef789e server_cookie=59310b2de0e72762 in_seq=0 out_seq=0 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe2deffd640 1 -- 172.21.15.159:0/1087311805 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a004621d60 con 0x55a00473e820 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe2deffd640 10 client.17043 handle_command_reply: tid=0 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 client.17043 shutdown 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 -- 172.21.15.159:0/1087311805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 msgr2=0x55a0046b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046b7170 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000fe70 tx=0x7fe2f000abc0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 -- 172.21.15.159:0/1087311805 shutdown_connections 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55a00473e820 0x55a004740c40 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0046bf680 0x55a004735590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe2deffd640 0 client.17043 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a0046b4dc0 0x55a0046b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 --2- 172.21.15.159:0/1087311805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0046b44a0 0x55a0046b7170 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 -- 172.21.15.159:0/1087311805 >> 172.21.15.159:0/1087311805 conn(0x55a0046b0a30 msgr2=0x55a0046be300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 -- 172.21.15.159:0/1087311805 shutdown_connections 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 1 -- 172.21.15.159:0/1087311805 wait complete. 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.672+0000 7fe308375740 20 client.17043 trim_cache size 0 max 16384 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:54:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: "7a2f10bb-1481-4624-9910-da03e14e9e50": { 2024-09-19T06:54:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:54:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "7a2f10bb-1481-4624-9910-da03e14e9e50", 2024-09-19T06:54:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:54:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:54:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:54:12.680 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 -- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2ec0a33b0 msgr2=0x7fe2ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2ec0a33b0 0x7fe2ec0a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009a60 tx=0x7fe2f803c040 comp rx=0 tx=0).stop 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 -- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102570 msgr2=0x7fe300198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102570 0x7fe300198850 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c920 tx=0x7fe2e800cd20 comp rx=0 tx=0).stop 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 -- 172.21.15.159:0/2181330126 shutdown_connections 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe2ec0a33b0 0x7fe2ec0a5870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe300102ef0 0x7fe30019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe300102570 0x7fe300198850 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 --2- 172.21.15.159:0/2181330126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe300100e20 0x7fe300198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 -- 172.21.15.159:0/2181330126 >> 172.21.15.159:0/2181330126 conn(0x7fe3000fc7d0 msgr2=0x7fe30006a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 -- 172.21.15.159:0/2181330126 shutdown_connections 2024-09-19T06:54:12.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:12.673+0000 7fe305f9c640 1 -- 172.21.15.159:0/2181330126 wait complete. 2024-09-19T06:54:12.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:12 smithi159 ceph-mon[30935]: pgmap v222: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 716 B/s wr, 3 op/s 2024-09-19T06:54:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:12 smithi203 ceph-mon[35473]: pgmap v222: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 716 B/s wr, 3 op/s 2024-09-19T06:54:13.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:12 smithi189 ceph-mon[34880]: pgmap v222: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 716 B/s wr, 3 op/s 2024-09-19T06:54:13.394 INFO:tasks.cephfs.filesystem:scrub status for tag:7a2f10bb-1481-4624-9910-da03e14e9e50 - {'path': '/', 'tag': '7a2f10bb-1481-4624-9910-da03e14e9e50', 'options': 'recursive,force'} 2024-09-19T06:54:14.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:14 smithi203 ceph-mon[35473]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:54:14.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:14 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:54:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:14 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:54:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:14 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:54:14.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:14 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:54:14.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:14 smithi189 ceph-mon[34880]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:54:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:14 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:54:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:14 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:54:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:14 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:54:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:14 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:54:14.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:14 smithi159 ceph-mon[30935]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:54:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:14 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:54:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:14 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:54:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:14 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:54:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:14 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:54:15.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:15 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:54:15.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:15 smithi203 ceph-mon[35473]: pgmap v224: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T06:54:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:15 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:54:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:15 smithi189 ceph-mon[34880]: pgmap v224: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T06:54:15.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:15 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:54:15.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:15 smithi159 ceph-mon[30935]: pgmap v224: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T06:54:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:16 smithi203 ceph-mon[35473]: pgmap v225: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-19T06:54:17.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:16 smithi189 ceph-mon[34880]: pgmap v225: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-19T06:54:17.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:16 smithi159 ceph-mon[30935]: pgmap v225: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-19T06:54:19.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:18 smithi203 ceph-mon[35473]: pgmap v226: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 687 B/s wr, 4 op/s 2024-09-19T06:54:19.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:18 smithi189 ceph-mon[34880]: pgmap v226: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 687 B/s wr, 4 op/s 2024-09-19T06:54:19.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:18 smithi159 ceph-mon[30935]: pgmap v226: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 687 B/s wr, 4 op/s 2024-09-19T06:54:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:20 smithi203 ceph-mon[35473]: pgmap v227: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 614 B/s wr, 3 op/s 2024-09-19T06:54:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:20 smithi189 ceph-mon[34880]: pgmap v227: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 614 B/s wr, 3 op/s 2024-09-19T06:54:21.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:20 smithi159 ceph-mon[30935]: pgmap v227: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 614 B/s wr, 3 op/s 2024-09-19T06:54:23.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:22 smithi203 ceph-mon[35473]: pgmap v228: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-19T06:54:23.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:22 smithi189 ceph-mon[34880]: pgmap v228: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-19T06:54:23.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:22 smithi159 ceph-mon[30935]: pgmap v228: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-19T06:54:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:24 smithi203 ceph-mon[35473]: pgmap v229: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-19T06:54:25.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:24 smithi189 ceph-mon[34880]: pgmap v229: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-19T06:54:25.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:24 smithi159 ceph-mon[30935]: pgmap v229: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-19T06:54:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:26 smithi203 ceph-mon[35473]: pgmap v230: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-19T06:54:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:26 smithi189 ceph-mon[34880]: pgmap v230: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-19T06:54:27.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:26 smithi159 ceph-mon[30935]: pgmap v230: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-19T06:54:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:28 smithi203 ceph-mon[35473]: pgmap v231: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:29.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:28 smithi189 ceph-mon[34880]: pgmap v231: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:29.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:28 smithi159 ceph-mon[30935]: pgmap v231: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:30 smithi203 ceph-mon[35473]: pgmap v232: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:31.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:30 smithi189 ceph-mon[34880]: pgmap v232: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:31.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:30 smithi159 ceph-mon[30935]: pgmap v232: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:32.971 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:32 smithi159 ceph-mon[30935]: pgmap v233: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:32 smithi203 ceph-mon[35473]: pgmap v233: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:33.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:32 smithi189 ceph-mon[34880]: pgmap v233: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:35.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:34 smithi203 ceph-mon[35473]: pgmap v234: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:35.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:34 smithi189 ceph-mon[34880]: pgmap v234: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:35.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:34 smithi159 ceph-mon[30935]: pgmap v234: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:37.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:36 smithi203 ceph-mon[35473]: pgmap v235: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:36 smithi189 ceph-mon[34880]: pgmap v235: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:37.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:36 smithi159 ceph-mon[30935]: pgmap v235: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:39.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:38 smithi203 ceph-mon[35473]: pgmap v236: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:39.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:38 smithi189 ceph-mon[34880]: pgmap v236: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:39.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:38 smithi159 ceph-mon[30935]: pgmap v236: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:41.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:40 smithi203 ceph-mon[35473]: pgmap v237: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:41.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:40 smithi189 ceph-mon[34880]: pgmap v237: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:41.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:40 smithi159 ceph-mon[30935]: pgmap v237: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:43.396 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:54:43.659 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:43.957 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:43 smithi159 ceph-mon[30935]: pgmap v238: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:44.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:43 smithi203 ceph-mon[35473]: pgmap v238: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:44.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:43 smithi189 ceph-mon[34880]: pgmap v238: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.150+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2302591008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4106f10 msgr2=0x7fd3c410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:44.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.150+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2302591008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4106f10 0x7fd3c410ea90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009ca0 tx=0x7fd3bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.150+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2302591008 shutdown_connections 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.150+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2302591008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4106f10 0x7fd3c410ea90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.150+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2302591008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3c4102790 0x7fd3c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.150+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2302591008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3c4101de0 0x7fd3c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.150+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2302591008 >> 172.21.15.159:0/2302591008 conn(0x7fd3c40fd8c0 msgr2=0x7fd3c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.150+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2302591008 shutdown_connections 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.150+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2302591008 wait complete. 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3cbcf9640 1 Processor -- start 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3cbcf9640 1 -- start start 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3cbcf9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4101de0 0x7fd3c4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3cbcf9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3c4102790 0x7fd3c41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3cbcf9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3c4106f10 0x7fd3c419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3cbcf9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4111f90 con 0x7fd3c4101de0 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3cbcf9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4111e10 con 0x7fd3c4106f10 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3cbcf9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4112110 con 0x7fd3c4102790 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3c9a95640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4101de0 0x7fd3c4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3c9a95640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4101de0 0x7fd3c4198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54832/0 (socket says 172.21.15.159:54832) 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.151+0000 7fd3c9a95640 1 -- 172.21.15.159:0/2039238451 learned_addr learned my addr 172.21.15.159:0/2039238451 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3ca296640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3c4106f10 0x7fd3c419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3c9294640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3c4102790 0x7fd3c41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3c9a95640 1 -- 172.21.15.159:0/2039238451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3c4102790 msgr2=0x7fd3c41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3c9a95640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3c4102790 0x7fd3c41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3c9a95640 1 -- 172.21.15.159:0/2039238451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3c4106f10 msgr2=0x7fd3c419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3c9a95640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3c4106f10 0x7fd3c419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3c9a95640 1 -- 172.21.15.159:0/2039238451 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c419d420 con 0x7fd3c4101de0 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3c9a95640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4101de0 0x7fd3c4198470 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000b4a0 tx=0x7fd3c000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3baffd640 1 -- 172.21.15.159:0/2039238451 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0014070 con 0x7fd3c4101de0 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3baffd640 1 -- 172.21.15.159:0/2039238451 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c0010af0 con 0x7fd3c4101de0 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3baffd640 1 -- 172.21.15.159:0/2039238451 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0017d10 con 0x7fd3c4101de0 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2039238451 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c419d710 con 0x7fd3c4101de0 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.152+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2039238451 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c41a4ff0 con 0x7fd3c4101de0 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.154+0000 7fd3baffd640 1 -- 172.21.15.159:0/2039238451 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd3c0017070 con 0x7fd3c4101de0 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3ce0d2740 1 Processor -- start 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3ce0d2740 1 -- start start 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d15760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3baffd640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd3b00a33b0 0x7fd3b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d24550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d26e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561178c7b2e0 con 0x561178d15ca0 2024-09-19T06:54:44.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561178c22ce0 con 0x561178d15380 2024-09-19T06:54:44.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561178c772a0 con 0x561178d24a90 2024-09-19T06:54:44.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3c9294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d24550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3c9294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d24550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54840/0 (socket says 172.21.15.159:54840) 2024-09-19T06:54:44.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3c9294640 1 -- 172.21.15.159:0/1192650996 learned_addr learned my addr 172.21.15.159:0/1192650996 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:44.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.155+0000 7fd3c9a95640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd3b00a33b0 0x7fd3b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d26e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3baffd640 1 -- 172.21.15.159:0/2039238451 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7fd3c00cf090 con 0x7fd3c4101de0 2024-09-19T06:54:44.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d15760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3c9294640 1 -- 172.21.15.159:0/1192650996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 msgr2=0x561178d26e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:44.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3c9294640 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d26e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3c9294640 1 -- 172.21.15.159:0/1192650996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 msgr2=0x561178d15760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:44.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3c9294640 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d15760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3c9294640 1 -- 172.21.15.159:0/1192650996 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561178c07440 con 0x561178d15ca0 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d15760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3c9294640 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d24550 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400dc80 tx=0x7fd3b400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbb74c470f2b996 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3c9a95640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd3b00a33b0 0x7fd3b00a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00cc940 tx=0x7fd3c0013310 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3affff640 1 -- 172.21.15.159:0/1192650996 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4015070 con 0x561178d15ca0 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3affff640 1 -- 172.21.15.159:0/1192650996 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b401a940 con 0x561178d15ca0 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.156+0000 7fd3affff640 1 -- 172.21.15.159:0/1192650996 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4011a40 con 0x561178d15ca0 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1192650996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 msgr2=0x561178d24550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d24550 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400dc80 tx=0x7fd3b400f730 comp rx=0 tx=0).stop 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1192650996 shutdown_connections 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d26e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d24550 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1192650996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d15760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1192650996 >> 172.21.15.159:0/1192650996 conn(0x561178d11a30 msgr2=0x561178d11e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1192650996 shutdown_connections 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1192650996 wait complete. 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.157+0000 7fd3ce0d2740 1 -- start start 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ce0d2740 1 Processor -- start 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15380 0x561178d24440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15ca0 0x561178d216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d21c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561178d27660 con 0x561178d15380 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561178c36050 con 0x561178d15ca0 2024-09-19T06:54:44.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561178d277e0 con 0x561178d24a90 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ce0d2740 10 client.0 _ll_register_callbacks cb 0x561178c76160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ca296640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15380 0x561178d24440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ca296640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15380 0x561178d24440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54856/0 (socket says 172.21.15.159:54856) 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ca296640 1 -- 172.21.15.159:0/1690389051 learned_addr learned my addr 172.21.15.159:0/1690389051 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3c9294640 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15ca0 0x561178d216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ca296640 1 -- 172.21.15.159:0/1690389051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 msgr2=0x561178d21c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d21c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ca296640 1 -- 172.21.15.159:0/1690389051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15ca0 msgr2=0x561178d216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15ca0 0x561178d216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.158+0000 7fd3ca296640 1 -- 172.21.15.159:0/1690389051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611789ec3c0 con 0x561178d15380 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15380 0x561178d24440 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009ca0 tx=0x7fd3bc031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291a22434116ddd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1690389051 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc02f610 con 0x561178d15380 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1690389051 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7fd3bc02f7b0 con 0x561178d15380 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1690389051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b401a940 con 0x561178d15380 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1690389051 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd3bc004b40 con 0x561178d15380 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ce0d2740 10 client.17055 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1690389051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561178d330b0 con 0x561178d15380 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1690389051 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b401a940 con 0x561178d15380 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1690389051 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd3bc047070 con 0x561178d15380 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ce0d2740 10 client.17055 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ce0d2740 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ce0d2740 20 client.17055 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561178d344a0 0x561178d36920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ce0d2740 4 client.17055 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:44.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.159+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1690389051 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561178c88850 con 0x561178d344a0 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.160+0000 7fd3c9294640 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561178d344a0 0x561178d36920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.160+0000 7fd3c9294640 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561178d344a0 0x561178d36920 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25006d6aea1dc989 server_cookie=ad9bb0f15a8f7994 in_seq=0 out_seq=0 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.160+0000 7fd3ad7fa640 10 client.17055 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1690389051 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561178c88850 con 0x561178d344a0 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ad7fa640 10 client.17055 handle_command_reply: tid=0 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 client.17055 shutdown 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1690389051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15380 msgr2=0x561178d24440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15380 0x561178d24440 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009ca0 tx=0x7fd3bc031f20 comp rx=0 tx=0).stop 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1690389051 shutdown_connections 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561178d344a0 0x561178d36920 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d21c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15ca0 0x561178d216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ad7fa640 0 client.17055 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:44.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1690389051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15380 0x561178d24440 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1690389051 >> 172.21.15.159:0/1690389051 conn(0x561178d11a30 msgr2=0x561178d17790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:44.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1690389051 shutdown_connections 2024-09-19T06:54:44.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1690389051 wait complete. 2024-09-19T06:54:44.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.161+0000 7fd3ce0d2740 20 client.17055 trim_cache size 0 max 16384 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.178+0000 7fd3ce0d2740 1 Processor -- start 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.178+0000 7fd3ce0d2740 1 -- start start 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d30900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d3c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d3c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41a9900 con 0x561178d15ca0 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41ac160 con 0x561178d15380 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41a9f50 con 0x561178d24a90 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3c9294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d3c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3c9294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d3c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54872/0 (socket says 172.21.15.159:54872) 2024-09-19T06:54:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3c9294640 1 -- 172.21.15.159:0/547064409 learned_addr learned my addr 172.21.15.159:0/547064409 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3ca296640 1 --2- 172.21.15.159:0/547064409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d30900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3ca296640 1 --2- 172.21.15.159:0/547064409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d3c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3c9294640 1 -- 172.21.15.159:0/547064409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 msgr2=0x561178d3c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3c9294640 1 --2- 172.21.15.159:0/547064409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d3c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3c9294640 1 -- 172.21.15.159:0/547064409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 msgr2=0x561178d30900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3c9294640 1 --2- 172.21.15.159:0/547064409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d30900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3c9294640 1 -- 172.21.15.159:0/547064409 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561178d114d0 con 0x561178d15ca0 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3c9294640 1 --2- 172.21.15.159:0/547064409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d3c1f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x561178d18090 tx=0x7fd3b400d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0221a283d41bf9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3af7fe640 1 -- 172.21.15.159:0/547064409 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4015050 con 0x561178d15ca0 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3af7fe640 1 -- 172.21.15.159:0/547064409 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b4005040 con 0x561178d15ca0 2024-09-19T06:54:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.179+0000 7fd3af7fe640 1 -- 172.21.15.159:0/547064409 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4011950 con 0x561178d15ca0 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.180+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/547064409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 msgr2=0x561178d3c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.180+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/547064409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d3c1f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x561178d18090 tx=0x7fd3b400d580 comp rx=0 tx=0).stop 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.180+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/547064409 shutdown_connections 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.180+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/547064409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d3c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.180+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/547064409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d3c1f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.180+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/547064409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d30900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.180+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/547064409 >> 172.21.15.159:0/547064409 conn(0x561178d11a30 msgr2=0x561178d1cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.180+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/547064409 shutdown_connections 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.180+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/547064409 wait complete. 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ce0d2740 1 -- start start 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ce0d2740 1 Processor -- start 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d28b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d29060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ce0d2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d9e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41aa620 con 0x561178d15ca0 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41aba90 con 0x561178d15380 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ce0d2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41aacf0 con 0x561178d24a90 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ce0d2740 10 client.0 _ll_register_callbacks cb 0x7fd3bc009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3c9294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d29060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3c9294640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d29060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54882/0 (socket says 172.21.15.159:54882) 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3c9294640 1 -- 172.21.15.159:0/1004651299 learned_addr learned my addr 172.21.15.159:0/1004651299 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d9e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.181+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d28b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3c9294640 1 -- 172.21.15.159:0/1004651299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 msgr2=0x561178d9e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3c9294640 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d9e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3c9294640 1 -- 172.21.15.159:0/1004651299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 msgr2=0x561178d28b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3c9294640 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d28b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3c9294640 1 -- 172.21.15.159:0/1004651299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561178d29910 con 0x561178d15ca0 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d28b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3c9294640 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d29060 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4005e00 tx=0x7fd3b400de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d13a8f69725ac4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1004651299 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4035060 con 0x561178d15ca0 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1004651299 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7fd3b4005400 con 0x561178d15ca0 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1004651299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b4005040 con 0x561178d15ca0 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1004651299 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd3b4005600 con 0x561178d15ca0 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ce0d2740 10 client.17061 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1004651299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561178d9f7f0 con 0x561178d15ca0 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1004651299 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b4005040 con 0x561178d15ca0 2024-09-19T06:54:44.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1004651299 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd3b4004680 con 0x561178d15ca0 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ce0d2740 10 client.17061 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ce0d2740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.182+0000 7fd3ce0d2740 20 client.17061 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.183+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561178d9fc70 0x561178da2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.183+0000 7fd3ce0d2740 4 client.17061 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.183+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1004651299 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561178c82d60 con 0x561178d9fc70 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.183+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561178d9fc70 0x561178da2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.183+0000 7fd3ca296640 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561178d9fc70 0x561178da2090 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2430981853e0e75b server_cookie=568a55d64deaf2df in_seq=0 out_seq=0 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.183+0000 7fd3ad7fa640 10 client.17061 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ad7fa640 1 -- 172.21.15.159:0/1004651299 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561178c82d60 con 0x561178d9fc70 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ad7fa640 10 client.17061 handle_command_reply: tid=0 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 client.17061 shutdown 2024-09-19T06:54:44.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1004651299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 msgr2=0x561178d29060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d29060 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4005e00 tx=0x7fd3b400de90 comp rx=0 tx=0).stop 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1004651299 shutdown_connections 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x561178d9fc70 0x561178da2090 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561178d24a90 0x561178d9e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561178d15ca0 0x561178d29060 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ad7fa640 0 client.17061 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 --2- 172.21.15.159:0/1004651299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561178d15380 0x561178d28b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1004651299 >> 172.21.15.159:0/1004651299 conn(0x561178d11a30 msgr2=0x561178d10350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1004651299 shutdown_connections 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 1 -- 172.21.15.159:0/1004651299 wait complete. 2024-09-19T06:54:44.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3ce0d2740 20 client.17061 trim_cache size 0 max 16384 2024-09-19T06:54:44.194 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:54:44.194 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:54:44.194 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:54:44.194 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd3b00a33b0 msgr2=0x7fd3b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd3b00a33b0 0x7fd3b00a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00cc940 tx=0x7fd3c0013310 comp rx=0 tx=0).stop 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4101de0 msgr2=0x7fd3c4198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.184+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4101de0 0x7fd3c4198470 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000b4a0 tx=0x7fd3c000b960 comp rx=0 tx=0).stop 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.185+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2039238451 shutdown_connections 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.185+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd3b00a33b0 0x7fd3b00a5870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.185+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3c4106f10 0x7fd3c419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.185+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3c4102790 0x7fd3c41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.185+0000 7fd3cbcf9640 1 --2- 172.21.15.159:0/2039238451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c4101de0 0x7fd3c4198470 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.185+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2039238451 >> 172.21.15.159:0/2039238451 conn(0x7fd3c40fd8c0 msgr2=0x7fd3c40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.185+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2039238451 shutdown_connections 2024-09-19T06:54:44.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:44.185+0000 7fd3cbcf9640 1 -- 172.21.15.159:0/2039238451 wait complete. 2024-09-19T06:54:45.088 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:54:45.089 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:54:45.337 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:45.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 -- 172.21.15.159:0/302912713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 msgr2=0x7f53fc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:45.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 --2- 172.21.15.159:0/302912713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 0x7f53fc106e60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009930 tx=0x7f53f802a420 comp rx=0 tx=0).stop 2024-09-19T06:54:45.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 -- 172.21.15.159:0/302912713 shutdown_connections 2024-09-19T06:54:45.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 --2- 172.21.15.159:0/302912713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc101420 0x7f53fc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:45.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 --2- 172.21.15.159:0/302912713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc100a80 0x7f53fc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 --2- 172.21.15.159:0/302912713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 0x7f53fc106e60 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 -- 172.21.15.159:0/302912713 >> 172.21.15.159:0/302912713 conn(0x7f53fc0fc7a0 msgr2=0x7f53fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 -- 172.21.15.159:0/302912713 shutdown_connections 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 -- 172.21.15.159:0/302912713 wait complete. 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.831+0000 7f5404682640 1 Processor -- start 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5404682640 1 -- start start 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5404682640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc100a80 0x7f53fc199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5404682640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc101420 0x7f53fc1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5404682640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 0x7f53fc1a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5404682640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc110ea0 con 0x7f53fc106a80 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5404682640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc110d20 con 0x7f53fc101420 2024-09-19T06:54:45.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5404682640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc111020 con 0x7f53fc100a80 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5402c1f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 0x7f53fc1a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5402c1f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 0x7f53fc1a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54914/0 (socket says 172.21.15.159:54914) 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5402c1f640 1 -- 172.21.15.159:0/3274616481 learned_addr learned my addr 172.21.15.159:0/3274616481 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f540241e640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc100a80 0x7f53fc199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5401c1d640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc101420 0x7f53fc1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5402c1f640 1 -- 172.21.15.159:0/3274616481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc100a80 msgr2=0x7f53fc199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5402c1f640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc100a80 0x7f53fc199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5402c1f640 1 -- 172.21.15.159:0/3274616481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc101420 msgr2=0x7f53fc1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5402c1f640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc101420 0x7f53fc1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5402c1f640 1 -- 172.21.15.159:0/3274616481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc1a4930 con 0x7f53fc106a80 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f5402c1f640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 0x7f53fc1a43f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f53f400cad0 tx=0x7f53f400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.832+0000 7f53f37fe640 1 -- 172.21.15.159:0/3274616481 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f400ae20 con 0x7f53fc106a80 2024-09-19T06:54:45.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.833+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc1a4b00 con 0x7f53fc106a80 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.833+0000 7f53f37fe640 1 -- 172.21.15.159:0/3274616481 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4005020 con 0x7f53fc106a80 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.833+0000 7f53f37fe640 1 -- 172.21.15.159:0/3274616481 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f400f6f0 con 0x7f53fc106a80 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.833+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc1a5010 con 0x7f53fc106a80 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.833+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53fc100ee0 con 0x7f53fc106a80 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.835+0000 7f53f37fe640 1 -- 172.21.15.159:0/3274616481 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f53f40051d0 con 0x7f53fc106a80 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.835+0000 7f53f37fe640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f53e80a33b0 0x7f53e80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.835+0000 7f540241e640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f53e80a33b0 0x7f53e80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.835+0000 7f53f37fe640 1 -- 172.21.15.159:0/3274616481 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f53f40d0170 con 0x7f53fc106a80 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.836+0000 7f540241e640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f53e80a33b0 0x7f53e80a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f53f8000c00 tx=0x7f53f8031490 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:45.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:45.839+0000 7f53f37fe640 1 -- 172.21.15.159:0/3274616481 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53f4014030 con 0x7f53fc106a80 2024-09-19T06:54:46.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.039+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53fc06ad80 con 0x7f53fc106a80 2024-09-19T06:54:46.041 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:45 smithi159 ceph-mon[30935]: pgmap v239: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:46.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.040+0000 7f53f37fe640 1 -- 172.21.15.159:0/3274616481 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f53fc06ad80 con 0x7f53fc106a80 2024-09-19T06:54:46.042 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:54:46.042 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:54:46.042 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:54:46.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f53e80a33b0 msgr2=0x7f53e80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:46.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f53e80a33b0 0x7f53e80a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f53f8000c00 tx=0x7f53f8031490 comp rx=0 tx=0).stop 2024-09-19T06:54:46.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 msgr2=0x7f53fc1a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:46.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 0x7f53fc1a43f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f53f400cad0 tx=0x7f53f400cf90 comp rx=0 tx=0).stop 2024-09-19T06:54:46.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 shutdown_connections 2024-09-19T06:54:46.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f53e80a33b0 0x7f53e80a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:46.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc106a80 0x7f53fc1a43f0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:46.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc101420 0x7f53fc1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:46.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 --2- 172.21.15.159:0/3274616481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53fc100a80 0x7f53fc199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:46.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.042+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 >> 172.21.15.159:0/3274616481 conn(0x7f53fc0fc7a0 msgr2=0x7f53fc0fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:46.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.043+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 shutdown_connections 2024-09-19T06:54:46.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:46.043+0000 7f5404682640 1 -- 172.21.15.159:0/3274616481 wait complete. 2024-09-19T06:54:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:45 smithi203 ceph-mon[35473]: pgmap v239: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:46.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:45 smithi189 ceph-mon[34880]: pgmap v239: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:46.744 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:54:46.767 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:46 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3274616481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:47.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:46 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3274616481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:47.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:46 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3274616481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.430+0000 7f39f8542640 1 -- 172.21.15.159:0/2602220130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0101de0 msgr2=0x7f39f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.430+0000 7f39f8542640 1 --2- 172.21.15.159:0/2602220130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0101de0 0x7f39f01021c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009900 tx=0x7f39ec02a410 comp rx=0 tx=0).stop 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.430+0000 7f39f8542640 1 -- 172.21.15.159:0/2602220130 shutdown_connections 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.430+0000 7f39f8542640 1 --2- 172.21.15.159:0/2602220130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39f0106f10 0x7f39f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.430+0000 7f39f8542640 1 --2- 172.21.15.159:0/2602220130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f0102790 0x7f39f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.430+0000 7f39f8542640 1 --2- 172.21.15.159:0/2602220130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0101de0 0x7f39f01021c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.430+0000 7f39f8542640 1 -- 172.21.15.159:0/2602220130 >> 172.21.15.159:0/2602220130 conn(0x7f39f00fd8c0 msgr2=0x7f39f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.430+0000 7f39f8542640 1 -- 172.21.15.159:0/2602220130 shutdown_connections 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.430+0000 7f39f8542640 1 -- 172.21.15.159:0/2602220130 wait complete. 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f8542640 1 Processor -- start 2024-09-19T06:54:47.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f8542640 1 -- start start 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f8542640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39f0101de0 0x7f39f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f8542640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0102790 0x7f39f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f8542640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f0106f10 0x7f39f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f8542640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0111f30 con 0x7f39f0102790 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f8542640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0111db0 con 0x7f39f0101de0 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f8542640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01120b0 con 0x7f39f0106f10 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f5add640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0102790 0x7f39f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f5add640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0102790 0x7f39f0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54926/0 (socket says 172.21.15.159:54926) 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f5add640 1 -- 172.21.15.159:0/2518089383 learned_addr learned my addr 172.21.15.159:0/2518089383 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f62de640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39f0101de0 0x7f39f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f5add640 1 -- 172.21.15.159:0/2518089383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f0106f10 msgr2=0x7f39f0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:47.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f6adf640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f0106f10 0x7f39f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f5add640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f0106f10 0x7f39f0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f5add640 1 -- 172.21.15.159:0/2518089383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39f0101de0 msgr2=0x7f39f00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f5add640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39f0101de0 0x7f39f00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f5add640 1 -- 172.21.15.159:0/2518089383 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f01a68f0 con 0x7f39f0102790 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.431+0000 7f39f6adf640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f0106f10 0x7f39f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.432+0000 7f39f62de640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39f0101de0 0x7f39f00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.432+0000 7f39f5add640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0102790 0x7f39f0074a30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f39e000c920 tx=0x7f39e000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.432+0000 7f39e77fe640 1 -- 172.21.15.159:0/2518089383 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0007c70 con 0x7f39f0102790 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.432+0000 7f39e77fe640 1 -- 172.21.15.159:0/2518089383 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39e0007e10 con 0x7f39f0102790 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.432+0000 7f39f8542640 1 -- 172.21.15.159:0/2518089383 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f01a6be0 con 0x7f39f0102790 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.432+0000 7f39e77fe640 1 -- 172.21.15.159:0/2518089383 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0018890 con 0x7f39f0102790 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.432+0000 7f39f8542640 1 -- 172.21.15.159:0/2518089383 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f01a7120 con 0x7f39f0102790 2024-09-19T06:54:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39fa91b740 1 Processor -- start 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39fa91b740 1 -- start start 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39e77fe640 1 -- 172.21.15.159:0/2518089383 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f39e0018a70 con 0x7f39f0102790 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde7b40 0x55b44cde6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde65d0 0x55b44cde6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 0x55b44cdf3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39fa91b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b44cd4c2f0 con 0x55b44cde65d0 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39fa91b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b44ccf3cf0 con 0x55b44cde7b40 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39fa91b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b44cd482b0 con 0x55b44cdf1370 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39f62de640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde65d0 0x55b44cde6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39f62de640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde65d0 0x55b44cde6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54942/0 (socket says 172.21.15.159:54942) 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39f62de640 1 -- 172.21.15.159:0/738376529 learned_addr learned my addr 172.21.15.159:0/738376529 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.435+0000 7f39f5add640 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 0x55b44cdf3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39f6adf640 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde7b40 0x55b44cde6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39f62de640 1 -- 172.21.15.159:0/738376529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 msgr2=0x55b44cdf3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39f62de640 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 0x55b44cdf3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39f62de640 1 -- 172.21.15.159:0/738376529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde7b40 msgr2=0x55b44cde6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39f62de640 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde7b40 0x55b44cde6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39f62de640 1 -- 172.21.15.159:0/738376529 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b44ccd83a0 con 0x55b44cde65d0 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39f5add640 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 0x55b44cdf3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39f62de640 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde65d0 0x55b44cde6a10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f39ec000c00 tx=0x7f39ec032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a83b0a86d91bed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39e77fe640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39dc0a33b0 0x7f39dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39f6adf640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39dc0a33b0 0x7f39dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39e4ff9640 1 -- 172.21.15.159:0/738376529 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec03f070 con 0x55b44cde65d0 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39e4ff9640 1 -- 172.21.15.159:0/738376529 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39ec0317b0 con 0x55b44cde65d0 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39e77fe640 1 -- 172.21.15.159:0/2518089383 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f39e00cff80 con 0x7f39f0102790 2024-09-19T06:54:47.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.436+0000 7f39e4ff9640 1 -- 172.21.15.159:0/738376529 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec035070 con 0x55b44cde65d0 2024-09-19T06:54:47.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 -- 172.21.15.159:0/738376529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde65d0 msgr2=0x55b44cde6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:47.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39f6adf640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39dc0a33b0 0x7f39dc0a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005fd0 tx=0x7f39e80085b0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:47.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde65d0 0x55b44cde6a10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f39ec000c00 tx=0x7f39ec032d70 comp rx=0 tx=0).stop 2024-09-19T06:54:47.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 -- 172.21.15.159:0/738376529 shutdown_connections 2024-09-19T06:54:47.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 0x55b44cdf3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde65d0 0x55b44cde6a10 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 --2- 172.21.15.159:0/738376529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde7b40 0x55b44cde6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 -- 172.21.15.159:0/738376529 >> 172.21.15.159:0/738376529 conn(0x55b44cdaf310 msgr2=0x55b44cde2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:47.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 -- 172.21.15.159:0/738376529 shutdown_connections 2024-09-19T06:54:47.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 -- 172.21.15.159:0/738376529 wait complete. 2024-09-19T06:54:47.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 -- start start 2024-09-19T06:54:47.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.437+0000 7f39fa91b740 1 Processor -- start 2024-09-19T06:54:47.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 0x55b44cdf0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdedf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cdee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39fa91b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b44cdf4010 con 0x55b44cde7b40 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39fa91b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b44cd07060 con 0x55b44cdf1370 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39fa91b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b44cdf4190 con 0x55b44cde65d0 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39fa91b740 10 client.0 _ll_register_callbacks cb 0x55b44ca5a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f5add640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdedf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f5add640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdedf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54954/0 (socket says 172.21.15.159:54954) 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f62de640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 0x55b44cdf0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f5add640 1 -- 172.21.15.159:0/587178106 learned_addr learned my addr 172.21.15.159:0/587178106 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f6adf640 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cdee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f5add640 1 -- 172.21.15.159:0/587178106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 msgr2=0x55b44cdf0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f5add640 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 0x55b44cdf0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f5add640 1 -- 172.21.15.159:0/587178106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 msgr2=0x55b44cdee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f5add640 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cdee4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f5add640 1 -- 172.21.15.159:0/587178106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b44cabd3c0 con 0x55b44cde7b40 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f6adf640 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cdee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39f5add640 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdedf70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f39e009c190 tx=0x7f39e009c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c96682a1ac9f5e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39d9ffb640 1 -- 172.21.15.159:0/587178106 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e009c900 con 0x55b44cde7b40 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39d9ffb640 1 -- 172.21.15.159:0/587178106 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f39e0098870 con 0x55b44cde7b40 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.438+0000 7f39fa91b740 1 -- 172.21.15.159:0/587178106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39ec0317b0 con 0x55b44cde7b40 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39d9ffb640 1 -- 172.21.15.159:0/587178106 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f39e009c200 con 0x55b44cde7b40 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39fa91b740 10 client.17079 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39fa91b740 1 -- 172.21.15.159:0/587178106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b44cdffa80 con 0x55b44cde7b40 2024-09-19T06:54:47.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39d9ffb640 1 -- 172.21.15.159:0/587178106 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39ec0317b0 con 0x55b44cde7b40 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39d9ffb640 1 -- 172.21.15.159:0/587178106 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f39e00d2070 con 0x55b44cde7b40 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39fa91b740 10 client.17079 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39fa91b740 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39fa91b740 20 client.17079 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39fa91b740 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b44ce00f40 0x55b44ce03330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39fa91b740 4 client.17079 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39fa91b740 1 -- 172.21.15.159:0/587178106 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b44cd59860 con 0x55b44ce00f40 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.439+0000 7f39f62de640 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b44ce00f40 0x55b44ce03330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.440+0000 7f39d9ffb640 10 client.17079 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.440+0000 7f39f62de640 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b44ce00f40 0x55b44ce03330 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292f2e2a0c4383af server_cookie=9c17a985ba98fe64 in_seq=0 out_seq=0 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.440+0000 7f39d9ffb640 1 -- 172.21.15.159:0/587178106 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b44cd59860 con 0x55b44ce00f40 2024-09-19T06:54:47.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.440+0000 7f39d9ffb640 10 client.17079 handle_command_reply: tid=0 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.440+0000 7f39fa91b740 1 client.17079 shutdown 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.440+0000 7f39fa91b740 1 -- 172.21.15.159:0/587178106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 msgr2=0x55b44cdedf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.440+0000 7f39fa91b740 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdedf70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f39e009c190 tx=0x7f39e009c090 comp rx=0 tx=0).stop 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39fa91b740 1 -- 172.21.15.159:0/587178106 shutdown_connections 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39fa91b740 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b44ce00f40 0x55b44ce03330 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39fa91b740 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cdee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39fa91b740 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdedf70 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39d9ffb640 0 client.17079 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39fa91b740 1 --2- 172.21.15.159:0/587178106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 0x55b44cdf0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39fa91b740 1 -- 172.21.15.159:0/587178106 >> 172.21.15.159:0/587178106 conn(0x55b44cdaf310 msgr2=0x55b44cde8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39fa91b740 1 -- 172.21.15.159:0/587178106 shutdown_connections 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39fa91b740 1 -- 172.21.15.159:0/587178106 wait complete. 2024-09-19T06:54:47.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.441+0000 7f39fa91b740 20 client.17079 trim_cache size 0 max 16384 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39fa91b740 1 Processor -- start 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39fa91b740 1 -- start start 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 0x55b44cdefee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cde9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cde9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39fa91b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01adb50 con 0x55b44cde7b40 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39fa91b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01b03b0 con 0x55b44cdf1370 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39fa91b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01ae1a0 con 0x55b44cde65d0 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39f5add640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cde9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39f5add640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cde9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54968/0 (socket says 172.21.15.159:54968) 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39f5add640 1 -- 172.21.15.159:0/315959670 learned_addr learned my addr 172.21.15.159:0/315959670 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39f62de640 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 0x55b44cdefee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.454+0000 7f39f6adf640 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cde9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39f5add640 1 -- 172.21.15.159:0/315959670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 msgr2=0x55b44cdefee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39f5add640 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 0x55b44cdefee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39f5add640 1 -- 172.21.15.159:0/315959670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 msgr2=0x55b44cde9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39f5add640 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cde9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39f5add640 1 -- 172.21.15.159:0/315959670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b44ce03990 con 0x55b44cde7b40 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39f62de640 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 0x55b44cdefee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39f6adf640 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cde9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39f5add640 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cde9120 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f39e00bc1a0 tx=0x7f39e009a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00914ad683838f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39dbfff640 1 -- 172.21.15.159:0/315959670 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e009c900 con 0x55b44cde7b40 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39dbfff640 1 -- 172.21.15.159:0/315959670 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39e00a05b0 con 0x55b44cde7b40 2024-09-19T06:54:47.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.455+0000 7f39dbfff640 1 -- 172.21.15.159:0/315959670 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e00a0150 con 0x55b44cde7b40 2024-09-19T06:54:47.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 -- 172.21.15.159:0/315959670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 msgr2=0x55b44cde9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cde9120 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f39e00bc1a0 tx=0x7f39e009a710 comp rx=0 tx=0).stop 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 -- 172.21.15.159:0/315959670 shutdown_connections 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cdf1370 0x55b44cde9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cde9120 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 --2- 172.21.15.159:0/315959670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cde65d0 0x55b44cdefee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 -- 172.21.15.159:0/315959670 >> 172.21.15.159:0/315959670 conn(0x55b44cdaf310 msgr2=0x55b44cdef7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 -- 172.21.15.159:0/315959670 shutdown_connections 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 -- 172.21.15.159:0/315959670 wait complete. 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 -- start start 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 Processor -- start 2024-09-19T06:54:47.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde65d0 0x55b44cdeb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdeb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 0x55b44cdebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01ae870 con 0x55b44cde7b40 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01afce0 con 0x55b44cde65d0 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01aef40 con 0x55b44cdf1370 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39fa91b740 10 client.0 _ll_register_callbacks cb 0x7f39e000c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.456+0000 7f39f5add640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdeb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f5add640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdeb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54980/0 (socket says 172.21.15.159:54980) 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f5add640 1 -- 172.21.15.159:0/1015673372 learned_addr learned my addr 172.21.15.159:0/1015673372 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f62de640 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde65d0 0x55b44cdeb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f6adf640 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 0x55b44cdebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f5add640 1 -- 172.21.15.159:0/1015673372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 msgr2=0x55b44cdebbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:47.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f5add640 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 0x55b44cdebbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f5add640 1 -- 172.21.15.159:0/1015673372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde65d0 msgr2=0x55b44cdeb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f5add640 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde65d0 0x55b44cdeb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f5add640 1 -- 172.21.15.159:0/1015673372 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b44ce6ad90 con 0x55b44cde7b40 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39f5add640 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdeb680 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f39e00bc010 tx=0x7f39e00d3910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f528508c81a09a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39d9ffb640 1 -- 172.21.15.159:0/1015673372 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e00a4be0 con 0x55b44cde7b40 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39d9ffb640 1 -- 172.21.15.159:0/1015673372 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f39e009b650 con 0x55b44cde7b40 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39fa91b740 1 -- 172.21.15.159:0/1015673372 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39e00a05b0 con 0x55b44cde7b40 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39d9ffb640 1 -- 172.21.15.159:0/1015673372 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f39e009c900 con 0x55b44cde7b40 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39fa91b740 10 client.17085 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39fa91b740 1 -- 172.21.15.159:0/1015673372 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b44ce6bf80 con 0x55b44cde7b40 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.457+0000 7f39d9ffb640 1 -- 172.21.15.159:0/1015673372 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39e00a05b0 con 0x55b44cde7b40 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39d9ffb640 1 -- 172.21.15.159:0/1015673372 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f39e009b0c0 con 0x55b44cde7b40 2024-09-19T06:54:47.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39fa91b740 10 client.17085 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39fa91b740 10 client.17085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39fa91b740 20 client.17085 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39fa91b740 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b44ce6c510 0x55b44ce6e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39fa91b740 4 client.17085 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39fa91b740 1 -- 172.21.15.159:0/1015673372 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b44cd53d70 con 0x55b44ce6c510 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39f62de640 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b44ce6c510 0x55b44ce6e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39d9ffb640 10 client.17085 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39f62de640 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b44ce6c510 0x55b44ce6e930 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fdbb64ba3ccfee5 server_cookie=3ab0153a91c3d1e8 in_seq=0 out_seq=0 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.458+0000 7f39d9ffb640 1 -- 172.21.15.159:0/1015673372 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b44cd53d70 con 0x55b44ce6c510 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39d9ffb640 10 client.17085 handle_command_reply: tid=0 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 client.17085 shutdown 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 -- 172.21.15.159:0/1015673372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 msgr2=0x55b44cdeb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:47.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdeb680 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f39e00bc010 tx=0x7f39e00d3910 comp rx=0 tx=0).stop 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 -- 172.21.15.159:0/1015673372 shutdown_connections 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55b44ce6c510 0x55b44ce6e930 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b44cdf1370 0x55b44cdebbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b44cde7b40 0x55b44cdeb680 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 --2- 172.21.15.159:0/1015673372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b44cde65d0 0x55b44cdeb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 -- 172.21.15.159:0/1015673372 >> 172.21.15.159:0/1015673372 conn(0x55b44cdaf310 msgr2=0x55b44cde1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39d9ffb640 0 client.17085 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 -- 172.21.15.159:0/1015673372 shutdown_connections 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 1 -- 172.21.15.159:0/1015673372 wait complete. 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39fa91b740 20 client.17085 trim_cache size 0 max 16384 2024-09-19T06:54:47.471 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:54:47.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 -- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39dc0a33b0 msgr2=0x7f39dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:47.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39dc0a33b0 0x7f39dc0a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005fd0 tx=0x7f39e80085b0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 -- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0102790 msgr2=0x7f39f0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:47.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0102790 0x7f39f0074a30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f39e000c920 tx=0x7f39e000cde0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 -- 172.21.15.159:0/2518089383 shutdown_connections 2024-09-19T06:54:47.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f39dc0a33b0 0x7f39dc0a5870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f0106f10 0x7f39f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39f0102790 0x7f39f0074a30 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 --2- 172.21.15.159:0/2518089383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39f0101de0 0x7f39f00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:47.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.459+0000 7f39f8542640 1 -- 172.21.15.159:0/2518089383 >> 172.21.15.159:0/2518089383 conn(0x7f39f00fd8c0 msgr2=0x7f39f00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:47.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.460+0000 7f39f8542640 1 -- 172.21.15.159:0/2518089383 shutdown_connections 2024-09-19T06:54:47.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:47.460+0000 7f39f8542640 1 -- 172.21.15.159:0/2518089383 wait complete. 2024-09-19T06:54:48.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:47 smithi203 ceph-mon[35473]: pgmap v240: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:48.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:47 smithi189 ceph-mon[34880]: pgmap v240: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:48.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:47 smithi159 ceph-mon[30935]: pgmap v240: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:54:49.235 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:54:49.235 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:54:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:49.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:49 smithi159 ceph-mon[30935]: pgmap v241: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:50.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.001+0000 7f907025a640 1 -- 172.21.15.159:0/2396481672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 msgr2=0x7f90681021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:50.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.001+0000 7f907025a640 1 --2- 172.21.15.159:0/2396481672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 0x7f90681021d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9064009900 tx=0x7f906402a410 comp rx=0 tx=0).stop 2024-09-19T06:54:50.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.001+0000 7f907025a640 1 -- 172.21.15.159:0/2396481672 shutdown_connections 2024-09-19T06:54:50.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.001+0000 7f907025a640 1 --2- 172.21.15.159:0/2396481672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9068106f20 0x7f906810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.001+0000 7f907025a640 1 --2- 172.21.15.159:0/2396481672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90681027a0 0x7f90681067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.001+0000 7f907025a640 1 --2- 172.21.15.159:0/2396481672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 0x7f90681021d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.001+0000 7f907025a640 1 -- 172.21.15.159:0/2396481672 >> 172.21.15.159:0/2396481672 conn(0x7f90680fd8b0 msgr2=0x7f90680ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:50.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.001+0000 7f907025a640 1 -- 172.21.15.159:0/2396481672 shutdown_connections 2024-09-19T06:54:50.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.001+0000 7f907025a640 1 -- 172.21.15.159:0/2396481672 wait complete. 2024-09-19T06:54:50.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f907025a640 1 Processor -- start 2024-09-19T06:54:50.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f907025a640 1 -- start start 2024-09-19T06:54:50.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f907025a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 0x7f90680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f907025a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90681027a0 0x7f9068074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f907025a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9068106f20 0x7f9068074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f907025a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9068111fa0 con 0x7f9068101df0 2024-09-19T06:54:50.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f907025a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9068111e20 con 0x7f90681027a0 2024-09-19T06:54:50.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f907025a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9068112120 con 0x7f9068106f20 2024-09-19T06:54:50.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906dff6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 0x7f90680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906dff6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 0x7f90680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40830/0 (socket says 172.21.15.159:40830) 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906dff6640 1 -- 172.21.15.159:0/799765884 learned_addr learned my addr 172.21.15.159:0/799765884 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906d7f5640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90681027a0 0x7f9068074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906dff6640 1 -- 172.21.15.159:0/799765884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9068106f20 msgr2=0x7f9068074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906dff6640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9068106f20 0x7f9068074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906dff6640 1 -- 172.21.15.159:0/799765884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90681027a0 msgr2=0x7f9068074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906dff6640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90681027a0 0x7f9068074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906dff6640 1 -- 172.21.15.159:0/799765884 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90681a6960 con 0x7f9068101df0 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.002+0000 7f906dff6640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 0x7f90680744f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9064006010 tx=0x7f90640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.003+0000 7f905effd640 1 -- 172.21.15.159:0/799765884 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906403f030 con 0x7f9068101df0 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.003+0000 7f905effd640 1 -- 172.21.15.159:0/799765884 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9064003ce0 con 0x7f9068101df0 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.003+0000 7f907025a640 1 -- 172.21.15.159:0/799765884 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90681a6bf0 con 0x7f9068101df0 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.003+0000 7f905effd640 1 -- 172.21.15.159:0/799765884 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064035070 con 0x7f9068101df0 2024-09-19T06:54:50.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.003+0000 7f907025a640 1 -- 172.21.15.159:0/799765884 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90681a70d0 con 0x7f9068101df0 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.005+0000 7f905effd640 1 -- 172.21.15.159:0/799765884 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9064042030 con 0x7f9068101df0 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.005+0000 7f9072633740 1 Processor -- start 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.005+0000 7f9072633740 1 -- start start 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f905effd640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f90540a33b0 0x7f90540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f9072633740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787eb60 0x556f4787ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f9072633740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f47889800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f9072633740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f4788c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f9072633740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x556f477e4280 con 0x556f47889d40 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f9072633740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556f4778bb10 con 0x556f4787eb60 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f9072633740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556f477e0240 con 0x556f4787f480 2024-09-19T06:54:50.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f90540a33b0 0x7f90540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f905effd640 1 -- 172.21.15.159:0/799765884 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f90640f0340 con 0x7f9068101df0 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f4788c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f4788c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40846/0 (socket says 172.21.15.159:40846) 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 -- 172.21.15.159:0/1836538241 learned_addr learned my addr 172.21.15.159:0/1836538241 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906d7f5640 1 --2- 172.21.15.159:0/1836538241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f47889800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906dff6640 1 --2- 172.21.15.159:0/1836538241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787eb60 0x556f4787ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 -- 172.21.15.159:0/1836538241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 msgr2=0x556f47889800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 --2- 172.21.15.159:0/1836538241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f47889800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 -- 172.21.15.159:0/1836538241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787eb60 msgr2=0x556f4787ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 --2- 172.21.15.159:0/1836538241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787eb60 0x556f4787ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 -- 172.21.15.159:0/1836538241 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f477981f0 con 0x556f47889d40 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f90540a33b0 0x7f90540a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9060012a80 tx=0x7f9060009cd0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:50.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.006+0000 7f906e7f7640 1 --2- 172.21.15.159:0/1836538241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f4788c130 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f906000f730 tx=0x7f9060019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe32829d53872af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9053fff640 1 -- 172.21.15.159:0/1836538241 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060022070 con 0x556f47889d40 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9053fff640 1 -- 172.21.15.159:0/1836538241 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f906000dbe0 con 0x556f47889d40 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9053fff640 1 -- 172.21.15.159:0/1836538241 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90600054e0 con 0x556f47889d40 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9072633740 1 -- 172.21.15.159:0/1836538241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 msgr2=0x556f4788c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9072633740 1 --2- 172.21.15.159:0/1836538241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f4788c130 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f906000f730 tx=0x7f9060019000 comp rx=0 tx=0).stop 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9072633740 1 -- 172.21.15.159:0/1836538241 shutdown_connections 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9072633740 1 --2- 172.21.15.159:0/1836538241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f4788c130 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9072633740 1 --2- 172.21.15.159:0/1836538241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f47889800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9072633740 1 --2- 172.21.15.159:0/1836538241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787eb60 0x556f4787ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9072633740 1 -- 172.21.15.159:0/1836538241 >> 172.21.15.159:0/1836538241 conn(0x556f4787b0f0 msgr2=0x556f4787b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9072633740 1 -- 172.21.15.159:0/1836538241 shutdown_connections 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.007+0000 7f9072633740 1 -- 172.21.15.159:0/1836538241 wait complete. 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f9072633740 1 -- start start 2024-09-19T06:54:50.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f9072633740 1 Processor -- start 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f9072633740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787eb60 0x556f47886c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f9072633740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787f480 0x556f47887150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f9072633740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f47887690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f9072633740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x556f4788c910 con 0x556f47889d40 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f9072633740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556f4779ef10 con 0x556f4787f480 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f9072633740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556f4788ca90 con 0x556f4787eb60 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f9072633740 10 client.0 _ll_register_callbacks cb 0x556f47767a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f906e7f7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f47887690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f906e7f7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f47887690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40850/0 (socket says 172.21.15.159:40850) 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f906e7f7640 1 -- 172.21.15.159:0/3137630253 learned_addr learned my addr 172.21.15.159:0/3137630253 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.008+0000 7f906d7f5640 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787f480 0x556f47887150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f906dff6640 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787eb60 0x556f47886c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f906e7f7640 1 -- 172.21.15.159:0/3137630253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787eb60 msgr2=0x556f47886c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f906e7f7640 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787eb60 0x556f47886c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f906e7f7640 1 -- 172.21.15.159:0/3137630253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787f480 msgr2=0x556f47887150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f906e7f7640 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787f480 0x556f47887150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f906e7f7640 1 -- 172.21.15.159:0/3137630253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f475556a0 con 0x556f47889d40 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f906e7f7640 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f47887690 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9060012fe0 tx=0x7f90600124d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa551060c4143c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f90517fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f90517fa640 1 -- 172.21.15.159:0/3137630253 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060033060 con 0x556f47889d40 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f90517fa640 1 -- 172.21.15.159:0/3137630253 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f9060004d20 con 0x556f47889d40 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f9072633740 1 -- 172.21.15.159:0/3137630253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f906000dbe0 con 0x556f47889d40 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f90517fa640 1 -- 172.21.15.159:0/3137630253 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9060022040 con 0x556f47889d40 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f9072633740 10 client.17097 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f9072633740 1 -- 172.21.15.159:0/3137630253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556f47898590 con 0x556f47889d40 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f90517fa640 1 -- 172.21.15.159:0/3137630253 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f906000dbe0 con 0x556f47889d40 2024-09-19T06:54:50.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.009+0000 7f90517fa640 1 -- 172.21.15.159:0/3137630253 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f906001e6b0 con 0x556f47889d40 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.010+0000 7f9072633740 10 client.17097 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.010+0000 7f9072633740 10 client.17097 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.010+0000 7f9072633740 20 client.17097 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.010+0000 7f9072633740 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556f478998e0 0x556f4789bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.010+0000 7f9072633740 4 client.17097 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.010+0000 7f9072633740 1 -- 172.21.15.159:0/3137630253 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f477f17f0 con 0x556f478998e0 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.010+0000 7f906dff6640 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556f478998e0 0x556f4789bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.010+0000 7f90517fa640 10 client.17097 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.010+0000 7f906dff6640 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556f478998e0 0x556f4789bcd0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76b6f5a3f0ced1e server_cookie=b766c05598222287 in_seq=0 out_seq=0 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f90517fa640 1 -- 172.21.15.159:0/3137630253 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f477f17f0 con 0x556f478998e0 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f90517fa640 10 client.17097 handle_command_reply: tid=0 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 client.17097 shutdown 2024-09-19T06:54:50.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 -- 172.21.15.159:0/3137630253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 msgr2=0x556f47887690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f47887690 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9060012fe0 tx=0x7f90600124d0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 -- 172.21.15.159:0/3137630253 shutdown_connections 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556f478998e0 0x556f4789bcd0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f47889d40 0x556f47887690 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4787f480 0x556f47887150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 --2- 172.21.15.159:0/3137630253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787eb60 0x556f47886c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f90517fa640 0 client.17097 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 -- 172.21.15.159:0/3137630253 >> 172.21.15.159:0/3137630253 conn(0x556f4787b0f0 msgr2=0x556f47880e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 -- 172.21.15.159:0/3137630253 shutdown_connections 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.011+0000 7f9072633740 1 -- 172.21.15.159:0/3137630253 wait complete. 2024-09-19T06:54:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.012+0000 7f9072633740 20 client.17097 trim_cache size 0 max 16384 2024-09-19T06:54:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f9072633740 1 Processor -- start 2024-09-19T06:54:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f9072633740 1 -- start start 2024-09-19T06:54:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f9072633740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f47883e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f9072633740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f478843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f9072633740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 0x556f47879a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f9072633740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f90681adc20 con 0x556f4787eb60 2024-09-19T06:54:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f9072633740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90681b0480 con 0x556f47889d40 2024-09-19T06:54:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f9072633740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f90681ae270 con 0x556f4787f480 2024-09-19T06:54:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906dff6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f47883e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906dff6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f47883e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40858/0 (socket says 172.21.15.159:40858) 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906dff6640 1 -- 172.21.15.159:0/2056669505 learned_addr learned my addr 172.21.15.159:0/2056669505 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906d7f5640 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f478843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906e7f7640 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 0x556f47879a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906dff6640 1 -- 172.21.15.159:0/2056669505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 msgr2=0x556f478843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906dff6640 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f478843b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906dff6640 1 -- 172.21.15.159:0/2056669505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 msgr2=0x556f47879a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906dff6640 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 0x556f47879a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906dff6640 1 -- 172.21.15.159:0/2056669505 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4787ab90 con 0x556f4787eb60 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906d7f5640 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f478843b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.029+0000 7f906e7f7640 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 0x556f47879a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f906dff6640 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f47883e70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9064005ab0 tx=0x7f906403bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462e5f3384202df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f90537fe640 1 -- 172.21.15.159:0/2056669505 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064049040 con 0x556f4787eb60 2024-09-19T06:54:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f90537fe640 1 -- 172.21.15.159:0/2056669505 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90640ef040 con 0x556f4787eb60 2024-09-19T06:54:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f90537fe640 1 -- 172.21.15.159:0/2056669505 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90640edcb0 con 0x556f4787eb60 2024-09-19T06:54:50.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f9072633740 1 -- 172.21.15.159:0/2056669505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 msgr2=0x556f47883e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:50.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f9072633740 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f47883e70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9064005ab0 tx=0x7f906403bcb0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f9072633740 1 -- 172.21.15.159:0/2056669505 shutdown_connections 2024-09-19T06:54:50.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f9072633740 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 0x556f47879a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f9072633740 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f478843b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f9072633740 1 --2- 172.21.15.159:0/2056669505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f47883e70 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.030+0000 7f9072633740 1 -- 172.21.15.159:0/2056669505 >> 172.21.15.159:0/2056669505 conn(0x556f4787b0f0 msgr2=0x556f47888b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 -- 172.21.15.159:0/2056669505 shutdown_connections 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 -- 172.21.15.159:0/2056669505 wait complete. 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 -- start start 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 Processor -- start 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f4789ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f4789d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 0x556f4789d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f90681ae940 con 0x556f4787eb60 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90681afdb0 con 0x556f47889d40 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f90681af010 con 0x556f4787f480 2024-09-19T06:54:50.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f9072633740 10 client.0 _ll_register_callbacks cb 0x7f905800b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.031+0000 7f906dff6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f4789ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906dff6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f4789ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40862/0 (socket says 172.21.15.159:40862) 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906dff6640 1 -- 172.21.15.159:0/3570333215 learned_addr learned my addr 172.21.15.159:0/3570333215 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906e7f7640 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 0x556f4789d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906d7f5640 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f4789d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906dff6640 1 -- 172.21.15.159:0/3570333215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 msgr2=0x556f4789d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906dff6640 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f4789d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906dff6640 1 -- 172.21.15.159:0/3570333215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 msgr2=0x556f4789d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906dff6640 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 0x556f4789d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906dff6640 1 -- 172.21.15.159:0/3570333215 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f47903470 con 0x556f4787eb60 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f906dff6640 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f4789ccc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f90640bc380 tx=0x7f90640ebb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ecd7bb48de1680 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:50.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f90517fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f90517fa640 1 -- 172.21.15.159:0/3570333215 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064049030 con 0x556f4787eb60 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f90517fa640 1 -- 172.21.15.159:0/3570333215 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f90640b8cf0 con 0x556f4787eb60 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f9072633740 1 -- 172.21.15.159:0/3570333215 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90640ef040 con 0x556f4787eb60 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f90517fa640 1 -- 172.21.15.159:0/3570333215 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90640bc680 con 0x556f4787eb60 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f9072633740 10 client.17103 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.032+0000 7f9072633740 1 -- 172.21.15.159:0/3570333215 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556f47904790 con 0x556f4787eb60 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f90517fa640 1 -- 172.21.15.159:0/3570333215 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90640ef040 con 0x556f4787eb60 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f90517fa640 1 -- 172.21.15.159:0/3570333215 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f90640c4e60 con 0x556f4787eb60 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f9072633740 10 client.17103 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f9072633740 10 client.17103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f9072633740 20 client.17103 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:50.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f9072633740 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556f47904e00 0x556f479071f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f9072633740 4 client.17103 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f9072633740 1 -- 172.21.15.159:0/3570333215 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556f477ebd00 con 0x556f47904e00 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f906d7f5640 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556f47904e00 0x556f479071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f906d7f5640 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556f47904e00 0x556f479071f0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f1c19981f3ccac server_cookie=d9e3eaaa9cfac66c in_seq=0 out_seq=0 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.033+0000 7f90517fa640 10 client.17103 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.034+0000 7f90517fa640 1 -- 172.21.15.159:0/3570333215 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556f477ebd00 con 0x556f47904e00 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.034+0000 7f90517fa640 10 client.17103 handle_command_reply: tid=0 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.034+0000 7f9072633740 1 client.17103 shutdown 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.034+0000 7f9072633740 1 -- 172.21.15.159:0/3570333215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 msgr2=0x556f4789ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.034+0000 7f9072633740 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f4789ccc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f90640bc380 tx=0x7f90640ebb30 comp rx=0 tx=0).stop 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f9072633740 1 -- 172.21.15.159:0/3570333215 shutdown_connections 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f9072633740 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x556f47904e00 0x556f479071f0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f9072633740 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f47889d40 0x556f4789d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f9072633740 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f4787f480 0x556f4789d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f90517fa640 0 client.17103 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:50.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f9072633740 1 --2- 172.21.15.159:0/3570333215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556f4787eb60 0x556f4789ccc0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f9072633740 1 -- 172.21.15.159:0/3570333215 >> 172.21.15.159:0/3570333215 conn(0x556f4787b0f0 msgr2=0x556f47894d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:50.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f9072633740 1 -- 172.21.15.159:0/3570333215 shutdown_connections 2024-09-19T06:54:50.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f9072633740 1 -- 172.21.15.159:0/3570333215 wait complete. 2024-09-19T06:54:50.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f9072633740 20 client.17103 trim_cache size 0 max 16384 2024-09-19T06:54:50.041 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:54:50.041 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:54:50.042 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "dd31ac09-d486-4e6b-8a90-9c40d7dfef7f", 2024-09-19T06:54:50.042 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:54:50.042 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:54:50.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 -- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f90540a33b0 msgr2=0x7f90540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:50.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f90540a33b0 0x7f90540a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9060012a80 tx=0x7f9060009cd0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 -- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 msgr2=0x7f90680744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:50.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 0x7f90680744f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9064006010 tx=0x7f90640042f0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 -- 172.21.15.159:0/799765884 shutdown_connections 2024-09-19T06:54:50.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f90540a33b0 0x7f90540a5870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9068106f20 0x7f9068074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90681027a0 0x7f9068074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 --2- 172.21.15.159:0/799765884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9068101df0 0x7f90680744f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:50.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 -- 172.21.15.159:0/799765884 >> 172.21.15.159:0/799765884 conn(0x7f90680fd8b0 msgr2=0x7f90680feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:50.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.035+0000 7f907025a640 1 -- 172.21.15.159:0/799765884 shutdown_connections 2024-09-19T06:54:50.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:50.036+0000 7f907025a640 1 -- 172.21.15.159:0/799765884 wait complete. 2024-09-19T06:54:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:49 smithi203 ceph-mon[35473]: pgmap v241: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:50.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:49 smithi189 ceph-mon[34880]: pgmap v241: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:50.806 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:54:50.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:50 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:54:50.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:50 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:50.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:50 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:54:50.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:50 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:51.053 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:51.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:50 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:54:51.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:50 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:51.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:50 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:54:51.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:50 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:50 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:54:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:50 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:50 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:54:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:50 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:51.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.534+0000 7f7bf0738640 1 -- 172.21.15.159:0/1537544387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 msgr2=0x7f7be8105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:51.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.534+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1537544387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 0x7f7be8105e70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009900 tx=0x7f7be402a410 comp rx=0 tx=0).stop 2024-09-19T06:54:51.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.534+0000 7f7bf0738640 1 -- 172.21.15.159:0/1537544387 shutdown_connections 2024-09-19T06:54:51.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.534+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1537544387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8101bc0 0x7f7be810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.534+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1537544387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7be8101240 0x7f7be8101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.534+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1537544387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 0x7f7be8105e70 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.534+0000 7f7bf0738640 1 -- 172.21.15.159:0/1537544387 >> 172.21.15.159:0/1537544387 conn(0x7f7be8077210 msgr2=0x7f7be80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.534+0000 7f7bf0738640 1 -- 172.21.15.159:0/1537544387 shutdown_connections 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.534+0000 7f7bf0738640 1 -- 172.21.15.159:0/1537544387 wait complete. 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.535+0000 7f7bf0738640 1 Processor -- start 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.535+0000 7f7bf0738640 1 -- start start 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.535+0000 7f7bf0738640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7be8101240 0x7f7be81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.535+0000 7f7bf0738640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8101bc0 0x7f7be8199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.535+0000 7f7bf0738640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 0x7f7be81a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.535+0000 7f7bf0738640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8110f70 con 0x7f7be8105a90 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.535+0000 7f7bf0738640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8110df0 con 0x7f7be8101240 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.535+0000 7f7bf0738640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81110f0 con 0x7f7be8101bc0 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7beecd5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 0x7f7be81a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7beecd5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 0x7f7be81a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40870/0 (socket says 172.21.15.159:40870) 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7beecd5640 1 -- 172.21.15.159:0/1851722503 learned_addr learned my addr 172.21.15.159:0/1851722503 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8101bc0 0x7f7be8199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7be8101240 0x7f7be81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7beecd5640 1 -- 172.21.15.159:0/1851722503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8101bc0 msgr2=0x7f7be8199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7beecd5640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8101bc0 0x7f7be8199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7beecd5640 1 -- 172.21.15.159:0/1851722503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7be8101240 msgr2=0x7f7be81993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7beecd5640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7be8101240 0x7f7be81993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7beecd5640 1 -- 172.21.15.159:0/1851722503 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be81a4980 con 0x7f7be8105a90 2024-09-19T06:54:51.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7beecd5640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 0x7f7be81a4440 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7be000eaa0 tx=0x7f7be000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7bdf7fe640 1 -- 172.21.15.159:0/1851722503 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be000cdb0 con 0x7f7be8105a90 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7bdf7fe640 1 -- 172.21.15.159:0/1851722503 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7be0005020 con 0x7f7be8105a90 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7bdf7fe640 1 -- 172.21.15.159:0/1851722503 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be00116b0 con 0x7f7be8105a90 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7bf0738640 1 -- 172.21.15.159:0/1851722503 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be81a4b50 con 0x7f7be8105a90 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.536+0000 7f7bf0738640 1 -- 172.21.15.159:0/1851722503 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be81a5060 con 0x7f7be8105a90 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.538+0000 7f7bdf7fe640 1 -- 172.21.15.159:0/1851722503 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7be0005560 con 0x7f7be8105a90 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bf2b11740 1 Processor -- start 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bf2b11740 1 -- start start 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf44a0 0x557809cf4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 0x557809cff140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cff680 0x557809d01a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557809c5a2e0 con 0x557809cff680 2024-09-19T06:54:51.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557809c01ce0 con 0x557809cf4dc0 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557809c562a0 con 0x557809cf44a0 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bedcd3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cff680 0x557809d01a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bedcd3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cff680 0x557809d01a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40880/0 (socket says 172.21.15.159:40880) 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bedcd3640 1 -- 172.21.15.159:0/3588646148 learned_addr learned my addr 172.21.15.159:0/3588646148 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 0x557809cff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.539+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf44a0 0x557809cf4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bdf7fe640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7bd40a33b0 0x7f7bd40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7beecd5640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7bd40a33b0 0x7f7bd40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bedcd3640 1 -- 172.21.15.159:0/3588646148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf44a0 msgr2=0x557809cf4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf44a0 0x557809cf4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bedcd3640 1 -- 172.21.15.159:0/3588646148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 msgr2=0x557809cff140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:51.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 0x557809cff140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bedcd3640 1 -- 172.21.15.159:0/3588646148 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557809be6440 con 0x557809cff680 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 0x557809cff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bdf7fe640 1 -- 172.21.15.159:0/1851722503 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f7be00cff80 con 0x7f7be8105a90 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cff680 0x557809d01a70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8011730 tx=0x7f7bd800a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77021304768e768 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7beecd5640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7bd40a33b0 0x7f7bd40a5870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7be009bea0 tx=0x7f7be0098440 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bdcff9640 1 -- 172.21.15.159:0/3588646148 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8004020 con 0x557809cff680 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bdcff9640 1 -- 172.21.15.159:0/3588646148 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd8005500 con 0x557809cff680 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.540+0000 7f7bdcff9640 1 -- 172.21.15.159:0/3588646148 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8004bd0 con 0x557809cff680 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3588646148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cff680 msgr2=0x557809d01a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cff680 0x557809d01a70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8011730 tx=0x7f7bd800a6a0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3588646148 shutdown_connections 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cff680 0x557809d01a70 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 0x557809cff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3588646148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf44a0 0x557809cf4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3588646148 >> 172.21.15.159:0/3588646148 conn(0x557809cf0a30 msgr2=0x557809cf0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3588646148 shutdown_connections 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3588646148 wait complete. 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 -- start start 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.541+0000 7f7bf2b11740 1 Processor -- start 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf44a0 0x557809cff000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf4dc0 0x557809cfc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cff680 0x557809cfc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557809d02250 con 0x557809cf4dc0 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557809c15050 con 0x557809cf44a0 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557809d023d0 con 0x557809cff680 2024-09-19T06:54:51.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bf2b11740 10 client.0 _ll_register_callbacks cb 0x557809c55160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bee4d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf4dc0 0x557809cfc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bee4d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf4dc0 0x557809cfc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40896/0 (socket says 172.21.15.159:40896) 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bee4d4640 1 -- 172.21.15.159:0/3466613373 learned_addr learned my addr 172.21.15.159:0/3466613373 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cff680 0x557809cfc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bee4d4640 1 -- 172.21.15.159:0/3466613373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cff680 msgr2=0x557809cfc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cff680 0x557809cfc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf44a0 0x557809cff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bee4d4640 1 -- 172.21.15.159:0/3466613373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf44a0 msgr2=0x557809cff000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf44a0 0x557809cff000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bee4d4640 1 -- 172.21.15.159:0/3466613373 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578099cb3c0 con 0x557809cf4dc0 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf44a0 0x557809cff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf4dc0 0x557809cfc2b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7be402a930 tx=0x7f7be40053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0a4dbf8ac6daaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:51.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.542+0000 7f7bd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/3466613373 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4035040 con 0x557809cf4dc0 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3466613373 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bd8005500 con 0x557809cf4dc0 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/3466613373 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f7be40048d0 con 0x557809cf4dc0 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/3466613373 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7be4004ad0 con 0x557809cf4dc0 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bf2b11740 10 client.17115 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3466613373 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557809d0dc90 con 0x557809cf4dc0 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/3466613373 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd8005500 con 0x557809cf4dc0 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/3466613373 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f7be40315d0 con 0x557809cf4dc0 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bf2b11740 10 client.17115 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bf2b11740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bf2b11740 20 client.17115 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557809d0f0a0 0x557809d11500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bf2b11740 4 client.17115 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:51.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3466613373 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557809c67850 con 0x557809d0f0a0 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.543+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557809d0f0a0 0x557809d11500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.544+0000 7f7bd1ffb640 10 client.17115 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.544+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557809d0f0a0 0x557809d11500 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7acc1979f00c5e server_cookie=7c53c946d0394b4c in_seq=0 out_seq=0 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/3466613373 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557809c67850 con 0x557809d0f0a0 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bd1ffb640 10 client.17115 handle_command_reply: tid=0 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 client.17115 shutdown 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3466613373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf4dc0 msgr2=0x557809cfc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf4dc0 0x557809cfc2b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7be402a930 tx=0x7f7be40053b0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3466613373 shutdown_connections 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557809d0f0a0 0x557809d11500 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cff680 0x557809cfc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf4dc0 0x557809cfc2b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bd1ffb640 0 client.17115 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:51.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3466613373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf44a0 0x557809cff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3466613373 >> 172.21.15.159:0/3466613373 conn(0x557809cf0a30 msgr2=0x557809cf6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:51.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3466613373 shutdown_connections 2024-09-19T06:54:51.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3466613373 wait complete. 2024-09-19T06:54:51.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.545+0000 7f7bf2b11740 20 client.17115 trim_cache size 0 max 16384 2024-09-19T06:54:51.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bf2b11740 1 Processor -- start 2024-09-19T06:54:51.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bf2b11740 1 -- start start 2024-09-19T06:54:51.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d0b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 0x557809d16dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cff680 0x557809d17310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81aba90 con 0x557809cf44a0 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81ae2f0 con 0x557809cf4dc0 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81ac0e0 con 0x557809cff680 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bedcd3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d0b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bedcd3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d0b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40908/0 (socket says 172.21.15.159:40908) 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bedcd3640 1 -- 172.21.15.159:0/3115033291 learned_addr learned my addr 172.21.15.159:0/3115033291 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.562+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/3115033291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 0x557809d16dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.563+0000 7f7bedcd3640 1 -- 172.21.15.159:0/3115033291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cff680 msgr2=0x557809d17310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.563+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3115033291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cff680 0x557809d17310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.563+0000 7f7bedcd3640 1 -- 172.21.15.159:0/3115033291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 msgr2=0x557809d16dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:51.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.563+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3115033291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 0x557809d16dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.563+0000 7f7bedcd3640 1 -- 172.21.15.159:0/3115033291 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557809cff370 con 0x557809cf44a0 2024-09-19T06:54:51.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.563+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/3115033291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d0b4b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8011730 tx=0x7f7bd800ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2643a3b5aef89c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:51.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.563+0000 7f7bd3fff640 1 -- 172.21.15.159:0/3115033291 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800f990 con 0x557809cf44a0 2024-09-19T06:54:51.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.563+0000 7f7bd3fff640 1 -- 172.21.15.159:0/3115033291 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd801e470 con 0x557809cf44a0 2024-09-19T06:54:51.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.563+0000 7f7bd3fff640 1 -- 172.21.15.159:0/3115033291 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd802b520 con 0x557809cf44a0 2024-09-19T06:54:51.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3115033291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 msgr2=0x557809d0b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:51.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3115033291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d0b4b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8011730 tx=0x7f7bd800ab20 comp rx=0 tx=0).stop 2024-09-19T06:54:51.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3115033291 shutdown_connections 2024-09-19T06:54:51.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3115033291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cff680 0x557809d17310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3115033291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cf4dc0 0x557809d16dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/3115033291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d0b4b0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3115033291 >> 172.21.15.159:0/3115033291 conn(0x557809cf0a30 msgr2=0x557809cfb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:51.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3115033291 shutdown_connections 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 -- 172.21.15.159:0/3115033291 wait complete. 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 -- start start 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 Processor -- start 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d07b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf4dc0 0x557809d02f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cff680 0x557809d03440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81ac7b0 con 0x557809cf44a0 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81adc20 con 0x557809cff680 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.564+0000 7f7bf2b11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81ace80 con 0x557809cf4dc0 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bf2b11740 10 client.0 _ll_register_callbacks cb 0x7f7be4005040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bedcd3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d07b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bedcd3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d07b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40916/0 (socket says 172.21.15.159:40916) 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bedcd3640 1 -- 172.21.15.159:0/965223304 learned_addr learned my addr 172.21.15.159:0/965223304 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf4dc0 0x557809d02f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bedcd3640 1 -- 172.21.15.159:0/965223304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf4dc0 msgr2=0x557809d02f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf4dc0 0x557809d02f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bedcd3640 1 -- 172.21.15.159:0/965223304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cff680 msgr2=0x557809d03440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cff680 0x557809d03440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bedcd3640 1 -- 172.21.15.159:0/965223304 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557809d03a80 con 0x557809cf44a0 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf4dc0 0x557809d02f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bedcd3640 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d07b80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8005cb0 tx=0x7f7bd80045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c83dcd2b84d1a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/965223304 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd801ee60 con 0x557809cf44a0 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/965223304 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8614+0+0 (secure 0 0 0) 0x7f7bd801e820 con 0x557809cf44a0 2024-09-19T06:54:51.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bf2b11740 1 -- 172.21.15.159:0/965223304 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bd801e470 con 0x557809cf44a0 2024-09-19T06:54:51.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/965223304 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7bd801ea20 con 0x557809cf44a0 2024-09-19T06:54:51.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bf2b11740 10 client.17121 fetch_fsmap learned FSMap version 24 2024-09-19T06:54:51.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.565+0000 7f7bf2b11740 1 -- 172.21.15.159:0/965223304 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557809d79bc0 con 0x557809cf44a0 2024-09-19T06:54:51.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.566+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/965223304 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd801e470 con 0x557809cf44a0 2024-09-19T06:54:51.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.566+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/965223304 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f7bd803e500 con 0x557809cf44a0 2024-09-19T06:54:51.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.566+0000 7f7bf2b11740 10 client.17121 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:54:51.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.566+0000 7f7bf2b11740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:54:51.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.566+0000 7f7bf2b11740 20 client.17121 populate_metadata read hostname 'smithi159' 2024-09-19T06:54:51.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.566+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557809d7a080 0x557809d7c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.566+0000 7f7bf2b11740 4 client.17121 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.566+0000 7f7bf2b11740 1 -- 172.21.15.159:0/965223304 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557809c61d60 con 0x557809d7a080 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.566+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557809d7a080 0x557809d7c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bd1ffb640 10 client.17121 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bee4d4640 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557809d7a080 0x557809d7c470 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abed6223abd9464e server_cookie=ffbebfea895c9366 in_seq=0 out_seq=0 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bd1ffb640 1 -- 172.21.15.159:0/965223304 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557809c61d60 con 0x557809d7a080 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bd1ffb640 10 client.17121 handle_command_reply: tid=0 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 client.17121 shutdown 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 -- 172.21.15.159:0/965223304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 msgr2=0x557809d07b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d07b80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8005cb0 tx=0x7f7bd80045a0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 -- 172.21.15.159:0/965223304 shutdown_connections 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557809d7a080 0x557809d7c470 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557809cff680 0x557809d03440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557809cf4dc0 0x557809d02f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 --2- 172.21.15.159:0/965223304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557809cf44a0 0x557809d07b80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 -- 172.21.15.159:0/965223304 >> 172.21.15.159:0/965223304 conn(0x557809cf0a30 msgr2=0x557809cfdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bd1ffb640 0 client.17121 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 -- 172.21.15.159:0/965223304 shutdown_connections 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 1 -- 172.21.15.159:0/965223304 wait complete. 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.567+0000 7f7bf2b11740 20 client.17121 trim_cache size 0 max 16384 2024-09-19T06:54:51.575 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:54:51.576 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:54:51.576 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:54:51.576 INFO:teuthology.orchestra.run.smithi159.stdout: "dd31ac09-d486-4e6b-8a90-9c40d7dfef7f": { 2024-09-19T06:54:51.576 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:54:51.576 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "dd31ac09-d486-4e6b-8a90-9c40d7dfef7f", 2024-09-19T06:54:51.576 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:54:51.576 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:54:51.576 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:54:51.576 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:54:51.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 -- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7bd40a33b0 msgr2=0x7f7bd40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:51.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7bd40a33b0 0x7f7bd40a5870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7be009bea0 tx=0x7f7be0098440 comp rx=0 tx=0).stop 2024-09-19T06:54:51.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 -- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 msgr2=0x7f7be81a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:51.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 0x7f7be81a4440 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7be000eaa0 tx=0x7f7be000ef60 comp rx=0 tx=0).stop 2024-09-19T06:54:51.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 -- 172.21.15.159:0/1851722503 shutdown_connections 2024-09-19T06:54:51.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7bd40a33b0 0x7f7bd40a5870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7be8105a90 0x7f7be81a4440 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8101bc0 0x7f7be8199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 --2- 172.21.15.159:0/1851722503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7be8101240 0x7f7be81993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:51.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 -- 172.21.15.159:0/1851722503 >> 172.21.15.159:0/1851722503 conn(0x7f7be8077210 msgr2=0x7f7be8103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:51.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 -- 172.21.15.159:0/1851722503 shutdown_connections 2024-09-19T06:54:51.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:54:51.568+0000 7f7bf0738640 1 -- 172.21.15.159:0/1851722503 wait complete. 2024-09-19T06:54:52.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:51 smithi203 ceph-mon[35473]: pgmap v242: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:52.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:51 smithi189 ceph-mon[34880]: pgmap v242: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:52.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:51 smithi159 ceph-mon[30935]: pgmap v242: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:54:52.287 INFO:tasks.cephfs.filesystem:scrub status for tag:dd31ac09-d486-4e6b-8a90-9c40d7dfef7f - {'path': '/', 'tag': 'dd31ac09-d486-4e6b-8a90-9c40d7dfef7f', 'options': 'recursive,force'} 2024-09-19T06:54:54.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:53 smithi203 ceph-mon[35473]: pgmap v243: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:54:54.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:53 smithi189 ceph-mon[34880]: pgmap v243: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:54:54.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:53 smithi159 ceph-mon[30935]: pgmap v243: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:54:56.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:55 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:54:56.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:55 smithi203 ceph-mon[35473]: pgmap v244: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:54:56.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:55 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:54:56.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:55 smithi189 ceph-mon[34880]: pgmap v244: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:54:56.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:55 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:54:56.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:55 smithi159 ceph-mon[30935]: pgmap v244: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:54:58.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:57 smithi203 ceph-mon[35473]: pgmap v245: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:54:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:57 smithi189 ceph-mon[34880]: pgmap v245: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:54:58.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:57 smithi159 ceph-mon[30935]: pgmap v245: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:55:00.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:54:59 smithi203 ceph-mon[35473]: pgmap v246: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:00.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:54:59 smithi189 ceph-mon[34880]: pgmap v246: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:00.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:54:59 smithi159 ceph-mon[30935]: pgmap v246: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:02.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:01 smithi203 ceph-mon[35473]: pgmap v247: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:02.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:01 smithi189 ceph-mon[34880]: pgmap v247: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:02.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:01 smithi159 ceph-mon[30935]: pgmap v247: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:04.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:03 smithi203 ceph-mon[35473]: pgmap v248: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-09-19T06:55:04.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:03 smithi189 ceph-mon[34880]: pgmap v248: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-09-19T06:55:04.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:03 smithi159 ceph-mon[30935]: pgmap v248: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-09-19T06:55:06.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:05 smithi203 ceph-mon[35473]: pgmap v249: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:55:06.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:05 smithi189 ceph-mon[34880]: pgmap v249: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:55:06.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:05 smithi159 ceph-mon[30935]: pgmap v249: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:55:08.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:07 smithi203 ceph-mon[35473]: pgmap v250: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:55:08.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:07 smithi189 ceph-mon[34880]: pgmap v250: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:55:08.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:07 smithi159 ceph-mon[30935]: pgmap v250: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:55:10.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:09 smithi203 ceph-mon[35473]: pgmap v251: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:55:10.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:09 smithi189 ceph-mon[34880]: pgmap v251: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:55:10.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:09 smithi159 ceph-mon[30935]: pgmap v251: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:55:11.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:10 smithi203 ceph-mon[35473]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:55:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:10 smithi189 ceph-mon[34880]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:55:11.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:10 smithi159 ceph-mon[30935]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:55:12.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:11 smithi203 ceph-mon[35473]: pgmap v253: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:55:12.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:11 smithi189 ceph-mon[34880]: pgmap v253: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:55:12.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:11 smithi159 ceph-mon[30935]: pgmap v253: 97 pgs: 97 active+clean; 77 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:55:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:14 smithi189 ceph-mon[34880]: pgmap v254: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:55:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:14 smithi189 ceph-mon[34880]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:55:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:14 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:55:14.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:14 smithi159 ceph-mon[30935]: pgmap v254: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:55:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:14 smithi159 ceph-mon[30935]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:55:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:14 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:55:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:14 smithi203 ceph-mon[35473]: pgmap v254: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:55:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:14 smithi203 ceph-mon[35473]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:55:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:14 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:55:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:15 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:55:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:15 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:55:15.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:15 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:55:15.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:15 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:55:15.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:15 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:55:15.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:15 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:55:15.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:15 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:55:15.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:15 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:55:15.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:15 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:55:16.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:16 smithi159 ceph-mon[30935]: pgmap v256: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T06:55:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:16 smithi203 ceph-mon[35473]: pgmap v256: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T06:55:17.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:16 smithi189 ceph-mon[34880]: pgmap v256: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T06:55:18.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:18 smithi159 ceph-mon[30935]: pgmap v257: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:55:19.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:18 smithi203 ceph-mon[35473]: pgmap v257: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:55:19.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:18 smithi189 ceph-mon[34880]: pgmap v257: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:55:20.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:20 smithi159 ceph-mon[30935]: pgmap v258: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 230 B/s wr, 2 op/s 2024-09-19T06:55:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:20 smithi203 ceph-mon[35473]: pgmap v258: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 230 B/s wr, 2 op/s 2024-09-19T06:55:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:20 smithi189 ceph-mon[34880]: pgmap v258: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 230 B/s wr, 2 op/s 2024-09-19T06:55:22.288 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:55:22.549 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:22.965 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:22 smithi159 ceph-mon[30935]: pgmap v259: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:55:23.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.046+0000 7f4ff558d640 1 -- 172.21.15.159:0/3216337579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 msgr2=0x7f4ff01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:23.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.046+0000 7f4ff558d640 1 --2- 172.21.15.159:0/3216337579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 0x7f4ff01021c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009900 tx=0x7f4fe002a410 comp rx=0 tx=0).stop 2024-09-19T06:55:23.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.046+0000 7f4ff558d640 1 -- 172.21.15.159:0/3216337579 shutdown_connections 2024-09-19T06:55:23.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.046+0000 7f4ff558d640 1 --2- 172.21.15.159:0/3216337579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ff0106f10 0x7f4ff010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.046+0000 7f4ff558d640 1 --2- 172.21.15.159:0/3216337579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ff0102790 0x7f4ff01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.046+0000 7f4ff558d640 1 --2- 172.21.15.159:0/3216337579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 0x7f4ff01021c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.046+0000 7f4ff558d640 1 -- 172.21.15.159:0/3216337579 >> 172.21.15.159:0/3216337579 conn(0x7f4ff00fd8c0 msgr2=0x7f4ff00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:23.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.046+0000 7f4ff558d640 1 -- 172.21.15.159:0/3216337579 shutdown_connections 2024-09-19T06:55:23.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.046+0000 7f4ff558d640 1 -- 172.21.15.159:0/3216337579 wait complete. 2024-09-19T06:55:23.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.047+0000 7f4ff558d640 1 Processor -- start 2024-09-19T06:55:23.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.047+0000 7f4ff558d640 1 -- start start 2024-09-19T06:55:23.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4ff558d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 0x7f4ff019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4ff558d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ff0102790 0x7f4ff019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4ff558d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ff0106f10 0x7f4ff010dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4ff558d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0111f70 con 0x7f4ff0101de0 2024-09-19T06:55:23.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4ff558d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0111df0 con 0x7f4ff0106f10 2024-09-19T06:55:23.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4ff558d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01120f0 con 0x7f4ff0102790 2024-09-19T06:55:23.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4feeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 0x7f4ff019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4feeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 0x7f4ff019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53136/0 (socket says 172.21.15.159:53136) 2024-09-19T06:55:23.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4feeffd640 1 -- 172.21.15.159:0/1196719660 learned_addr learned my addr 172.21.15.159:0/1196719660 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:23.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4fef7fe640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ff0106f10 0x7f4ff010dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ff0102790 0x7f4ff019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4feeffd640 1 -- 172.21.15.159:0/1196719660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ff0102790 msgr2=0x7f4ff019f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:23.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4feeffd640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ff0102790 0x7f4ff019f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4feeffd640 1 -- 172.21.15.159:0/1196719660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ff0106f10 msgr2=0x7f4ff010dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:23.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4feeffd640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ff0106f10 0x7f4ff010dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4feeffd640 1 -- 172.21.15.159:0/1196719660 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff010e4c0 con 0x7f4ff0101de0 2024-09-19T06:55:23.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4feeffd640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 0x7f4ff019ef80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0005ab0 tx=0x7f4fe00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:23.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4fecff9640 1 -- 172.21.15.159:0/1196719660 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe003f030 con 0x7f4ff0101de0 2024-09-19T06:55:23.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4ff558d640 1 -- 172.21.15.159:0/1196719660 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff010e750 con 0x7f4ff0101de0 2024-09-19T06:55:23.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4fecff9640 1 -- 172.21.15.159:0/1196719660 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe0003ce0 con 0x7f4ff0101de0 2024-09-19T06:55:23.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4fecff9640 1 -- 172.21.15.159:0/1196719660 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0035070 con 0x7f4ff0101de0 2024-09-19T06:55:23.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.048+0000 7f4ff558d640 1 -- 172.21.15.159:0/1196719660 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff019ac90 con 0x7f4ff0101de0 2024-09-19T06:55:23.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.051+0000 7f4fecff9640 1 -- 172.21.15.159:0/1196719660 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4fe0042030 con 0x7f4ff0101de0 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.051+0000 7f4ff7966740 1 Processor -- start 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.051+0000 7f4ff7966740 1 -- start start 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.051+0000 7f4fecff9640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4fdc0a33b0 0x7f4fdc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.051+0000 7f4fecff9640 1 -- 172.21.15.159:0/1196719660 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f4fe00f0720 con 0x7f4ff0101de0 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.051+0000 7f4fef7fe640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4fdc0a33b0 0x7f4fdc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b84a0 0x56140a7b8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b8dc0 0x56140a7c3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4feeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b84a0 0x56140a7b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4feeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b84a0 0x56140a7b8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53152/0 (socket says 172.21.15.159:53152) 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4feeffd640 1 -- 172.21.15.159:0/3451811249 learned_addr learned my addr 172.21.15.159:0/3451811249 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4ff7966740 1 -- 172.21.15.159:0/3451811249 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56140a71e2e0 con 0x56140a7b84a0 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4ff7966740 1 -- 172.21.15.159:0/3451811249 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56140a6c5ce0 con 0x56140a7c3680 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4ff7966740 1 -- 172.21.15.159:0/3451811249 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56140a71a2a0 con 0x56140a7b8dc0 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/3451811249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b8dc0 0x56140a7c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4fef7fe640 1 --2- 172.21.15.159:0/3451811249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4fef7fe640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4fdc0a33b0 0x7f4fdc0a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ff019fbe0 tx=0x7f4fe800a2b0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4feeffd640 1 -- 172.21.15.159:0/3451811249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b8dc0 msgr2=0x56140a7c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4feeffd640 1 --2- 172.21.15.159:0/3451811249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b8dc0 0x56140a7c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4feeffd640 1 -- 172.21.15.159:0/3451811249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 msgr2=0x56140a7c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:23.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4feeffd640 1 --2- 172.21.15.159:0/3451811249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4feeffd640 1 -- 172.21.15.159:0/3451811249 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140a6aa440 con 0x56140a7b84a0 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4feeffd640 1 --2- 172.21.15.159:0/3451811249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b84a0 0x56140a7b8880 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00bc930 tx=0x7f4fe002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862eb4e1b01202dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4fe57fa640 1 -- 172.21.15.159:0/3451811249 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0049070 con 0x56140a7b84a0 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4fe57fa640 1 -- 172.21.15.159:0/3451811249 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe00c0d50 con 0x56140a7b84a0 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.052+0000 7f4fe57fa640 1 -- 172.21.15.159:0/3451811249 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00ee220 con 0x56140a7b84a0 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.053+0000 7f4ff7966740 1 -- 172.21.15.159:0/3451811249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b84a0 msgr2=0x56140a7b8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.053+0000 7f4ff7966740 1 --2- 172.21.15.159:0/3451811249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b84a0 0x56140a7b8880 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00bc930 tx=0x7f4fe002a410 comp rx=0 tx=0).stop 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.053+0000 7f4ff7966740 1 -- 172.21.15.159:0/3451811249 shutdown_connections 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.053+0000 7f4ff7966740 1 --2- 172.21.15.159:0/3451811249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.053+0000 7f4ff7966740 1 --2- 172.21.15.159:0/3451811249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b8dc0 0x56140a7c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.053+0000 7f4ff7966740 1 --2- 172.21.15.159:0/3451811249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b84a0 0x56140a7b8880 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.053+0000 7f4ff7966740 1 -- 172.21.15.159:0/3451811249 >> 172.21.15.159:0/3451811249 conn(0x56140a7b4a30 msgr2=0x56140a7b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.053+0000 7f4ff7966740 1 -- 172.21.15.159:0/3451811249 shutdown_connections 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.053+0000 7f4ff7966740 1 -- 172.21.15.159:0/3451811249 wait complete. 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4ff7966740 1 -- start start 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4ff7966740 1 Processor -- start 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4ff7966740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56140a7c6010 con 0x56140a7b8dc0 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4ff7966740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56140a6d9050 con 0x56140a7c3680 2024-09-19T06:55:23.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4ff7966740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56140a7c6190 con 0x56140a7b84a0 2024-09-19T06:55:23.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4ff7966740 10 client.0 _ll_register_callbacks cb 0x56140a719160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:23.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4fe7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4fe7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53166/0 (socket says 172.21.15.159:53166) 2024-09-19T06:55:23.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4fe7fff640 1 -- 172.21.15.159:0/4157187894 learned_addr learned my addr 172.21.15.159:0/4157187894 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:23.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4fef7fe640 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4feeffd640 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4fe7fff640 1 -- 172.21.15.159:0/4157187894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 msgr2=0x56140a7c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:23.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4fe7fff640 1 -- 172.21.15.159:0/4157187894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 msgr2=0x56140a7c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.054+0000 7f4fe7fff640 1 -- 172.21.15.159:0/4157187894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56140a48f3c0 con 0x56140a7b8dc0 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c02a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8011740 tx=0x7f4fd8011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595bf0e4e0da3374 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4fd67fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4fd67fc640 1 -- 172.21.15.159:0/4157187894 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800fdb0 con 0x56140a7b8dc0 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4fd67fc640 1 -- 172.21.15.159:0/4157187894 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f4fd8004020 con 0x56140a7b8dc0 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4ff7966740 1 -- 172.21.15.159:0/4157187894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe00c0d50 con 0x56140a7b8dc0 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4fd67fc640 1 -- 172.21.15.159:0/4157187894 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fd8004220 con 0x56140a7b8dc0 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4ff7966740 10 client.17133 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4ff7966740 1 -- 172.21.15.159:0/4157187894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56140a7d1a00 con 0x56140a7b8dc0 2024-09-19T06:55:23.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4fd67fc640 1 -- 172.21.15.159:0/4157187894 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe00c0d50 con 0x56140a7b8dc0 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4fd67fc640 1 -- 172.21.15.159:0/4157187894 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f4fd8018030 con 0x56140a7b8dc0 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4ff7966740 10 client.17133 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4ff7966740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4ff7966740 20 client.17133 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4ff7966740 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56140a7d2fb0 0x56140a7d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4ff7966740 4 client.17133 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.055+0000 7f4ff7966740 1 -- 172.21.15.159:0/4157187894 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56140a72b850 con 0x56140a7d2fb0 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.056+0000 7f4feeffd640 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56140a7d2fb0 0x56140a7d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.056+0000 7f4fd67fc640 10 client.17133 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.056+0000 7f4feeffd640 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56140a7d2fb0 0x56140a7d53a0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3437c5c12251a5a6 server_cookie=57cfd4dfbc03896c in_seq=0 out_seq=0 2024-09-19T06:55:23.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4fd67fc640 1 -- 172.21.15.159:0/4157187894 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56140a72b850 con 0x56140a7d2fb0 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4fd67fc640 10 client.17133 handle_command_reply: tid=0 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 client.17133 shutdown 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 -- 172.21.15.159:0/4157187894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 msgr2=0x56140a7c02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c02a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8011740 tx=0x7f4fd8011c00 comp rx=0 tx=0).stop 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 -- 172.21.15.159:0/4157187894 shutdown_connections 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56140a7d2fb0 0x56140a7d53a0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c02a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 --2- 172.21.15.159:0/4157187894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 -- 172.21.15.159:0/4157187894 >> 172.21.15.159:0/4157187894 conn(0x56140a7b4a30 msgr2=0x56140a7ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:23.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4fd67fc640 0 client.17133 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:23.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 -- 172.21.15.159:0/4157187894 shutdown_connections 2024-09-19T06:55:23.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 1 -- 172.21.15.159:0/4157187894 wait complete. 2024-09-19T06:55:23.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.057+0000 7f4ff7966740 20 client.17133 trim_cache size 0 max 16384 2024-09-19T06:55:23.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4ff7966740 1 Processor -- start 2024-09-19T06:55:23.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4ff7966740 1 -- start start 2024-09-19T06:55:23.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7beb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4ff7966740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01ba7a0 con 0x56140a7b8dc0 2024-09-19T06:55:23.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4ff7966740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01bd000 con 0x56140a7c3680 2024-09-19T06:55:23.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4ff7966740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01badf0 con 0x56140a7b84a0 2024-09-19T06:55:23.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4fe7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4fe7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7dacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53174/0 (socket says 172.21.15.159:53174) 2024-09-19T06:55:23.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.074+0000 7f4fe7fff640 1 -- 172.21.15.159:0/3874802828 learned_addr learned my addr 172.21.15.159:0/3874802828 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:23.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fef7fe640 1 --2- 172.21.15.159:0/3874802828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4feeffd640 1 --2- 172.21.15.159:0/3874802828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7beb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fe7fff640 1 -- 172.21.15.159:0/3874802828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 msgr2=0x56140a7beb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/3874802828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7beb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fe7fff640 1 -- 172.21.15.159:0/3874802828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 msgr2=0x56140a7db1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/3874802828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7db1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fe7fff640 1 -- 172.21.15.159:0/3874802828 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140a7bf250 con 0x56140a7b8dc0 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/3874802828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7dacb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80197e0 tx=0x7f4fd80056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f3d0353005ea30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fe4ff9640 1 -- 172.21.15.159:0/3874802828 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8019a60 con 0x56140a7b8dc0 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fe4ff9640 1 -- 172.21.15.159:0/3874802828 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fd8011e50 con 0x56140a7b8dc0 2024-09-19T06:55:23.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.075+0000 7f4fe4ff9640 1 -- 172.21.15.159:0/3874802828 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8010910 con 0x56140a7b8dc0 2024-09-19T06:55:23.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 -- 172.21.15.159:0/3874802828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 msgr2=0x56140a7dacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:23.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 --2- 172.21.15.159:0/3874802828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7dacb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80197e0 tx=0x7f4fd80056f0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 -- 172.21.15.159:0/3874802828 shutdown_connections 2024-09-19T06:55:23.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 --2- 172.21.15.159:0/3874802828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7db1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 --2- 172.21.15.159:0/3874802828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7dacb0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 --2- 172.21.15.159:0/3874802828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7beb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 -- 172.21.15.159:0/3874802828 >> 172.21.15.159:0/3874802828 conn(0x56140a7b4a30 msgr2=0x56140a7c2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:23.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 -- 172.21.15.159:0/3874802828 shutdown_connections 2024-09-19T06:55:23.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 -- 172.21.15.159:0/3874802828 wait complete. 2024-09-19T06:55:23.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 -- start start 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 Processor -- start 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01bb4c0 con 0x56140a7b8dc0 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01bc930 con 0x56140a7c3680 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01bbb90 con 0x56140a7b84a0 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.076+0000 7f4ff7966740 10 client.0 _ll_register_callbacks cb 0x7f4fd800c690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fe7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fe7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53190/0 (socket says 172.21.15.159:53190) 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fe7fff640 1 -- 172.21.15.159:0/56586095 learned_addr learned my addr 172.21.15.159:0/56586095 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4feeffd640 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fef7fe640 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fe7fff640 1 -- 172.21.15.159:0/56586095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 msgr2=0x56140a7c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fe7fff640 1 -- 172.21.15.159:0/56586095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 msgr2=0x56140a7c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fe7fff640 1 -- 172.21.15.159:0/56586095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56140a7d5710 con 0x56140a7b8dc0 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fe7fff640 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c9720 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80058c0 tx=0x7f4fd800fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb278913f4d553 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:23.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fd67fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:23.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fd67fc640 1 -- 172.21.15.159:0/56586095 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8004480 con 0x56140a7b8dc0 2024-09-19T06:55:23.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4ff7966740 1 -- 172.21.15.159:0/56586095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fd8011e50 con 0x56140a7b8dc0 2024-09-19T06:55:23.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fd67fc640 1 -- 172.21.15.159:0/56586095 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f4fd8019a20 con 0x56140a7b8dc0 2024-09-19T06:55:23.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4fd67fc640 1 -- 172.21.15.159:0/56586095 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fd8041050 con 0x56140a7b8dc0 2024-09-19T06:55:23.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4ff7966740 10 client.17139 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:23.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.077+0000 7f4ff7966740 1 -- 172.21.15.159:0/56586095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56140a83de30 con 0x56140a7b8dc0 2024-09-19T06:55:23.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4fd67fc640 1 -- 172.21.15.159:0/56586095 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fd8011e50 con 0x56140a7b8dc0 2024-09-19T06:55:23.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4fd67fc640 1 -- 172.21.15.159:0/56586095 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f4fd803c030 con 0x56140a7b8dc0 2024-09-19T06:55:23.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4ff7966740 10 client.17139 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4ff7966740 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4ff7966740 20 client.17139 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4ff7966740 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56140a83e430 0x56140a840820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4ff7966740 4 client.17139 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4ff7966740 1 -- 172.21.15.159:0/56586095 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56140a725d60 con 0x56140a83e430 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4feeffd640 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56140a83e430 0x56140a840820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4fd67fc640 10 client.17139 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.078+0000 7f4feeffd640 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56140a83e430 0x56140a840820 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aff4b2ab142be81b server_cookie=821b2cee03db17cc in_seq=0 out_seq=0 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4fd67fc640 1 -- 172.21.15.159:0/56586095 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56140a725d60 con 0x56140a83e430 2024-09-19T06:55:23.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4fd67fc640 10 client.17139 handle_command_reply: tid=0 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 client.17139 shutdown 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 -- 172.21.15.159:0/56586095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 msgr2=0x56140a7c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c9720 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80058c0 tx=0x7f4fd800fee0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 -- 172.21.15.159:0/56586095 shutdown_connections 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56140a83e430 0x56140a840820 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56140a7c3680 0x56140a7c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56140a7b8dc0 0x56140a7c9720 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 --2- 172.21.15.159:0/56586095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56140a7b84a0 0x56140a7c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4fd67fc640 0 client.17139 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:23.088 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 -- 172.21.15.159:0/56586095 >> 172.21.15.159:0/56586095 conn(0x56140a7b4a30 msgr2=0x56140a7c2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:23.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 -- 172.21.15.159:0/56586095 shutdown_connections 2024-09-19T06:55:23.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 1 -- 172.21.15.159:0/56586095 wait complete. 2024-09-19T06:55:23.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff7966740 20 client.17139 trim_cache size 0 max 16384 2024-09-19T06:55:23.089 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:55:23.089 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:55:23.089 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:55:23.089 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:55:23.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff558d640 1 -- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4fdc0a33b0 msgr2=0x7f4fdc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:23.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff558d640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4fdc0a33b0 0x7f4fdc0a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ff019fbe0 tx=0x7f4fe800a2b0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff558d640 1 -- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 msgr2=0x7f4ff019ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:23.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.079+0000 7f4ff558d640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 0x7f4ff019ef80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0005ab0 tx=0x7f4fe00042f0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.080+0000 7f4ff558d640 1 -- 172.21.15.159:0/1196719660 shutdown_connections 2024-09-19T06:55:23.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.080+0000 7f4ff558d640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4fdc0a33b0 0x7f4fdc0a5870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.080+0000 7f4ff558d640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ff0106f10 0x7f4ff010dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.080+0000 7f4ff558d640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ff0102790 0x7f4ff019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.080+0000 7f4ff558d640 1 --2- 172.21.15.159:0/1196719660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff0101de0 0x7f4ff019ef80 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:23.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.080+0000 7f4ff558d640 1 -- 172.21.15.159:0/1196719660 >> 172.21.15.159:0/1196719660 conn(0x7f4ff00fd8c0 msgr2=0x7f4ff00feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:23.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.080+0000 7f4ff558d640 1 -- 172.21.15.159:0/1196719660 shutdown_connections 2024-09-19T06:55:23.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:23.080+0000 7f4ff558d640 1 -- 172.21.15.159:0/1196719660 wait complete. 2024-09-19T06:55:23.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:22 smithi203 ceph-mon[35473]: pgmap v259: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:55:23.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:22 smithi189 ceph-mon[34880]: pgmap v259: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:55:23.935 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:55:23.935 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:55:24.184 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:24.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.657+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3689188154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50102570 msgr2=0x7f4f501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:24.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.657+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3689188154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50102570 0x7f4f501029b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009900 tx=0x7f4f3802a480 comp rx=0 tx=0).stop 2024-09-19T06:55:24.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.657+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3689188154 shutdown_connections 2024-09-19T06:55:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.657+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3689188154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f50102ef0 0x7f4f5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.657+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3689188154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50102570 0x7f4f501029b0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.657+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3689188154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f50100e20 0x7f4f50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.657+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3689188154 >> 172.21.15.159:0/3689188154 conn(0x7f4f500fc7d0 msgr2=0x7f4f500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.657+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3689188154 shutdown_connections 2024-09-19T06:55:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.657+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3689188154 wait complete. 2024-09-19T06:55:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f55b3f640 1 Processor -- start 2024-09-19T06:55:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f55b3f640 1 -- start start 2024-09-19T06:55:24.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f55b3f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50100e20 0x7f4f500fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f55b3f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f50102570 0x7f4f500fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f55b3f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f50102ef0 0x7f4f500fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f55b3f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50110f80 con 0x7f4f50100e20 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f55b3f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50110e00 con 0x7f4f50102ef0 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f55b3f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50111100 con 0x7f4f50102570 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f4f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50100e20 0x7f4f500fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f4f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50100e20 0x7f4f500fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53210/0 (socket says 172.21.15.159:53210) 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f4f7fe640 1 -- 172.21.15.159:0/3166365634 learned_addr learned my addr 172.21.15.159:0/3166365634 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.658+0000 7f4f47fff640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f50102570 0x7f4f500fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4ffff640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f50102ef0 0x7f4f500fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4f7fe640 1 -- 172.21.15.159:0/3166365634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f50102570 msgr2=0x7f4f500fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:24.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4f7fe640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f50102570 0x7f4f500fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4f7fe640 1 -- 172.21.15.159:0/3166365634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f50102ef0 msgr2=0x7f4f500fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4f7fe640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f50102ef0 0x7f4f500fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4f7fe640 1 -- 172.21.15.159:0/3166365634 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f501a6970 con 0x7f4f50100e20 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4f7fe640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50100e20 0x7f4f500fcc80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000e9f0 tx=0x7f4f4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4d7fa640 1 -- 172.21.15.159:0/3166365634 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4000cd80 con 0x7f4f50100e20 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4d7fa640 1 -- 172.21.15.159:0/3166365634 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f40010910 con 0x7f4f50100e20 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f501a6c60 con 0x7f4f50100e20 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f4d7fa640 1 -- 172.21.15.159:0/3166365634 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40018990 con 0x7f4f50100e20 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.659+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f501a71c0 con 0x7f4f50100e20 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.660+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f50101200 con 0x7f4f50100e20 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.661+0000 7f4f4d7fa640 1 -- 172.21.15.159:0/3166365634 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4f40010ac0 con 0x7f4f50100e20 2024-09-19T06:55:24.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.662+0000 7f4f4d7fa640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4f3c0a3430 0x7f4f3c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:24.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.662+0000 7f4f47fff640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4f3c0a3430 0x7f4f3c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:24.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.662+0000 7f4f4d7fa640 1 -- 172.21.15.159:0/3166365634 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f4f400cfff0 con 0x7f4f50100e20 2024-09-19T06:55:24.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.663+0000 7f4f47fff640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4f3c0a3430 0x7f4f3c0a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009230 tx=0x7f4f380058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:24.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.667+0000 7f4f4d7fa640 1 -- 172.21.15.159:0/3166365634 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f4009c320 con 0x7f4f50100e20 2024-09-19T06:55:24.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.870+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f5002d7c0 con 0x7f4f50100e20 2024-09-19T06:55:24.871 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:24 smithi159 ceph-mon[30935]: pgmap v260: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T06:55:24.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.871+0000 7f4f4d7fa640 1 -- 172.21.15.159:0/3166365634 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f4f400a0620 con 0x7f4f50100e20 2024-09-19T06:55:24.872 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:55:24.872 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:55:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:55:24.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4f3c0a3430 msgr2=0x7f4f3c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:24.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4f3c0a3430 0x7f4f3c0a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009230 tx=0x7f4f380058d0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50100e20 msgr2=0x7f4f500fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50100e20 0x7f4f500fcc80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000e9f0 tx=0x7f4f4000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 shutdown_connections 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4f3c0a3430 0x7f4f3c0a58f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f50102ef0 0x7f4f500fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f50102570 0x7f4f500fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 --2- 172.21.15.159:0/3166365634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f50100e20 0x7f4f500fcc80 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 >> 172.21.15.159:0/3166365634 conn(0x7f4f500fc7d0 msgr2=0x7f4f5006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 shutdown_connections 2024-09-19T06:55:24.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:24.873+0000 7f4f55b3f640 1 -- 172.21.15.159:0/3166365634 wait complete. 2024-09-19T06:55:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:24 smithi203 ceph-mon[35473]: pgmap v260: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T06:55:25.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:24 smithi189 ceph-mon[34880]: pgmap v260: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-19T06:55:25.584 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:55:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:25.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:25 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3166365634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:26.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:25 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3166365634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:26.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:25 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3166365634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:26.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.302+0000 7fb57a9d8640 1 -- 172.21.15.159:0/1187880402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101df0 msgr2=0x7fb574105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:26.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.302+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/1187880402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101df0 0x7fb574105920 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009900 tx=0x7fb55c02a410 comp rx=0 tx=0).stop 2024-09-19T06:55:26.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.302+0000 7fb57a9d8640 1 -- 172.21.15.159:0/1187880402 shutdown_connections 2024-09-19T06:55:26.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.302+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/1187880402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb574106050 0x7fb57410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.302+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/1187880402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101df0 0x7fb574105920 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.302+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/1187880402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb574101440 0x7fb574101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.302+0000 7fb57a9d8640 1 -- 172.21.15.159:0/1187880402 >> 172.21.15.159:0/1187880402 conn(0x7fb574077210 msgr2=0x7fb5740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.302+0000 7fb57a9d8640 1 -- 172.21.15.159:0/1187880402 shutdown_connections 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.302+0000 7fb57a9d8640 1 -- 172.21.15.159:0/1187880402 wait complete. 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb57a9d8640 1 Processor -- start 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb57a9d8640 1 -- start start 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb57a9d8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101440 0x7fb574198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb57a9d8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb574101df0 0x7fb574198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb57a9d8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb574106050 0x7fb57419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb57a9d8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb574111070 con 0x7fb574101440 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb57a9d8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb574110ef0 con 0x7fb574101df0 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb57a9d8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741111f0 con 0x7fb574106050 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb573fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101440 0x7fb574198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb573fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101440 0x7fb574198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53228/0 (socket says 172.21.15.159:53228) 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.303+0000 7fb573fff640 1 -- 172.21.15.159:0/127789035 learned_addr learned my addr 172.21.15.159:0/127789035 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb578f75640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb574106050 0x7fb57419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb5737fe640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb574101df0 0x7fb574198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb573fff640 1 -- 172.21.15.159:0/127789035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb574106050 msgr2=0x7fb57419cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb573fff640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb574106050 0x7fb57419cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb573fff640 1 -- 172.21.15.159:0/127789035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb574101df0 msgr2=0x7fb574198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb573fff640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb574101df0 0x7fb574198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb573fff640 1 -- 172.21.15.159:0/127789035 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57419d630 con 0x7fb574101440 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb573fff640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101440 0x7fb574198680 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb56400c970 tx=0x7fb56400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb5717fa640 1 -- 172.21.15.159:0/127789035 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb564007bb0 con 0x7fb574101440 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb57a9d8640 1 -- 172.21.15.159:0/127789035 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57419d920 con 0x7fb574101440 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb5717fa640 1 -- 172.21.15.159:0/127789035 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb564007d50 con 0x7fb574101440 2024-09-19T06:55:26.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb5717fa640 1 -- 172.21.15.159:0/127789035 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56400f450 con 0x7fb574101440 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.304+0000 7fb57a9d8640 1 -- 172.21.15.159:0/127789035 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5741a5200 con 0x7fb574101440 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.306+0000 7fb5717fa640 1 -- 172.21.15.159:0/127789035 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb564005020 con 0x7fb574101440 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.306+0000 7fb57cdb1740 1 Processor -- start 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb57cdb1740 1 -- start start 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f144a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f14e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f21b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c5c7e762f0 con 0x55c5c7f1f780 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c5c7e1dcf0 con 0x55c5c7f149e0 2024-09-19T06:55:26.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c5c7e722b0 con 0x55c5c7f15f50 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5717fa640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5600a33b0 0x7fb5600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f21b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f21b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53244/0 (socket says 172.21.15.159:53244) 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5737fe640 1 -- 172.21.15.159:0/3504059686 learned_addr learned my addr 172.21.15.159:0/3504059686 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb573fff640 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f14e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb578f75640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5600a33b0 0x7fb5600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb578f75640 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5717fa640 1 -- 172.21.15.159:0/127789035 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fb5640cfc10 con 0x7fb574101440 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5737fe640 1 -- 172.21.15.159:0/3504059686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 msgr2=0x55c5c7f144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5737fe640 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5737fe640 1 -- 172.21.15.159:0/3504059686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 msgr2=0x55c5c7f14e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5737fe640 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f14e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb5737fe640 1 -- 172.21.15.159:0/3504059686 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5c7e023a0 con 0x55c5c7f1f780 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.307+0000 7fb578f75640 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb5737fe640 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f21b70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb55c005ab0 tx=0x7fb55c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2088b1e95a8e4d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb578f75640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5600a33b0 0x7fb5600a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb56c005cc0 tx=0x7fb56c00b3e0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb56a7fc640 1 -- 172.21.15.159:0/3504059686 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c03f070 con 0x55c5c7f1f780 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb56a7fc640 1 -- 172.21.15.159:0/3504059686 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb55c031a20 con 0x55c5c7f1f780 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb56a7fc640 1 -- 172.21.15.159:0/3504059686 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c035070 con 0x55c5c7f1f780 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3504059686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 msgr2=0x55c5c7f21b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f21b70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb55c005ab0 tx=0x7fb55c031630 comp rx=0 tx=0).stop 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3504059686 shutdown_connections 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f21b70 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f14e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3504059686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3504059686 >> 172.21.15.159:0/3504059686 conn(0x55c5c7ed9310 msgr2=0x55c5c7f11070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3504059686 shutdown_connections 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.308+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3504059686 wait complete. 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb57cdb1740 1 -- start start 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb57cdb1740 1 Processor -- start 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f149e0 0x55c5c7f1f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f1c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f1f780 0x55c5c7f1c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c5c7f22420 con 0x55c5c7f149e0 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c5c7e31060 con 0x55c5c7f1f780 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c5c7f225a0 con 0x55c5c7f15f50 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb57cdb1740 10 client.0 _ll_register_callbacks cb 0x55c5c7b848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb573fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f149e0 0x55c5c7f1f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb573fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f149e0 0x55c5c7f1f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53256/0 (socket says 172.21.15.159:53256) 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb573fff640 1 -- 172.21.15.159:0/2068870926 learned_addr learned my addr 172.21.15.159:0/2068870926 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.309+0000 7fb5737fe640 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f1c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb578f75640 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f1f780 0x55c5c7f1c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb573fff640 1 -- 172.21.15.159:0/2068870926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 msgr2=0x55c5c7f1c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb573fff640 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f1c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb573fff640 1 -- 172.21.15.159:0/2068870926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f1f780 msgr2=0x55c5c7f1c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb573fff640 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f1f780 0x55c5c7f1c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb573fff640 1 -- 172.21.15.159:0/2068870926 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5c7be73c0 con 0x55c5c7f149e0 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb573fff640 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f149e0 0x55c5c7f1f0f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb56409be20 tx=0x7fb564066c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a17c76396218c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb5537fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb5537fe640 1 -- 172.21.15.159:0/2068870926 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56401d040 con 0x55c5c7f149e0 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb5537fe640 1 -- 172.21.15.159:0/2068870926 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fb564005310 con 0x55c5c7f149e0 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb57cdb1740 1 -- 172.21.15.159:0/2068870926 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb55c031a20 con 0x55c5c7f149e0 2024-09-19T06:55:26.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb5537fe640 1 -- 172.21.15.159:0/2068870926 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb564066ce0 con 0x55c5c7f149e0 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb57cdb1740 10 client.17157 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb57cdb1740 1 -- 172.21.15.159:0/2068870926 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c5c7f2de00 con 0x55c5c7f149e0 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.310+0000 7fb5537fe640 1 -- 172.21.15.159:0/2068870926 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb55c031a20 con 0x55c5c7f149e0 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb5537fe640 1 -- 172.21.15.159:0/2068870926 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb5640a4670 con 0x55c5c7f149e0 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb57cdb1740 10 client.17157 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb57cdb1740 10 client.17157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb57cdb1740 20 client.17157 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c5c7f2f210 0x55c5c7f31680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb57cdb1740 4 client.17157 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb57cdb1740 1 -- 172.21.15.159:0/2068870926 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5c7e83860 con 0x55c5c7f2f210 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb5737fe640 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c5c7f2f210 0x55c5c7f31680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb5737fe640 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c5c7f2f210 0x55c5c7f31680 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca35f0ff0ded869e server_cookie=9e2ceef1b74555bf in_seq=0 out_seq=0 2024-09-19T06:55:26.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.311+0000 7fb5537fe640 10 client.17157 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb5537fe640 1 -- 172.21.15.159:0/2068870926 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5c7e83860 con 0x55c5c7f2f210 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb5537fe640 10 client.17157 handle_command_reply: tid=0 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 client.17157 shutdown 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 -- 172.21.15.159:0/2068870926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f149e0 msgr2=0x55c5c7f1f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f149e0 0x55c5c7f1f0f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb56409be20 tx=0x7fb564066c70 comp rx=0 tx=0).stop 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 -- 172.21.15.159:0/2068870926 shutdown_connections 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c5c7f2f210 0x55c5c7f31680 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f1f780 0x55c5c7f1c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f1c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/2068870926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f149e0 0x55c5c7f1f0f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb5537fe640 0 client.17157 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 -- 172.21.15.159:0/2068870926 >> 172.21.15.159:0/2068870926 conn(0x55c5c7ed9310 msgr2=0x55c5c7f16d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.312+0000 7fb57cdb1740 1 -- 172.21.15.159:0/2068870926 shutdown_connections 2024-09-19T06:55:26.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.313+0000 7fb57cdb1740 1 -- 172.21.15.159:0/2068870926 wait complete. 2024-09-19T06:55:26.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.313+0000 7fb57cdb1740 20 client.17157 trim_cache size 0 max 16384 2024-09-19T06:55:26.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.325+0000 7fb57cdb1740 1 Processor -- start 2024-09-19T06:55:26.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.325+0000 7fb57cdb1740 1 -- start start 2024-09-19T06:55:26.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f0bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f20b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f210b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741a9730 con 0x55c5c7f1f780 2024-09-19T06:55:26.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741abf70 con 0x55c5c7f149e0 2024-09-19T06:55:26.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741a9d80 con 0x55c5c7f15f50 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb578f75640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb578f75640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f210b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53260/0 (socket says 172.21.15.159:53260) 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb578f75640 1 -- 172.21.15.159:0/1030156511 learned_addr learned my addr 172.21.15.159:0/1030156511 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb573fff640 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f0bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb5737fe640 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f20b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb578f75640 1 -- 172.21.15.159:0/1030156511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 msgr2=0x55c5c7f20b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb578f75640 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f20b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb578f75640 1 -- 172.21.15.159:0/1030156511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 msgr2=0x55c5c7f0bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb578f75640 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f0bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb578f75640 1 -- 172.21.15.159:0/1030156511 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5c7f1a8f0 con 0x55c5c7f1f780 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb5737fe640 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f20b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb578f75640 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f210b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0117d0 tx=0x7fb56c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2011e406ecdbe192 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:26.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.326+0000 7fb569ffb640 1 -- 172.21.15.159:0/1030156511 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c01db40 con 0x55c5c7f1f780 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb569ffb640 1 -- 172.21.15.159:0/1030156511 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb56c022070 con 0x55c5c7f1f780 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb569ffb640 1 -- 172.21.15.159:0/1030156511 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c01e630 con 0x55c5c7f1f780 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 -- 172.21.15.159:0/1030156511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 msgr2=0x55c5c7f210b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f210b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0117d0 tx=0x7fb56c013000 comp rx=0 tx=0).stop 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 -- 172.21.15.159:0/1030156511 shutdown_connections 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f1f780 0x55c5c7f210b0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f15f50 0x55c5c7f20b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/1030156511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f0bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 -- 172.21.15.159:0/1030156511 >> 172.21.15.159:0/1030156511 conn(0x55c5c7ed9310 msgr2=0x55c5c7f0b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 -- 172.21.15.159:0/1030156511 shutdown_connections 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 -- 172.21.15.159:0/1030156511 wait complete. 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.327+0000 7fb57cdb1740 1 -- start start 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb57cdb1740 1 Processor -- start 2024-09-19T06:55:26.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f19e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f15f50 0x55c5c7f27830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb57cdb1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f1f780 0x55c5c7f27d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741aa430 con 0x55c5c7f15f50 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741ab8a0 con 0x55c5c7f149e0 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb57cdb1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741aab00 con 0x55c5c7f1f780 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb57cdb1740 10 client.0 _ll_register_callbacks cb 0x7fb56400c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb5737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f15f50 0x55c5c7f27830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb5737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f15f50 0x55c5c7f27830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53270/0 (socket says 172.21.15.159:53270) 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb5737fe640 1 -- 172.21.15.159:0/3494900107 learned_addr learned my addr 172.21.15.159:0/3494900107 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb573fff640 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f19e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb578f75640 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f1f780 0x55c5c7f27d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb5737fe640 1 -- 172.21.15.159:0/3494900107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f1f780 msgr2=0x55c5c7f27d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb5737fe640 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f1f780 0x55c5c7f27d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb5737fe640 1 -- 172.21.15.159:0/3494900107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 msgr2=0x55c5c7f19e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb5737fe640 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f19e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb5737fe640 1 -- 172.21.15.159:0/3494900107 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5c7f36930 con 0x55c5c7f15f50 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.328+0000 7fb578f75640 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f1f780 0x55c5c7f27d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb5737fe640 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f15f50 0x55c5c7f27830 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb55c000c00 tx=0x7fb55c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc053fb109474eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb5537fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb5537fe640 1 -- 172.21.15.159:0/3494900107 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c053060 con 0x55c5c7f15f50 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb5537fe640 1 -- 172.21.15.159:0/3494900107 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fb55c03b670 con 0x55c5c7f15f50 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3494900107 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb56c022070 con 0x55c5c7f15f50 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb5537fe640 1 -- 172.21.15.159:0/3494900107 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb55c035040 con 0x55c5c7f15f50 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb57cdb1740 10 client.17163 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3494900107 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c5c7f9a030 con 0x55c5c7f15f50 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb5537fe640 1 -- 172.21.15.159:0/3494900107 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb56c022070 con 0x55c5c7f15f50 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb5537fe640 1 -- 172.21.15.159:0/3494900107 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb55c04c070 con 0x55c5c7f15f50 2024-09-19T06:55:26.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb57cdb1740 10 client.17163 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb57cdb1740 10 client.17163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb57cdb1740 20 client.17163 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c5c7f9a320 0x55c5c7f9c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb57cdb1740 4 client.17163 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.329+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3494900107 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c5c7e7dd70 con 0x55c5c7f9a320 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb573fff640 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c5c7f9a320 0x55c5c7f9c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb573fff640 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c5c7f9a320 0x55c5c7f9c710 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c5e7363885aaa9b server_cookie=1da6ad27dcc9e5a1 in_seq=0 out_seq=0 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb5537fe640 10 client.17163 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb5537fe640 1 -- 172.21.15.159:0/3494900107 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c5c7e7dd70 con 0x55c5c7f9a320 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb5537fe640 10 client.17163 handle_command_reply: tid=0 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 client.17163 shutdown 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3494900107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f15f50 msgr2=0x55c5c7f27830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f15f50 0x55c5c7f27830 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb55c000c00 tx=0x7fb55c005a20 comp rx=0 tx=0).stop 2024-09-19T06:55:26.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3494900107 shutdown_connections 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55c5c7f9a320 0x55c5c7f9c710 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5c7f1f780 0x55c5c7f27d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c5c7f15f50 0x55c5c7f27830 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 --2- 172.21.15.159:0/3494900107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c5c7f149e0 0x55c5c7f19e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb5537fe640 0 client.17163 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3494900107 >> 172.21.15.159:0/3494900107 conn(0x55c5c7ed9310 msgr2=0x55c5c7f1e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3494900107 shutdown_connections 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.330+0000 7fb57cdb1740 1 -- 172.21.15.159:0/3494900107 wait complete. 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57cdb1740 20 client.17163 trim_cache size 0 max 16384 2024-09-19T06:55:26.342 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:55:26.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 -- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5600a33b0 msgr2=0x7fb5600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:26.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5600a33b0 0x7fb5600a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb56c005cc0 tx=0x7fb56c00b3e0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 -- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101440 msgr2=0x7fb574198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:26.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101440 0x7fb574198680 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb56400c970 tx=0x7fb56400ce30 comp rx=0 tx=0).stop 2024-09-19T06:55:26.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 -- 172.21.15.159:0/127789035 shutdown_connections 2024-09-19T06:55:26.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5600a33b0 0x7fb5600a5870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb574106050 0x7fb57419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb574101df0 0x7fb574198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 --2- 172.21.15.159:0/127789035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb574101440 0x7fb574198680 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:26.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 -- 172.21.15.159:0/127789035 >> 172.21.15.159:0/127789035 conn(0x7fb574077210 msgr2=0x7fb574100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:26.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 -- 172.21.15.159:0/127789035 shutdown_connections 2024-09-19T06:55:26.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:26.331+0000 7fb57a9d8640 1 -- 172.21.15.159:0/127789035 wait complete. 2024-09-19T06:55:26.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:26 smithi159 ceph-mon[30935]: pgmap v261: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 B/s rd, 92 B/s wr, 1 op/s 2024-09-19T06:55:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:26 smithi203 ceph-mon[35473]: pgmap v261: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 B/s rd, 92 B/s wr, 1 op/s 2024-09-19T06:55:27.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:26 smithi189 ceph-mon[34880]: pgmap v261: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 B/s rd, 92 B/s wr, 1 op/s 2024-09-19T06:55:28.115 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:55:28.115 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:55:28.375 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:28.759 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:28 smithi159 ceph-mon[30935]: pgmap v262: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:55:28.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.840+0000 7f609c272640 1 -- 172.21.15.159:0/2557724112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094106f70 msgr2=0x7f609410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.840+0000 7f609c272640 1 --2- 172.21.15.159:0/2557724112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094106f70 0x7f609410eab0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f608c009900 tx=0x7f608c02a410 comp rx=0 tx=0).stop 2024-09-19T06:55:28.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.840+0000 7f609c272640 1 -- 172.21.15.159:0/2557724112 shutdown_connections 2024-09-19T06:55:28.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.840+0000 7f609c272640 1 --2- 172.21.15.159:0/2557724112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094106f70 0x7f609410eab0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.840+0000 7f609c272640 1 --2- 172.21.15.159:0/2557724112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6094100eb0 0x7f6094106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.840+0000 7f609c272640 1 --2- 172.21.15.159:0/2557724112 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6094100500 0x7f60941008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.840+0000 7f609c272640 1 -- 172.21.15.159:0/2557724112 >> 172.21.15.159:0/2557724112 conn(0x7f60940fc5c0 msgr2=0x7f60940fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.840+0000 7f609c272640 1 -- 172.21.15.159:0/2557724112 shutdown_connections 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.840+0000 7f609c272640 1 -- 172.21.15.159:0/2557724112 wait complete. 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.841+0000 7f609c272640 1 Processor -- start 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.841+0000 7f609c272640 1 -- start start 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.841+0000 7f609c272640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6094100500 0x7f60941983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.841+0000 7f609c272640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094100eb0 0x7f6094198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.841+0000 7f609c272640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6094106f70 0x7f609419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.841+0000 7f609c272640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6094111f90 con 0x7f6094100eb0 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.841+0000 7f609c272640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6094111e10 con 0x7f6094100500 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.841+0000 7f609c272640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6094112110 con 0x7f6094106f70 2024-09-19T06:55:28.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609980d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094100eb0 0x7f6094198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609980d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094100eb0 0x7f6094198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53284/0 (socket says 172.21.15.159:53284) 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609980d640 1 -- 172.21.15.159:0/2529117335 learned_addr learned my addr 172.21.15.159:0/2529117335 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609a00e640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6094100500 0x7f60941983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609a80f640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6094106f70 0x7f609419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609980d640 1 -- 172.21.15.159:0/2529117335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6094106f70 msgr2=0x7f609419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609980d640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6094106f70 0x7f609419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609980d640 1 -- 172.21.15.159:0/2529117335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6094100500 msgr2=0x7f60941983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609980d640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6094100500 0x7f60941983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609980d640 1 -- 172.21.15.159:0/2529117335 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609419d3a0 con 0x7f6094100eb0 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609a00e640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6094100500 0x7f60941983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609980d640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094100eb0 0x7f6094198930 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f608400d950 tx=0x7f608400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f608b7fe640 1 -- 172.21.15.159:0/2529117335 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084017070 con 0x7f6094100eb0 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609c272640 1 -- 172.21.15.159:0/2529117335 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609419d690 con 0x7f6094100eb0 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f608b7fe640 1 -- 172.21.15.159:0/2529117335 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6084009c30 con 0x7f6094100eb0 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f608b7fe640 1 -- 172.21.15.159:0/2529117335 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60840047a0 con 0x7f6094100eb0 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.842+0000 7f609c272640 1 -- 172.21.15.159:0/2529117335 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60941a4f70 con 0x7f6094100eb0 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f608b7fe640 1 -- 172.21.15.159:0/2529117335 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6084004020 con 0x7f6094100eb0 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609e64b740 1 Processor -- start 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609e64b740 1 -- start start 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609e64b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x561195196e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609e64b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561195197360 0x5611951a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609e64b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611951a6150 0x5611951a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609e64b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5611950fc280 con 0x561195197360 2024-09-19T06:55:28.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609e64b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5611950a3b10 con 0x5611951a6150 2024-09-19T06:55:28.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609e64b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5611950f8240 con 0x561195196a40 2024-09-19T06:55:28.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609a00e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561195197360 0x5611951a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f608b7fe640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f60800a33b0 0x7f60800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609a00e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561195197360 0x5611951a5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53290/0 (socket says 172.21.15.159:53290) 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.845+0000 7f609a00e640 1 -- 172.21.15.159:0/1676780197 learned_addr learned my addr 172.21.15.159:0/1676780197 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609a80f640 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x561195196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609a80f640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f60800a33b0 0x7f60800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609980d640 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611951a6150 0x5611951a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609a00e640 1 -- 172.21.15.159:0/1676780197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 msgr2=0x561195196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609a00e640 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x561195196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f608b7fe640 1 -- 172.21.15.159:0/2529117335 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f60840cfa80 con 0x7f6094100eb0 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609a00e640 1 -- 172.21.15.159:0/1676780197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611951a6150 msgr2=0x5611951a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609a00e640 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611951a6150 0x5611951a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609a00e640 1 -- 172.21.15.159:0/1676780197 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611950b01f0 con 0x561195197360 2024-09-19T06:55:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609980d640 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611951a6150 0x5611951a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609a00e640 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561195197360 0x5611951a5c10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6090007f40 tx=0x7f609000e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf2068fe3566fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f6088dea640 1 -- 172.21.15.159:0/1676780197 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090014070 con 0x561195197360 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f609a80f640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f60800a33b0 0x7f60800a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f608c02a930 tx=0x7f608c005fd0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f6088dea640 1 -- 172.21.15.159:0/1676780197 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6090003e50 con 0x561195197360 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.846+0000 7f6088dea640 1 -- 172.21.15.159:0/1676780197 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090010640 con 0x561195197360 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 -- 172.21.15.159:0/1676780197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561195197360 msgr2=0x5611951a5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561195197360 0x5611951a5c10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6090007f40 tx=0x7f609000e7e0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 -- 172.21.15.159:0/1676780197 shutdown_connections 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5611951a6150 0x5611951a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561195197360 0x5611951a5c10 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 --2- 172.21.15.159:0/1676780197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x561195196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 -- 172.21.15.159:0/1676780197 >> 172.21.15.159:0/1676780197 conn(0x5611951930f0 msgr2=0x5611951934d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 -- 172.21.15.159:0/1676780197 shutdown_connections 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 -- 172.21.15.159:0/1676780197 wait complete. 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 -- start start 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.847+0000 7f609e64b740 1 Processor -- start 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609e64b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195196a40 0x5611951a3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609e64b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195197360 0x5611951a3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609e64b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609e64b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5611951a8d20 con 0x5611951a6150 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609e64b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5611950b6f10 con 0x561195196a40 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609e64b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5611951a8ea0 con 0x561195197360 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609e64b740 10 client.0 _ll_register_callbacks cb 0x56119507fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a80f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a80f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951a3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53296/0 (socket says 172.21.15.159:53296) 2024-09-19T06:55:28.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a80f640 1 -- 172.21.15.159:0/3960779230 learned_addr learned my addr 172.21.15.159:0/3960779230 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a00e640 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195196a40 0x5611951a3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609980d640 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195197360 0x5611951a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a80f640 1 -- 172.21.15.159:0/3960779230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195197360 msgr2=0x5611951a3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a80f640 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195197360 0x5611951a3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a80f640 1 -- 172.21.15.159:0/3960779230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195196a40 msgr2=0x5611951a3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a80f640 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195196a40 0x5611951a3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a80f640 1 -- 172.21.15.159:0/3960779230 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561194e6d6a0 con 0x5611951a6150 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609980d640 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195197360 0x5611951a3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609a80f640 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951a3ad0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f608c004530 tx=0x7f608c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b932a9c87589789d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f607dffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f607dffb640 1 -- 172.21.15.159:0/3960779230 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c04d020 con 0x5611951a6150 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f607dffb640 1 -- 172.21.15.159:0/3960779230 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f608c003980 con 0x5611951a6150 2024-09-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.848+0000 7f609e64b740 1 -- 172.21.15.159:0/3960779230 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6090003e50 con 0x5611951a6150 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f607dffb640 1 -- 172.21.15.159:0/3960779230 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f608c058050 con 0x5611951a6150 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f609e64b740 10 client.17175 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f609e64b740 1 -- 172.21.15.159:0/3960779230 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5611951b4900 con 0x5611951a6150 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f607dffb640 1 -- 172.21.15.159:0/3960779230 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6090003e50 con 0x5611951a6150 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f607dffb640 1 -- 172.21.15.159:0/3960779230 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f608c048070 con 0x5611951a6150 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f609e64b740 10 client.17175 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f609e64b740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f609e64b740 20 client.17175 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f609e64b740 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5611951b5e10 0x5611951b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f609e64b740 4 client.17175 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f609e64b740 1 -- 172.21.15.159:0/3960779230 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611951097f0 con 0x5611951b5e10 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.849+0000 7f609a00e640 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5611951b5e10 0x5611951b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.850+0000 7f607dffb640 10 client.17175 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.850+0000 7f609a00e640 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5611951b5e10 0x5611951b82b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917318ac70e7c81a server_cookie=6af8725c0e57d890 in_seq=0 out_seq=0 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.850+0000 7f607dffb640 1 -- 172.21.15.159:0/3960779230 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611951097f0 con 0x5611951b5e10 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.850+0000 7f607dffb640 10 client.17175 handle_command_reply: tid=0 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 client.17175 shutdown 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 -- 172.21.15.159:0/3960779230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 msgr2=0x5611951a3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951a3ad0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f608c004530 tx=0x7f608c009260 comp rx=0 tx=0).stop 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 -- 172.21.15.159:0/3960779230 shutdown_connections 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5611951b5e10 0x5611951b82b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951a3ad0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195197360 0x5611951a3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 --2- 172.21.15.159:0/3960779230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195196a40 0x5611951a3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f607dffb640 0 client.17175 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:28.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 -- 172.21.15.159:0/3960779230 >> 172.21.15.159:0/3960779230 conn(0x5611951930f0 msgr2=0x561195198e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 -- 172.21.15.159:0/3960779230 shutdown_connections 2024-09-19T06:55:28.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 1 -- 172.21.15.159:0/3960779230 wait complete. 2024-09-19T06:55:28.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.851+0000 7f609e64b740 20 client.17175 trim_cache size 0 max 16384 2024-09-19T06:55:28.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.868+0000 7f609e64b740 1 Processor -- start 2024-09-19T06:55:28.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.868+0000 7f609e64b740 1 -- start start 2024-09-19T06:55:28.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.868+0000 7f609e64b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x5611951a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.868+0000 7f609e64b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 0x5611951bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.868+0000 7f609e64b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.868+0000 7f609e64b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f60941a9760 con 0x5611951a6150 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.868+0000 7f609e64b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60941abfc0 con 0x561195197360 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.868+0000 7f609e64b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60941a9db0 con 0x561195196a40 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.868+0000 7f609a80f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609a80f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951be0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53300/0 (socket says 172.21.15.159:53300) 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609a80f640 1 -- 172.21.15.159:0/392351792 learned_addr learned my addr 172.21.15.159:0/392351792 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609980d640 1 --2- 172.21.15.159:0/392351792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 0x5611951bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609a00e640 1 --2- 172.21.15.159:0/392351792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x5611951a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609a80f640 1 -- 172.21.15.159:0/392351792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 msgr2=0x5611951a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609a80f640 1 --2- 172.21.15.159:0/392351792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x5611951a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609a80f640 1 -- 172.21.15.159:0/392351792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 msgr2=0x5611951bdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609a80f640 1 --2- 172.21.15.159:0/392351792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 0x5611951bdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609a80f640 1 -- 172.21.15.159:0/392351792 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611951a2000 con 0x5611951a6150 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f609a80f640 1 --2- 172.21.15.159:0/392351792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951be0c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f608c009230 tx=0x7f608c005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce4969553226701 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f607ffff640 1 -- 172.21.15.159:0/392351792 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c060070 con 0x5611951a6150 2024-09-19T06:55:28.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f607ffff640 1 -- 172.21.15.159:0/392351792 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f608c03e4d0 con 0x5611951a6150 2024-09-19T06:55:28.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.869+0000 7f607ffff640 1 -- 172.21.15.159:0/392351792 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c04d070 con 0x5611951a6150 2024-09-19T06:55:28.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 -- 172.21.15.159:0/392351792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 msgr2=0x5611951be0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 --2- 172.21.15.159:0/392351792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951be0c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f608c009230 tx=0x7f608c005b90 comp rx=0 tx=0).stop 2024-09-19T06:55:28.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 -- 172.21.15.159:0/392351792 shutdown_connections 2024-09-19T06:55:28.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 --2- 172.21.15.159:0/392351792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951be0c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 --2- 172.21.15.159:0/392351792 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 0x5611951bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 --2- 172.21.15.159:0/392351792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x5611951a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 -- 172.21.15.159:0/392351792 >> 172.21.15.159:0/392351792 conn(0x5611951930f0 msgr2=0x5611951a47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 -- 172.21.15.159:0/392351792 shutdown_connections 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 -- 172.21.15.159:0/392351792 wait complete. 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 -- start start 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 Processor -- start 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x5611951a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 0x5611951aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f60941aa480 con 0x5611951a6150 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60941ab8f0 con 0x561195197360 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.870+0000 7f609e64b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60941aab50 con 0x561195196a40 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609e64b740 10 client.0 _ll_register_callbacks cb 0x7f608c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:28.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a00e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x5611951a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a80f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a00e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x5611951a9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.159:40912/0 (socket says 172.21.15.159:40912) 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a00e640 1 -- 172.21.15.159:0/3595589274 learned_addr learned my addr 172.21.15.159:0/3595589274 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609980d640 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 0x5611951aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a80f640 1 -- 172.21.15.159:0/3595589274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 msgr2=0x5611951a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a80f640 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x5611951a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a80f640 1 -- 172.21.15.159:0/3595589274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 msgr2=0x5611951aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a80f640 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 0x5611951aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a80f640 1 -- 172.21.15.159:0/3595589274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56119521fba0 con 0x5611951a6150 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609980d640 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 0x5611951aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609a80f640 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951aa960 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f608c004220 tx=0x7f608c02abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a8ee3702bcbcb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f607dffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:28.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f607dffb640 1 -- 172.21.15.159:0/3595589274 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c069070 con 0x5611951a6150 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f607dffb640 1 -- 172.21.15.159:0/3595589274 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f608c003980 con 0x5611951a6150 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609e64b740 1 -- 172.21.15.159:0/3595589274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f608c03e4d0 con 0x5611951a6150 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f607dffb640 1 -- 172.21.15.159:0/3595589274 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f608c075050 con 0x5611951a6150 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609e64b740 10 client.17181 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.871+0000 7f609e64b740 1 -- 172.21.15.159:0/3595589274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561195220ec0 con 0x5611951a6150 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f607dffb640 1 -- 172.21.15.159:0/3595589274 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f608c03e4d0 con 0x5611951a6150 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f607dffb640 1 -- 172.21.15.159:0/3595589274 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f608c048050 con 0x5611951a6150 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f609e64b740 10 client.17181 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f609e64b740 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f609e64b740 20 client.17181 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f609e64b740 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5611952214d0 0x5611952238c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f609e64b740 4 client.17181 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f609e64b740 1 -- 172.21.15.159:0/3595589274 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561195103d00 con 0x5611952214d0 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f609a00e640 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5611952214d0 0x5611952238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f607dffb640 10 client.17181 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.872+0000 7f609a00e640 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5611952214d0 0x5611952238c0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f43e46747811c7d8 server_cookie=5bd1c585e2b80f84 in_seq=0 out_seq=0 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.873+0000 7f607dffb640 1 -- 172.21.15.159:0/3595589274 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561195103d00 con 0x5611952214d0 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.873+0000 7f607dffb640 10 client.17181 handle_command_reply: tid=0 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.873+0000 7f609e64b740 1 client.17181 shutdown 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 -- 172.21.15.159:0/3595589274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 msgr2=0x5611951aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951aa960 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f608c004220 tx=0x7f608c02abc0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 -- 172.21.15.159:0/3595589274 shutdown_connections 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5611952214d0 0x5611952238c0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5611951a6150 0x5611951aa960 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f607dffb640 0 client.17181 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561195197360 0x5611951aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 --2- 172.21.15.159:0/3595589274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561195196a40 0x5611951a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 -- 172.21.15.159:0/3595589274 >> 172.21.15.159:0/3595589274 conn(0x5611951930f0 msgr2=0x561195198d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 -- 172.21.15.159:0/3595589274 shutdown_connections 2024-09-19T06:55:28.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 1 -- 172.21.15.159:0/3595589274 wait complete. 2024-09-19T06:55:28.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609e64b740 20 client.17181 trim_cache size 0 max 16384 2024-09-19T06:55:28.880 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:55:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:55:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "aa2dac77-6147-4bfd-8d1a-d5dcfe66a8d6", 2024-09-19T06:55:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:55:28.880 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:55:28.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609c272640 1 -- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f60800a33b0 msgr2=0x7f60800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609c272640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f60800a33b0 0x7f60800a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f608c02a930 tx=0x7f608c005fd0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609c272640 1 -- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094100eb0 msgr2=0x7f6094198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.874+0000 7f609c272640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094100eb0 0x7f6094198930 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f608400d950 tx=0x7f608400de10 comp rx=0 tx=0).stop 2024-09-19T06:55:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.875+0000 7f609c272640 1 -- 172.21.15.159:0/2529117335 shutdown_connections 2024-09-19T06:55:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.875+0000 7f609c272640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f60800a33b0 0x7f60800a5870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.875+0000 7f609c272640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6094106f70 0x7f609419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.875+0000 7f609c272640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6094100eb0 0x7f6094198930 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.875+0000 7f609c272640 1 --2- 172.21.15.159:0/2529117335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6094100500 0x7f60941983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.875+0000 7f609c272640 1 -- 172.21.15.159:0/2529117335 >> 172.21.15.159:0/2529117335 conn(0x7f60940fc5c0 msgr2=0x7f6094105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.875+0000 7f609c272640 1 -- 172.21.15.159:0/2529117335 shutdown_connections 2024-09-19T06:55:28.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:28.875+0000 7f609c272640 1 -- 172.21.15.159:0/2529117335 wait complete. 2024-09-19T06:55:29.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:28 smithi203 ceph-mon[35473]: pgmap v262: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:55:29.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:28 smithi189 ceph-mon[34880]: pgmap v262: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:55:29.744 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:55:29.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:29 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:55:29.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:29 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:29.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:29 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:55:29.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:29 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:29.991 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:30.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:29 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:55:30.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:29 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:30.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:29 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:55:30.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:29 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:30.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:29 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:55:30.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:29 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:30.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:29 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:55:30.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:29 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:30.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.532+0000 7fb608077640 1 -- 172.21.15.159:0/152175000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 msgr2=0x7fb60010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.532+0000 7fb608077640 1 --2- 172.21.15.159:0/152175000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 0x7fb60010d950 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009cd0 tx=0x7fb5f802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.532+0000 7fb608077640 1 -- 172.21.15.159:0/152175000 shutdown_connections 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.532+0000 7fb608077640 1 --2- 172.21.15.159:0/152175000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 0x7fb60010d950 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.532+0000 7fb608077640 1 --2- 172.21.15.159:0/152175000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb600100a80 0x7fb600100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.532+0000 7fb608077640 1 --2- 172.21.15.159:0/152175000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb600106a80 0x7fb600106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.532+0000 7fb608077640 1 -- 172.21.15.159:0/152175000 >> 172.21.15.159:0/152175000 conn(0x7fb6000fc7a0 msgr2=0x7fb6000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.533+0000 7fb608077640 1 -- 172.21.15.159:0/152175000 shutdown_connections 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.533+0000 7fb608077640 1 -- 172.21.15.159:0/152175000 wait complete. 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.533+0000 7fb608077640 1 Processor -- start 2024-09-19T06:55:30.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.533+0000 7fb608077640 1 -- start start 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb608077640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb600100a80 0x7fb6000fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb608077640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 0x7fb6000fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb608077640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb600106a80 0x7fb6000fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb608077640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb600110e80 con 0x7fb600101420 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb608077640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb600110d00 con 0x7fb600106a80 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb608077640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb600111000 con 0x7fb600100a80 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605612640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 0x7fb6000fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605612640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 0x7fb6000fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41296/0 (socket says 172.21.15.159:41296) 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605612640 1 -- 172.21.15.159:0/701270829 learned_addr learned my addr 172.21.15.159:0/701270829 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:30.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb606614640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb600106a80 0x7fb6000fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605e13640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb600100a80 0x7fb6000fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605612640 1 -- 172.21.15.159:0/701270829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb600100a80 msgr2=0x7fb6000fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:30.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605612640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb600100a80 0x7fb6000fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605612640 1 -- 172.21.15.159:0/701270829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb600106a80 msgr2=0x7fb6000fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:30.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605612640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb600106a80 0x7fb6000fd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605612640 1 -- 172.21.15.159:0/701270829 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6001a68d0 con 0x7fb600101420 2024-09-19T06:55:30.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb606614640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb600106a80 0x7fb6000fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:30.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb605612640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 0x7fb6000fd230 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c920 tx=0x7fb5f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:30.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.534+0000 7fb5f6ffd640 1 -- 172.21.15.159:0/701270829 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007c70 con 0x7fb600101420 2024-09-19T06:55:30.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.535+0000 7fb608077640 1 -- 172.21.15.159:0/701270829 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6001a6bc0 con 0x7fb600101420 2024-09-19T06:55:30.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.535+0000 7fb5f6ffd640 1 -- 172.21.15.159:0/701270829 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f0007e10 con 0x7fb600101420 2024-09-19T06:55:30.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.535+0000 7fb5f6ffd640 1 -- 172.21.15.159:0/701270829 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0005260 con 0x7fb600101420 2024-09-19T06:55:30.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.535+0000 7fb608077640 1 -- 172.21.15.159:0/701270829 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6001a7150 con 0x7fb600101420 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.537+0000 7fb5f6ffd640 1 -- 172.21.15.159:0/701270829 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb5f0005400 con 0x7fb600101420 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.537+0000 7fb60a450740 1 Processor -- start 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb60a450740 1 -- start start 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb5f6ffd640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5ec0a33b0 0x7fb5ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb60a450740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589507274a0 0x558950727880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb60a450740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950732140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb60a450740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950732680 0x558950734a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb60a450740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55895068d2e0 con 0x558950727dc0 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb60a450740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558950634ce0 con 0x5589507274a0 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb60a450740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5589506892a0 con 0x558950732680 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb606614640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5ec0a33b0 0x7fb5ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb605612640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950732140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb605612640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950732140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41302/0 (socket says 172.21.15.159:41302) 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb605612640 1 -- 172.21.15.159:0/1794695206 learned_addr learned my addr 172.21.15.159:0/1794695206 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb606614640 1 --2- 172.21.15.159:0/1794695206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950732680 0x558950734a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb605e13640 1 --2- 172.21.15.159:0/1794695206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589507274a0 0x558950727880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb5f6ffd640 1 -- 172.21.15.159:0/701270829 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fb5f00cff80 con 0x7fb600101420 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb605612640 1 -- 172.21.15.159:0/1794695206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950732680 msgr2=0x558950734a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb605612640 1 --2- 172.21.15.159:0/1794695206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950732680 0x558950734a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb606614640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5ec0a33b0 0x7fb5ec0a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009430 tx=0x7fb5f80318c0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb605612640 1 -- 172.21.15.159:0/1794695206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589507274a0 msgr2=0x558950727880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.538+0000 7fb605612640 1 --2- 172.21.15.159:0/1794695206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589507274a0 0x558950727880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.539+0000 7fb605612640 1 -- 172.21.15.159:0/1794695206 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558950619440 con 0x558950727dc0 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.539+0000 7fb605612640 1 --2- 172.21.15.159:0/1794695206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950732140 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0098bd0 tx=0x7fb5f0013b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cff3544fa14a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:30.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.539+0000 7fb5ebfff640 1 -- 172.21.15.159:0/1794695206 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00056f0 con 0x558950727dc0 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.539+0000 7fb5ebfff640 1 -- 172.21.15.159:0/1794695206 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f009c900 con 0x558950727dc0 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.539+0000 7fb5ebfff640 1 -- 172.21.15.159:0/1794695206 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00a05b0 con 0x558950727dc0 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 -- 172.21.15.159:0/1794695206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 msgr2=0x558950732140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 --2- 172.21.15.159:0/1794695206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950732140 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0098bd0 tx=0x7fb5f0013b80 comp rx=0 tx=0).stop 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 -- 172.21.15.159:0/1794695206 shutdown_connections 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 --2- 172.21.15.159:0/1794695206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950732680 0x558950734a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 --2- 172.21.15.159:0/1794695206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950732140 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 --2- 172.21.15.159:0/1794695206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589507274a0 0x558950727880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 -- 172.21.15.159:0/1794695206 >> 172.21.15.159:0/1794695206 conn(0x558950723a30 msgr2=0x558950723e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 -- 172.21.15.159:0/1794695206 shutdown_connections 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 -- 172.21.15.159:0/1794695206 wait complete. 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 -- start start 2024-09-19T06:55:30.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.540+0000 7fb60a450740 1 Processor -- start 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb60a450740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5589507274a0 0x558950731f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb60a450740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950727dc0 0x55895072f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb60a450740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 0x55895072f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb60a450740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558950735250 con 0x5589507274a0 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb60a450740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558950648050 con 0x558950732680 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb60a450740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5589507353d0 con 0x558950727dc0 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb60a450740 10 client.0 _ll_register_callbacks cb 0x558950688160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605e13640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5589507274a0 0x558950731f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605e13640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5589507274a0 0x558950731f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41308/0 (socket says 172.21.15.159:41308) 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605e13640 1 -- 172.21.15.159:0/224832019 learned_addr learned my addr 172.21.15.159:0/224832019 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb606614640 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 0x55895072f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605612640 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950727dc0 0x55895072f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605e13640 1 -- 172.21.15.159:0/224832019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950727dc0 msgr2=0x55895072f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605e13640 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950727dc0 0x55895072f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605e13640 1 -- 172.21.15.159:0/224832019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 msgr2=0x55895072f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605e13640 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 0x55895072f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605e13640 1 -- 172.21.15.159:0/224832019 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589503fe3c0 con 0x5589507274a0 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb605e13640 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5589507274a0 0x558950731f70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00bed0 tx=0x7fb5fc012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9c395c5486c291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb5e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb5e97fa640 1 -- 172.21.15.159:0/224832019 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc01f060 con 0x5589507274a0 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb5e97fa640 1 -- 172.21.15.159:0/224832019 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fb5fc0107e0 con 0x5589507274a0 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.541+0000 7fb60a450740 1 -- 172.21.15.159:0/224832019 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f009c900 con 0x5589507274a0 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb5e97fa640 1 -- 172.21.15.159:0/224832019 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb5fc0109e0 con 0x5589507274a0 2024-09-19T06:55:30.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb60a450740 10 client.17193 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb60a450740 1 -- 172.21.15.159:0/224832019 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558950740c80 con 0x5589507274a0 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb5e97fa640 1 -- 172.21.15.159:0/224832019 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f009c900 con 0x5589507274a0 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb5e97fa640 1 -- 172.21.15.159:0/224832019 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb5fc019030 con 0x5589507274a0 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb60a450740 10 client.17193 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb60a450740 10 client.17193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb60a450740 20 client.17193 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb60a450740 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558950742140 0x558950744550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb60a450740 4 client.17193 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb60a450740 1 -- 172.21.15.159:0/224832019 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55895069a850 con 0x558950742140 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.542+0000 7fb605612640 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558950742140 0x558950744550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.543+0000 7fb605612640 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558950742140 0x558950744550 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1884a68af7919ffb server_cookie=bf20e64e955fd114 in_seq=0 out_seq=0 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.543+0000 7fb5e97fa640 10 client.17193 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:30.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb5e97fa640 1 -- 172.21.15.159:0/224832019 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55895069a850 con 0x558950742140 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb5e97fa640 10 client.17193 handle_command_reply: tid=0 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 client.17193 shutdown 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 -- 172.21.15.159:0/224832019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5589507274a0 msgr2=0x558950731f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5589507274a0 0x558950731f70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00bed0 tx=0x7fb5fc012820 comp rx=0 tx=0).stop 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 -- 172.21.15.159:0/224832019 shutdown_connections 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x558950742140 0x558950744550 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 0x55895072f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb5e97fa640 0 client.17193 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558950727dc0 0x55895072f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 --2- 172.21.15.159:0/224832019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5589507274a0 0x558950731f70 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 -- 172.21.15.159:0/224832019 >> 172.21.15.159:0/224832019 conn(0x558950723a30 msgr2=0x558950722b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 -- 172.21.15.159:0/224832019 shutdown_connections 2024-09-19T06:55:30.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 1 -- 172.21.15.159:0/224832019 wait complete. 2024-09-19T06:55:30.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.544+0000 7fb60a450740 20 client.17193 trim_cache size 0 max 16384 2024-09-19T06:55:30.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb60a450740 1 Processor -- start 2024-09-19T06:55:30.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb60a450740 1 -- start start 2024-09-19T06:55:30.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb60a450740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 0x558950722a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb60a450740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950727dc0 0x558950749e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb60a450740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950732680 0x55895074a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb60a450740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001adb60 con 0x558950732680 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb60a450740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001b03c0 con 0x558950727dc0 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb60a450740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001ae1b0 con 0x5589507274a0 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb606614640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950732680 0x55895074a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb606614640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950732680 0x55895074a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41314/0 (socket says 172.21.15.159:41314) 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.561+0000 7fb606614640 1 -- 172.21.15.159:0/2911573222 learned_addr learned my addr 172.21.15.159:0/2911573222 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb605e13640 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 0x558950722a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb606614640 1 -- 172.21.15.159:0/2911573222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 msgr2=0x558950722a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb606614640 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 0x558950722a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb606614640 1 -- 172.21.15.159:0/2911573222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950727dc0 msgr2=0x558950749e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb605612640 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950727dc0 0x558950749e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb606614640 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950727dc0 0x558950749e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb606614640 1 -- 172.21.15.159:0/2911573222 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558950727220 con 0x558950732680 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb605e13640 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 0x558950722a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb606614640 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950732680 0x55895074a360 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009cd0 tx=0x7fb5f8048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901467d9970cb0b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb5eb7fe640 1 -- 172.21.15.159:0/2911573222 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8004610 con 0x558950732680 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb5eb7fe640 1 -- 172.21.15.159:0/2911573222 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f8036040 con 0x558950732680 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.562+0000 7fb5eb7fe640 1 -- 172.21.15.159:0/2911573222 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80546e0 con 0x558950732680 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 -- 172.21.15.159:0/2911573222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950732680 msgr2=0x55895074a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950732680 0x55895074a360 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009cd0 tx=0x7fb5f8048000 comp rx=0 tx=0).stop 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 -- 172.21.15.159:0/2911573222 shutdown_connections 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950732680 0x55895074a360 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950727dc0 0x558950749e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 --2- 172.21.15.159:0/2911573222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 0x558950722a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 -- 172.21.15.159:0/2911573222 >> 172.21.15.159:0/2911573222 conn(0x558950723a30 msgr2=0x558950722350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:30.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 -- 172.21.15.159:0/2911573222 shutdown_connections 2024-09-19T06:55:30.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 -- 172.21.15.159:0/2911573222 wait complete. 2024-09-19T06:55:30.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 -- start start 2024-09-19T06:55:30.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.563+0000 7fb60a450740 1 Processor -- start 2024-09-19T06:55:30.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 0x55895073ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950737f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 0x5589507384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001ae880 con 0x558950727dc0 2024-09-19T06:55:30.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001afcf0 con 0x558950732680 2024-09-19T06:55:30.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001aef50 con 0x5589507274a0 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 10 client.0 _ll_register_callbacks cb 0x7fb5fc00b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605612640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950737f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605612640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950737f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41328/0 (socket says 172.21.15.159:41328) 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605612640 1 -- 172.21.15.159:0/4230777020 learned_addr learned my addr 172.21.15.159:0/4230777020 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605e13640 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 0x55895073ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb606614640 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 0x5589507384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605612640 1 -- 172.21.15.159:0/4230777020 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 msgr2=0x55895073ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605612640 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 0x55895073ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605612640 1 -- 172.21.15.159:0/4230777020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 msgr2=0x5589507384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605612640 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 0x5589507384a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605612640 1 -- 172.21.15.159:0/4230777020 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558950738ae0 con 0x558950727dc0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb605612640 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950737f60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00a4940 tx=0x7fb5f0011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c183c89e5fc6bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb5e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb5e97fa640 1 -- 172.21.15.159:0/4230777020 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f007a070 con 0x558950727dc0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb5e97fa640 1 -- 172.21.15.159:0/4230777020 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fb5f00700b0 con 0x558950727dc0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 1 -- 172.21.15.159:0/4230777020 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f8036040 con 0x558950727dc0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb5e97fa640 1 -- 172.21.15.159:0/4230777020 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb5f0067e50 con 0x558950727dc0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 10 client.17199 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.564+0000 7fb60a450740 1 -- 172.21.15.159:0/4230777020 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5589507b5440 con 0x558950727dc0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.565+0000 7fb5e97fa640 1 -- 172.21.15.159:0/4230777020 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f8036040 con 0x558950727dc0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.565+0000 7fb5e97fa640 1 -- 172.21.15.159:0/4230777020 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fb5f0061020 con 0x558950727dc0 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.565+0000 7fb60a450740 10 client.17199 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.565+0000 7fb60a450740 10 client.17199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:30.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.565+0000 7fb60a450740 20 client.17199 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.565+0000 7fb60a450740 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5589507b5730 0x5589507b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.565+0000 7fb60a450740 4 client.17199 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.565+0000 7fb60a450740 1 -- 172.21.15.159:0/4230777020 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55895072faf0 con 0x5589507b5730 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.565+0000 7fb605e13640 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5589507b5730 0x5589507b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb5e97fa640 10 client.17199 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb605e13640 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5589507b5730 0x5589507b7b20 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32e25558871d021 server_cookie=9b11021987001279 in_seq=0 out_seq=0 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb5e97fa640 1 -- 172.21.15.159:0/4230777020 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55895072faf0 con 0x5589507b5730 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb5e97fa640 10 client.17199 handle_command_reply: tid=0 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 client.17199 shutdown 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 -- 172.21.15.159:0/4230777020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 msgr2=0x558950737f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950737f60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00a4940 tx=0x7fb5f0011040 comp rx=0 tx=0).stop 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 -- 172.21.15.159:0/4230777020 shutdown_connections 2024-09-19T06:55:30.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5589507b5730 0x5589507b7b20 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558950732680 0x5589507384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558950727dc0 0x558950737f60 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 --2- 172.21.15.159:0/4230777020 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589507274a0 0x55895073ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb5e97fa640 0 client.17199 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:30.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 -- 172.21.15.159:0/4230777020 >> 172.21.15.159:0/4230777020 conn(0x558950723a30 msgr2=0x558950722b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:30.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 -- 172.21.15.159:0/4230777020 shutdown_connections 2024-09-19T06:55:30.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 1 -- 172.21.15.159:0/4230777020 wait complete. 2024-09-19T06:55:30.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.566+0000 7fb60a450740 20 client.17199 trim_cache size 0 max 16384 2024-09-19T06:55:30.574 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:55:30.575 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:55:30.575 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:55:30.575 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:55:30.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 -- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5ec0a33b0 msgr2=0x7fb5ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:30.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5ec0a33b0 0x7fb5ec0a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009430 tx=0x7fb5f80318c0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 -- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 msgr2=0x7fb6000fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:30.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 0x7fb6000fd230 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c920 tx=0x7fb5f000cde0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 -- 172.21.15.159:0/701270829 shutdown_connections 2024-09-19T06:55:30.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fb5ec0a33b0 0x7fb5ec0a5870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb600106a80 0x7fb6000fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb600101420 0x7fb6000fd230 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 --2- 172.21.15.159:0/701270829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb600100a80 0x7fb6000fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:30.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 -- 172.21.15.159:0/701270829 >> 172.21.15.159:0/701270829 conn(0x7fb6000fc7a0 msgr2=0x7fb60006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:30.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 -- 172.21.15.159:0/701270829 shutdown_connections 2024-09-19T06:55:30.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:30.567+0000 7fb608077640 1 -- 172.21.15.159:0/701270829 wait complete. 2024-09-19T06:55:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:30 smithi159 ceph-mon[30935]: pgmap v263: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:30.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:30 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:55:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:30 smithi203 ceph-mon[35473]: pgmap v263: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:31.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:30 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:55:31.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:30 smithi189 ceph-mon[34880]: pgmap v263: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:31.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:30 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:55:31.337 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:55:31.338 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:55:31.584 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:31.972 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:31 smithi159 ceph-mon[30935]: pgmap v264: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:32.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.051+0000 7f624732a640 1 -- 172.21.15.159:0/191777805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62401055b0 msgr2=0x7f624010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:32.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.051+0000 7f624732a640 1 --2- 172.21.15.159:0/191777805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62401055b0 0x7f624010d130 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f6238009ca0 tx=0x7f623802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.051+0000 7f624732a640 1 -- 172.21.15.159:0/191777805 shutdown_connections 2024-09-19T06:55:32.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.051+0000 7f624732a640 1 --2- 172.21.15.159:0/191777805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62401055b0 0x7f624010d130 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.051+0000 7f624732a640 1 --2- 172.21.15.159:0/191777805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6240100e30 0x7f6240104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.051+0000 7f624732a640 1 --2- 172.21.15.159:0/191777805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6240100480 0x7f6240100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.051+0000 7f624732a640 1 -- 172.21.15.159:0/191777805 >> 172.21.15.159:0/191777805 conn(0x7f6240077210 msgr2=0x7f62400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.051+0000 7f624732a640 1 -- 172.21.15.159:0/191777805 shutdown_connections 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.051+0000 7f624732a640 1 -- 172.21.15.159:0/191777805 wait complete. 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f624732a640 1 Processor -- start 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f624732a640 1 -- start start 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f624732a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6240100480 0x7f62401983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f624732a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6240100e30 0x7f6240198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f624732a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62401055b0 0x7f624019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f624732a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f62401105c0 con 0x7f6240100e30 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f624732a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6240110440 con 0x7f62401055b0 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f624732a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6240110740 con 0x7f6240100480 2024-09-19T06:55:32.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f62448c5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6240100e30 0x7f6240198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f62448c5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6240100e30 0x7f6240198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41336/0 (socket says 172.21.15.159:41336) 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f62448c5640 1 -- 172.21.15.159:0/722485138 learned_addr learned my addr 172.21.15.159:0/722485138 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.052+0000 7f62458c7640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62401055b0 0x7f624019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62450c6640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6240100480 0x7f62401983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62448c5640 1 -- 172.21.15.159:0/722485138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6240100480 msgr2=0x7f62401983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62448c5640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6240100480 0x7f62401983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62448c5640 1 -- 172.21.15.159:0/722485138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62401055b0 msgr2=0x7f624019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62448c5640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62401055b0 0x7f624019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62448c5640 1 -- 172.21.15.159:0/722485138 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624019d390 con 0x7f6240100e30 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62448c5640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6240100e30 0x7f6240198920 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f623000c890 tx=0x7f623000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62367fc640 1 -- 172.21.15.159:0/722485138 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230004220 con 0x7f6240100e30 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62367fc640 1 -- 172.21.15.159:0/722485138 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62300043c0 con 0x7f6240100e30 2024-09-19T06:55:32.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624019d680 con 0x7f6240100e30 2024-09-19T06:55:32.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f62367fc640 1 -- 172.21.15.159:0/722485138 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62300049e0 con 0x7f6240100e30 2024-09-19T06:55:32.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.053+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62401a4f60 con 0x7f6240100e30 2024-09-19T06:55:32.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.054+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6240100860 con 0x7f6240100e30 2024-09-19T06:55:32.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.055+0000 7f62367fc640 1 -- 172.21.15.159:0/722485138 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f62300079b0 con 0x7f6240100e30 2024-09-19T06:55:32.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.056+0000 7f62367fc640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f622c0a33b0 0x7f622c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:32.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.056+0000 7f62450c6640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f622c0a33b0 0x7f622c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:32.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.056+0000 7f62367fc640 1 -- 172.21.15.159:0/722485138 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f62300cfe30 con 0x7f6240100e30 2024-09-19T06:55:32.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.056+0000 7f62450c6640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f622c0a33b0 0x7f622c0a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f623c0058c0 tx=0x7f623c00a4c0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:32.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.060+0000 7f62367fc640 1 -- 172.21.15.159:0/722485138 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6230014030 con 0x7f6240100e30 2024-09-19T06:55:32.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:31 smithi203 ceph-mon[35473]: pgmap v264: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:32.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:31 smithi189 ceph-mon[34880]: pgmap v264: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:32.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.260+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62401a5190 con 0x7f6240100e30 2024-09-19T06:55:32.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.261+0000 7f62367fc640 1 -- 172.21.15.159:0/722485138 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f623009c7b0 con 0x7f6240100e30 2024-09-19T06:55:32.262 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:55:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:55:32.263 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:55:32.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f622c0a33b0 msgr2=0x7f622c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:32.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f622c0a33b0 0x7f622c0a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f623c0058c0 tx=0x7f623c00a4c0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6240100e30 msgr2=0x7f6240198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:32.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6240100e30 0x7f6240198920 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f623000c890 tx=0x7f623000cd50 comp rx=0 tx=0).stop 2024-09-19T06:55:32.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 shutdown_connections 2024-09-19T06:55:32.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f622c0a33b0 0x7f622c0a5870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62401055b0 0x7f624019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6240100e30 0x7f6240198920 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 --2- 172.21.15.159:0/722485138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6240100480 0x7f62401983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:32.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 >> 172.21.15.159:0/722485138 conn(0x7f6240077210 msgr2=0x7f62401034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:32.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 shutdown_connections 2024-09-19T06:55:32.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:32.263+0000 7f624732a640 1 -- 172.21.15.159:0/722485138 wait complete. 2024-09-19T06:55:32.931 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:55:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:32 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/722485138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:33.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:32 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/722485138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:33.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:32 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/722485138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:33.178 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.662+0000 7fbc9bb38640 1 -- 172.21.15.159:0/3788838253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101bc0 msgr2=0x7fbc9410d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.662+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/3788838253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101bc0 0x7fbc9410d910 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009ca0 tx=0x7fbc8c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 -- 172.21.15.159:0/3788838253 shutdown_connections 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/3788838253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101bc0 0x7fbc9410d910 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/3788838253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc94101240 0x7fbc94101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/3788838253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc94105a90 0x7fbc94105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 -- 172.21.15.159:0/3788838253 >> 172.21.15.159:0/3788838253 conn(0x7fbc94077210 msgr2=0x7fbc940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 -- 172.21.15.159:0/3788838253 shutdown_connections 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 -- 172.21.15.159:0/3788838253 wait complete. 2024-09-19T06:55:33.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 Processor -- start 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 -- start start 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101240 0x7fbc94199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc94101bc0 0x7fbc941997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc94105a90 0x7fbc941a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94110f70 con 0x7fbc94101240 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94110df0 con 0x7fbc94105a90 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.663+0000 7fbc9bb38640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941110f0 con 0x7fbc94101bc0 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc998d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101240 0x7fbc94199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc998d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101240 0x7fbc94199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41352/0 (socket says 172.21.15.159:41352) 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc998d4640 1 -- 172.21.15.159:0/1317899052 learned_addr learned my addr 172.21.15.159:0/1317899052 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc9a0d5640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc94105a90 0x7fbc941a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc990d3640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc94101bc0 0x7fbc941997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc998d4640 1 -- 172.21.15.159:0/1317899052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc94101bc0 msgr2=0x7fbc941997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc998d4640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc94101bc0 0x7fbc941997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc998d4640 1 -- 172.21.15.159:0/1317899052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc94105a90 msgr2=0x7fbc941a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc998d4640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc94105a90 0x7fbc941a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc998d4640 1 -- 172.21.15.159:0/1317899052 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc941a4840 con 0x7fbc94101240 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc998d4640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101240 0x7fbc94199280 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400d950 tx=0x7fbc8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc92ffd640 1 -- 172.21.15.159:0/1317899052 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84017030 con 0x7fbc94101240 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc92ffd640 1 -- 172.21.15.159:0/1317899052 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc84004020 con 0x7fbc94101240 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc9bb38640 1 -- 172.21.15.159:0/1317899052 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc941a4a10 con 0x7fbc94101240 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc92ffd640 1 -- 172.21.15.159:0/1317899052 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc840047a0 con 0x7fbc94101240 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.664+0000 7fbc9bb38640 1 -- 172.21.15.159:0/1317899052 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc941a4f20 con 0x7fbc94101240 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.666+0000 7fbc92ffd640 1 -- 172.21.15.159:0/1317899052 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fbc840041d0 con 0x7fbc94101240 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc9df11740 1 Processor -- start 2024-09-19T06:55:33.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc9df11740 1 -- start start 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44d4780 0x5568a44d6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc9df11740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5568a442b2f0 con 0x5568a44c55d0 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc9df11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5568a43d2cf0 con 0x5568a44d4780 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc9df11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5568a44272b0 con 0x5568a44c6b40 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc998d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc998d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41360/0 (socket says 172.21.15.159:41360) 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc998d4640 1 -- 172.21.15.159:0/2524839842 learned_addr learned my addr 172.21.15.159:0/2524839842 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc92ffd640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbc7c0a33b0 0x7fbc7c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc990d3640 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44d4780 0x5568a44d6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.667+0000 7fbc9a0d5640 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc9a0d5640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbc7c0a33b0 0x7fbc7c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc92ffd640 1 -- 172.21.15.159:0/1317899052 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fbc840cf700 con 0x7fbc94101240 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc998d4640 1 -- 172.21.15.159:0/2524839842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 msgr2=0x5568a44c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc998d4640 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc998d4640 1 -- 172.21.15.159:0/2524839842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44d4780 msgr2=0x5568a44d6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc998d4640 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44d4780 0x5568a44d6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc998d4640 1 -- 172.21.15.159:0/2524839842 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a43b73a0 con 0x5568a44c55d0 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc9a0d5640 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc998d4640 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c5a10 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fbc84097de0 tx=0x7fbc840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d26dcf0707738e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc7bfff640 1 -- 172.21.15.159:0/2524839842 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8409b4c0 con 0x5568a44c55d0 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc9a0d5640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbc7c0a33b0 0x7fbc7c0a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c005fe0 tx=0x7fbc8c009360 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc7bfff640 1 -- 172.21.15.159:0/2524839842 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc8409c080 con 0x5568a44c55d0 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.668+0000 7fbc7bfff640 1 -- 172.21.15.159:0/2524839842 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8409b2e0 con 0x5568a44c55d0 2024-09-19T06:55:33.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 -- 172.21.15.159:0/2524839842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 msgr2=0x5568a44c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c5a10 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fbc84097de0 tx=0x7fbc840046c0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 -- 172.21.15.159:0/2524839842 shutdown_connections 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44d4780 0x5568a44d6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c5a10 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 --2- 172.21.15.159:0/2524839842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 -- 172.21.15.159:0/2524839842 >> 172.21.15.159:0/2524839842 conn(0x5568a448e310 msgr2=0x5568a44c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 -- 172.21.15.159:0/2524839842 shutdown_connections 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 -- 172.21.15.159:0/2524839842 wait complete. 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 -- start start 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.669+0000 7fbc9df11740 1 Processor -- start 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c55d0 0x5568a44d41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c6b40 0x5568a44d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44d4780 0x5568a44d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9df11740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5568a44d73c0 con 0x5568a44d4780 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9df11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5568a43e6060 con 0x5568a44c6b40 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9df11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5568a44d7540 con 0x5568a44c55d0 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9df11740 10 client.0 _ll_register_callbacks cb 0x5568a41398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9a0d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44d4780 0x5568a44d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9a0d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44d4780 0x5568a44d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41372/0 (socket says 172.21.15.159:41372) 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9a0d5640 1 -- 172.21.15.159:0/1560774542 learned_addr learned my addr 172.21.15.159:0/1560774542 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc990d3640 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c6b40 0x5568a44d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc998d4640 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c55d0 0x5568a44d41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9a0d5640 1 -- 172.21.15.159:0/1560774542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c55d0 msgr2=0x5568a44d41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9a0d5640 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c55d0 0x5568a44d41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9a0d5640 1 -- 172.21.15.159:0/1560774542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c6b40 msgr2=0x5568a44d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9a0d5640 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c6b40 0x5568a44d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.670+0000 7fbc9a0d5640 1 -- 172.21.15.159:0/1560774542 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568a419c3c0 con 0x5568a44d4780 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9a0d5640 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44d4780 0x5568a44d1c10 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c035000 tx=0x7fbc8c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0859cede5f9661 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc797fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc797fa640 1 -- 172.21.15.159:0/1560774542 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c004240 con 0x5568a44d4780 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc797fa640 1 -- 172.21.15.159:0/1560774542 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fbc8c0043e0 con 0x5568a44d4780 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9df11740 1 -- 172.21.15.159:0/1560774542 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc8409c080 con 0x5568a44d4780 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc797fa640 1 -- 172.21.15.159:0/1560774542 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbc8c0045e0 con 0x5568a44d4780 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9df11740 10 client.17217 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9df11740 1 -- 172.21.15.159:0/1560774542 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5568a44e2f00 con 0x5568a44d4780 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc797fa640 1 -- 172.21.15.159:0/1560774542 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc8409c080 con 0x5568a44d4780 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc797fa640 1 -- 172.21.15.159:0/1560774542 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fbc8c047070 con 0x5568a44d4780 2024-09-19T06:55:33.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9df11740 10 client.17217 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9df11740 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9df11740 20 client.17217 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9df11740 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5568a44e4310 0x5568a44e6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9df11740 4 client.17217 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc9df11740 1 -- 172.21.15.159:0/1560774542 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568a4438860 con 0x5568a44e4310 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.671+0000 7fbc998d4640 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5568a44e4310 0x5568a44e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.672+0000 7fbc797fa640 10 client.17217 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.672+0000 7fbc998d4640 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5568a44e4310 0x5568a44e6790 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=862205efaee19adc server_cookie=555011aa2230773f in_seq=0 out_seq=0 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.672+0000 7fbc797fa640 1 -- 172.21.15.159:0/1560774542 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568a4438860 con 0x5568a44e4310 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc797fa640 10 client.17217 handle_command_reply: tid=0 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 client.17217 shutdown 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 -- 172.21.15.159:0/1560774542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44d4780 msgr2=0x5568a44d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44d4780 0x5568a44d1c10 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c035000 tx=0x7fbc8c0095c0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 -- 172.21.15.159:0/1560774542 shutdown_connections 2024-09-19T06:55:33.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5568a44e4310 0x5568a44e6790 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44d4780 0x5568a44d1c10 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c6b40 0x5568a44d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc797fa640 0 client.17217 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:33.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 --2- 172.21.15.159:0/1560774542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c55d0 0x5568a44d41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 -- 172.21.15.159:0/1560774542 >> 172.21.15.159:0/1560774542 conn(0x5568a448e310 msgr2=0x5568a44c7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:33.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 -- 172.21.15.159:0/1560774542 shutdown_connections 2024-09-19T06:55:33.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 1 -- 172.21.15.159:0/1560774542 wait complete. 2024-09-19T06:55:33.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.673+0000 7fbc9df11740 20 client.17217 trim_cache size 0 max 16384 2024-09-19T06:55:33.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc9df11740 1 Processor -- start 2024-09-19T06:55:33.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc9df11740 1 -- start start 2024-09-19T06:55:33.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44d4780 0x5568a44ec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc9df11740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941a97e0 con 0x5568a44c55d0 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc9df11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941ac060 con 0x5568a44d4780 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc9df11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941a9e50 con 0x5568a44c6b40 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc998d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc998d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41384/0 (socket says 172.21.15.159:41384) 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc998d4640 1 -- 172.21.15.159:0/746541744 learned_addr learned my addr 172.21.15.159:0/746541744 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc990d3640 1 --2- 172.21.15.159:0/746541744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc998d4640 1 -- 172.21.15.159:0/746541744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 msgr2=0x5568a44ec0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc998d4640 1 --2- 172.21.15.159:0/746541744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44ec0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc998d4640 1 -- 172.21.15.159:0/746541744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44d4780 msgr2=0x5568a44ec5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:33.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc998d4640 1 --2- 172.21.15.159:0/746541744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44d4780 0x5568a44ec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc998d4640 1 -- 172.21.15.159:0/746541744 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a44d4540 con 0x5568a44c55d0 2024-09-19T06:55:33.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc990d3640 1 --2- 172.21.15.159:0/746541744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44ec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:33.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.686+0000 7fbc998d4640 1 --2- 172.21.15.159:0/746541744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c1e10 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fbc8409b680 tx=0x7fbc84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9765516c9bf675b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:33.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc7b7fe640 1 -- 172.21.15.159:0/746541744 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8409b2e0 con 0x5568a44c55d0 2024-09-19T06:55:33.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc7b7fe640 1 -- 172.21.15.159:0/746541744 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc8409c080 con 0x5568a44c55d0 2024-09-19T06:55:33.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc7b7fe640 1 -- 172.21.15.159:0/746541744 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84097c20 con 0x5568a44c55d0 2024-09-19T06:55:33.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc9df11740 1 -- 172.21.15.159:0/746541744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 msgr2=0x5568a44c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc9df11740 1 --2- 172.21.15.159:0/746541744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c1e10 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fbc8409b680 tx=0x7fbc84004730 comp rx=0 tx=0).stop 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc9df11740 1 -- 172.21.15.159:0/746541744 shutdown_connections 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc9df11740 1 --2- 172.21.15.159:0/746541744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44d4780 0x5568a44ec5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc9df11740 1 --2- 172.21.15.159:0/746541744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44c6b40 0x5568a44ec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc9df11740 1 --2- 172.21.15.159:0/746541744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c55d0 0x5568a44c1e10 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc9df11740 1 -- 172.21.15.159:0/746541744 >> 172.21.15.159:0/746541744 conn(0x5568a448e310 msgr2=0x5568a44c1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc9df11740 1 -- 172.21.15.159:0/746541744 shutdown_connections 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.687+0000 7fbc9df11740 1 -- 172.21.15.159:0/746541744 wait complete. 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9df11740 1 -- start start 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9df11740 1 Processor -- start 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c55d0 0x5568a44dcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c6b40 0x5568a44d90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9df11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44d4780 0x5568a44d95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9df11740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941aa520 con 0x5568a44c6b40 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9df11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941ab990 con 0x5568a44c55d0 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9df11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941aabf0 con 0x5568a44d4780 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9df11740 10 client.0 _ll_register_callbacks cb 0x7fbc8c003a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc990d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c6b40 0x5568a44d90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc990d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c6b40 0x5568a44d90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41396/0 (socket says 172.21.15.159:41396) 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc990d3640 1 -- 172.21.15.159:0/788425929 learned_addr learned my addr 172.21.15.159:0/788425929 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.688+0000 7fbc9a0d5640 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44d4780 0x5568a44d95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc998d4640 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c55d0 0x5568a44dcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc990d3640 1 -- 172.21.15.159:0/788425929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44d4780 msgr2=0x5568a44d95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc990d3640 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44d4780 0x5568a44d95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc990d3640 1 -- 172.21.15.159:0/788425929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c55d0 msgr2=0x5568a44dcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc990d3640 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c55d0 0x5568a44dcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc990d3640 1 -- 172.21.15.159:0/788425929 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568a44d9c20 con 0x5568a44c6b40 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc998d4640 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c55d0 0x5568a44dcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc990d3640 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c6b40 0x5568a44d90a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x5568a44c6070 tx=0x7fbc8800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2aa3c26023a322 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc797fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc797fa640 1 -- 172.21.15.159:0/788425929 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88004030 con 0x5568a44c6b40 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc797fa640 1 -- 172.21.15.159:0/788425929 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fbc880041d0 con 0x5568a44c6b40 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc9df11740 1 -- 172.21.15.159:0/788425929 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc8409c080 con 0x5568a44c6b40 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc797fa640 1 -- 172.21.15.159:0/788425929 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbc880043d0 con 0x5568a44c6b40 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc9df11740 10 client.17223 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc9df11740 1 -- 172.21.15.159:0/788425929 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5568a454fe90 con 0x5568a44c6b40 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc797fa640 1 -- 172.21.15.159:0/788425929 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc8409c080 con 0x5568a44c6b40 2024-09-19T06:55:33.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.689+0000 7fbc797fa640 1 -- 172.21.15.159:0/788425929 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fbc88011740 con 0x5568a44c6b40 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc9df11740 10 client.17223 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc9df11740 10 client.17223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc9df11740 20 client.17223 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc9df11740 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5568a4550670 0x5568a4552a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc9df11740 4 client.17223 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc9df11740 1 -- 172.21.15.159:0/788425929 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5568a4432d70 con 0x5568a4550670 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc998d4640 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5568a4550670 0x5568a4552a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc797fa640 10 client.17223 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc998d4640 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5568a4550670 0x5568a4552a90 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=910e844b5be740a9 server_cookie=3f2903b93ec3c435 in_seq=0 out_seq=0 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc797fa640 1 -- 172.21.15.159:0/788425929 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5568a4432d70 con 0x5568a4550670 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc797fa640 10 client.17223 handle_command_reply: tid=0 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.690+0000 7fbc9df11740 1 client.17223 shutdown 2024-09-19T06:55:33.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 -- 172.21.15.159:0/788425929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c6b40 msgr2=0x5568a44d90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c6b40 0x5568a44d90a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x5568a44c6070 tx=0x7fbc8800bf90 comp rx=0 tx=0).stop 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 -- 172.21.15.159:0/788425929 shutdown_connections 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5568a4550670 0x5568a4552a90 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568a44d4780 0x5568a44d95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5568a44c6b40 0x5568a44d90a0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc797fa640 0 client.17223 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 --2- 172.21.15.159:0/788425929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568a44c55d0 0x5568a44dcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 -- 172.21.15.159:0/788425929 >> 172.21.15.159:0/788425929 conn(0x5568a448e310 msgr2=0x5568a44d2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 -- 172.21.15.159:0/788425929 shutdown_connections 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 1 -- 172.21.15.159:0/788425929 wait complete. 2024-09-19T06:55:33.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9df11740 20 client.17223 trim_cache size 0 max 16384 2024-09-19T06:55:33.699 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:55:33.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 -- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbc7c0a33b0 msgr2=0x7fbc7c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:33.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbc7c0a33b0 0x7fbc7c0a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c005fe0 tx=0x7fbc8c009360 comp rx=0 tx=0).stop 2024-09-19T06:55:33.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 -- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101240 msgr2=0x7fbc94199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:33.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101240 0x7fbc94199280 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400d950 tx=0x7fbc8400de10 comp rx=0 tx=0).stop 2024-09-19T06:55:33.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 -- 172.21.15.159:0/1317899052 shutdown_connections 2024-09-19T06:55:33.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbc7c0a33b0 0x7fbc7c0a5870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc94105a90 0x7fbc941a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc94101bc0 0x7fbc941997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 --2- 172.21.15.159:0/1317899052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc94101240 0x7fbc94199280 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:33.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.691+0000 7fbc9bb38640 1 -- 172.21.15.159:0/1317899052 >> 172.21.15.159:0/1317899052 conn(0x7fbc94077210 msgr2=0x7fbc94103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:33.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.692+0000 7fbc9bb38640 1 -- 172.21.15.159:0/1317899052 shutdown_connections 2024-09-19T06:55:33.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:33.692+0000 7fbc9bb38640 1 -- 172.21.15.159:0/1317899052 wait complete. 2024-09-19T06:55:34.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:33 smithi203 ceph-mon[35473]: pgmap v265: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:55:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:33 smithi189 ceph-mon[34880]: pgmap v265: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:55:34.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:33 smithi159 ceph-mon[30935]: pgmap v265: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:55:35.484 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:55:35.484 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:55:35.742 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:35.864 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:35 smithi159 ceph-mon[30935]: pgmap v266: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:36.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:35 smithi203 ceph-mon[35473]: pgmap v266: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:36.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:35 smithi189 ceph-mon[34880]: pgmap v266: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:36.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.269+0000 7f2da4c2b640 1 -- 172.21.15.159:0/472454134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 msgr2=0x7f2da010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:36.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.269+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/472454134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 0x7f2da010da40 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009ca0 tx=0x7f2d9802a950 comp rx=0 tx=0).stop 2024-09-19T06:55:36.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.269+0000 7f2da4c2b640 1 -- 172.21.15.159:0/472454134 shutdown_connections 2024-09-19T06:55:36.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.269+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/472454134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 0x7f2da010da40 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.269+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/472454134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2da0102570 0x7f2da01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.269+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/472454134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2da0100e20 0x7f2da0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.269+0000 7f2da4c2b640 1 -- 172.21.15.159:0/472454134 >> 172.21.15.159:0/472454134 conn(0x7f2da00fc7d0 msgr2=0x7f2da00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.269+0000 7f2da4c2b640 1 -- 172.21.15.159:0/472454134 shutdown_connections 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.269+0000 7f2da4c2b640 1 -- 172.21.15.159:0/472454134 wait complete. 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.270+0000 7f2da4c2b640 1 Processor -- start 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.270+0000 7f2da4c2b640 1 -- start start 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.270+0000 7f2da4c2b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2da0100e20 0x7f2da0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.270+0000 7f2da4c2b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2da0102570 0x7f2da0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.270+0000 7f2da4c2b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 0x7f2da019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.270+0000 7f2da4c2b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2da01120a0 con 0x7f2da0102ef0 2024-09-19T06:55:36.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.270+0000 7f2da4c2b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2da0111f20 con 0x7f2da0102570 2024-09-19T06:55:36.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.270+0000 7f2da4c2b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2da0112220 con 0x7f2da0100e20 2024-09-19T06:55:36.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 0x7f2da019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 0x7f2da019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41410/0 (socket says 172.21.15.159:41410) 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9ed9d640 1 -- 172.21.15.159:0/3360749413 learned_addr learned my addr 172.21.15.159:0/3360749413 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2da0100e20 0x7f2da0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2da0102570 0x7f2da0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9ed9d640 1 -- 172.21.15.159:0/3360749413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2da0100e20 msgr2=0x7f2da0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2da0100e20 0x7f2da0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9ed9d640 1 -- 172.21.15.159:0/3360749413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2da0102570 msgr2=0x7f2da0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2da0102570 0x7f2da0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9ed9d640 1 -- 172.21.15.159:0/3360749413 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da019d3f0 con 0x7f2da0102ef0 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2da0102570 0x7f2da0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2da0100e20 0x7f2da0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 0x7f2da019cd10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2d98004af0 tx=0x7f2d9802f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:36.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d8f7fe640 1 -- 172.21.15.159:0/3360749413 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98034040 con 0x7f2da0102ef0 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d8f7fe640 1 -- 172.21.15.159:0/3360749413 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d98030920 con 0x7f2da0102ef0 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2d8f7fe640 1 -- 172.21.15.159:0/3360749413 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98004630 con 0x7f2da0102ef0 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2da4c2b640 1 -- 172.21.15.159:0/3360749413 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da019d680 con 0x7f2da0102ef0 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.271+0000 7f2da4c2b640 1 -- 172.21.15.159:0/3360749413 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da01a4fc0 con 0x7f2da0102ef0 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.273+0000 7f2d8f7fe640 1 -- 172.21.15.159:0/3360749413 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2d98037020 con 0x7f2da0102ef0 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.274+0000 7f2da7004740 1 Processor -- start 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.274+0000 7f2da7004740 1 -- start start 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.274+0000 7f2d8f7fe640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2d880a33b0 0x7f2d880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.274+0000 7f2da7004740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992ca40 0x562d1992ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.274+0000 7f2da7004740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 0x562d1993bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.274+0000 7f2da7004740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d1993e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.274+0000 7f2da7004740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562d19892280 con 0x562d1993c150 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.274+0000 7f2da7004740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d19839b10 con 0x562d1992d360 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.274+0000 7f2da7004740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562d1988e240 con 0x562d1992ca40 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2d880a33b0 0x7f2d880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d1993e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d1993e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41416/0 (socket says 172.21.15.159:41416) 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9ed9d640 1 -- 172.21.15.159:0/2759215313 learned_addr learned my addr 172.21.15.159:0/2759215313 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2759215313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992ca40 0x562d1992ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d8f7fe640 1 -- 172.21.15.159:0/3360749413 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f2d980f0af0 con 0x7f2da0102ef0 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2759215313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 msgr2=0x562d1993bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2759215313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 0x562d1993bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2759215313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 msgr2=0x562d1993e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:36.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2759215313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d1993e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2759215313 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d198461f0 con 0x562d1992ca40 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/2759215313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d1993e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2d880a33b0 0x7f2d880a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2da00ffde0 tx=0x7f2d940137d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2759215313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992ca40 0x562d1992ce20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009c30 tx=0x7f2d900117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f793338f63f32611 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d8cff9640 1 -- 172.21.15.159:0/2759215313 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90005020 con 0x562d1992ca40 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d8cff9640 1 -- 172.21.15.159:0/2759215313 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d900047a0 con 0x562d1992ca40 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.275+0000 7f2d8cff9640 1 -- 172.21.15.159:0/2759215313 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d900126b0 con 0x562d1992ca40 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.276+0000 7f2da7004740 1 -- 172.21.15.159:0/2759215313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992ca40 msgr2=0x562d1992ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.276+0000 7f2da7004740 1 --2- 172.21.15.159:0/2759215313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992ca40 0x562d1992ce20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009c30 tx=0x7f2d900117b0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.276+0000 7f2da7004740 1 -- 172.21.15.159:0/2759215313 shutdown_connections 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.276+0000 7f2da7004740 1 --2- 172.21.15.159:0/2759215313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d1993e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.276+0000 7f2da7004740 1 --2- 172.21.15.159:0/2759215313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 0x562d1993bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.276+0000 7f2da7004740 1 --2- 172.21.15.159:0/2759215313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992ca40 0x562d1992ce20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.276+0000 7f2da7004740 1 -- 172.21.15.159:0/2759215313 >> 172.21.15.159:0/2759215313 conn(0x562d199290f0 msgr2=0x562d199294d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.276+0000 7f2da7004740 1 -- 172.21.15.159:0/2759215313 shutdown_connections 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.276+0000 7f2da7004740 1 -- 172.21.15.159:0/2759215313 wait complete. 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2da7004740 1 -- start start 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2da7004740 1 Processor -- start 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2da7004740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19939020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2da7004740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 0x562d19939560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2da7004740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1993c150 0x562d19939aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2da7004740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562d1993ed20 con 0x562d1992ca40 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2da7004740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d1984cf10 con 0x562d1992d360 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2da7004740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562d1993eea0 con 0x562d1993c150 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2da7004740 10 client.0 _ll_register_callbacks cb 0x562d19815a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:36.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19939020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19939020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41422/0 (socket says 172.21.15.159:41422) 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2782273810 learned_addr learned my addr 172.21.15.159:0/2782273810 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1993c150 0x562d19939aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 0x562d19939560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2782273810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1993c150 msgr2=0x562d19939aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1993c150 0x562d19939aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2782273810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 msgr2=0x562d19939560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 0x562d19939560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2782273810 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d196036a0 con 0x562d1992ca40 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 0x562d19939560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.277+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19939020 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2d900049d0 tx=0x7f2d90004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b38522a5054f45d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:36.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2d85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2d85ffb640 1 -- 172.21.15.159:0/2782273810 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90028030 con 0x562d1992ca40 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2d85ffb640 1 -- 172.21.15.159:0/2782273810 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f2d9001f050 con 0x562d1992ca40 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2da7004740 1 -- 172.21.15.159:0/2782273810 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d900047a0 con 0x562d1992ca40 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2d85ffb640 1 -- 172.21.15.159:0/2782273810 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2d90032050 con 0x562d1992ca40 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2da7004740 10 client.17235 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2da7004740 1 -- 172.21.15.159:0/2782273810 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d1994a960 con 0x562d1992ca40 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2d85ffb640 1 -- 172.21.15.159:0/2782273810 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d900047a0 con 0x562d1992ca40 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2d85ffb640 1 -- 172.21.15.159:0/2782273810 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f2d90024ba0 con 0x562d1992ca40 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2da7004740 10 client.17235 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2da7004740 10 client.17235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2da7004740 20 client.17235 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2da7004740 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d1994be20 0x562d1994e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2da7004740 4 client.17235 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2da7004740 1 -- 172.21.15.159:0/2782273810 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d1989f7f0 con 0x562d1994be20 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.278+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d1994be20 0x562d1994e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.279+0000 7f2d85ffb640 10 client.17235 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.279+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d1994be20 0x562d1994e210 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=605f798036c74a19 server_cookie=62505bcd0a361d59 in_seq=0 out_seq=0 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2d85ffb640 1 -- 172.21.15.159:0/2782273810 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d1989f7f0 con 0x562d1994be20 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2d85ffb640 10 client.17235 handle_command_reply: tid=0 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 client.17235 shutdown 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 -- 172.21.15.159:0/2782273810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 msgr2=0x562d19939020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19939020 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2d900049d0 tx=0x7f2d90004a00 comp rx=0 tx=0).stop 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 -- 172.21.15.159:0/2782273810 shutdown_connections 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d1994be20 0x562d1994e210 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1993c150 0x562d19939aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992d360 0x562d19939560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2d85ffb640 0 client.17235 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:36.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 --2- 172.21.15.159:0/2782273810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19939020 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 -- 172.21.15.159:0/2782273810 >> 172.21.15.159:0/2782273810 conn(0x562d199290f0 msgr2=0x562d1992ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:36.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 -- 172.21.15.159:0/2782273810 shutdown_connections 2024-09-19T06:55:36.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 1 -- 172.21.15.159:0/2782273810 wait complete. 2024-09-19T06:55:36.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.280+0000 7f2da7004740 20 client.17235 trim_cache size 0 max 16384 2024-09-19T06:55:36.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.297+0000 7f2da7004740 1 Processor -- start 2024-09-19T06:55:36.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.297+0000 7f2da7004740 1 -- start start 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.297+0000 7f2da7004740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19953930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.297+0000 7f2da7004740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 0x562d19953e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.297+0000 7f2da7004740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1993c150 0x562d1992e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2da7004740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2da01a96b0 con 0x562d1992ca40 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2da7004740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2da01abf10 con 0x562d1993c150 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2da7004740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2da01a9d00 con 0x562d1992d360 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19953930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19953930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41438/0 (socket says 172.21.15.159:41438) 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2804125795 learned_addr learned my addr 172.21.15.159:0/2804125795 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 0x562d19953e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1993c150 0x562d1992e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2804125795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 msgr2=0x562d19953e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:36.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 0x562d19953e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2804125795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1993c150 msgr2=0x562d1992e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:36.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1993c150 0x562d1992e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9e59c640 1 -- 172.21.15.159:0/2804125795 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d19947fc0 con 0x562d1992ca40 2024-09-19T06:55:36.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1993c150 0x562d1992e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:36.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19953930 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2d90011cb0 tx=0x7f2d90009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5d4afa5c5845cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:36.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d87fff640 1 -- 172.21.15.159:0/2804125795 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9003b070 con 0x562d1992ca40 2024-09-19T06:55:36.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d87fff640 1 -- 172.21.15.159:0/2804125795 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d90004a70 con 0x562d1992ca40 2024-09-19T06:55:36.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.298+0000 7f2d87fff640 1 -- 172.21.15.159:0/2804125795 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90028070 con 0x562d1992ca40 2024-09-19T06:55:36.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 -- 172.21.15.159:0/2804125795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 msgr2=0x562d19953930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:36.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19953930 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2d90011cb0 tx=0x7f2d90009530 comp rx=0 tx=0).stop 2024-09-19T06:55:36.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 -- 172.21.15.159:0/2804125795 shutdown_connections 2024-09-19T06:55:36.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1993c150 0x562d1992e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 0x562d19953e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 --2- 172.21.15.159:0/2804125795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1992ca40 0x562d19953930 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 -- 172.21.15.159:0/2804125795 >> 172.21.15.159:0/2804125795 conn(0x562d199290f0 msgr2=0x562d19928270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 -- 172.21.15.159:0/2804125795 shutdown_connections 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 -- 172.21.15.159:0/2804125795 wait complete. 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 -- start start 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.299+0000 7f2da7004740 1 Processor -- start 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2da7004740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992ca40 0x562d19944780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2da7004740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 0x562d1993fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2da7004740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d19940040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2da7004740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2da01aa3d0 con 0x562d1993c150 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2da7004740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2da01ab840 con 0x562d1992ca40 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2da7004740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2da01aaaa0 con 0x562d1992d360 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2da7004740 10 client.0 _ll_register_callbacks cb 0x7f2d980dd050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d19940040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d19940040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41440/0 (socket says 172.21.15.159:41440) 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9ed9d640 1 -- 172.21.15.159:0/633868571 learned_addr learned my addr 172.21.15.159:0/633868571 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9dd9b640 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 0x562d1993fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992ca40 0x562d19944780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9ed9d640 1 -- 172.21.15.159:0/633868571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 msgr2=0x562d1993fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 0x562d1993fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9ed9d640 1 -- 172.21.15.159:0/633868571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992ca40 msgr2=0x562d19944780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992ca40 0x562d19944780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9ed9d640 1 -- 172.21.15.159:0/633868571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d19940870 con 0x562d1993c150 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d9ed9d640 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d19940040 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2d980ee7e0 tx=0x7f2d9802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c386fff09cc988 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d85ffb640 1 -- 172.21.15.159:0/633868571 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d980098d0 con 0x562d1993c150 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2d85ffb640 1 -- 172.21.15.159:0/633868571 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f2d980b94f0 con 0x562d1993c150 2024-09-19T06:55:36.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.300+0000 7f2da7004740 1 -- 172.21.15.159:0/633868571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d90004a70 con 0x562d1993c150 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2d85ffb640 1 -- 172.21.15.159:0/633868571 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2d980a5050 con 0x562d1993c150 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2da7004740 10 client.17241 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2da7004740 1 -- 172.21.15.159:0/633868571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d199b6810 con 0x562d1993c150 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2d85ffb640 1 -- 172.21.15.159:0/633868571 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d90004a70 con 0x562d1993c150 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2d85ffb640 1 -- 172.21.15.159:0/633868571 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f2d9804d030 con 0x562d1993c150 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2da7004740 10 client.17241 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2da7004740 10 client.17241 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2da7004740 20 client.17241 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2da7004740 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d199b6f30 0x562d199b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2da7004740 4 client.17241 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2da7004740 1 -- 172.21.15.159:0/633868571 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562d19899d00 con 0x562d199b6f30 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d199b6f30 0x562d199b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2d9e59c640 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d199b6f30 0x562d199b9350 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57acb35eb7b6d6fe server_cookie=f6b156540e72fa9 in_seq=0 out_seq=0 2024-09-19T06:55:36.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.301+0000 7f2d85ffb640 10 client.17241 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.302+0000 7f2d85ffb640 1 -- 172.21.15.159:0/633868571 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562d19899d00 con 0x562d199b6f30 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.302+0000 7f2d85ffb640 10 client.17241 handle_command_reply: tid=0 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.302+0000 7f2da7004740 1 client.17241 shutdown 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 -- 172.21.15.159:0/633868571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 msgr2=0x562d19940040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d19940040 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2d980ee7e0 tx=0x7f2d9802a950 comp rx=0 tx=0).stop 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 -- 172.21.15.159:0/633868571 shutdown_connections 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562d199b6f30 0x562d199b9350 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562d1993c150 0x562d19940040 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d1992d360 0x562d1993fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2d85ffb640 0 client.17241 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 --2- 172.21.15.159:0/633868571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d1992ca40 0x562d19944780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 -- 172.21.15.159:0/633868571 >> 172.21.15.159:0/633868571 conn(0x562d199290f0 msgr2=0x562d19946fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 -- 172.21.15.159:0/633868571 shutdown_connections 2024-09-19T06:55:36.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 1 -- 172.21.15.159:0/633868571 wait complete. 2024-09-19T06:55:36.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da7004740 20 client.17241 trim_cache size 0 max 16384 2024-09-19T06:55:36.309 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:55:36.309 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:55:36.309 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "147dc293-41ef-4d0f-a442-d30febc27558", 2024-09-19T06:55:36.309 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:55:36.309 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:55:36.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da4c2b640 1 -- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2d880a33b0 msgr2=0x7f2d880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:36.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2d880a33b0 0x7f2d880a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2da00ffde0 tx=0x7f2d940137d0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.303+0000 7f2da4c2b640 1 -- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 msgr2=0x7f2da019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:36.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.304+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 0x7f2da019cd10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2d98004af0 tx=0x7f2d9802f3a0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.304+0000 7f2da4c2b640 1 -- 172.21.15.159:0/3360749413 shutdown_connections 2024-09-19T06:55:36.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.304+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2d880a33b0 0x7f2d880a5870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.304+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2da0102ef0 0x7f2da019cd10 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.304+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2da0102570 0x7f2da0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.304+0000 7f2da4c2b640 1 --2- 172.21.15.159:0/3360749413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2da0100e20 0x7f2da0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:36.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.304+0000 7f2da4c2b640 1 -- 172.21.15.159:0/3360749413 >> 172.21.15.159:0/3360749413 conn(0x7f2da00fc7d0 msgr2=0x7f2da00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:36.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.304+0000 7f2da4c2b640 1 -- 172.21.15.159:0/3360749413 shutdown_connections 2024-09-19T06:55:36.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:36.304+0000 7f2da4c2b640 1 -- 172.21.15.159:0/3360749413 wait complete. 2024-09-19T06:55:37.067 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:36 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:55:37.067 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:36 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:37.067 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:36 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:55:37.067 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:36 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:37.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:36 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:55:37.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:36 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:37.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:36 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:55:37.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:36 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:37.094 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:55:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:36 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:55:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:36 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:36 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:55:37.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:36 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:37.343 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:37.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.802+0000 7fd7b6977640 1 -- 172.21.15.159:0/2811898819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100e30 msgr2=0x7fd7b0104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:37.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.802+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2811898819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100e30 0x7fd7b0104e80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400aa10 tx=0x7fd7a402b720 comp rx=0 tx=0).stop 2024-09-19T06:55:37.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.802+0000 7fd7b6977640 1 -- 172.21.15.159:0/2811898819 shutdown_connections 2024-09-19T06:55:37.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.802+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2811898819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7b01055b0 0x7fd7b010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.802+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2811898819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100e30 0x7fd7b0104e80 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.802+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2811898819 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7b0100480 0x7fd7b0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.802+0000 7fd7b6977640 1 -- 172.21.15.159:0/2811898819 >> 172.21.15.159:0/2811898819 conn(0x7fd7b0077210 msgr2=0x7fd7b00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.802+0000 7fd7b6977640 1 -- 172.21.15.159:0/2811898819 shutdown_connections 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.802+0000 7fd7b6977640 1 -- 172.21.15.159:0/2811898819 wait complete. 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.803+0000 7fd7b6977640 1 Processor -- start 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.803+0000 7fd7b6977640 1 -- start start 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.803+0000 7fd7b6977640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100480 0x7fd7b00fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.803+0000 7fd7b6977640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7b0100e30 0x7fd7b00fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.803+0000 7fd7b6977640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7b01055b0 0x7fd7b00fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.803+0000 7fd7b6977640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b010fdb0 con 0x7fd7b0100480 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.803+0000 7fd7b6977640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b010fc30 con 0x7fd7b0100e30 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.803+0000 7fd7b6977640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b010ff30 con 0x7fd7b01055b0 2024-09-19T06:55:37.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.803+0000 7fd7affff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100480 0x7fd7b00fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7affff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100480 0x7fd7b00fc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41458/0 (socket says 172.21.15.159:41458) 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7affff640 1 -- 172.21.15.159:0/2697950313 learned_addr learned my addr 172.21.15.159:0/2697950313 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7b0100e30 0x7fd7b00fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7b4f14640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7b01055b0 0x7fd7b00fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7affff640 1 -- 172.21.15.159:0/2697950313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7b01055b0 msgr2=0x7fd7b00fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7affff640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7b01055b0 0x7fd7b00fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7affff640 1 -- 172.21.15.159:0/2697950313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7b0100e30 msgr2=0x7fd7b00fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7affff640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7b0100e30 0x7fd7b00fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7affff640 1 -- 172.21.15.159:0/2697950313 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b01a6a50 con 0x7fd7b0100480 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7affff640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100480 0x7fd7b00fc690 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000b4a0 tx=0x7fd7a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7ad7fa640 1 -- 172.21.15.159:0/2697950313 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0014070 con 0x7fd7b0100480 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7ad7fa640 1 -- 172.21.15.159:0/2697950313 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a0010af0 con 0x7fd7b0100480 2024-09-19T06:55:37.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7b6977640 1 -- 172.21.15.159:0/2697950313 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b01a6d40 con 0x7fd7b0100480 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7ad7fa640 1 -- 172.21.15.159:0/2697950313 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0017d10 con 0x7fd7b0100480 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.804+0000 7fd7b6977640 1 -- 172.21.15.159:0/2697950313 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b01a71f0 con 0x7fd7b0100480 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.806+0000 7fd7ad7fa640 1 -- 172.21.15.159:0/2697950313 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd7a0017070 con 0x7fd7b0100480 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7b8d50740 1 Processor -- start 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7b8d50740 1 -- start start 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade564a0 0x5642ade56880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 0x5642ade61140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade61680 0x5642ade63a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5642addbc2e0 con 0x5642ade61680 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5642add63ce0 con 0x5642ade56dc0 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5642addb82a0 con 0x5642ade564a0 2024-09-19T06:55:37.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade61680 0x5642ade63a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade61680 0x5642ade63a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41464/0 (socket says 172.21.15.159:41464) 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7af7fe640 1 -- 172.21.15.159:0/2243475422 learned_addr learned my addr 172.21.15.159:0/2243475422 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7ad7fa640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7980a3430 0x7fd7980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7b4f14640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7980a3430 0x7fd7980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7af7fe640 1 -- 172.21.15.159:0/2243475422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade564a0 msgr2=0x5642ade56880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/2243475422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade564a0 0x5642ade56880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7af7fe640 1 -- 172.21.15.159:0/2243475422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 msgr2=0x5642ade61140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7ad7fa640 1 -- 172.21.15.159:0/2697950313 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fd7a00cef20 con 0x7fd7b0100480 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7affff640 1 --2- 172.21.15.159:0/2243475422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 0x5642ade61140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/2243475422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 0x5642ade61140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7af7fe640 1 -- 172.21.15.159:0/2243475422 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642add48440 con 0x5642ade61680 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.807+0000 7fd7affff640 1 --2- 172.21.15.159:0/2243475422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 0x5642ade61140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:37.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.808+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/2243475422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade61680 0x5642ade63a70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400aa10 tx=0x7fd7a4030e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20983502cf203ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.808+0000 7fd7b4f14640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7980a3430 0x7fd7980a58f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800a780 tx=0x7fd7a8005f60 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.808+0000 7fd7967fc640 1 -- 172.21.15.159:0/2243475422 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4041070 con 0x5642ade61680 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.808+0000 7fd7967fc640 1 -- 172.21.15.159:0/2243475422 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a4030980 con 0x5642ade61680 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.808+0000 7fd7967fc640 1 -- 172.21.15.159:0/2243475422 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4036040 con 0x5642ade61680 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 -- 172.21.15.159:0/2243475422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade61680 msgr2=0x5642ade63a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/2243475422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade61680 0x5642ade63a70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400aa10 tx=0x7fd7a4030e60 comp rx=0 tx=0).stop 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 -- 172.21.15.159:0/2243475422 shutdown_connections 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/2243475422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade61680 0x5642ade63a70 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/2243475422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 0x5642ade61140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/2243475422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade564a0 0x5642ade56880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 -- 172.21.15.159:0/2243475422 >> 172.21.15.159:0/2243475422 conn(0x5642ade52a30 msgr2=0x5642ade52e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 -- 172.21.15.159:0/2243475422 shutdown_connections 2024-09-19T06:55:37.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 -- 172.21.15.159:0/2243475422 wait complete. 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 -- start start 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.809+0000 7fd7b8d50740 1 Processor -- start 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade564a0 0x5642ade60f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade5e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade61680 0x5642ade5e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5642ade64250 con 0x5642ade56dc0 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5642add77050 con 0x5642ade564a0 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5642ade643d0 con 0x5642ade61680 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7b8d50740 10 client.0 _ll_register_callbacks cb 0x5642addb7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:37.844 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:55:37.845 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:55:37.845 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:55:37.845 INFO:teuthology.orchestra.run.smithi159.stdout: "147dc293-41ef-4d0f-a442-d30febc27558": { 2024-09-19T06:55:37.845 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:55:37.845 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "147dc293-41ef-4d0f-a442-d30febc27558", 2024-09-19T06:55:37.845 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:55:37.845 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:55:37.845 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:55:37.845 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade5e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade5e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41476/0 (socket says 172.21.15.159:41476) 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7af7fe640 1 -- 172.21.15.159:0/4267614760 learned_addr learned my addr 172.21.15.159:0/4267614760 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7affff640 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade564a0 0x5642ade60f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7b4f14640 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade61680 0x5642ade5e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7af7fe640 1 -- 172.21.15.159:0/4267614760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade61680 msgr2=0x5642ade5e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade61680 0x5642ade5e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7af7fe640 1 -- 172.21.15.159:0/4267614760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade564a0 msgr2=0x5642ade60f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade564a0 0x5642ade60f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7af7fe640 1 -- 172.21.15.159:0/4267614760 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642adb2d3c0 con 0x5642ade56dc0 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade5e220 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd7a402bc40 tx=0x7fd7a4005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6023cf6e9d812c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd78f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd78f7fe640 1 -- 172.21.15.159:0/4267614760 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4036030 con 0x5642ade56dc0 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd78f7fe640 1 -- 172.21.15.159:0/4267614760 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fd7a40047a0 con 0x5642ade56dc0 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.810+0000 7fd7b8d50740 1 -- 172.21.15.159:0/4267614760 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7a4030980 con 0x5642ade56dc0 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd78f7fe640 1 -- 172.21.15.159:0/4267614760 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd7a4055050 con 0x5642ade56dc0 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd7b8d50740 10 client.17253 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd7b8d50740 1 -- 172.21.15.159:0/4267614760 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5642ade6fb60 con 0x5642ade56dc0 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd78f7fe640 1 -- 172.21.15.159:0/4267614760 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a4030980 con 0x5642ade56dc0 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd78f7fe640 1 -- 172.21.15.159:0/4267614760 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd7a403b040 con 0x5642ade56dc0 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd7b8d50740 10 client.17253 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd7b8d50740 10 client.17253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd7b8d50740 20 client.17253 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:37.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5642ade70eb0 0x5642ade732a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd7b8d50740 4 client.17253 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd7b8d50740 1 -- 172.21.15.159:0/4267614760 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642addc9850 con 0x5642ade70eb0 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.811+0000 7fd7affff640 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5642ade70eb0 0x5642ade732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.812+0000 7fd7affff640 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5642ade70eb0 0x5642ade732a0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e95b6db23d938cf4 server_cookie=2b5a44ff39671e7a in_seq=0 out_seq=0 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.812+0000 7fd78f7fe640 10 client.17253 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.812+0000 7fd78f7fe640 1 -- 172.21.15.159:0/4267614760 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642addc9850 con 0x5642ade70eb0 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.812+0000 7fd78f7fe640 10 client.17253 handle_command_reply: tid=0 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 client.17253 shutdown 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 -- 172.21.15.159:0/4267614760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 msgr2=0x5642ade5e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade5e220 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd7a402bc40 tx=0x7fd7a4005430 comp rx=0 tx=0).stop 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 -- 172.21.15.159:0/4267614760 shutdown_connections 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5642ade70eb0 0x5642ade732a0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade61680 0x5642ade5e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade5e220 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/4267614760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade564a0 0x5642ade60f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 -- 172.21.15.159:0/4267614760 >> 172.21.15.159:0/4267614760 conn(0x5642ade52a30 msgr2=0x5642ade58710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd78f7fe640 0 client.17253 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 -- 172.21.15.159:0/4267614760 shutdown_connections 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 1 -- 172.21.15.159:0/4267614760 wait complete. 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.813+0000 7fd7b8d50740 20 client.17253 trim_cache size 0 max 16384 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b8d50740 1 Processor -- start 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b8d50740 1 -- start start 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade52a30 0x5642ade6d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade564a0 0x5642ade5d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade788d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b01adb80 con 0x5642ade56dc0 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b01b03e0 con 0x5642ade52a30 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b01ae1d0 con 0x5642ade564a0 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b4f14640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b4f14640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade788d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41486/0 (socket says 172.21.15.159:41486) 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b4f14640 1 -- 172.21.15.159:0/955291244 learned_addr learned my addr 172.21.15.159:0/955291244 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/955291244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade564a0 0x5642ade5d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b4f14640 1 -- 172.21.15.159:0/955291244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade564a0 msgr2=0x5642ade5d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b4f14640 1 --2- 172.21.15.159:0/955291244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade564a0 0x5642ade5d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b4f14640 1 -- 172.21.15.159:0/955291244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade52a30 msgr2=0x5642ade6d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b4f14640 1 --2- 172.21.15.159:0/955291244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade52a30 0x5642ade6d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b4f14640 1 -- 172.21.15.159:0/955291244 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642ade562d0 con 0x5642ade56dc0 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.830+0000 7fd7b4f14640 1 --2- 172.21.15.159:0/955291244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade788d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005e50 tx=0x7fd7a8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cac73c9292d819 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:37.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd795ffb640 1 -- 172.21.15.159:0/955291244 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a801d8f0 con 0x5642ade56dc0 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd795ffb640 1 -- 172.21.15.159:0/955291244 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a8021030 con 0x5642ade56dc0 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd795ffb640 1 -- 172.21.15.159:0/955291244 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a801c420 con 0x5642ade56dc0 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd7b8d50740 1 -- 172.21.15.159:0/955291244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 msgr2=0x5642ade788d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/955291244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade788d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005e50 tx=0x7fd7a8013000 comp rx=0 tx=0).stop 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd7b8d50740 1 -- 172.21.15.159:0/955291244 shutdown_connections 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/955291244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade56dc0 0x5642ade788d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/955291244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade564a0 0x5642ade5d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/955291244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade52a30 0x5642ade6d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd7b8d50740 1 -- 172.21.15.159:0/955291244 >> 172.21.15.159:0/955291244 conn(0x5642ade5e8c0 msgr2=0x5642ade5caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd7b8d50740 1 -- 172.21.15.159:0/955291244 shutdown_connections 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.831+0000 7fd7b8d50740 1 -- 172.21.15.159:0/955291244 wait complete. 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b8d50740 1 -- start start 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b8d50740 1 Processor -- start 2024-09-19T06:55:37.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade52a30 0x5642ade65a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade564a0 0x5642ade65f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b8d50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 0x5642adeda8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b01ae8a0 con 0x5642ade564a0 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b01afd10 con 0x5642ade56dc0 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b8d50740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b01aef70 con 0x5642ade52a30 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b8d50740 10 client.0 _ll_register_callbacks cb 0x7fd7a4030d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade564a0 0x5642ade65f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7af7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade564a0 0x5642ade65f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41498/0 (socket says 172.21.15.159:41498) 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7af7fe640 1 -- 172.21.15.159:0/1886852740 learned_addr learned my addr 172.21.15.159:0/1886852740 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7b4f14640 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 0x5642adeda8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7affff640 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade52a30 0x5642ade65a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7af7fe640 1 -- 172.21.15.159:0/1886852740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade52a30 msgr2=0x5642ade65a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade52a30 0x5642ade65a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7af7fe640 1 -- 172.21.15.159:0/1886852740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 msgr2=0x5642adeda8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 0x5642adeda8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7af7fe640 1 -- 172.21.15.159:0/1886852740 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642adedade0 con 0x5642ade564a0 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.832+0000 7fd7affff640 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade52a30 0x5642ade65a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7af7fe640 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade564a0 0x5642ade65f80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4003a80 tx=0x7fd7a400a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685345a6c4b808e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd78f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd78f7fe640 1 -- 172.21.15.159:0/1886852740 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4036070 con 0x5642ade564a0 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd78f7fe640 1 -- 172.21.15.159:0/1886852740 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7fd7a4030780 con 0x5642ade564a0 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7b8d50740 1 -- 172.21.15.159:0/1886852740 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7a8021030 con 0x5642ade564a0 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd78f7fe640 1 -- 172.21.15.159:0/1886852740 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd7a4061050 con 0x5642ade564a0 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7b8d50740 10 client.17259 fetch_fsmap learned FSMap version 24 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7b8d50740 1 -- 172.21.15.159:0/1886852740 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5642adedbff0 con 0x5642ade564a0 2024-09-19T06:55:37.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd78f7fe640 1 -- 172.21.15.159:0/1886852740 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a8021030 con 0x5642ade564a0 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd78f7fe640 1 -- 172.21.15.159:0/1886852740 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd7a400b040 con 0x5642ade564a0 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7b8d50740 10 client.17259 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7b8d50740 10 client.17259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7b8d50740 20 client.17259 populate_metadata read hostname 'smithi159' 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5642ade61680 0x5642adede6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7b8d50740 4 client.17259 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.833+0000 7fd7b8d50740 1 -- 172.21.15.159:0/1886852740 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5642addc3d60 con 0x5642ade61680 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7affff640 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5642ade61680 0x5642adede6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd78f7fe640 10 client.17259 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7affff640 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5642ade61680 0x5642adede6c0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=964e99822b488cf2 server_cookie=817a551f86ee09f6 in_seq=0 out_seq=0 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd78f7fe640 1 -- 172.21.15.159:0/1886852740 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5642addc3d60 con 0x5642ade61680 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd78f7fe640 10 client.17259 handle_command_reply: tid=0 2024-09-19T06:55:37.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7b8d50740 1 client.17259 shutdown 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7b8d50740 1 -- 172.21.15.159:0/1886852740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade564a0 msgr2=0x5642ade65f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade564a0 0x5642ade65f80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4003a80 tx=0x7fd7a400a630 comp rx=0 tx=0).stop 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7b8d50740 1 -- 172.21.15.159:0/1886852740 shutdown_connections 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5642ade61680 0x5642adede6c0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5642ade56dc0 0x5642adeda8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5642ade564a0 0x5642ade65f80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd78f7fe640 0 client.17259 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7b8d50740 1 --2- 172.21.15.159:0/1886852740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5642ade52a30 0x5642ade65a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.834+0000 7fd7b8d50740 1 -- 172.21.15.159:0/1886852740 >> 172.21.15.159:0/1886852740 conn(0x5642ade5e8c0 msgr2=0x5642ade5d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b8d50740 1 -- 172.21.15.159:0/1886852740 shutdown_connections 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b8d50740 1 -- 172.21.15.159:0/1886852740 wait complete. 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b8d50740 20 client.17259 trim_cache size 0 max 16384 2024-09-19T06:55:37.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 -- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7980a3430 msgr2=0x7fd7980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7980a3430 0x7fd7980a58f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800a780 tx=0x7fd7a8005f60 comp rx=0 tx=0).stop 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 -- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100480 msgr2=0x7fd7b00fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100480 0x7fd7b00fc690 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000b4a0 tx=0x7fd7a000b960 comp rx=0 tx=0).stop 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 -- 172.21.15.159:0/2697950313 shutdown_connections 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd7980a3430 0x7fd7980a58f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7b01055b0 0x7fd7b00fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7b0100e30 0x7fd7b00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 --2- 172.21.15.159:0/2697950313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7b0100480 0x7fd7b00fc690 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 -- 172.21.15.159:0/2697950313 >> 172.21.15.159:0/2697950313 conn(0x7fd7b0077210 msgr2=0x7fd7b0103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 -- 172.21.15.159:0/2697950313 shutdown_connections 2024-09-19T06:55:37.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:55:37.835+0000 7fd7b6977640 1 -- 172.21.15.159:0/2697950313 wait complete. 2024-09-19T06:55:38.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:37 smithi203 ceph-mon[35473]: pgmap v267: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4 op/s 2024-09-19T06:55:38.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:37 smithi189 ceph-mon[34880]: pgmap v267: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4 op/s 2024-09-19T06:55:38.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:37 smithi159 ceph-mon[30935]: pgmap v267: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4 op/s 2024-09-19T06:55:38.593 INFO:tasks.cephfs.filesystem:scrub status for tag:147dc293-41ef-4d0f-a442-d30febc27558 - {'path': '/', 'tag': '147dc293-41ef-4d0f-a442-d30febc27558', 'options': 'recursive,force'} 2024-09-19T06:55:40.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:39 smithi203 ceph-mon[35473]: pgmap v268: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3 op/s 2024-09-19T06:55:40.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:39 smithi189 ceph-mon[34880]: pgmap v268: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3 op/s 2024-09-19T06:55:40.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:39 smithi159 ceph-mon[30935]: pgmap v268: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3 op/s 2024-09-19T06:55:41.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:40 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:55:41.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:40 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:55:41.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:40 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:55:42.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:41 smithi203 ceph-mon[35473]: pgmap v269: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3 op/s 2024-09-19T06:55:42.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:41 smithi189 ceph-mon[34880]: pgmap v269: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3 op/s 2024-09-19T06:55:42.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:41 smithi159 ceph-mon[30935]: pgmap v269: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3 op/s 2024-09-19T06:55:44.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:43 smithi203 ceph-mon[35473]: pgmap v270: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4 op/s 2024-09-19T06:55:44.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:43 smithi189 ceph-mon[34880]: pgmap v270: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4 op/s 2024-09-19T06:55:44.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:43 smithi159 ceph-mon[30935]: pgmap v270: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4 op/s 2024-09-19T06:55:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:45 smithi203 ceph-mon[35473]: pgmap v271: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:46.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:45 smithi189 ceph-mon[34880]: pgmap v271: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:46.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:45 smithi159 ceph-mon[30935]: pgmap v271: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:55:48.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:47 smithi203 ceph-mon[35473]: pgmap v272: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:55:48.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:47 smithi189 ceph-mon[34880]: pgmap v272: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:55:48.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:47 smithi159 ceph-mon[30935]: pgmap v272: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:55:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:49 smithi203 ceph-mon[35473]: pgmap v273: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:50.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:49 smithi189 ceph-mon[34880]: pgmap v273: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:50.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:49 smithi159 ceph-mon[30935]: pgmap v273: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:52.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:51 smithi203 ceph-mon[35473]: pgmap v274: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:52.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:51 smithi189 ceph-mon[34880]: pgmap v274: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:52.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:51 smithi159 ceph-mon[30935]: pgmap v274: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:54.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:54 smithi189 ceph-mon[34880]: pgmap v275: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:55:54.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:54 smithi159 ceph-mon[30935]: pgmap v275: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:55:55.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:54 smithi203 ceph-mon[35473]: pgmap v275: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:55:56.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:56 smithi189 ceph-mon[34880]: pgmap v276: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:56.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:56 smithi159 ceph-mon[30935]: pgmap v276: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:57.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:56 smithi203 ceph-mon[35473]: pgmap v276: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:55:58.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:55:58 smithi189 ceph-mon[34880]: pgmap v277: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:55:58.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:55:58 smithi159 ceph-mon[30935]: pgmap v277: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:55:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:55:58 smithi203 ceph-mon[35473]: pgmap v277: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:00.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:00 smithi189 ceph-mon[34880]: pgmap v278: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:00.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:00 smithi159 ceph-mon[30935]: pgmap v278: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:00 smithi203 ceph-mon[35473]: pgmap v278: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:02.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:02 smithi189 ceph-mon[34880]: pgmap v279: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:02.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:02 smithi159 ceph-mon[30935]: pgmap v279: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:03.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:02 smithi203 ceph-mon[35473]: pgmap v279: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:04.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:04 smithi189 ceph-mon[34880]: pgmap v280: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:56:04.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:04 smithi159 ceph-mon[30935]: pgmap v280: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:56:05.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:04 smithi203 ceph-mon[35473]: pgmap v280: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:56:06.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:06 smithi189 ceph-mon[34880]: pgmap v281: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:56:06.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:06 smithi159 ceph-mon[30935]: pgmap v281: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:56:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:06 smithi203 ceph-mon[35473]: pgmap v281: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:56:08.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:56:08.863 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:08.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:08 smithi189 ceph-mon[34880]: pgmap v282: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:56:08.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:08 smithi159 ceph-mon[30935]: pgmap v282: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:56:09.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:08 smithi203 ceph-mon[35473]: pgmap v282: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:56:09.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.336+0000 7f088689d640 1 -- 172.21.15.159:0/2186746968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08801036e0 msgr2=0x7f088010bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:09.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.336+0000 7f088689d640 1 --2- 172.21.15.159:0/2186746968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08801036e0 0x7f088010bbd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f0874009900 tx=0x7f087402a480 comp rx=0 tx=0).stop 2024-09-19T06:56:09.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.336+0000 7f088689d640 1 -- 172.21.15.159:0/2186746968 shutdown_connections 2024-09-19T06:56:09.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.336+0000 7f088689d640 1 --2- 172.21.15.159:0/2186746968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f088010c1a0 0x7f088010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.336+0000 7f088689d640 1 --2- 172.21.15.159:0/2186746968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08801036e0 0x7f088010bbd0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.336+0000 7f088689d640 1 --2- 172.21.15.159:0/2186746968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0880102dc0 0x7f08801031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.336+0000 7f088689d640 1 -- 172.21.15.159:0/2186746968 >> 172.21.15.159:0/2186746968 conn(0x7f08800fc7a0 msgr2=0x7f08800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.336+0000 7f088689d640 1 -- 172.21.15.159:0/2186746968 shutdown_connections 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.336+0000 7f088689d640 1 -- 172.21.15.159:0/2186746968 wait complete. 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f088689d640 1 Processor -- start 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f088689d640 1 -- start start 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f088689d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0880102dc0 0x7f08801984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f088689d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08801036e0 0x7f08801989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f088689d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f088010c1a0 0x7f088019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f088689d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0880111fb0 con 0x7f088010c1a0 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f088689d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0880111e30 con 0x7f08801036e0 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f088689d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0880112130 con 0x7f0880102dc0 2024-09-19T06:56:09.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f0884e3a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f088010c1a0 0x7f088019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f0884e3a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f088010c1a0 0x7f088019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36584/0 (socket says 172.21.15.159:36584) 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f0884e3a640 1 -- 172.21.15.159:0/711733097 learned_addr learned my addr 172.21.15.159:0/711733097 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.337+0000 7f087f7fe640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08801036e0 0x7f08801989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f087ffff640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0880102dc0 0x7f08801984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f0884e3a640 1 -- 172.21.15.159:0/711733097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0880102dc0 msgr2=0x7f08801984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f0884e3a640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0880102dc0 0x7f08801984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f0884e3a640 1 -- 172.21.15.159:0/711733097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08801036e0 msgr2=0x7f08801989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f0884e3a640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08801036e0 0x7f08801989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f0884e3a640 1 -- 172.21.15.159:0/711733097 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088019d450 con 0x7f088010c1a0 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f0884e3a640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f088010c1a0 0x7f088019cd70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f087800cad0 tx=0x7f087800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f087d7fa640 1 -- 172.21.15.159:0/711733097 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087800ae20 con 0x7f088010c1a0 2024-09-19T06:56:09.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f087d7fa640 1 -- 172.21.15.159:0/711733097 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0878005020 con 0x7f088010c1a0 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f088689d640 1 -- 172.21.15.159:0/711733097 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088019d740 con 0x7f088010c1a0 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f087d7fa640 1 -- 172.21.15.159:0/711733097 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087800f6f0 con 0x7f088010c1a0 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.338+0000 7f088689d640 1 -- 172.21.15.159:0/711733097 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08801a5020 con 0x7f088010c1a0 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.341+0000 7f0888c76740 1 Processor -- start 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.341+0000 7f087d7fa640 1 -- 172.21.15.159:0/711733097 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f08780051d0 con 0x7f088010c1a0 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.341+0000 7f0888c76740 1 -- start start 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.341+0000 7f0888c76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acf4a0 0x563698acf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.341+0000 7f0888c76740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acfdc0 0x563698ada140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.341+0000 7f0888c76740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698ada680 0x563698adca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.341+0000 7f0888c76740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563698a352e0 con 0x563698ada680 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.341+0000 7f0888c76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5636989dcce0 con 0x563698acf4a0 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.341+0000 7f0888c76740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563698a312a0 con 0x563698acfdc0 2024-09-19T06:56:09.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698ada680 0x563698adca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698ada680 0x563698adca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36594/0 (socket says 172.21.15.159:36594) 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 -- 172.21.15.159:0/2164602967 learned_addr learned my addr 172.21.15.159:0/2164602967 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 --2- 172.21.15.159:0/2164602967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acf4a0 0x563698acf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087ffff640 1 --2- 172.21.15.159:0/2164602967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acfdc0 0x563698ada140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087d7fa640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08680a33b0 0x7f08680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 -- 172.21.15.159:0/2164602967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acfdc0 msgr2=0x563698ada140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 --2- 172.21.15.159:0/2164602967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acfdc0 0x563698ada140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 -- 172.21.15.159:0/2164602967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acf4a0 msgr2=0x563698acf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 --2- 172.21.15.159:0/2164602967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acf4a0 0x563698acf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 -- 172.21.15.159:0/2164602967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636989c1440 con 0x563698ada680 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f0884e3a640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08680a33b0 0x7f08680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087f7fe640 1 --2- 172.21.15.159:0/2164602967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698ada680 0x563698adca70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0874009900 tx=0x7f08740314d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0c720723f4e73f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:09.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f087d7fa640 1 -- 172.21.15.159:0/711733097 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f08780cfe20 con 0x7f088010c1a0 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f08667fc640 1 -- 172.21.15.159:0/2164602967 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874035070 con 0x563698ada680 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f08667fc640 1 -- 172.21.15.159:0/2164602967 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0874031a10 con 0x563698ada680 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.342+0000 7f08667fc640 1 -- 172.21.15.159:0/2164602967 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087403d6b0 con 0x563698ada680 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.343+0000 7f0888c76740 1 -- 172.21.15.159:0/2164602967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698ada680 msgr2=0x563698adca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.343+0000 7f0888c76740 1 --2- 172.21.15.159:0/2164602967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698ada680 0x563698adca70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0874009900 tx=0x7f08740314d0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.343+0000 7f0884e3a640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08680a33b0 0x7f08680a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0878098a70 tx=0x7f087806d040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.344+0000 7f0888c76740 1 -- 172.21.15.159:0/2164602967 shutdown_connections 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.344+0000 7f0888c76740 1 --2- 172.21.15.159:0/2164602967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698ada680 0x563698adca70 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.344+0000 7f0888c76740 1 --2- 172.21.15.159:0/2164602967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acfdc0 0x563698ada140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.344+0000 7f0888c76740 1 --2- 172.21.15.159:0/2164602967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acf4a0 0x563698acf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.344+0000 7f0888c76740 1 -- 172.21.15.159:0/2164602967 >> 172.21.15.159:0/2164602967 conn(0x563698acba30 msgr2=0x563698acbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.344+0000 7f0888c76740 1 -- 172.21.15.159:0/2164602967 shutdown_connections 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.344+0000 7f0888c76740 1 -- 172.21.15.159:0/2164602967 wait complete. 2024-09-19T06:56:09.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.344+0000 7f0888c76740 1 -- start start 2024-09-19T06:56:09.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f0888c76740 1 Processor -- start 2024-09-19T06:56:09.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f0888c76740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698ada010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f0888c76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 0x563698ad72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f0888c76740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698ada680 0x563698ad7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f0888c76740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563698add250 con 0x563698acf4a0 2024-09-19T06:56:09.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f0888c76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5636989f0050 con 0x563698acfdc0 2024-09-19T06:56:09.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f0888c76740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563698add3d0 con 0x563698ada680 2024-09-19T06:56:09.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f0888c76740 10 client.0 _ll_register_callbacks cb 0x563698a30160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:09.404 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:56:09.405 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:56:09.405 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:56:09.405 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:56:09.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698ada010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698ada010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36600/0 (socket says 172.21.15.159:36600) 2024-09-19T06:56:09.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 -- 172.21.15.159:0/1558826962 learned_addr learned my addr 172.21.15.159:0/1558826962 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:09.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087ffff640 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 0x563698ad72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698ada680 0x563698ad7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 -- 172.21.15.159:0/1558826962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698ada680 msgr2=0x563698ad7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698ada680 0x563698ad7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 -- 172.21.15.159:0/1558826962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 msgr2=0x563698ad72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 0x563698ad72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 -- 172.21.15.159:0/1558826962 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636987a63c0 con 0x563698acf4a0 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f087f7fe640 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698ada010 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f087402a4c0 tx=0x7f0874003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf74fc9e35542fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f085f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.345+0000 7f085f7fe640 1 -- 172.21.15.159:0/1558826962 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874041070 con 0x563698acf4a0 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f085f7fe640 1 -- 172.21.15.159:0/1558826962 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f0874003ab0 con 0x563698acf4a0 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f0888c76740 1 -- 172.21.15.159:0/1558826962 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563698a42850 con 0x563698acf4a0 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f085f7fe640 1 -- 172.21.15.159:0/1558826962 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f087405c050 con 0x563698acf4a0 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f0888c76740 10 client.17271 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:09.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f0888c76740 1 -- 172.21.15.159:0/1558826962 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563698ae8c40 con 0x563698acf4a0 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f085f7fe640 1 -- 172.21.15.159:0/1558826962 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563698a42850 con 0x563698acf4a0 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f085f7fe640 1 -- 172.21.15.159:0/1558826962 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f08740047a0 con 0x563698acf4a0 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f0888c76740 10 client.17271 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f0888c76740 10 client.17271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f0888c76740 20 client.17271 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f0888c76740 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563698ae9f90 0x563698aec380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f0888c76740 4 client.17271 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f0888c76740 1 -- 172.21.15.159:0/1558826962 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563698a3cd60 con 0x563698ae9f90 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.346+0000 7f087ffff640 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563698ae9f90 0x563698aec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.347+0000 7f087ffff640 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563698ae9f90 0x563698aec380 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=910d20dda59f38db server_cookie=fc03a42eb61722d in_seq=0 out_seq=0 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.347+0000 7f085f7fe640 10 client.17271 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.347+0000 7f085f7fe640 1 -- 172.21.15.159:0/1558826962 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563698a3cd60 con 0x563698ae9f90 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.347+0000 7f085f7fe640 10 client.17271 handle_command_reply: tid=0 2024-09-19T06:56:09.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.347+0000 7f0888c76740 1 client.17271 shutdown 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 -- 172.21.15.159:0/1558826962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 msgr2=0x563698ada010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698ada010 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f087402a4c0 tx=0x7f0874003ce0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 -- 172.21.15.159:0/1558826962 shutdown_connections 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563698ae9f90 0x563698aec380 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698ada680 0x563698ad7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f085f7fe640 0 client.17271 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 0x563698ad72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 --2- 172.21.15.159:0/1558826962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698ada010 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 -- 172.21.15.159:0/1558826962 >> 172.21.15.159:0/1558826962 conn(0x563698acba30 msgr2=0x563698ad1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 -- 172.21.15.159:0/1558826962 shutdown_connections 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 1 -- 172.21.15.159:0/1558826962 wait complete. 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.348+0000 7f0888c76740 20 client.17271 trim_cache size 0 max 16384 2024-09-19T06:56:09.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.364+0000 7f0888c76740 1 Processor -- start 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.364+0000 7f0888c76740 1 -- start start 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f0888c76740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698aef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f0888c76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 0x563698aef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f0888c76740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698ada680 0x563698ad4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f0888c76740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f08801ab980 con 0x563698acf4a0 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f0888c76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08801ae1e0 con 0x563698acfdc0 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f0888c76740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08801abfd0 con 0x563698ada680 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698aef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698aef3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36602/0 (socket says 172.21.15.159:36602) 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087f7fe640 1 -- 172.21.15.159:0/2818060319 learned_addr learned my addr 172.21.15.159:0/2818060319 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087ffff640 1 --2- 172.21.15.159:0/2818060319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 0x563698aef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087f7fe640 1 -- 172.21.15.159:0/2818060319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698ada680 msgr2=0x563698ad4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:09.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087f7fe640 1 --2- 172.21.15.159:0/2818060319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698ada680 0x563698ad4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087f7fe640 1 -- 172.21.15.159:0/2818060319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 msgr2=0x563698aef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087f7fe640 1 --2- 172.21.15.159:0/2818060319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 0x563698aef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087f7fe640 1 -- 172.21.15.159:0/2818060319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563698ad7bb0 con 0x563698acf4a0 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087ffff640 1 --2- 172.21.15.159:0/2818060319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 0x563698aef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f087f7fe640 1 --2- 172.21.15.159:0/2818060319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698aef3a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f08740319e0 tx=0x7f0874032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb35a4cd10da5e12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f0865ffb640 1 -- 172.21.15.159:0/2818060319 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874041040 con 0x563698acf4a0 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f0865ffb640 1 -- 172.21.15.159:0/2818060319 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0874031630 con 0x563698acf4a0 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.365+0000 7f0865ffb640 1 -- 172.21.15.159:0/2818060319 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874035040 con 0x563698acf4a0 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 -- 172.21.15.159:0/2818060319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 msgr2=0x563698aef3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 --2- 172.21.15.159:0/2818060319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698aef3a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f08740319e0 tx=0x7f0874032d30 comp rx=0 tx=0).stop 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 -- 172.21.15.159:0/2818060319 shutdown_connections 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 --2- 172.21.15.159:0/2818060319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698ada680 0x563698ad4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 --2- 172.21.15.159:0/2818060319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698acfdc0 0x563698aef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 --2- 172.21.15.159:0/2818060319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acf4a0 0x563698aef3a0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 -- 172.21.15.159:0/2818060319 >> 172.21.15.159:0/2818060319 conn(0x563698acba30 msgr2=0x563698ad28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 -- 172.21.15.159:0/2818060319 shutdown_connections 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 -- 172.21.15.159:0/2818060319 wait complete. 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.366+0000 7f0888c76740 1 -- start start 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f0888c76740 1 Processor -- start 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f0888c76740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acf4a0 0x563698aecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f0888c76740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acfdc0 0x563698aed040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f0888c76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698ada680 0x563698b4c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f0888c76740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f08801ac6a0 con 0x563698acfdc0 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f0888c76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08801adb10 con 0x563698ada680 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f0888c76740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08801acd70 con 0x563698acf4a0 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f0888c76740 10 client.0 _ll_register_callbacks cb 0x7f0874032ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:09.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acfdc0 0x563698aed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acfdc0 0x563698aed040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36614/0 (socket says 172.21.15.159:36614) 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087ffff640 1 -- 172.21.15.159:0/76221712 learned_addr learned my addr 172.21.15.159:0/76221712 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087f7fe640 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acf4a0 0x563698aecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087f7fe640 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698ada680 0x563698b4c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087ffff640 1 -- 172.21.15.159:0/76221712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acf4a0 msgr2=0x563698aecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087ffff640 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acf4a0 0x563698aecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087ffff640 1 -- 172.21.15.159:0/76221712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698ada680 msgr2=0x563698b4c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087ffff640 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698ada680 0x563698b4c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087ffff640 1 -- 172.21.15.159:0/76221712 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563698b4cf30 con 0x563698acfdc0 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f087ffff640 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acfdc0 0x563698aed040 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f0870000c00 tx=0x7f08700157f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c149ed7db3e93588 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.367+0000 7f085f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f085f7fe640 1 -- 172.21.15.159:0/76221712 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870020070 con 0x563698acfdc0 2024-09-19T06:56:09.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f085f7fe640 1 -- 172.21.15.159:0/76221712 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8614+0+0 (secure 0 0 0) 0x7f08700059c0 con 0x563698acfdc0 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f0888c76740 1 -- 172.21.15.159:0/76221712 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0874031630 con 0x563698acfdc0 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f085f7fe640 1 -- 172.21.15.159:0/76221712 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f087002c050 con 0x563698acfdc0 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f0888c76740 10 client.17277 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f0888c76740 1 -- 172.21.15.159:0/76221712 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563698b542b0 con 0x563698acfdc0 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f085f7fe640 1 -- 172.21.15.159:0/76221712 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0874031630 con 0x563698acfdc0 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f085f7fe640 1 -- 172.21.15.159:0/76221712 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f08700243b0 con 0x563698acfdc0 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f0888c76740 10 client.17277 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f0888c76740 10 client.17277 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f0888c76740 20 client.17277 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f0888c76740 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563698ae9f90 0x563698b56aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f0888c76740 4 client.17277 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.368+0000 7f0888c76740 1 -- 172.21.15.159:0/76221712 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5636989b9210 con 0x563698ae9f90 2024-09-19T06:56:09.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f087f7fe640 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563698ae9f90 0x563698b56aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f085f7fe640 10 client.17277 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f087f7fe640 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563698ae9f90 0x563698b56aa0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16a4bac6d7322b67 server_cookie=433e03002b772992 in_seq=0 out_seq=0 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f085f7fe640 1 -- 172.21.15.159:0/76221712 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5636989b9210 con 0x563698ae9f90 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f085f7fe640 10 client.17277 handle_command_reply: tid=0 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 client.17277 shutdown 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 -- 172.21.15.159:0/76221712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acfdc0 msgr2=0x563698aed040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acfdc0 0x563698aed040 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f0870000c00 tx=0x7f08700157f0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 -- 172.21.15.159:0/76221712 shutdown_connections 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x563698ae9f90 0x563698b56aa0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563698ada680 0x563698b4c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f085f7fe640 0 client.17277 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563698acfdc0 0x563698aed040 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 --2- 172.21.15.159:0/76221712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563698acf4a0 0x563698aecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 -- 172.21.15.159:0/76221712 >> 172.21.15.159:0/76221712 conn(0x563698acba30 msgr2=0x563698aca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 -- 172.21.15.159:0/76221712 shutdown_connections 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.369+0000 7f0888c76740 1 -- 172.21.15.159:0/76221712 wait complete. 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f0888c76740 20 client.17277 trim_cache size 0 max 16384 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 -- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08680a33b0 msgr2=0x7f08680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08680a33b0 0x7f08680a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0878098a70 tx=0x7f087806d040 comp rx=0 tx=0).stop 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 -- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f088010c1a0 msgr2=0x7f088019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f088010c1a0 0x7f088019cd70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f087800cad0 tx=0x7f087800cf90 comp rx=0 tx=0).stop 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 -- 172.21.15.159:0/711733097 shutdown_connections 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08680a33b0 0x7f08680a5870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f088010c1a0 0x7f088019cd70 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08801036e0 0x7f08801989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 --2- 172.21.15.159:0/711733097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0880102dc0 0x7f08801984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:09.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 -- 172.21.15.159:0/711733097 >> 172.21.15.159:0/711733097 conn(0x7f08800fc7a0 msgr2=0x7f08800fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:09.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 -- 172.21.15.159:0/711733097 shutdown_connections 2024-09-19T06:56:09.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:09.370+0000 7f088689d640 1 -- 172.21.15.159:0/711733097 wait complete. 2024-09-19T06:56:10.437 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:56:10.438 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:56:10.822 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:10.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:10 smithi159 ceph-mon[30935]: pgmap v283: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:56:10.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:10 smithi159 ceph-mon[30935]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:56:11.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:10 smithi203 ceph-mon[35473]: pgmap v283: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:56:11.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:10 smithi203 ceph-mon[35473]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:56:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:10 smithi189 ceph-mon[34880]: pgmap v283: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:56:11.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:10 smithi189 ceph-mon[34880]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:56:11.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 -- 172.21.15.159:0/3655440473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb54103660 msgr2=0x7fdb5410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:11.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/3655440473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb54103660 0x7fdb5410bb50 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c009900 tx=0x7fdb3c02a480 comp rx=0 tx=0).stop 2024-09-19T06:56:11.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 -- 172.21.15.159:0/3655440473 shutdown_connections 2024-09-19T06:56:11.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/3655440473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb5410c170 0x7fdb5410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:11.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/3655440473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb54103660 0x7fdb5410bb50 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/3655440473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb54102d40 0x7fdb54103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 -- 172.21.15.159:0/3655440473 >> 172.21.15.159:0/3655440473 conn(0x7fdb540fc7a0 msgr2=0x7fdb540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 -- 172.21.15.159:0/3655440473 shutdown_connections 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 -- 172.21.15.159:0/3655440473 wait complete. 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.304+0000 7fdb59ecd640 1 Processor -- start 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb59ecd640 1 -- start start 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb59ecd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb54102d40 0x7fdb541984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb59ecd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb54103660 0x7fdb54198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb59ecd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb5410c170 0x7fdb5419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb59ecd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdb54111f70 con 0x7fdb5410c170 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb59ecd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb54111df0 con 0x7fdb54103660 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb59ecd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541120f0 con 0x7fdb54102d40 2024-09-19T06:56:11.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb5410c170 0x7fdb5419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb5410c170 0x7fdb5419cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36642/0 (socket says 172.21.15.159:36642) 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb53fff640 1 -- 172.21.15.159:0/134658518 learned_addr learned my addr 172.21.15.159:0/134658518 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb537fe640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb54102d40 0x7fdb541984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb4affd640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb54103660 0x7fdb54198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb53fff640 1 -- 172.21.15.159:0/134658518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb54102d40 msgr2=0x7fdb541984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb53fff640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb54102d40 0x7fdb541984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb53fff640 1 -- 172.21.15.159:0/134658518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb54103660 msgr2=0x7fdb54198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb53fff640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb54103660 0x7fdb54198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.305+0000 7fdb53fff640 1 -- 172.21.15.159:0/134658518 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5419d4a0 con 0x7fdb5410c170 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.306+0000 7fdb53fff640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb5410c170 0x7fdb5419cdc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00eaa0 tx=0x7fdb4c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.306+0000 7fdb517fa640 1 -- 172.21.15.159:0/134658518 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00cdb0 con 0x7fdb5410c170 2024-09-19T06:56:11.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.306+0000 7fdb517fa640 1 -- 172.21.15.159:0/134658518 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb4c005020 con 0x7fdb5410c170 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.306+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5419d790 con 0x7fdb5410c170 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.306+0000 7fdb517fa640 1 -- 172.21.15.159:0/134658518 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c0116b0 con 0x7fdb5410c170 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.306+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb541a5070 con 0x7fdb5410c170 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.307+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb54103120 con 0x7fdb5410c170 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.308+0000 7fdb517fa640 1 -- 172.21.15.159:0/134658518 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fdb4c005560 con 0x7fdb5410c170 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.309+0000 7fdb517fa640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb400a33b0 0x7fdb400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.309+0000 7fdb517fa640 1 -- 172.21.15.159:0/134658518 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fdb4c0cfef0 con 0x7fdb5410c170 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.309+0000 7fdb537fe640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb400a33b0 0x7fdb400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.309+0000 7fdb537fe640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb400a33b0 0x7fdb400a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400bbe0 tx=0x7fdb4400b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:11.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.313+0000 7fdb517fa640 1 -- 172.21.15.159:0/134658518 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb4c016030 con 0x7fdb5410c170 2024-09-19T06:56:11.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.515+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb541071e0 con 0x7fdb5410c170 2024-09-19T06:56:11.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.515+0000 7fdb517fa640 1 -- 172.21.15.159:0/134658518 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7fdb4c09c1f0 con 0x7fdb5410c170 2024-09-19T06:56:11.517 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:56:11.517 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:56:11.517 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:56:11.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb400a33b0 msgr2=0x7fdb400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:11.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb400a33b0 0x7fdb400a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400bbe0 tx=0x7fdb4400b390 comp rx=0 tx=0).stop 2024-09-19T06:56:11.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb5410c170 msgr2=0x7fdb5419cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:11.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb5410c170 0x7fdb5419cdc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00eaa0 tx=0x7fdb4c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:56:11.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 shutdown_connections 2024-09-19T06:56:11.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fdb400a33b0 0x7fdb400a5870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:11.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb5410c170 0x7fdb5419cdc0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:11.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb54103660 0x7fdb54198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:11.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 --2- 172.21.15.159:0/134658518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb54102d40 0x7fdb541984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:11.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 >> 172.21.15.159:0/134658518 conn(0x7fdb540fc7a0 msgr2=0x7fdb540fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:11.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 shutdown_connections 2024-09-19T06:56:11.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:11.518+0000 7fdb59ecd640 1 -- 172.21.15.159:0/134658518 wait complete. 2024-09-19T06:56:11.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:11 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/134658518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:12.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:11 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/134658518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:12.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:11 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/134658518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:12.633 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:56:12.887 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:12.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:12 smithi159 ceph-mon[30935]: pgmap v285: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:56:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:12 smithi203 ceph-mon[35473]: pgmap v285: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:56:13.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:12 smithi189 ceph-mon[34880]: pgmap v285: 97 pgs: 97 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:56:13.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.366+0000 7fc923cb9640 1 -- 172.21.15.159:0/3449532808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100e30 msgr2=0x7fc91c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:13.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.366+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3449532808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100e30 0x7fc91c104e80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009900 tx=0x7fc90c02a410 comp rx=0 tx=0).stop 2024-09-19T06:56:13.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.366+0000 7fc923cb9640 1 -- 172.21.15.159:0/3449532808 shutdown_connections 2024-09-19T06:56:13.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.366+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3449532808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c1055b0 0x7fc91c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.366+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3449532808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100e30 0x7fc91c104e80 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.366+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3449532808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc91c100480 0x7fc91c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.366+0000 7fc923cb9640 1 -- 172.21.15.159:0/3449532808 >> 172.21.15.159:0/3449532808 conn(0x7fc91c077220 msgr2=0x7fc91c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.366+0000 7fc923cb9640 1 -- 172.21.15.159:0/3449532808 shutdown_connections 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.366+0000 7fc923cb9640 1 -- 172.21.15.159:0/3449532808 wait complete. 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc923cb9640 1 Processor -- start 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc923cb9640 1 -- start start 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc923cb9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100480 0x7fc91c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc923cb9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc91c100e30 0x7fc91c199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc923cb9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c1055b0 0x7fc91c1a4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc923cb9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c110f30 con 0x7fc91c100480 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc923cb9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c110db0 con 0x7fc91c100e30 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc923cb9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1110b0 con 0x7fc91c1055b0 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc921a55640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100480 0x7fc91c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc921a55640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100480 0x7fc91c199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36654/0 (socket says 172.21.15.159:36654) 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.367+0000 7fc921a55640 1 -- 172.21.15.159:0/3198234916 learned_addr learned my addr 172.21.15.159:0/3198234916 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc921254640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc91c100e30 0x7fc91c199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc922256640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c1055b0 0x7fc91c1a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc921a55640 1 -- 172.21.15.159:0/3198234916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c1055b0 msgr2=0x7fc91c1a4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc921a55640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c1055b0 0x7fc91c1a4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc921a55640 1 -- 172.21.15.159:0/3198234916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc91c100e30 msgr2=0x7fc91c199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc921a55640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc91c100e30 0x7fc91c199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc921a55640 1 -- 172.21.15.159:0/3198234916 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c1a49c0 con 0x7fc91c100480 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc921254640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc91c100e30 0x7fc91c199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc922256640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c1055b0 0x7fc91c1a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc921a55640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100480 0x7fc91c199400 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc91800b4a0 tx=0x7fc91800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc912ffd640 1 -- 172.21.15.159:0/3198234916 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918014070 con 0x7fc91c100480 2024-09-19T06:56:13.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc912ffd640 1 -- 172.21.15.159:0/3198234916 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc918010af0 con 0x7fc91c100480 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc923cb9640 1 -- 172.21.15.159:0/3198234916 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91c1a4b90 con 0x7fc91c100480 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc912ffd640 1 -- 172.21.15.159:0/3198234916 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918017d10 con 0x7fc91c100480 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.368+0000 7fc923cb9640 1 -- 172.21.15.159:0/3198234916 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91c1a50a0 con 0x7fc91c100480 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.370+0000 7fc912ffd640 1 -- 172.21.15.159:0/3198234916 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc918017070 con 0x7fc91c100480 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc926092740 1 Processor -- start 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc926092740 1 -- start start 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc926092740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f65390a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc912ffd640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc9080a33b0 0x7fc9080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc926092740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f65390aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc926092740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f65391bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc926092740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f6538702f0 con 0x55f653919780 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc926092740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f653817cf0 con 0x55f65390bb40 2024-09-19T06:56:13.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc926092740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f65386c2b0 con 0x55f65390a5d0 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc921a55640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc9080a33b0 0x7fc9080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc922256640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f65391bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc922256640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f65391bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36662/0 (socket says 172.21.15.159:36662) 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.371+0000 7fc922256640 1 -- 172.21.15.159:0/3580894068 learned_addr learned my addr 172.21.15.159:0/3580894068 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc922256640 1 --2- 172.21.15.159:0/3580894068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f65390a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc912ffd640 1 -- 172.21.15.159:0/3198234916 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fc9180cf0c0 con 0x7fc91c100480 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc921254640 1 --2- 172.21.15.159:0/3580894068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f65390aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc922256640 1 -- 172.21.15.159:0/3580894068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 msgr2=0x55f65390aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc922256640 1 --2- 172.21.15.159:0/3580894068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f65390aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc922256640 1 -- 172.21.15.159:0/3580894068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 msgr2=0x55f65390a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc922256640 1 --2- 172.21.15.159:0/3580894068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f65390a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc922256640 1 -- 172.21.15.159:0/3580894068 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6537fc3a0 con 0x55f653919780 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc921a55640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc9080a33b0 0x7fc9080a5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc918097880 tx=0x7fc9180976c0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc922256640 1 --2- 172.21.15.159:0/3580894068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f65391bb70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc914014bc0 tx=0x7fc91400a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d51f5396a412c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc907fff640 1 -- 172.21.15.159:0/3580894068 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914014250 con 0x55f653919780 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc907fff640 1 -- 172.21.15.159:0/3580894068 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc914011400 con 0x55f653919780 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.372+0000 7fc907fff640 1 -- 172.21.15.159:0/3580894068 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914013630 con 0x55f653919780 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 -- 172.21.15.159:0/3580894068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 msgr2=0x55f65391bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 --2- 172.21.15.159:0/3580894068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f65391bb70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc914014bc0 tx=0x7fc91400a6b0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 -- 172.21.15.159:0/3580894068 shutdown_connections 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 --2- 172.21.15.159:0/3580894068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f65391bb70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 --2- 172.21.15.159:0/3580894068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f65390aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 --2- 172.21.15.159:0/3580894068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f65390a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 -- 172.21.15.159:0/3580894068 >> 172.21.15.159:0/3580894068 conn(0x55f6538d3310 msgr2=0x55f653906c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 -- 172.21.15.159:0/3580894068 shutdown_connections 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 -- 172.21.15.159:0/3580894068 wait complete. 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 -- start start 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.373+0000 7fc926092740 1 Processor -- start 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc926092740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f65390a5d0 0x55f653919150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc926092740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390bb40 0x55f653916400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc926092740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f653919780 0x55f6539169f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc926092740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f65391c480 con 0x55f65390a5d0 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc926092740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f65382b060 con 0x55f653919780 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc926092740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f65391c600 con 0x55f65390bb40 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc926092740 10 client.0 _ll_register_callbacks cb 0x55f65357e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc922256640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f65390a5d0 0x55f653919150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc922256640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f65390a5d0 0x55f653919150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36678/0 (socket says 172.21.15.159:36678) 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc922256640 1 -- 172.21.15.159:0/3095318507 learned_addr learned my addr 172.21.15.159:0/3095318507 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc921254640 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390bb40 0x55f653916400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc922256640 1 -- 172.21.15.159:0/3095318507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390bb40 msgr2=0x55f653916400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc922256640 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390bb40 0x55f653916400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc922256640 1 -- 172.21.15.159:0/3095318507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f653919780 msgr2=0x55f6539169f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc922256640 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f653919780 0x55f6539169f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc922256640 1 -- 172.21.15.159:0/3095318507 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6535e13c0 con 0x55f65390a5d0 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc921254640 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390bb40 0x55f653916400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc922256640 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f65390a5d0 0x55f653919150 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc914004a80 tx=0x7fc914011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9a6f258986b02f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.374+0000 7fc9057fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc9057fa640 1 -- 172.21.15.159:0/3095318507 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914014310 con 0x55f65390a5d0 2024-09-19T06:56:13.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc9057fa640 1 -- 172.21.15.159:0/3095318507 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fc9140115b0 con 0x55f65390a5d0 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc926092740 1 -- 172.21.15.159:0/3095318507 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc914011400 con 0x55f65390a5d0 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc9057fa640 1 -- 172.21.15.159:0/3095318507 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc91402e050 con 0x55f65390a5d0 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc926092740 10 client.17295 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc926092740 1 -- 172.21.15.159:0/3095318507 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f653927ef0 con 0x55f65390a5d0 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc9057fa640 1 -- 172.21.15.159:0/3095318507 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc914011400 con 0x55f65390a5d0 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc9057fa640 1 -- 172.21.15.159:0/3095318507 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fc914010040 con 0x55f65390a5d0 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc926092740 10 client.17295 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc926092740 10 client.17295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc926092740 20 client.17295 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc926092740 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f6539292f0 0x55f65392b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc926092740 4 client.17295 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.375+0000 7fc926092740 1 -- 172.21.15.159:0/3095318507 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f65387d860 con 0x55f6539292f0 2024-09-19T06:56:13.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.376+0000 7fc921254640 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f6539292f0 0x55f65392b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.376+0000 7fc921254640 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f6539292f0 0x55f65392b6e0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=399da1a8d14af440 server_cookie=2d2e4693bd805e6 in_seq=0 out_seq=0 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.376+0000 7fc9057fa640 10 client.17295 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc9057fa640 1 -- 172.21.15.159:0/3095318507 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f65387d860 con 0x55f6539292f0 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc9057fa640 10 client.17295 handle_command_reply: tid=0 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 client.17295 shutdown 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 -- 172.21.15.159:0/3095318507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f65390a5d0 msgr2=0x55f653919150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f65390a5d0 0x55f653919150 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc914004a80 tx=0x7fc914011b40 comp rx=0 tx=0).stop 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 -- 172.21.15.159:0/3095318507 shutdown_connections 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f6539292f0 0x55f65392b6e0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f653919780 0x55f6539169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390bb40 0x55f653916400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc9057fa640 0 client.17295 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:13.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 --2- 172.21.15.159:0/3095318507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f65390a5d0 0x55f653919150 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 -- 172.21.15.159:0/3095318507 >> 172.21.15.159:0/3095318507 conn(0x55f6538d3310 msgr2=0x55f65390c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:13.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 -- 172.21.15.159:0/3095318507 shutdown_connections 2024-09-19T06:56:13.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 1 -- 172.21.15.159:0/3095318507 wait complete. 2024-09-19T06:56:13.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.377+0000 7fc926092740 20 client.17295 trim_cache size 0 max 16384 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc926092740 1 Processor -- start 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc926092740 1 -- start start 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc926092740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f653925720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc926092740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f6539153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc926092740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653930c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc926092740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1a9a80 con 0x55f653919780 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc926092740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1ac2e0 con 0x55f65390bb40 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc926092740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1aa0d0 con 0x55f65390a5d0 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc922256640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653930c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc922256640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653930c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36680/0 (socket says 172.21.15.159:36680) 2024-09-19T06:56:13.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.390+0000 7fc922256640 1 -- 172.21.15.159:0/572891888 learned_addr learned my addr 172.21.15.159:0/572891888 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc921254640 1 --2- 172.21.15.159:0/572891888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f6539153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc922256640 1 -- 172.21.15.159:0/572891888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 msgr2=0x55f653925720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc922256640 1 --2- 172.21.15.159:0/572891888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f653925720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc922256640 1 -- 172.21.15.159:0/572891888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 msgr2=0x55f6539153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc922256640 1 --2- 172.21.15.159:0/572891888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f6539153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc922256640 1 -- 172.21.15.159:0/572891888 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65390d120 con 0x55f653919780 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc922256640 1 --2- 172.21.15.159:0/572891888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653930c80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc9140146e0 tx=0x7fc91400a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ada95a8bdefbd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc9077fe640 1 -- 172.21.15.159:0/572891888 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914037070 con 0x55f653919780 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc9077fe640 1 -- 172.21.15.159:0/572891888 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc914011bb0 con 0x55f653919780 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.391+0000 7fc9077fe640 1 -- 172.21.15.159:0/572891888 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914011e60 con 0x55f653919780 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 -- 172.21.15.159:0/572891888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 msgr2=0x55f653930c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 --2- 172.21.15.159:0/572891888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653930c80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc9140146e0 tx=0x7fc91400a960 comp rx=0 tx=0).stop 2024-09-19T06:56:13.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 -- 172.21.15.159:0/572891888 shutdown_connections 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 --2- 172.21.15.159:0/572891888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653930c80 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 --2- 172.21.15.159:0/572891888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f6539153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 --2- 172.21.15.159:0/572891888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f653925720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 -- 172.21.15.159:0/572891888 >> 172.21.15.159:0/572891888 conn(0x55f6538d3310 msgr2=0x55f653914cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 -- 172.21.15.159:0/572891888 shutdown_connections 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 -- 172.21.15.159:0/572891888 wait complete. 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 -- start start 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 Processor -- start 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f653921f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f6539130e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653913620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1aa7a0 con 0x55f653919780 2024-09-19T06:56:13.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1abc10 con 0x55f65390bb40 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1aae70 con 0x55f65390a5d0 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.392+0000 7fc926092740 10 client.0 _ll_register_callbacks cb 0x7fc914014500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653913620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653913620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36694/0 (socket says 172.21.15.159:36694) 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 -- 172.21.15.159:0/2751100624 learned_addr learned my addr 172.21.15.159:0/2751100624 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f653921f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc921254640 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f6539130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 -- 172.21.15.159:0/2751100624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 msgr2=0x55f653921f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f653921f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 -- 172.21.15.159:0/2751100624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 msgr2=0x55f6539130e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f6539130e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 -- 172.21.15.159:0/2751100624 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f653913df0 con 0x55f653919780 2024-09-19T06:56:13.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc922256640 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653913620 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc914004a80 tx=0x7fc914021460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f678863aeb8acd02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc9057fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc9057fa640 1 -- 172.21.15.159:0/2751100624 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914037040 con 0x55f653919780 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc9057fa640 1 -- 172.21.15.159:0/2751100624 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fc914002030 con 0x55f653919780 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc926092740 1 -- 172.21.15.159:0/2751100624 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc914011bb0 con 0x55f653919780 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc9057fa640 1 -- 172.21.15.159:0/2751100624 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc914011e60 con 0x55f653919780 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc926092740 10 client.17301 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.393+0000 7fc926092740 1 -- 172.21.15.159:0/2751100624 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f653993bf0 con 0x55f653919780 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc9057fa640 1 -- 172.21.15.159:0/2751100624 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc914011bb0 con 0x55f653919780 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc9057fa640 1 -- 172.21.15.159:0/2751100624 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fc91403d040 con 0x55f653919780 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc926092740 10 client.17301 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc926092740 10 client.17301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc926092740 20 client.17301 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:13.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc926092740 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f653994200 0x55f6539965f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc926092740 4 client.17301 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc926092740 1 -- 172.21.15.159:0/2751100624 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f653877d70 con 0x55f653994200 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc921254640 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f653994200 0x55f6539965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc9057fa640 10 client.17301 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.394+0000 7fc921254640 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f653994200 0x55f6539965f0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=537fb8a7fe6ab4cf server_cookie=30120a31a06efb6a in_seq=0 out_seq=0 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc9057fa640 1 -- 172.21.15.159:0/2751100624 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f653877d70 con 0x55f653994200 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc9057fa640 10 client.17301 handle_command_reply: tid=0 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 client.17301 shutdown 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 -- 172.21.15.159:0/2751100624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 msgr2=0x55f653913620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653913620 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc914004a80 tx=0x7fc914021460 comp rx=0 tx=0).stop 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 -- 172.21.15.159:0/2751100624 shutdown_connections 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55f653994200 0x55f6539965f0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f653919780 0x55f653913620 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f65390bb40 0x55f6539130e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc9057fa640 0 client.17301 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:13.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 --2- 172.21.15.159:0/2751100624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65390a5d0 0x55f653921f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 -- 172.21.15.159:0/2751100624 >> 172.21.15.159:0/2751100624 conn(0x55f6538d3310 msgr2=0x55f6539154f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:13.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 -- 172.21.15.159:0/2751100624 shutdown_connections 2024-09-19T06:56:13.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 1 -- 172.21.15.159:0/2751100624 wait complete. 2024-09-19T06:56:13.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc926092740 20 client.17301 trim_cache size 0 max 16384 2024-09-19T06:56:13.409 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc923cb9640 1 -- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc9080a33b0 msgr2=0x7fc9080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc9080a33b0 0x7fc9080a5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc918097880 tx=0x7fc9180976c0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc923cb9640 1 -- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100480 msgr2=0x7fc91c199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.395+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100480 0x7fc91c199400 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc91800b4a0 tx=0x7fc91800b960 comp rx=0 tx=0).stop 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.396+0000 7fc923cb9640 1 -- 172.21.15.159:0/3198234916 shutdown_connections 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.396+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc9080a33b0 0x7fc9080a5870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.396+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c1055b0 0x7fc91c1a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.396+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc91c100e30 0x7fc91c199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.396+0000 7fc923cb9640 1 --2- 172.21.15.159:0/3198234916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc91c100480 0x7fc91c199400 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:13.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.396+0000 7fc923cb9640 1 -- 172.21.15.159:0/3198234916 >> 172.21.15.159:0/3198234916 conn(0x7fc91c077220 msgr2=0x7fc91c103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:13.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.396+0000 7fc923cb9640 1 -- 172.21.15.159:0/3198234916 shutdown_connections 2024-09-19T06:56:13.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:13.396+0000 7fc923cb9640 1 -- 172.21.15.159:0/3198234916 wait complete. 2024-09-19T06:56:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:14 smithi203 ceph-mon[35473]: pgmap v286: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:56:15.097 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:56:15.097 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:56:15.120 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:14 smithi159 ceph-mon[30935]: pgmap v286: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:56:15.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:14 smithi189 ceph-mon[34880]: pgmap v286: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:56:15.356 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:15.798 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:15 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:56:15.798 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:15 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:56:15.798 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:15 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:56:15.798 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:15 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:56:15.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.881+0000 7fa7099fc640 1 -- 172.21.15.159:0/189773374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 msgr2=0x7fa7041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.881+0000 7fa7099fc640 1 --2- 172.21.15.159:0/189773374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 0x7fa7041067e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009900 tx=0x7fa6ec02a410 comp rx=0 tx=0).stop 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.881+0000 7fa7099fc640 1 -- 172.21.15.159:0/189773374 shutdown_connections 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.881+0000 7fa7099fc640 1 --2- 172.21.15.159:0/189773374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704106f10 0x7fa70410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.881+0000 7fa7099fc640 1 --2- 172.21.15.159:0/189773374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 0x7fa7041067e0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.881+0000 7fa7099fc640 1 --2- 172.21.15.159:0/189773374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa704101de0 0x7fa7041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.881+0000 7fa7099fc640 1 -- 172.21.15.159:0/189773374 >> 172.21.15.159:0/189773374 conn(0x7fa7040fd8c0 msgr2=0x7fa7040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.881+0000 7fa7099fc640 1 -- 172.21.15.159:0/189773374 shutdown_connections 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.881+0000 7fa7099fc640 1 -- 172.21.15.159:0/189773374 wait complete. 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa7099fc640 1 Processor -- start 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa7099fc640 1 -- start start 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa7099fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704101de0 0x7fa7040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa7099fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 0x7fa704074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa7099fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa704106f10 0x7fa704074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa7099fc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa704111fb0 con 0x7fa704102790 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa7099fc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa704111e30 con 0x7fa704106f10 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa7099fc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa704112130 con 0x7fa704101de0 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 0x7fa704074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 0x7fa704074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36708/0 (socket says 172.21.15.159:36708) 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa6fbfff640 1 -- 172.21.15.159:0/4056453837 learned_addr learned my addr 172.21.15.159:0/4056453837 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa702ffd640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704101de0 0x7fa7040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.882+0000 7fa7037fe640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa704106f10 0x7fa704074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa6fbfff640 1 -- 172.21.15.159:0/4056453837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704101de0 msgr2=0x7fa7040744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704101de0 0x7fa7040744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa6fbfff640 1 -- 172.21.15.159:0/4056453837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa704106f10 msgr2=0x7fa704074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa704106f10 0x7fa704074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa6fbfff640 1 -- 172.21.15.159:0/4056453837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7041a69e0 con 0x7fa704102790 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 0x7fa704074a30 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec005ab0 tx=0x7fa6ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa7089fa640 1 -- 172.21.15.159:0/4056453837 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec03f030 con 0x7fa704102790 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa7099fc640 1 -- 172.21.15.159:0/4056453837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7041a6c70 con 0x7fa704102790 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa7089fa640 1 -- 172.21.15.159:0/4056453837 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec003ce0 con 0x7fa704102790 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa7089fa640 1 -- 172.21.15.159:0/4056453837 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec035070 con 0x7fa704102790 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.883+0000 7fa7099fc640 1 -- 172.21.15.159:0/4056453837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7041a7150 con 0x7fa704102790 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.885+0000 7fa7089fa640 1 -- 172.21.15.159:0/4056453837 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fa6ec042030 con 0x7fa704102790 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.885+0000 7fa70bdd5740 1 Processor -- start 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa70bdd5740 1 -- start start 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 0x557a340cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340cf480 0x557a340d9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340d9d40 0x557a340dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557a34034280 con 0x557a340d9d40 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a33fdbb10 con 0x557a340cf480 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557a34030240 con 0x557a340ceb60 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340d9d40 0x557a340dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340d9d40 0x557a340dc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36712/0 (socket says 172.21.15.159:36712) 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa6fbfff640 1 -- 172.21.15.159:0/483239578 learned_addr learned my addr 172.21.15.159:0/483239578 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa702ffd640 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340cf480 0x557a340d9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa7037fe640 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 0x557a340cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa7089fa640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6f00a33b0 0x7fa6f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa6fbfff640 1 -- 172.21.15.159:0/483239578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 msgr2=0x557a340cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 0x557a340cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa7037fe640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6f00a33b0 0x7fa6f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa6fbfff640 1 -- 172.21.15.159:0/483239578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340cf480 msgr2=0x557a340d9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340cf480 0x557a340d9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa6fbfff640 1 -- 172.21.15.159:0/483239578 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a33fe81f0 con 0x557a340d9d40 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.886+0000 7fa702ffd640 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340cf480 0x557a340d9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.887+0000 7fa7089fa640 1 -- 172.21.15.159:0/4056453837 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fa6ec0f0670 con 0x7fa704102790 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.887+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340d9d40 0x557a340dc130 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0edca0 tx=0x7fa6ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db87c795f077df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.887+0000 7fa7037fe640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6f00a33b0 0x7fa6f00a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00afd0 tx=0x7fa6fc004ab0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.887+0000 7fa6f9ffb640 1 -- 172.21.15.159:0/483239578 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0bc220 con 0x557a340d9d40 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.887+0000 7fa6f9ffb640 1 -- 172.21.15.159:0/483239578 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec0bcfc0 con 0x557a340d9d40 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.887+0000 7fa6f9ffb640 1 -- 172.21.15.159:0/483239578 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec03bd00 con 0x557a340d9d40 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.887+0000 7fa70bdd5740 1 -- 172.21.15.159:0/483239578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340d9d40 msgr2=0x557a340dc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.887+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340d9d40 0x557a340dc130 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0edca0 tx=0x7fa6ec04c000 comp rx=0 tx=0).stop 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 -- 172.21.15.159:0/483239578 shutdown_connections 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340d9d40 0x557a340dc130 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340cf480 0x557a340d9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/483239578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 0x557a340cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 -- 172.21.15.159:0/483239578 >> 172.21.15.159:0/483239578 conn(0x557a340cb0f0 msgr2=0x557a340cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 -- 172.21.15.159:0/483239578 shutdown_connections 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 -- 172.21.15.159:0/483239578 wait complete. 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 -- start start 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 Processor -- start 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340d70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340d9d40 0x557a340d7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x557a340dc6d0 con 0x557a340cf480 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a33feef10 con 0x557a340ceb60 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557a340dc850 con 0x557a340d9d40 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.888+0000 7fa70bdd5740 10 client.0 _ll_register_callbacks cb 0x557a33fb7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340d70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340d70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36728/0 (socket says 172.21.15.159:36728) 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa702ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6fbfff640 1 -- 172.21.15.159:0/3694581006 learned_addr learned my addr 172.21.15.159:0/3694581006 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa7037fe640 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340d9d40 0x557a340d7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6fbfff640 1 -- 172.21.15.159:0/3694581006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340d9d40 msgr2=0x557a340d7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340d9d40 0x557a340d7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6fbfff640 1 -- 172.21.15.159:0/3694581006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 msgr2=0x557a340d6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340d6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6fbfff640 1 -- 172.21.15.159:0/3694581006 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a33da56a0 con 0x557a340cf480 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa702ffd640 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340d70c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec000c00 tx=0x7fa6ec0edcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900bf0303f5e5d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/3694581006 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0bc220 con 0x557a340cf480 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/3694581006 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fa6ec03bd00 con 0x557a340cf480 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa70bdd5740 1 -- 172.21.15.159:0/3694581006 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6ec0bcfc0 con 0x557a340cf480 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/3694581006 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa6ec0bc8c0 con 0x557a340cf480 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa70bdd5740 10 client.17313 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa70bdd5740 1 -- 172.21.15.159:0/3694581006 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557a340dc6d0 con 0x557a340cf480 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.889+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/3694581006 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec0bcfc0 con 0x557a340cf480 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/3694581006 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fa6ec0edfb0 con 0x557a340cf480 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa70bdd5740 10 client.17313 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa70bdd5740 10 client.17313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa70bdd5740 20 client.17313 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557a340e93f0 0x557a340eb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa70bdd5740 4 client.17313 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa70bdd5740 1 -- 172.21.15.159:0/3694581006 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a340417f0 con 0x557a340e93f0 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa702ffd640 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557a340e93f0 0x557a340eb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa702ffd640 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557a340e93f0 0x557a340eb820 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3b56eedca38a053 server_cookie=3c9095277e1f1557 in_seq=0 out_seq=0 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.890+0000 7fa6e2ffd640 10 client.17313 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/3694581006 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a340417f0 con 0x557a340e93f0 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa6e2ffd640 10 client.17313 handle_command_reply: tid=0 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 client.17313 shutdown 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 -- 172.21.15.159:0/3694581006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 msgr2=0x557a340d70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340d70c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec000c00 tx=0x7fa6ec0edcd0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 -- 172.21.15.159:0/3694581006 shutdown_connections 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557a340e93f0 0x557a340eb820 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340d9d40 0x557a340d7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340d70c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/3694581006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa6e2ffd640 0 client.17313 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 -- 172.21.15.159:0/3694581006 >> 172.21.15.159:0/3694581006 conn(0x557a340cb0f0 msgr2=0x557a340d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 -- 172.21.15.159:0/3694581006 shutdown_connections 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 1 -- 172.21.15.159:0/3694581006 wait complete. 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.891+0000 7fa70bdd5740 20 client.17313 trim_cache size 0 max 16384 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.908+0000 7fa70bdd5740 1 Processor -- start 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.908+0000 7fa70bdd5740 1 -- start start 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.908+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 0x557a340d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.908+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.908+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340d9d40 0x557a340f1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa7041adb40 con 0x557a340cf480 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7041b03a0 con 0x557a340d9d40 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa7041ae190 con 0x557a340ceb60 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340f10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36738/0 (socket says 172.21.15.159:36738) 2024-09-19T06:56:15.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6fbfff640 1 -- 172.21.15.159:0/670920286 learned_addr learned my addr 172.21.15.159:0/670920286 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa702ffd640 1 --2- 172.21.15.159:0/670920286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 0x557a340d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6fbfff640 1 -- 172.21.15.159:0/670920286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 msgr2=0x557a340d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/670920286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 0x557a340d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6fbfff640 1 -- 172.21.15.159:0/670920286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340d9d40 msgr2=0x557a340f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/670920286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340d9d40 0x557a340f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6fbfff640 1 -- 172.21.15.159:0/670920286 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a340c6830 con 0x557a340cf480 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa702ffd640 1 --2- 172.21.15.159:0/670920286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 0x557a340d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/670920286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340f10f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0bc5c0 tx=0x7fa6ec0badd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969ed68751b3bfb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6f97fa640 1 -- 172.21.15.159:0/670920286 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec049070 con 0x557a340cf480 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6f97fa640 1 -- 172.21.15.159:0/670920286 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec0bcfc0 con 0x557a340cf480 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.909+0000 7fa6f97fa640 1 -- 172.21.15.159:0/670920286 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0c0c70 con 0x557a340cf480 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 -- 172.21.15.159:0/670920286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 msgr2=0x557a340f10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/670920286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340f10f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0bc5c0 tx=0x7fa6ec0badd0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 -- 172.21.15.159:0/670920286 shutdown_connections 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/670920286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340d9d40 0x557a340f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/670920286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340f10f0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/670920286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340ceb60 0x557a340d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 -- 172.21.15.159:0/670920286 >> 172.21.15.159:0/670920286 conn(0x557a340cb0f0 msgr2=0x557a340d8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 -- 172.21.15.159:0/670920286 shutdown_connections 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 -- 172.21.15.159:0/670920286 wait complete. 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 -- start start 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 Processor -- start 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.910+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340dd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340dde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa70bdd5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340d9d40 0x557a340de340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa7041ae860 con 0x557a340cf480 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7041afcd0 con 0x557a340ceb60 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa70bdd5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa7041aef30 con 0x557a340d9d40 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa70bdd5740 10 client.0 _ll_register_callbacks cb 0x7fa6f40093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340dde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36750/0 (socket says 172.21.15.159:36750) 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6fbfff640 1 -- 172.21.15.159:0/101671872 learned_addr learned my addr 172.21.15.159:0/101671872 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa702ffd640 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340dd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6fbfff640 1 -- 172.21.15.159:0/101671872 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340d9d40 msgr2=0x557a340de340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340d9d40 0x557a340de340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6fbfff640 1 -- 172.21.15.159:0/101671872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 msgr2=0x557a340dd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340dd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6fbfff640 1 -- 172.21.15.159:0/101671872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a34153260 con 0x557a340cf480 2024-09-19T06:56:15.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa702ffd640 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340dd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6fbfff640 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340dde00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec000c00 tx=0x7fa6ec005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b06ca68298b0d9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/101671872 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec049070 con 0x557a340cf480 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/101671872 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fa6ec03bd00 con 0x557a340cf480 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa70bdd5740 1 -- 172.21.15.159:0/101671872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6ec0bcfc0 con 0x557a340cf480 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/101671872 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa6ec0bc220 con 0x557a340cf480 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa70bdd5740 10 client.17319 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.911+0000 7fa70bdd5740 1 -- 172.21.15.159:0/101671872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557a34153260 con 0x557a340cf480 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/101671872 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec0bcfc0 con 0x557a340cf480 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/101671872 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fa6ec031bd0 con 0x557a340cf480 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa70bdd5740 10 client.17319 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa70bdd5740 10 client.17319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa70bdd5740 20 client.17319 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:15.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557a34154760 0x557a34156b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa70bdd5740 4 client.17319 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa70bdd5740 1 -- 172.21.15.159:0/101671872 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557a3403bd00 con 0x557a34154760 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa702ffd640 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557a34154760 0x557a34156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa6e2ffd640 10 client.17319 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.912+0000 7fa702ffd640 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557a34154760 0x557a34156b80 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=588184eadc760e50 server_cookie=387c7db0084e221d in_seq=0 out_seq=0 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa6e2ffd640 1 -- 172.21.15.159:0/101671872 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557a3403bd00 con 0x557a34154760 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa6e2ffd640 10 client.17319 handle_command_reply: tid=0 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 client.17319 shutdown 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 -- 172.21.15.159:0/101671872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 msgr2=0x557a340dde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340dde00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec000c00 tx=0x7fa6ec005890 comp rx=0 tx=0).stop 2024-09-19T06:56:15.947 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:56:15.948 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:56:15.948 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "721ff456-225d-47cc-9b21-0bd320115ba0", 2024-09-19T06:56:15.948 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:56:15.948 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:56:15.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 -- 172.21.15.159:0/101671872 shutdown_connections 2024-09-19T06:56:15.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x557a34154760 0x557a34156b80 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa6e2ffd640 0 client.17319 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:15.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a340d9d40 0x557a340de340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557a340cf480 0x557a340dde00 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 --2- 172.21.15.159:0/101671872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a340ceb60 0x557a340dd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 -- 172.21.15.159:0/101671872 >> 172.21.15.159:0/101671872 conn(0x557a340cb0f0 msgr2=0x557a340c9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.913+0000 7fa70bdd5740 1 -- 172.21.15.159:0/101671872 shutdown_connections 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa70bdd5740 1 -- 172.21.15.159:0/101671872 wait complete. 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa70bdd5740 20 client.17319 trim_cache size 0 max 16384 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 -- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6f00a33b0 msgr2=0x7fa6f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6f00a33b0 0x7fa6f00a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00afd0 tx=0x7fa6fc004ab0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 -- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 msgr2=0x7fa704074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 0x7fa704074a30 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec005ab0 tx=0x7fa6ec0042f0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 -- 172.21.15.159:0/4056453837 shutdown_connections 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fa6f00a33b0 0x7fa6f00a5870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa704106f10 0x7fa704074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa704102790 0x7fa704074a30 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 --2- 172.21.15.159:0/4056453837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704101de0 0x7fa7040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 -- 172.21.15.159:0/4056453837 >> 172.21.15.159:0/4056453837 conn(0x7fa7040fd8c0 msgr2=0x7fa7040fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 -- 172.21.15.159:0/4056453837 shutdown_connections 2024-09-19T06:56:15.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:15.914+0000 7fa7099fc640 1 -- 172.21.15.159:0/4056453837 wait complete. 2024-09-19T06:56:15.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:15 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:56:15.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:15 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:56:15.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:15 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:56:15.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:15 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:56:16.040 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:15 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:56:16.040 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:15 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:56:16.040 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:15 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:56:16.040 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:15 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:56:16.716 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:56:16.780 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:16 smithi159 ceph-mon[30935]: pgmap v287: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:56:16.780 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:16 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:56:16.780 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:16 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:16.781 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:16 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:56:16.781 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:16 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:17.005 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:16 smithi203 ceph-mon[35473]: pgmap v287: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:56:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:16 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:56:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:16 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:16 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:56:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:16 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:17.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:16 smithi189 ceph-mon[34880]: pgmap v287: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:56:17.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:16 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:56:17.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:16 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:17.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:16 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:56:17.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:16 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:17.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.555+0000 7f08211ce640 1 -- 172.21.15.159:0/1487830035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 msgr2=0x7f081c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.555+0000 7f08211ce640 1 --2- 172.21.15.159:0/1487830035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 0x7f081c10e610 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0814009900 tx=0x7f081402a480 comp rx=0 tx=0).stop 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.555+0000 7f08211ce640 1 -- 172.21.15.159:0/1487830035 shutdown_connections 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.555+0000 7f08211ce640 1 --2- 172.21.15.159:0/1487830035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 0x7f081c10e610 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.555+0000 7f08211ce640 1 --2- 172.21.15.159:0/1487830035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f081c103660 0x7f081c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.555+0000 7f08211ce640 1 --2- 172.21.15.159:0/1487830035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c102d40 0x7f081c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.555+0000 7f08211ce640 1 -- 172.21.15.159:0/1487830035 >> 172.21.15.159:0/1487830035 conn(0x7f081c0fc7a0 msgr2=0x7f081c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.555+0000 7f08211ce640 1 -- 172.21.15.159:0/1487830035 shutdown_connections 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.555+0000 7f08211ce640 1 -- 172.21.15.159:0/1487830035 wait complete. 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.556+0000 7f08211ce640 1 Processor -- start 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.556+0000 7f08211ce640 1 -- start start 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.556+0000 7f08211ce640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f081c102d40 0x7f081c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.556+0000 7f08211ce640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c103660 0x7f081c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.556+0000 7f08211ce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 0x7f081c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.556+0000 7f08211ce640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f081c111f50 con 0x7f081c10c170 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.556+0000 7f08211ce640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f081c111dd0 con 0x7f081c103660 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.556+0000 7f08211ce640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1120d0 con 0x7f081c102d40 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 0x7f081c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 0x7f081c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36760/0 (socket says 172.21.15.159:36760) 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081b59e640 1 -- 172.21.15.159:0/931987783 learned_addr learned my addr 172.21.15.159:0/931987783 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081a59c640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c103660 0x7f081c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081ad9d640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f081c102d40 0x7f081c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081b59e640 1 -- 172.21.15.159:0/931987783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f081c102d40 msgr2=0x7f081c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081b59e640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f081c102d40 0x7f081c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081b59e640 1 -- 172.21.15.159:0/931987783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c103660 msgr2=0x7f081c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:17.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081b59e640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c103660 0x7f081c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081b59e640 1 -- 172.21.15.159:0/931987783 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081c19d410 con 0x7f081c10c170 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f081b59e640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 0x7f081c19cd30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0814005ab0 tx=0x7f08140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f0803fff640 1 -- 172.21.15.159:0/931987783 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081403f030 con 0x7f081c10c170 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f08211ce640 1 -- 172.21.15.159:0/931987783 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081c19d6a0 con 0x7f081c10c170 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f0803fff640 1 -- 172.21.15.159:0/931987783 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0814003ce0 con 0x7f081c10c170 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f0803fff640 1 -- 172.21.15.159:0/931987783 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814035070 con 0x7f081c10c170 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.557+0000 7f08211ce640 1 -- 172.21.15.159:0/931987783 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f081c1a4fe0 con 0x7f081c10c170 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.559+0000 7f0803fff640 1 -- 172.21.15.159:0/931987783 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0814042030 con 0x7f081c10c170 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f08235a7740 1 Processor -- start 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f0803fff640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08040a33b0 0x7f08040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f08235a7740 1 -- start start 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f08235a7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfcfb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f081a59c640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08040a33b0 0x7f08040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f08235a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd06140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f08235a7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd08a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f0803fff640 1 -- 172.21.15.159:0/931987783 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f08140f05c0 con 0x7f081c10c170 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f08235a7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559ecfc612e0 con 0x559ecfd06680 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f08235a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559ecfc08ce0 con 0x559ecfcfbdc0 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f08235a7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559ecfc5d2a0 con 0x559ecfcfb4a0 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f081b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd08a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f081b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd08a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36762/0 (socket says 172.21.15.159:36762) 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f081b59e640 1 -- 172.21.15.159:0/3808611105 learned_addr learned my addr 172.21.15.159:0/3808611105 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.560+0000 7f081ad9d640 1 --2- 172.21.15.159:0/3808611105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfcfb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f081a59c640 1 --2- 172.21.15.159:0/3808611105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd06140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f081b59e640 1 -- 172.21.15.159:0/3808611105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 msgr2=0x559ecfcfb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:17.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f081b59e640 1 --2- 172.21.15.159:0/3808611105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfcfb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f081b59e640 1 -- 172.21.15.159:0/3808611105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 msgr2=0x559ecfd06140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f081b59e640 1 --2- 172.21.15.159:0/3808611105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd06140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f081a59c640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08040a33b0 0x7f08040a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f081c0fedc0 tx=0x7f081000ba50 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f081b59e640 1 -- 172.21.15.159:0/3808611105 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ecfbed440 con 0x559ecfd06680 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f081b59e640 1 --2- 172.21.15.159:0/3808611105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd08a70 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f08140b91e0 tx=0x7f08140b8ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dc9594d0524d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f08017fa640 1 -- 172.21.15.159:0/3808611105 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814049030 con 0x559ecfd06680 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f08017fa640 1 -- 172.21.15.159:0/3808611105 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08140bcf10 con 0x559ecfd06680 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.561+0000 7f08017fa640 1 -- 172.21.15.159:0/3808611105 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08140b8e80 con 0x559ecfd06680 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 -- 172.21.15.159:0/3808611105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 msgr2=0x559ecfd08a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 --2- 172.21.15.159:0/3808611105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd08a70 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f08140b91e0 tx=0x7f08140b8ab0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 -- 172.21.15.159:0/3808611105 shutdown_connections 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 --2- 172.21.15.159:0/3808611105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd08a70 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 --2- 172.21.15.159:0/3808611105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd06140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 --2- 172.21.15.159:0/3808611105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfcfb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 -- 172.21.15.159:0/3808611105 >> 172.21.15.159:0/3808611105 conn(0x559ecfcf7a30 msgr2=0x559ecfcf7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 -- 172.21.15.159:0/3808611105 shutdown_connections 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 -- 172.21.15.159:0/3808611105 wait complete. 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 -- start start 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.562+0000 7f08235a7740 1 Processor -- start 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f08235a7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfd05f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f08235a7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfbdc0 0x559ecfd03220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f08235a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfd06680 0x559ecfd03760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f08235a7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559ecfd09010 con 0x559ecfcfbdc0 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f08235a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559ecfc1c050 con 0x559ecfd06680 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f08235a7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559ecfd09190 con 0x559ecfcfb4a0 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f08235a7740 10 client.0 _ll_register_callbacks cb 0x559ecfc5c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:17.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfbdc0 0x559ecfd03220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfbdc0 0x559ecfd03220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36770/0 (socket says 172.21.15.159:36770) 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081a59c640 1 -- 172.21.15.159:0/1235822276 learned_addr learned my addr 172.21.15.159:0/1235822276 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081b59e640 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfd06680 0x559ecfd03760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081ad9d640 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfd05f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081a59c640 1 -- 172.21.15.159:0/1235822276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 msgr2=0x559ecfd05f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081a59c640 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfd05f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081a59c640 1 -- 172.21.15.159:0/1235822276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfd06680 msgr2=0x559ecfd03760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081a59c640 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfd06680 0x559ecfd03760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081a59c640 1 -- 172.21.15.159:0/1235822276 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ecf9d23c0 con 0x559ecfcfbdc0 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f081a59c640 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfbdc0 0x559ecfd03220 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0810003ec0 tx=0x7f0810004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4643abc2f0ada57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f07feff5640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:17.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f07feff5640 1 -- 172.21.15.159:0/1235822276 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810028670 con 0x559ecfcfbdc0 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f07feff5640 1 -- 172.21.15.159:0/1235822276 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f0810011440 con 0x559ecfcfbdc0 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.563+0000 7f08235a7740 1 -- 172.21.15.159:0/1235822276 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08140bcf10 con 0x559ecfcfbdc0 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f07feff5640 1 -- 172.21.15.159:0/1235822276 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0810028810 con 0x559ecfcfbdc0 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f08235a7740 10 client.17331 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f08235a7740 1 -- 172.21.15.159:0/1235822276 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559ecfd148f0 con 0x559ecfcfbdc0 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f07feff5640 1 -- 172.21.15.159:0/1235822276 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08140bcf10 con 0x559ecfcfbdc0 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f07feff5640 1 -- 172.21.15.159:0/1235822276 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f0810011af0 con 0x559ecfcfbdc0 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f08235a7740 10 client.17331 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f08235a7740 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f08235a7740 20 client.17331 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f08235a7740 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559ecfd15db0 0x559ecfd181f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f08235a7740 4 client.17331 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f08235a7740 1 -- 172.21.15.159:0/1235822276 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ecfc6e850 con 0x559ecfd15db0 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.564+0000 7f081ad9d640 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559ecfd15db0 0x559ecfd181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.565+0000 7f081ad9d640 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559ecfd15db0 0x559ecfd181f0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eee4bf181bec4c1e server_cookie=2a2ee38fb000e48c in_seq=0 out_seq=0 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.565+0000 7f07feff5640 10 client.17331 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.565+0000 7f07feff5640 1 -- 172.21.15.159:0/1235822276 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ecfc6e850 con 0x559ecfd15db0 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.565+0000 7f07feff5640 10 client.17331 handle_command_reply: tid=0 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.565+0000 7f08235a7740 1 client.17331 shutdown 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.565+0000 7f08235a7740 1 -- 172.21.15.159:0/1235822276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfbdc0 msgr2=0x559ecfd03220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.565+0000 7f08235a7740 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfbdc0 0x559ecfd03220 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0810003ec0 tx=0x7f0810004730 comp rx=0 tx=0).stop 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.565+0000 7f08235a7740 1 -- 172.21.15.159:0/1235822276 shutdown_connections 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.565+0000 7f08235a7740 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559ecfd15db0 0x559ecfd181f0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.566+0000 7f07feff5640 0 client.17331 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.566+0000 7f08235a7740 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfd06680 0x559ecfd03760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.566+0000 7f08235a7740 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfbdc0 0x559ecfd03220 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.566+0000 7f08235a7740 1 --2- 172.21.15.159:0/1235822276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfd05f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.566+0000 7f08235a7740 1 -- 172.21.15.159:0/1235822276 >> 172.21.15.159:0/1235822276 conn(0x559ecfcf7a30 msgr2=0x559ecfcfd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:17.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.566+0000 7f08235a7740 1 -- 172.21.15.159:0/1235822276 shutdown_connections 2024-09-19T06:56:17.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.566+0000 7f08235a7740 1 -- 172.21.15.159:0/1235822276 wait complete. 2024-09-19T06:56:17.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.566+0000 7f08235a7740 20 client.17331 trim_cache size 0 max 16384 2024-09-19T06:56:17.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.582+0000 7f08235a7740 1 Processor -- start 2024-09-19T06:56:17.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.582+0000 7f08235a7740 1 -- start start 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f08235a7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfd121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f08235a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd1dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f08235a7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd1e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f08235a7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1aba90 con 0x559ecfd06680 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f08235a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1ae2f0 con 0x559ecfcfbdc0 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f08235a7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1ac0e0 con 0x559ecfcfb4a0 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd1e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd1e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36776/0 (socket says 172.21.15.159:36776) 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081b59e640 1 -- 172.21.15.159:0/2972486910 learned_addr learned my addr 172.21.15.159:0/2972486910 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081ad9d640 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfd121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081a59c640 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd1dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081b59e640 1 -- 172.21.15.159:0/2972486910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 msgr2=0x559ecfd121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:17.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081b59e640 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfd121e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081b59e640 1 -- 172.21.15.159:0/2972486910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 msgr2=0x559ecfd1dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081b59e640 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd1dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081b59e640 1 -- 172.21.15.159:0/2972486910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ecfcfb2d0 con 0x559ecfd06680 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081a59c640 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd1dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f081b59e640 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd1e000 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0814004650 tx=0x7f081403b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d70620d04b0ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f0800ff9640 1 -- 172.21.15.159:0/2972486910 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08140da070 con 0x559ecfd06680 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f0800ff9640 1 -- 172.21.15.159:0/2972486910 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08140bcf10 con 0x559ecfd06680 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.583+0000 7f0800ff9640 1 -- 172.21.15.159:0/2972486910 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814049070 con 0x559ecfd06680 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 -- 172.21.15.159:0/2972486910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 msgr2=0x559ecfd1e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd1e000 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0814004650 tx=0x7f081403b6b0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 -- 172.21.15.159:0/2972486910 shutdown_connections 2024-09-19T06:56:17.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfd06680 0x559ecfd1e000 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd1dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 --2- 172.21.15.159:0/2972486910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfcfb4a0 0x559ecfd121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 -- 172.21.15.159:0/2972486910 >> 172.21.15.159:0/2972486910 conn(0x559ecfcf7a30 msgr2=0x559ecfd01af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:17.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 -- 172.21.15.159:0/2972486910 shutdown_connections 2024-09-19T06:56:17.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 -- 172.21.15.159:0/2972486910 wait complete. 2024-09-19T06:56:17.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.584+0000 7f08235a7740 1 -- start start 2024-09-19T06:56:17.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f08235a7740 1 Processor -- start 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f08235a7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfb4a0 0x559ecfd0a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f08235a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd0a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f08235a7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfd06680 0x559ecfd0ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f08235a7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1ac7b0 con 0x559ecfcfb4a0 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f08235a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1adc20 con 0x559ecfcfbdc0 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f08235a7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1ace80 con 0x559ecfd06680 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f08235a7740 10 client.0 _ll_register_callbacks cb 0x7f0810003bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfb4a0 0x559ecfd0a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfb4a0 0x559ecfd0a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36784/0 (socket says 172.21.15.159:36784) 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081ad9d640 1 -- 172.21.15.159:0/2336315886 learned_addr learned my addr 172.21.15.159:0/2336315886 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:17.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081a59c640 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd0a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081ad9d640 1 -- 172.21.15.159:0/2336315886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfd06680 msgr2=0x559ecfd0ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081ad9d640 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfd06680 0x559ecfd0ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081ad9d640 1 -- 172.21.15.159:0/2336315886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 msgr2=0x559ecfd0a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081ad9d640 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd0a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081ad9d640 1 -- 172.21.15.159:0/2336315886 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ecfd7fa90 con 0x559ecfcfb4a0 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f081ad9d640 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfb4a0 0x559ecfd0a090 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f080c012450 tx=0x7f080c012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23e510ba97fb7f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f07feff5640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f07feff5640 1 -- 172.21.15.159:0/2336315886 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c01b820 con 0x559ecfcfb4a0 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.585+0000 7f07feff5640 1 -- 172.21.15.159:0/2336315886 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f080c01b9c0 con 0x559ecfcfb4a0 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f08235a7740 1 -- 172.21.15.159:0/2336315886 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08140bcf10 con 0x559ecfcfb4a0 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f07feff5640 1 -- 172.21.15.159:0/2336315886 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f080c02b050 con 0x559ecfcfb4a0 2024-09-19T06:56:17.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f08235a7740 10 client.17337 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f08235a7740 1 -- 172.21.15.159:0/2336315886 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559ecfd80d30 con 0x559ecfcfb4a0 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f07feff5640 1 -- 172.21.15.159:0/2336315886 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08140bcf10 con 0x559ecfcfb4a0 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f07feff5640 1 -- 172.21.15.159:0/2336315886 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f080c00f040 con 0x559ecfcfb4a0 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f08235a7740 10 client.17337 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f08235a7740 10 client.17337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f08235a7740 20 client.17337 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f08235a7740 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559ecfd15db0 0x559ecfd834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f08235a7740 4 client.17337 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f08235a7740 1 -- 172.21.15.159:0/2336315886 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559ecfd03af0 con 0x559ecfd15db0 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.586+0000 7f081a59c640 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559ecfd15db0 0x559ecfd834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f081a59c640 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559ecfd15db0 0x559ecfd834a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=571766d526645a26 server_cookie=becf2e232c8251ad in_seq=0 out_seq=0 2024-09-19T06:56:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f07feff5640 10 client.17337 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f07feff5640 1 -- 172.21.15.159:0/2336315886 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559ecfd03af0 con 0x559ecfd15db0 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f07feff5640 10 client.17337 handle_command_reply: tid=0 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 client.17337 shutdown 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 -- 172.21.15.159:0/2336315886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfb4a0 msgr2=0x559ecfd0a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfb4a0 0x559ecfd0a090 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f080c012450 tx=0x7f080c012910 comp rx=0 tx=0).stop 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 -- 172.21.15.159:0/2336315886 shutdown_connections 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x559ecfd15db0 0x559ecfd834a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ecfd06680 0x559ecfd0ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f07feff5640 0 client.17337 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:17.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ecfcfbdc0 0x559ecfd0a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 --2- 172.21.15.159:0/2336315886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559ecfcfb4a0 0x559ecfd0a090 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 -- 172.21.15.159:0/2336315886 >> 172.21.15.159:0/2336315886 conn(0x559ecfcf7a30 msgr2=0x559ecfd052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:17.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 -- 172.21.15.159:0/2336315886 shutdown_connections 2024-09-19T06:56:17.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 1 -- 172.21.15.159:0/2336315886 wait complete. 2024-09-19T06:56:17.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.587+0000 7f08235a7740 20 client.17337 trim_cache size 0 max 16384 2024-09-19T06:56:17.595 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:56:17.595 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:56:17.595 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:56:17.595 INFO:teuthology.orchestra.run.smithi159.stdout: "721ff456-225d-47cc-9b21-0bd320115ba0": { 2024-09-19T06:56:17.596 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:56:17.596 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "721ff456-225d-47cc-9b21-0bd320115ba0", 2024-09-19T06:56:17.596 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:56:17.596 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:56:17.596 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:56:17.596 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:56:17.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 -- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08040a33b0 msgr2=0x7f08040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08040a33b0 0x7f08040a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f081c0fedc0 tx=0x7f081000ba50 comp rx=0 tx=0).stop 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 -- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 msgr2=0x7f081c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 0x7f081c19cd30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0814005ab0 tx=0x7f08140042f0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 -- 172.21.15.159:0/931987783 shutdown_connections 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f08040a33b0 0x7f08040a5870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f081c10c170 0x7f081c19cd30 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c103660 0x7f081c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 --2- 172.21.15.159:0/931987783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f081c102d40 0x7f081c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 -- 172.21.15.159:0/931987783 >> 172.21.15.159:0/931987783 conn(0x7f081c0fc7a0 msgr2=0x7f081c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 -- 172.21.15.159:0/931987783 shutdown_connections 2024-09-19T06:56:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:17.588+0000 7f08211ce640 1 -- 172.21.15.159:0/931987783 wait complete. 2024-09-19T06:56:18.519 INFO:tasks.cephfs.filesystem:scrub status for tag:721ff456-225d-47cc-9b21-0bd320115ba0 - {'path': '/', 'tag': '721ff456-225d-47cc-9b21-0bd320115ba0', 'options': 'recursive,force'} 2024-09-19T06:56:18.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:18 smithi159 ceph-mon[30935]: pgmap v288: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-19T06:56:18.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:18 smithi159 ceph-mon[30935]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:56:19.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:18 smithi203 ceph-mon[35473]: pgmap v288: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-19T06:56:19.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:18 smithi203 ceph-mon[35473]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:56:19.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:18 smithi189 ceph-mon[34880]: pgmap v288: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-19T06:56:19.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:18 smithi189 ceph-mon[34880]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:56:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:20 smithi203 ceph-mon[35473]: pgmap v290: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 226 B/s wr, 3 op/s 2024-09-19T06:56:21.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:20 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:56:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:20 smithi189 ceph-mon[34880]: pgmap v290: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 226 B/s wr, 3 op/s 2024-09-19T06:56:21.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:20 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:56:21.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:20 smithi159 ceph-mon[30935]: pgmap v290: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 226 B/s wr, 3 op/s 2024-09-19T06:56:21.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:20 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:56:23.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:22 smithi203 ceph-mon[35473]: pgmap v291: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-19T06:56:23.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:22 smithi189 ceph-mon[34880]: pgmap v291: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-19T06:56:23.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:22 smithi159 ceph-mon[30935]: pgmap v291: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-19T06:56:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:24 smithi203 ceph-mon[35473]: pgmap v292: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 102 B/s wr, 3 op/s 2024-09-19T06:56:25.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:24 smithi189 ceph-mon[34880]: pgmap v292: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 102 B/s wr, 3 op/s 2024-09-19T06:56:25.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:24 smithi159 ceph-mon[30935]: pgmap v292: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 102 B/s wr, 3 op/s 2024-09-19T06:56:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:26 smithi203 ceph-mon[35473]: pgmap v293: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 102 B/s wr, 3 op/s 2024-09-19T06:56:27.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:26 smithi189 ceph-mon[34880]: pgmap v293: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 102 B/s wr, 3 op/s 2024-09-19T06:56:27.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:26 smithi159 ceph-mon[30935]: pgmap v293: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 102 B/s wr, 3 op/s 2024-09-19T06:56:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:28 smithi203 ceph-mon[35473]: pgmap v294: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T06:56:29.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:28 smithi189 ceph-mon[34880]: pgmap v294: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T06:56:29.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:28 smithi159 ceph-mon[30935]: pgmap v294: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T06:56:30.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:29 smithi203 ceph-mon[35473]: pgmap v295: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 B/s rd, 1 op/s 2024-09-19T06:56:30.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:29 smithi189 ceph-mon[34880]: pgmap v295: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 B/s rd, 1 op/s 2024-09-19T06:56:30.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:29 smithi159 ceph-mon[30935]: pgmap v295: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 B/s rd, 1 op/s 2024-09-19T06:56:32.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:31 smithi203 ceph-mon[35473]: pgmap v296: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:32.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:31 smithi189 ceph-mon[34880]: pgmap v296: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:32.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:31 smithi159 ceph-mon[30935]: pgmap v296: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:34.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:33 smithi203 ceph-mon[35473]: pgmap v297: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:34.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:33 smithi189 ceph-mon[34880]: pgmap v297: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:34.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:33 smithi159 ceph-mon[30935]: pgmap v297: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:36.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:35 smithi203 ceph-mon[35473]: pgmap v298: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:36.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:35 smithi189 ceph-mon[34880]: pgmap v298: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:36.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:35 smithi159 ceph-mon[30935]: pgmap v298: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:38.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:37 smithi203 ceph-mon[35473]: pgmap v299: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:38.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:37 smithi189 ceph-mon[34880]: pgmap v299: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:38.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:37 smithi159 ceph-mon[30935]: pgmap v299: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:40.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:39 smithi203 ceph-mon[35473]: pgmap v300: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:40.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:39 smithi189 ceph-mon[34880]: pgmap v300: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:40.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:39 smithi159 ceph-mon[30935]: pgmap v300: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:42.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:41 smithi203 ceph-mon[35473]: pgmap v301: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:42.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:41 smithi189 ceph-mon[34880]: pgmap v301: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:42.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:41 smithi159 ceph-mon[30935]: pgmap v301: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:44.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:43 smithi203 ceph-mon[35473]: pgmap v302: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:44.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:43 smithi189 ceph-mon[34880]: pgmap v302: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:44.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:43 smithi159 ceph-mon[30935]: pgmap v302: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:45 smithi203 ceph-mon[35473]: pgmap v303: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:46.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:45 smithi189 ceph-mon[34880]: pgmap v303: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:46.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:45 smithi159 ceph-mon[30935]: pgmap v303: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:48.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:47 smithi203 ceph-mon[35473]: pgmap v304: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:48.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:47 smithi189 ceph-mon[34880]: pgmap v304: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:48.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:47 smithi159 ceph-mon[30935]: pgmap v304: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:48.521 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:56:48.786 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:49.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.467+0000 7f940be93640 1 -- 172.21.15.159:0/2912524959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9404102da0 msgr2=0x7f9404103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:49.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.467+0000 7f940be93640 1 --2- 172.21.15.159:0/2912524959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9404102da0 0x7f9404103180 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f9400009900 tx=0x7f940002a480 comp rx=0 tx=0).stop 2024-09-19T06:56:49.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.467+0000 7f940be93640 1 -- 172.21.15.159:0/2912524959 shutdown_connections 2024-09-19T06:56:49.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.467+0000 7f940be93640 1 --2- 172.21.15.159:0/2912524959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f940410c180 0x7f940410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.467+0000 7f940be93640 1 --2- 172.21.15.159:0/2912524959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94041036c0 0x7f940410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.467+0000 7f940be93640 1 --2- 172.21.15.159:0/2912524959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9404102da0 0x7f9404103180 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.467+0000 7f940be93640 1 -- 172.21.15.159:0/2912524959 >> 172.21.15.159:0/2912524959 conn(0x7f94040fc7a0 msgr2=0x7f94040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.467+0000 7f940be93640 1 -- 172.21.15.159:0/2912524959 shutdown_connections 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.467+0000 7f940be93640 1 -- 172.21.15.159:0/2912524959 wait complete. 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.468+0000 7f940be93640 1 Processor -- start 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.468+0000 7f940be93640 1 -- start start 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.468+0000 7f940be93640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9404102da0 0x7f94041984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.468+0000 7f940be93640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94041036c0 0x7f94041989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.468+0000 7f940be93640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f940410c180 0x7f940419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.468+0000 7f940be93640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9404111f60 con 0x7f94041036c0 2024-09-19T06:56:49.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.468+0000 7f940be93640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9404111de0 con 0x7f9404102da0 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.468+0000 7f940be93640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f94041120e0 con 0x7f940410c180 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940942e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94041036c0 0x7f94041989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940942e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94041036c0 0x7f94041989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55184/0 (socket says 172.21.15.159:55184) 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940942e640 1 -- 172.21.15.159:0/1100883891 learned_addr learned my addr 172.21.15.159:0/1100883891 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f9409c2f640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9404102da0 0x7f94041984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940a430640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f940410c180 0x7f940419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940942e640 1 -- 172.21.15.159:0/1100883891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f940410c180 msgr2=0x7f940419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940942e640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f940410c180 0x7f940419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940942e640 1 -- 172.21.15.159:0/1100883891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9404102da0 msgr2=0x7f94041984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940942e640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9404102da0 0x7f94041984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940942e640 1 -- 172.21.15.159:0/1100883891 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940419d460 con 0x7f94041036c0 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f9409c2f640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9404102da0 0x7f94041984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940942e640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94041036c0 0x7f94041989f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f93f400d770 tx=0x7f93f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:49.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f93faffd640 1 -- 172.21.15.159:0/1100883891 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4017070 con 0x7f94041036c0 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f93faffd640 1 -- 172.21.15.159:0/1100883891 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f4005500 con 0x7f94041036c0 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f93faffd640 1 -- 172.21.15.159:0/1100883891 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4004e00 con 0x7f94041036c0 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940be93640 1 -- 172.21.15.159:0/1100883891 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940419d750 con 0x7f94041036c0 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.469+0000 7f940be93640 1 -- 172.21.15.159:0/1100883891 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94041a5030 con 0x7f94041036c0 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.472+0000 7f93faffd640 1 -- 172.21.15.159:0/1100883891 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f93f4004fa0 con 0x7f94041036c0 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.472+0000 7f940e26c740 1 Processor -- start 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.472+0000 7f940e26c740 1 -- start start 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.472+0000 7f940e26c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 0x55d97742f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.472+0000 7f940e26c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742fca0 0x55d97743e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940e26c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d977440e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940e26c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d9773952e0 con 0x55d97743ea90 2024-09-19T06:56:49.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940e26c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d97733cce0 con 0x55d97742f380 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940e26c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d9773912a0 con 0x55d97742fca0 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940942e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d977440e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940942e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d977440e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55190/0 (socket says 172.21.15.159:55190) 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940942e640 1 -- 172.21.15.159:0/3104719639 learned_addr learned my addr 172.21.15.159:0/3104719639 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940a430640 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 0x55d97742f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f9409c2f640 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742fca0 0x55d97743e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f93faffd640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f93f00a33b0 0x7f93f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940942e640 1 -- 172.21.15.159:0/3104719639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742fca0 msgr2=0x55d97743e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940942e640 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742fca0 0x55d97743e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940942e640 1 -- 172.21.15.159:0/3104719639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 msgr2=0x55d97742f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940942e640 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 0x55d97742f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940942e640 1 -- 172.21.15.159:0/3104719639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d977321440 con 0x55d97743ea90 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940a430640 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 0x55d97742f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:49.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940a430640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f93f00a33b0 0x7f93f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f93faffd640 1 -- 172.21.15.159:0/1100883891 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7f93f40cf750 con 0x7f94041036c0 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.473+0000 7f940942e640 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d977440e80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ccdb0 tx=0x7f93f4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fb4e82bbd434c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.474+0000 7f93effff640 1 -- 172.21.15.159:0/3104719639 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f409b850 con 0x55d97743ea90 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.474+0000 7f940a430640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f93f00a33b0 0x7f93f00a5870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f93fc005fd0 tx=0x7f93fc004a40 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.474+0000 7f93effff640 1 -- 172.21.15.159:0/3104719639 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f40046c0 con 0x55d97743ea90 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.474+0000 7f93effff640 1 -- 172.21.15.159:0/3104719639 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f409b3e0 con 0x55d97743ea90 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.474+0000 7f940e26c740 1 -- 172.21.15.159:0/3104719639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 msgr2=0x55d977440e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.474+0000 7f940e26c740 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d977440e80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ccdb0 tx=0x7f93f4022000 comp rx=0 tx=0).stop 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 -- 172.21.15.159:0/3104719639 shutdown_connections 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d977440e80 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742fca0 0x55d97743e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 --2- 172.21.15.159:0/3104719639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 0x55d97742f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 -- 172.21.15.159:0/3104719639 >> 172.21.15.159:0/3104719639 conn(0x55d97742ba30 msgr2=0x55d97742be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:49.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 -- 172.21.15.159:0/3104719639 shutdown_connections 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 -- 172.21.15.159:0/3104719639 wait complete. 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 -- start start 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 Processor -- start 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 0x55d97743e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742fca0 0x55d97743b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d97743bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d977441660 con 0x55d97743ea90 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d977350050 con 0x55d97742fca0 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.475+0000 7f940e26c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d9774417e0 con 0x55d97742f380 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940e26c740 10 client.0 _ll_register_callbacks cb 0x55d977390160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940a430640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d97743bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940a430640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d97743bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55196/0 (socket says 172.21.15.159:55196) 2024-09-19T06:56:49.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940942e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742fca0 0x55d97743b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940a430640 1 -- 172.21.15.159:0/3903615074 learned_addr learned my addr 172.21.15.159:0/3903615074 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f9409c2f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 0x55d97743e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940a430640 1 -- 172.21.15.159:0/3903615074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 msgr2=0x55d97743e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940a430640 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 0x55d97743e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940a430640 1 -- 172.21.15.159:0/3903615074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742fca0 msgr2=0x55d97743b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940a430640 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742fca0 0x55d97743b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940a430640 1 -- 172.21.15.159:0/3903615074 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9771063c0 con 0x55d97743ea90 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940a430640 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d97743bba0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f93fc013490 tx=0x7f93fc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a76789125f25fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f93ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:49.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3903615074 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc003970 con 0x55d97743ea90 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940e26c740 1 -- 172.21.15.159:0/3903615074 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9773a2850 con 0x55d97743ea90 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3903615074 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7f93fc018070 con 0x55d97743ea90 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3903615074 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f93fc003b10 con 0x55d97743ea90 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940e26c740 10 client.17349 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f940e26c740 1 -- 172.21.15.159:0/3903615074 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d97744d0d0 con 0x55d97743ea90 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.476+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3903615074 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d9773a2850 con 0x55d97743ea90 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.477+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3903615074 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f93fc00f040 con 0x55d97743ea90 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.477+0000 7f940e26c740 10 client.17349 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.477+0000 7f940e26c740 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.477+0000 7f940e26c740 20 client.17349 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.477+0000 7f940e26c740 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d97744e5e0 0x55d9774509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.477+0000 7f940e26c740 4 client.17349 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:49.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.477+0000 7f940e26c740 1 -- 172.21.15.159:0/3903615074 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d97739cd60 con 0x55d97744e5e0 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.477+0000 7f9409c2f640 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d97744e5e0 0x55d9774509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.478+0000 7f9409c2f640 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d97744e5e0 0x55d9774509d0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d5d0a7cd944c7f8 server_cookie=f86b59eabe0f0fe2 in_seq=0 out_seq=0 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.478+0000 7f93ed7fa640 10 client.17349 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.478+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3903615074 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d97739cd60 con 0x55d97744e5e0 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.478+0000 7f93ed7fa640 10 client.17349 handle_command_reply: tid=0 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.478+0000 7f940e26c740 1 client.17349 shutdown 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.478+0000 7f940e26c740 1 -- 172.21.15.159:0/3903615074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 msgr2=0x55d97743bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.478+0000 7f940e26c740 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d97743bba0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f93fc013490 tx=0x7f93fc004ab0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f940e26c740 1 -- 172.21.15.159:0/3903615074 shutdown_connections 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f940e26c740 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d97744e5e0 0x55d9774509d0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f940e26c740 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97743ea90 0x55d97743bba0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f940e26c740 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742fca0 0x55d97743b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f940e26c740 1 --2- 172.21.15.159:0/3903615074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 0x55d97743e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f93ed7fa640 0 client.17349 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:49.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f940e26c740 1 -- 172.21.15.159:0/3903615074 >> 172.21.15.159:0/3903615074 conn(0x55d97742ba30 msgr2=0x55d977431790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:49.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f940e26c740 1 -- 172.21.15.159:0/3903615074 shutdown_connections 2024-09-19T06:56:49.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f940e26c740 1 -- 172.21.15.159:0/3903615074 wait complete. 2024-09-19T06:56:49.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.479+0000 7f940e26c740 20 client.17349 trim_cache size 0 max 16384 2024-09-19T06:56:49.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940e26c740 1 Processor -- start 2024-09-19T06:56:49.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940e26c740 1 -- start start 2024-09-19T06:56:49.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940e26c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 0x55d97744a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940e26c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d97743a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940e26c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97743ea90 0x55d9774562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940e26c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f94041a9740 con 0x55d97742fca0 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940e26c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f94041abfa0 con 0x55d97743ea90 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940e26c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f94041a9d90 con 0x55d97742f380 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940942e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d97743a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940942e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d97743a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55210/0 (socket says 172.21.15.159:55210) 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940942e640 1 -- 172.21.15.159:0/1391343088 learned_addr learned my addr 172.21.15.159:0/1391343088 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940a430640 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97743ea90 0x55d9774562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f940942e640 1 -- 172.21.15.159:0/1391343088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 msgr2=0x55d97744a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.496+0000 7f9409c2f640 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 0x55d97744a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f940942e640 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 0x55d97744a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f940942e640 1 -- 172.21.15.159:0/1391343088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97743ea90 msgr2=0x55d9774562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f940942e640 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97743ea90 0x55d9774562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f940942e640 1 -- 172.21.15.159:0/1391343088 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9774411c0 con 0x55d97742fca0 2024-09-19T06:56:49.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f940a430640 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97743ea90 0x55d9774562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f9409c2f640 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 0x55d97744a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f940942e640 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d97743a5a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009610 tx=0x7f93f407e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c53894c4f6a3119 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f93ef7fe640 1 -- 172.21.15.159:0/1391343088 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f409b5c0 con 0x55d97742fca0 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f93ef7fe640 1 -- 172.21.15.159:0/1391343088 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f409fda0 con 0x55d97742fca0 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.497+0000 7f93ef7fe640 1 -- 172.21.15.159:0/1391343088 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f40978d0 con 0x55d97742fca0 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 -- 172.21.15.159:0/1391343088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 msgr2=0x55d97743a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d97743a5a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009610 tx=0x7f93f407e040 comp rx=0 tx=0).stop 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 -- 172.21.15.159:0/1391343088 shutdown_connections 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97743ea90 0x55d9774562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d97743a5a0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 --2- 172.21.15.159:0/1391343088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97742f380 0x55d97744a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 -- 172.21.15.159:0/1391343088 >> 172.21.15.159:0/1391343088 conn(0x55d97742ba30 msgr2=0x55d977436d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:49.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 -- 172.21.15.159:0/1391343088 shutdown_connections 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 -- 172.21.15.159:0/1391343088 wait complete. 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 -- start start 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.498+0000 7f940e26c740 1 Processor -- start 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940e26c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 0x55d977441f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940e26c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d9774424d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940e26c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97743ea90 0x55d9774b7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940e26c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f94041aa460 con 0x55d97742fca0 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940e26c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f94041ab8d0 con 0x55d97742f380 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940e26c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f94041aab30 con 0x55d97743ea90 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940e26c740 10 client.0 _ll_register_callbacks cb 0x7f93fc009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940942e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d9774424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940942e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d9774424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55212/0 (socket says 172.21.15.159:55212) 2024-09-19T06:56:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940942e640 1 -- 172.21.15.159:0/3679923603 learned_addr learned my addr 172.21.15.159:0/3679923603 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940a430640 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97743ea90 0x55d9774b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f9409c2f640 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 0x55d977441f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940942e640 1 -- 172.21.15.159:0/3679923603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97743ea90 msgr2=0x55d9774b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940942e640 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97743ea90 0x55d9774b7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940942e640 1 -- 172.21.15.159:0/3679923603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 msgr2=0x55d977441f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940942e640 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 0x55d977441f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940942e640 1 -- 172.21.15.159:0/3679923603 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9774b7850 con 0x55d97742fca0 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f940942e640 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d9774424d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f93f40048e0 tx=0x7f93f409b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acb304cb873ba65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f93ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.499+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3679923603 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f40a4640 con 0x55d97742fca0 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3679923603 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7f93f4009cc0 con 0x55d97742fca0 2024-09-19T06:56:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f940e26c740 1 -- 172.21.15.159:0/3679923603 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93f409fda0 con 0x55d97742fca0 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3679923603 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f93f40d51b0 con 0x55d97742fca0 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f940e26c740 10 client.17355 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f940e26c740 1 -- 172.21.15.159:0/3679923603 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d9774b8ab0 con 0x55d97742fca0 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3679923603 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f409fda0 con 0x55d97742fca0 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3679923603 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f93f407cce0 con 0x55d97742fca0 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f940e26c740 10 client.17355 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f940e26c740 10 client.17355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f940e26c740 20 client.17355 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f940e26c740 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d9774b8d30 0x55d9774bb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f940e26c740 4 client.17355 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f940e26c740 1 -- 172.21.15.159:0/3679923603 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d977319210 con 0x55d9774b8d30 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.500+0000 7f9409c2f640 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d9774b8d30 0x55d9774bb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f93ed7fa640 10 client.17355 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f9409c2f640 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d9774b8d30 0x55d9774bb120 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6c9bc3b11a66955 server_cookie=2a0d4f40f767da39 in_seq=0 out_seq=0 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f93ed7fa640 1 -- 172.21.15.159:0/3679923603 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d977319210 con 0x55d9774b8d30 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f93ed7fa640 10 client.17355 handle_command_reply: tid=0 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 client.17355 shutdown 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 -- 172.21.15.159:0/3679923603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 msgr2=0x55d9774424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d9774424d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f93f40048e0 tx=0x7f93f409b5c0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 -- 172.21.15.159:0/3679923603 shutdown_connections 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x55d9774b8d30 0x55d9774bb120 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d97743ea90 0x55d9774b7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d97742fca0 0x55d9774424d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 --2- 172.21.15.159:0/3679923603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d97742f380 0x55d977441f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f93ed7fa640 0 client.17355 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 -- 172.21.15.159:0/3679923603 >> 172.21.15.159:0/3679923603 conn(0x55d97742ba30 msgr2=0x55d97742a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 -- 172.21.15.159:0/3679923603 shutdown_connections 2024-09-19T06:56:49.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 1 -- 172.21.15.159:0/3679923603 wait complete. 2024-09-19T06:56:49.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.501+0000 7f940e26c740 20 client.17355 trim_cache size 0 max 16384 2024-09-19T06:56:49.510 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:56:49.510 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:56:49.510 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:56:49.510 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:56:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 -- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f93f00a33b0 msgr2=0x7f93f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f93f00a33b0 0x7f93f00a5870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f93fc005fd0 tx=0x7f93fc004a40 comp rx=0 tx=0).stop 2024-09-19T06:56:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 -- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94041036c0 msgr2=0x7f94041989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94041036c0 0x7f94041989f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f93f400d770 tx=0x7f93f400dc30 comp rx=0 tx=0).stop 2024-09-19T06:56:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 -- 172.21.15.159:0/1100883891 shutdown_connections 2024-09-19T06:56:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f93f00a33b0 0x7f93f00a5870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f940410c180 0x7f940419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94041036c0 0x7f94041989f0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 --2- 172.21.15.159:0/1100883891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9404102da0 0x7f94041984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:49.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 -- 172.21.15.159:0/1100883891 >> 172.21.15.159:0/1100883891 conn(0x7f94040fc7a0 msgr2=0x7f94040fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:49.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 -- 172.21.15.159:0/1100883891 shutdown_connections 2024-09-19T06:56:49.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:49.502+0000 7f940be93640 1 -- 172.21.15.159:0/1100883891 wait complete. 2024-09-19T06:56:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:49 smithi203 ceph-mon[35473]: pgmap v305: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:50.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:49 smithi189 ceph-mon[34880]: pgmap v305: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:50.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:49 smithi159 ceph-mon[30935]: pgmap v305: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:50.304 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:56:50.305 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:56:50.559 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:51.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2854704824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 msgr2=0x7fcd1810df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:51.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2854704824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 0x7fcd1810df50 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009900 tx=0x7fcd0802a410 comp rx=0 tx=0).stop 2024-09-19T06:56:51.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2854704824 shutdown_connections 2024-09-19T06:56:51.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2854704824 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd1810e490 0x7fcd18110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2854704824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 0x7fcd1810df50 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2854704824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd181008e0 0x7fcd18100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2854704824 >> 172.21.15.159:0/2854704824 conn(0x7fcd180fc7d0 msgr2=0x7fcd180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2854704824 shutdown_connections 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2854704824 wait complete. 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 Processor -- start 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.069+0000 7fcd1fa2b640 1 -- start start 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1fa2b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd181008e0 0x7fcd1819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1fa2b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 0x7fcd1819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1fa2b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd1810e490 0x7fcd1819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1fa2b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181141b0 con 0x7fcd18101290 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1fa2b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcd18114030 con 0x7fcd1810e490 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1fa2b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcd18114330 con 0x7fcd181008e0 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1cfc6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 0x7fcd1819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1cfc6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 0x7fcd1819abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55234/0 (socket says 172.21.15.159:55234) 2024-09-19T06:56:51.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1cfc6640 1 -- 172.21.15.159:0/2386651141 learned_addr learned my addr 172.21.15.159:0/2386651141 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1d7c7640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd181008e0 0x7fcd1819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1dfc8640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd1810e490 0x7fcd1819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1cfc6640 1 -- 172.21.15.159:0/2386651141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd181008e0 msgr2=0x7fcd1819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1cfc6640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd181008e0 0x7fcd1819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1cfc6640 1 -- 172.21.15.159:0/2386651141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd1810e490 msgr2=0x7fcd1819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1cfc6640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd1810e490 0x7fcd1819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1cfc6640 1 -- 172.21.15.159:0/2386651141 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1819f660 con 0x7fcd18101290 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1cfc6640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 0x7fcd1819abf0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcd08006010 tx=0x7fcd080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd0e7fc640 1 -- 172.21.15.159:0/2386651141 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0803f030 con 0x7fcd18101290 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1819f8f0 con 0x7fcd18101290 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd0e7fc640 1 -- 172.21.15.159:0/2386651141 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd08003ce0 con 0x7fcd18101290 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.070+0000 7fcd0e7fc640 1 -- 172.21.15.159:0/2386651141 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08035070 con 0x7fcd18101290 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.071+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd181a7230 con 0x7fcd18101290 2024-09-19T06:56:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.071+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1806b070 con 0x7fcd18101290 2024-09-19T06:56:51.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.073+0000 7fcd0e7fc640 1 -- 172.21.15.159:0/2386651141 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fcd08042030 con 0x7fcd18101290 2024-09-19T06:56:51.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.074+0000 7fcd0e7fc640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcd040a33b0 0x7fcd040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:51.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.074+0000 7fcd1d7c7640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcd040a33b0 0x7fcd040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:51.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.074+0000 7fcd0e7fc640 1 -- 172.21.15.159:0/2386651141 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7fcd080f06f0 con 0x7fcd18101290 2024-09-19T06:56:51.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.074+0000 7fcd1d7c7640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcd040a33b0 0x7fcd040a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd140058c0 tx=0x7fcd1400a2d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:51.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.077+0000 7fcd0e7fc640 1 -- 172.21.15.159:0/2386651141 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd080bd130 con 0x7fcd18101290 2024-09-19T06:56:51.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.276+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd18100cc0 con 0x7fcd18101290 2024-09-19T06:56:51.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.276+0000 7fcd0e7fc640 1 -- 172.21.15.159:0/2386651141 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7fcd18100cc0 con 0x7fcd18101290 2024-09-19T06:56:51.278 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:56:51.278 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:56:51.278 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.278+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcd040a33b0 msgr2=0x7fcd040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.278+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcd040a33b0 0x7fcd040a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd140058c0 tx=0x7fcd1400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.278+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 msgr2=0x7fcd1819abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.278+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 0x7fcd1819abf0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcd08006010 tx=0x7fcd080042f0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.279+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 shutdown_connections 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.279+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fcd040a33b0 0x7fcd040a5870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.279+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd1810e490 0x7fcd1819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.279+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd18101290 0x7fcd1819abf0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.279+0000 7fcd1fa2b640 1 --2- 172.21.15.159:0/2386651141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd181008e0 0x7fcd1819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:51.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.279+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 >> 172.21.15.159:0/2386651141 conn(0x7fcd180fc7d0 msgr2=0x7fcd180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:51.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.279+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 shutdown_connections 2024-09-19T06:56:51.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:51.279+0000 7fcd1fa2b640 1 -- 172.21.15.159:0/2386651141 wait complete. 2024-09-19T06:56:52.087 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:51 smithi159 ceph-mon[30935]: pgmap v306: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:52.088 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:51 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2386651141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:52.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:51 smithi203 ceph-mon[35473]: pgmap v306: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:52.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:51 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2386651141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:52.116 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:56:52.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:51 smithi189 ceph-mon[34880]: pgmap v306: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:52.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:51 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2386651141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:52.364 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.855+0000 7f7312a93640 1 -- 172.21.15.159:0/3648275212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c102790 msgr2=0x7f730c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.855+0000 7f7312a93640 1 --2- 172.21.15.159:0/3648275212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c102790 0x7f730c1067e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009900 tx=0x7f72f802a410 comp rx=0 tx=0).stop 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.855+0000 7f7312a93640 1 -- 172.21.15.159:0/3648275212 shutdown_connections 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.855+0000 7f7312a93640 1 --2- 172.21.15.159:0/3648275212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c106f10 0x7f730c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.855+0000 7f7312a93640 1 --2- 172.21.15.159:0/3648275212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c102790 0x7f730c1067e0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.855+0000 7f7312a93640 1 --2- 172.21.15.159:0/3648275212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c101de0 0x7f730c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.855+0000 7f7312a93640 1 -- 172.21.15.159:0/3648275212 >> 172.21.15.159:0/3648275212 conn(0x7f730c0fd8c0 msgr2=0x7f730c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.855+0000 7f7312a93640 1 -- 172.21.15.159:0/3648275212 shutdown_connections 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.855+0000 7f7312a93640 1 -- 172.21.15.159:0/3648275212 wait complete. 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7312a93640 1 Processor -- start 2024-09-19T06:56:52.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7312a93640 1 -- start start 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7312a93640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c101de0 0x7f730c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7312a93640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c102790 0x7f730c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7312a93640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c106f10 0x7f730c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7312a93640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f730c111f70 con 0x7f730c106f10 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7312a93640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f730c111df0 con 0x7f730c101de0 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7312a93640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1120f0 con 0x7f730c102790 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7311030640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c106f10 0x7f730c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7311030640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c106f10 0x7f730c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55254/0 (socket says 172.21.15.159:55254) 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7311030640 1 -- 172.21.15.159:0/1519891450 learned_addr learned my addr 172.21.15.159:0/1519891450 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f731082f640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c101de0 0x7f730c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f730bfff640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c102790 0x7f730c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7311030640 1 -- 172.21.15.159:0/1519891450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c102790 msgr2=0x7f730c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:52.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7311030640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c102790 0x7f730c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7311030640 1 -- 172.21.15.159:0/1519891450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c101de0 msgr2=0x7f730c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7311030640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c101de0 0x7f730c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.856+0000 7f7311030640 1 -- 172.21.15.159:0/1519891450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c19d420 con 0x7f730c106f10 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.857+0000 7f7311030640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c106f10 0x7f730c19cd40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f730400eaa0 tx=0x7f730400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.857+0000 7f7309ffb640 1 -- 172.21.15.159:0/1519891450 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730400cdb0 con 0x7f730c106f10 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.857+0000 7f7312a93640 1 -- 172.21.15.159:0/1519891450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c19d710 con 0x7f730c106f10 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.857+0000 7f7309ffb640 1 -- 172.21.15.159:0/1519891450 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7304005020 con 0x7f730c106f10 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.857+0000 7f7309ffb640 1 -- 172.21.15.159:0/1519891450 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040116b0 con 0x7f730c106f10 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.857+0000 7f7312a93640 1 -- 172.21.15.159:0/1519891450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1a4ff0 con 0x7f730c106f10 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.859+0000 7f7309ffb640 1 -- 172.21.15.159:0/1519891450 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7304005560 con 0x7f730c106f10 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.859+0000 7f7314e6c740 1 Processor -- start 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7314e6c740 1 -- start start 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b3fd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7309ffb640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f72fc0a33b0 0x7f72fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b3fda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 0x56361b40eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7314e6c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56361b3632f0 con 0x56361b3feb40 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7314e6c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56361b30acf0 con 0x56361b3fd5d0 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7314e6c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56361b35f2b0 con 0x56361b40c780 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f731082f640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f72fc0a33b0 0x7f72fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f730bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b3fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f730bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b3fd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55270/0 (socket says 172.21.15.159:55270) 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f730bfff640 1 -- 172.21.15.159:0/1493208836 learned_addr learned my addr 172.21.15.159:0/1493208836 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7309ffb640 1 -- 172.21.15.159:0/1519891450 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7f73040cff60 con 0x7f730c106f10 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f7311030640 1 --2- 172.21.15.159:0/1493208836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 0x56361b40eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f730bfff640 1 --2- 172.21.15.159:0/1493208836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b3fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f730bfff640 1 -- 172.21.15.159:0/1493208836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 msgr2=0x56361b40eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f730bfff640 1 --2- 172.21.15.159:0/1493208836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 0x56361b40eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f730bfff640 1 -- 172.21.15.159:0/1493208836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 msgr2=0x56361b3fda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f730bfff640 1 --2- 172.21.15.159:0/1493208836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b3fda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f730bfff640 1 -- 172.21.15.159:0/1493208836 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361b2ef3a0 con 0x56361b3feb40 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.860+0000 7f731082f640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f72fc0a33b0 0x7f72fc0a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f730000bbe0 tx=0x7f730000b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f730bfff640 1 --2- 172.21.15.159:0/1493208836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b3fd090 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005940 tx=0x7f72f8005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344bd8b2edd0f5af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f72f6ffd640 1 -- 172.21.15.159:0/1493208836 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8035050 con 0x56361b3feb40 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f72f6ffd640 1 -- 172.21.15.159:0/1493208836 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f8031730 con 0x56361b3feb40 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f72f6ffd640 1 -- 172.21.15.159:0/1493208836 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8005640 con 0x56361b3feb40 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f7314e6c740 1 -- 172.21.15.159:0/1493208836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 msgr2=0x56361b3fd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1493208836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b3fd090 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005940 tx=0x7f72f8005b50 comp rx=0 tx=0).stop 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f7314e6c740 1 -- 172.21.15.159:0/1493208836 shutdown_connections 2024-09-19T06:56:52.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1493208836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 0x56361b40eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1493208836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b3fda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1493208836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b3fd090 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.861+0000 7f7314e6c740 1 -- 172.21.15.159:0/1493208836 >> 172.21.15.159:0/1493208836 conn(0x56361b3c6310 msgr2=0x56361b3f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 -- 172.21.15.159:0/1493208836 shutdown_connections 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 -- 172.21.15.159:0/1493208836 wait complete. 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 -- start start 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 Processor -- start 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b40c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b409420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 0x56361b409a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56361b40f420 con 0x56361b3feb40 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56361b31e060 con 0x56361b3fd5d0 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56361b40f5a0 con 0x56361b40c780 2024-09-19T06:56:52.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.862+0000 7f7314e6c740 10 client.0 _ll_register_callbacks cb 0x56361b0718c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f730bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b409420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f730bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b409420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55282/0 (socket says 172.21.15.159:55282) 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f730bfff640 1 -- 172.21.15.159:0/2403119858 learned_addr learned my addr 172.21.15.159:0/2403119858 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f731082f640 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b40c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f7311030640 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 0x56361b409a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f730bfff640 1 -- 172.21.15.159:0/2403119858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 msgr2=0x56361b409a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f730bfff640 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 0x56361b409a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f730bfff640 1 -- 172.21.15.159:0/2403119858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 msgr2=0x56361b40c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f730bfff640 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b40c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f730bfff640 1 -- 172.21.15.159:0/2403119858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361b0d43c0 con 0x56361b3feb40 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f7311030640 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 0x56361b409a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f730bfff640 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b409420 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005200 tx=0x7f72f80318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c175f8f24a8122e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f72ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:52.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f72ebfff640 1 -- 172.21.15.159:0/2403119858 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f804c070 con 0x56361b3feb40 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f72ebfff640 1 -- 172.21.15.159:0/2403119858 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7f72f8004240 con 0x56361b3feb40 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f7314e6c740 1 -- 172.21.15.159:0/2403119858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f8031730 con 0x56361b3feb40 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f72ebfff640 1 -- 172.21.15.159:0/2403119858 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f72f8055050 con 0x56361b3feb40 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f7314e6c740 10 client.17373 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f7314e6c740 1 -- 172.21.15.159:0/2403119858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56361b41aec0 con 0x56361b3feb40 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.863+0000 7f72ebfff640 1 -- 172.21.15.159:0/2403119858 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f8031730 con 0x56361b3feb40 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.864+0000 7f72ebfff640 1 -- 172.21.15.159:0/2403119858 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f72f804f020 con 0x56361b3feb40 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.864+0000 7f7314e6c740 10 client.17373 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.864+0000 7f7314e6c740 10 client.17373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.864+0000 7f7314e6c740 20 client.17373 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:52.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.864+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56361b41c210 0x56361b41e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.864+0000 7f7314e6c740 4 client.17373 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:52.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.864+0000 7f7314e6c740 1 -- 172.21.15.159:0/2403119858 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56361b370860 con 0x56361b41c210 2024-09-19T06:56:52.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.864+0000 7f731082f640 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56361b41c210 0x56361b41e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f731082f640 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56361b41c210 0x56361b41e600 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c33df54ea4736cf3 server_cookie=1e7cda3333bfce50 in_seq=0 out_seq=0 2024-09-19T06:56:52.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f72ebfff640 10 client.17373 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:52.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f72ebfff640 1 -- 172.21.15.159:0/2403119858 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56361b370860 con 0x56361b41c210 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f72ebfff640 10 client.17373 handle_command_reply: tid=0 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f7314e6c740 1 client.17373 shutdown 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f7314e6c740 1 -- 172.21.15.159:0/2403119858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 msgr2=0x56361b409420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b409420 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005200 tx=0x7f72f80318e0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f7314e6c740 1 -- 172.21.15.159:0/2403119858 shutdown_connections 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56361b41c210 0x56361b41e600 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b40c780 0x56361b409a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b3feb40 0x56361b409420 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f72ebfff640 0 client.17373 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2403119858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b40c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.865+0000 7f7314e6c740 1 -- 172.21.15.159:0/2403119858 >> 172.21.15.159:0/2403119858 conn(0x56361b3c6310 msgr2=0x56361b3ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.866+0000 7f7314e6c740 1 -- 172.21.15.159:0/2403119858 shutdown_connections 2024-09-19T06:56:52.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.866+0000 7f7314e6c740 1 -- 172.21.15.159:0/2403119858 wait complete. 2024-09-19T06:56:52.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.866+0000 7f7314e6c740 20 client.17373 trim_cache size 0 max 16384 2024-09-19T06:56:52.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7314e6c740 1 Processor -- start 2024-09-19T06:56:52.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7314e6c740 1 -- start start 2024-09-19T06:56:52.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b408400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3feb40 0x56361b421620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b421b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7314e6c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1a9780 con 0x56361b40c780 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7314e6c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1abfe0 con 0x56361b3fd5d0 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7314e6c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1a9dd0 con 0x56361b3feb40 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7311030640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b421b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7311030640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b421b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55296/0 (socket says 172.21.15.159:55296) 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7311030640 1 -- 172.21.15.159:0/2831849486 learned_addr learned my addr 172.21.15.159:0/2831849486 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f731082f640 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b408400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7311030640 1 -- 172.21.15.159:0/2831849486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3feb40 msgr2=0x56361b421620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f730bfff640 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3feb40 0x56361b421620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7311030640 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3feb40 0x56361b421620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7311030640 1 -- 172.21.15.159:0/2831849486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 msgr2=0x56361b408400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7311030640 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b408400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f7311030640 1 -- 172.21.15.159:0/2831849486 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361b3fa960 con 0x56361b40c780 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.879+0000 7f731082f640 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b408400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f7311030640 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b421b60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f73040cd700 tx=0x7f730409c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8f0acfffe23f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f72f67fc640 1 -- 172.21.15.159:0/2831849486 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730401f040 con 0x56361b40c780 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f72f67fc640 1 -- 172.21.15.159:0/2831849486 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73040a4e50 con 0x56361b40c780 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f72f67fc640 1 -- 172.21.15.159:0/2831849486 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040b57a0 con 0x56361b40c780 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f7314e6c740 1 -- 172.21.15.159:0/2831849486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 msgr2=0x56361b421b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b421b60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f73040cd700 tx=0x7f730409c8e0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f7314e6c740 1 -- 172.21.15.159:0/2831849486 shutdown_connections 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b421b60 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3feb40 0x56361b421620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.880+0000 7f7314e6c740 1 --2- 172.21.15.159:0/2831849486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3fd5d0 0x56361b408400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.881+0000 7f7314e6c740 1 -- 172.21.15.159:0/2831849486 >> 172.21.15.159:0/2831849486 conn(0x56361b3c6310 msgr2=0x56361b407cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.881+0000 7f7314e6c740 1 -- 172.21.15.159:0/2831849486 shutdown_connections 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.881+0000 7f7314e6c740 1 -- 172.21.15.159:0/2831849486 wait complete. 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.881+0000 7f7314e6c740 1 -- start start 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.881+0000 7f7314e6c740 1 Processor -- start 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.881+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3fd5d0 0x56361b421e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.881+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3feb40 0x56361b41f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.881+0000 7f7314e6c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b41f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7314e6c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1aa4a0 con 0x56361b40c780 2024-09-19T06:56:52.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7314e6c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1ab910 con 0x56361b3feb40 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7314e6c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1aab70 con 0x56361b3fd5d0 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7314e6c740 10 client.0 _ll_register_callbacks cb 0x7f7304098480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7311030640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b41f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7311030640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b41f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55310/0 (socket says 172.21.15.159:55310) 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7311030640 1 -- 172.21.15.159:0/1564590077 learned_addr learned my addr 172.21.15.159:0/1564590077 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f731082f640 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3fd5d0 0x56361b421e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f730bfff640 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3feb40 0x56361b41f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7311030640 1 -- 172.21.15.159:0/1564590077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3fd5d0 msgr2=0x56361b421e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7311030640 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3fd5d0 0x56361b421e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7311030640 1 -- 172.21.15.159:0/1564590077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3feb40 msgr2=0x56361b41f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7311030640 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3feb40 0x56361b41f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7311030640 1 -- 172.21.15.159:0/1564590077 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361b41ff60 con 0x56361b40c780 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7311030640 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b41f730 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f73040cdc50 tx=0x7f73040b52e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352dff16e8d53b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f72ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f72ebfff640 1 -- 172.21.15.159:0/1564590077 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730401f040 con 0x56361b40c780 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f72ebfff640 1 -- 172.21.15.159:0/1564590077 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7f7304098850 con 0x56361b40c780 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7314e6c740 1 -- 172.21.15.159:0/1564590077 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73040a4e50 con 0x56361b40c780 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f72ebfff640 1 -- 172.21.15.159:0/1564590077 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f73040bc0c0 con 0x56361b40c780 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7314e6c740 10 client.17379 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.882+0000 7f7314e6c740 1 -- 172.21.15.159:0/1564590077 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56361b486c20 con 0x56361b40c780 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.883+0000 7f72ebfff640 1 -- 172.21.15.159:0/1564590077 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73040a4e50 con 0x56361b40c780 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.883+0000 7f72ebfff640 1 -- 172.21.15.159:0/1564590077 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f730400f040 con 0x56361b40c780 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.883+0000 7f7314e6c740 10 client.17379 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:52.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.883+0000 7f7314e6c740 10 client.17379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.883+0000 7f7314e6c740 20 client.17379 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.883+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56361b487290 0x56361b489680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.883+0000 7f7314e6c740 4 client.17379 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.883+0000 7f7314e6c740 1 -- 172.21.15.159:0/1564590077 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56361b36ad70 con 0x56361b487290 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.883+0000 7f731082f640 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56361b487290 0x56361b489680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f72ebfff640 10 client.17379 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f731082f640 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56361b487290 0x56361b489680 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa55d53fa8f1dec4 server_cookie=cca549603c56b827 in_seq=0 out_seq=0 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f72ebfff640 1 -- 172.21.15.159:0/1564590077 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56361b36ad70 con 0x56361b487290 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f72ebfff640 10 client.17379 handle_command_reply: tid=0 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 client.17379 shutdown 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 -- 172.21.15.159:0/1564590077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 msgr2=0x56361b41f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b41f730 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f73040cdc50 tx=0x7f73040b52e0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 -- 172.21.15.159:0/1564590077 shutdown_connections 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x56361b487290 0x56361b489680 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f72ebfff640 0 client.17379 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56361b40c780 0x56361b41f730 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361b3feb40 0x56361b41f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 --2- 172.21.15.159:0/1564590077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56361b3fd5d0 0x56361b421e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 -- 172.21.15.159:0/1564590077 >> 172.21.15.159:0/1564590077 conn(0x56361b3c6310 msgr2=0x56361b408510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 -- 172.21.15.159:0/1564590077 shutdown_connections 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 1 -- 172.21.15.159:0/1564590077 wait complete. 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.884+0000 7f7314e6c740 20 client.17379 trim_cache size 0 max 16384 2024-09-19T06:56:52.898 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:56:52.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 -- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f72fc0a33b0 msgr2=0x7f72fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:52.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f72fc0a33b0 0x7f72fc0a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f730000bbe0 tx=0x7f730000b390 comp rx=0 tx=0).stop 2024-09-19T06:56:52.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 -- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c106f10 msgr2=0x7f730c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:52.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c106f10 0x7f730c19cd40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f730400eaa0 tx=0x7f730400ef60 comp rx=0 tx=0).stop 2024-09-19T06:56:52.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 -- 172.21.15.159:0/1519891450 shutdown_connections 2024-09-19T06:56:52.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f72fc0a33b0 0x7f72fc0a5870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f730c106f10 0x7f730c19cd40 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c102790 0x7f730c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 --2- 172.21.15.159:0/1519891450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c101de0 0x7f730c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:52.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 -- 172.21.15.159:0/1519891450 >> 172.21.15.159:0/1519891450 conn(0x7f730c0fd8c0 msgr2=0x7f730c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:52.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 -- 172.21.15.159:0/1519891450 shutdown_connections 2024-09-19T06:56:52.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:52.885+0000 7f7312a93640 1 -- 172.21.15.159:0/1519891450 wait complete. 2024-09-19T06:56:54.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:53 smithi203 ceph-mon[35473]: pgmap v307: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:54.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:53 smithi189 ceph-mon[34880]: pgmap v307: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:54.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:53 smithi159 ceph-mon[30935]: pgmap v307: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:56:54.653 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:56:54.653 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:56:54.917 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.418+0000 7f9c547b0640 1 -- 172.21.15.159:0/2447227413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c10c180 msgr2=0x7f9c4c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.418+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2447227413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c10c180 0x7f9c4c10e600 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009ca0 tx=0x7f9c4402a950 comp rx=0 tx=0).stop 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.418+0000 7f9c547b0640 1 -- 172.21.15.159:0/2447227413 shutdown_connections 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.418+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2447227413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c10c180 0x7f9c4c10e600 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.418+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2447227413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c4c1036c0 0x7f9c4c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.418+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2447227413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4c102da0 0x7f9c4c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.418+0000 7f9c547b0640 1 -- 172.21.15.159:0/2447227413 >> 172.21.15.159:0/2447227413 conn(0x7f9c4c0fc7a0 msgr2=0x7f9c4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.418+0000 7f9c547b0640 1 -- 172.21.15.159:0/2447227413 shutdown_connections 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.418+0000 7f9c547b0640 1 -- 172.21.15.159:0/2447227413 wait complete. 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.419+0000 7f9c547b0640 1 Processor -- start 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.419+0000 7f9c547b0640 1 -- start start 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.419+0000 7f9c547b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c102da0 0x7f9c4c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.419+0000 7f9c547b0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c4c1036c0 0x7f9c4c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.419+0000 7f9c547b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4c10c180 0x7f9c4c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.419+0000 7f9c547b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c111f20 con 0x7f9c4c102da0 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.419+0000 7f9c547b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c111da0 con 0x7f9c4c10c180 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.419+0000 7f9c547b0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c1120a0 con 0x7f9c4c1036c0 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c5254c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c102da0 0x7f9c4c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c5254c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c102da0 0x7f9c4c1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55336/0 (socket says 172.21.15.159:55336) 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c5254c640 1 -- 172.21.15.159:0/2900715070 learned_addr learned my addr 172.21.15.159:0/2900715070 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c51d4b640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c4c1036c0 0x7f9c4c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4c10c180 0x7f9c4c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c5254c640 1 -- 172.21.15.159:0/2900715070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c4c1036c0 msgr2=0x7f9c4c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c5254c640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c4c1036c0 0x7f9c4c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c5254c640 1 -- 172.21.15.159:0/2900715070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4c10c180 msgr2=0x7f9c4c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c5254c640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4c10c180 0x7f9c4c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c5254c640 1 -- 172.21.15.159:0/2900715070 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c19d360 con 0x7f9c4c102da0 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4c10c180 0x7f9c4c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c5254c640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c102da0 0x7f9c4c1983b0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800d950 tx=0x7f9c4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c437fe640 1 -- 172.21.15.159:0/2900715070 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48017030 con 0x7f9c4c102da0 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c437fe640 1 -- 172.21.15.159:0/2900715070 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c48004020 con 0x7f9c4c102da0 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c547b0640 1 -- 172.21.15.159:0/2900715070 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4c19d650 con 0x7f9c4c102da0 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c437fe640 1 -- 172.21.15.159:0/2900715070 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c480047a0 con 0x7f9c4c102da0 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.420+0000 7f9c547b0640 1 -- 172.21.15.159:0/2900715070 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4c1a4f30 con 0x7f9c4c102da0 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.422+0000 7f9c437fe640 1 -- 172.21.15.159:0/2900715070 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9c480041d0 con 0x7f9c4c102da0 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c56b89740 1 Processor -- start 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c56b89740 1 -- start start 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 0x564c995fbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fc480 0x564c99606800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 0x564c99609130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c56b89740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564c99561280 con 0x564c995fc480 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c56b89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564c99508b10 con 0x564c99606d40 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c56b89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564c9955d240 con 0x564c995fbb60 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c5254c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fc480 0x564c99606800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c5254c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fc480 0x564c99606800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55350/0 (socket says 172.21.15.159:55350) 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c5254c640 1 -- 172.21.15.159:0/2788516576 learned_addr learned my addr 172.21.15.159:0/2788516576 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 0x564c995fbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c437fe640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c380a33b0 0x7f9c380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c51d4b640 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 0x564c99609130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.423+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c380a33b0 0x7f9c380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c437fe640 1 -- 172.21.15.159:0/2900715070 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7f9c480cf800 con 0x7f9c4c102da0 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c5254c640 1 -- 172.21.15.159:0/2788516576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 msgr2=0x564c995fbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c5254c640 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 0x564c995fbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c5254c640 1 -- 172.21.15.159:0/2788516576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 msgr2=0x564c99609130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c5254c640 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 0x564c99609130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c5254c640 1 -- 172.21.15.159:0/2788516576 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c995151f0 con 0x564c995fc480 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 0x564c995fbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c5254c640 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fc480 0x564c99606800 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9c4809ba10 tx=0x7f9c48004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e8fec951bd3565 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c380a33b0 0x7f9c380a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009430 tx=0x7f9c4402a950 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c40ff9640 1 -- 172.21.15.159:0/2788516576 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c480d2e60 con 0x564c995fc480 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c40ff9640 1 -- 172.21.15.159:0/2788516576 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c4809c180 con 0x564c995fc480 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.424+0000 7f9c40ff9640 1 -- 172.21.15.159:0/2788516576 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c480860e0 con 0x564c995fc480 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 -- 172.21.15.159:0/2788516576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fc480 msgr2=0x564c99606800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fc480 0x564c99606800 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9c4809ba10 tx=0x7f9c48004540 comp rx=0 tx=0).stop 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 -- 172.21.15.159:0/2788516576 shutdown_connections 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 0x564c99609130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fc480 0x564c99606800 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 --2- 172.21.15.159:0/2788516576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 0x564c995fbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 -- 172.21.15.159:0/2788516576 >> 172.21.15.159:0/2788516576 conn(0x564c995f80f0 msgr2=0x564c995f84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 -- 172.21.15.159:0/2788516576 shutdown_connections 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 -- 172.21.15.159:0/2788516576 wait complete. 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 -- start start 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.425+0000 7f9c56b89740 1 Processor -- start 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fbb60 0x564c99603c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 0x564c99604170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 0x564c996046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c56b89740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564c99609910 con 0x564c995fbb60 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c56b89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564c9951bf10 con 0x564c99606d40 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c56b89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564c99609a90 con 0x564c995fc480 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c56b89740 10 client.0 _ll_register_callbacks cb 0x564c994e4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c5254c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fbb60 0x564c99603c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c5254c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fbb60 0x564c99603c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55360/0 (socket says 172.21.15.159:55360) 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c5254c640 1 -- 172.21.15.159:0/1787242351 learned_addr learned my addr 172.21.15.159:0/1787242351 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 0x564c996046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c5254c640 1 -- 172.21.15.159:0/1787242351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 msgr2=0x564c99604170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c5254c640 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 0x564c99604170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c5254c640 1 -- 172.21.15.159:0/1787242351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 msgr2=0x564c996046b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c5254c640 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 0x564c996046b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c5254c640 1 -- 172.21.15.159:0/1787242351 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c992d26a0 con 0x564c995fbb60 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c5254c640 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fbb60 0x564c99603c30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9c48098450 tx=0x7f9c48009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777b5340a5421698 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c35ffb640 1 -- 172.21.15.159:0/1787242351 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c480b4060 con 0x564c995fbb60 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c35ffb640 1 -- 172.21.15.159:0/1787242351 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7f9c480860b0 con 0x564c995fbb60 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c56b89740 1 -- 172.21.15.159:0/1787242351 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c4809c180 con 0x564c995fbb60 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c35ffb640 1 -- 172.21.15.159:0/1787242351 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9c4809b3e0 con 0x564c995fbb60 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.426+0000 7f9c56b89740 10 client.17391 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c56b89740 1 -- 172.21.15.159:0/1787242351 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564c99615550 con 0x564c995fbb60 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c35ffb640 1 -- 172.21.15.159:0/1787242351 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c4809c180 con 0x564c995fbb60 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c35ffb640 1 -- 172.21.15.159:0/1787242351 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f9c480ba1a0 con 0x564c995fbb60 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c56b89740 10 client.17391 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c56b89740 10 client.17391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c56b89740 20 client.17391 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c56b89740 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564c996168a0 0x564c99618c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c56b89740 4 client.17391 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c56b89740 1 -- 172.21.15.159:0/1787242351 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c9956e7f0 con 0x564c996168a0 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.427+0000 7f9c51d4b640 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564c996168a0 0x564c99618c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c35ffb640 10 client.17391 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c51d4b640 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564c996168a0 0x564c99618c90 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c0c5c6acf016b2 server_cookie=b73fb24c90a978c5 in_seq=0 out_seq=0 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c35ffb640 1 -- 172.21.15.159:0/1787242351 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c9956e7f0 con 0x564c996168a0 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c35ffb640 10 client.17391 handle_command_reply: tid=0 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 client.17391 shutdown 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 -- 172.21.15.159:0/1787242351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fbb60 msgr2=0x564c99603c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fbb60 0x564c99603c30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9c48098450 tx=0x7f9c48009740 comp rx=0 tx=0).stop 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 -- 172.21.15.159:0/1787242351 shutdown_connections 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564c996168a0 0x564c99618c90 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c99606d40 0x564c996046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 0x564c99604170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 --2- 172.21.15.159:0/1787242351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c995fbb60 0x564c99603c30 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c35ffb640 0 client.17391 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 -- 172.21.15.159:0/1787242351 >> 172.21.15.159:0/1787242351 conn(0x564c995f80f0 msgr2=0x564c995f7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 -- 172.21.15.159:0/1787242351 shutdown_connections 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.428+0000 7f9c56b89740 1 -- 172.21.15.159:0/1787242351 wait complete. 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.429+0000 7f9c56b89740 20 client.17391 trim_cache size 0 max 16384 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c56b89740 1 Processor -- start 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c56b89740 1 -- start start 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 0x564c99605a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fc480 0x564c9961b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c9961be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c56b89740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c1abaa0 con 0x564c99606d40 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c56b89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c1ae300 con 0x564c995fc480 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c56b89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c1ac0f0 con 0x564c995fbb60 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c52d4d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c9961be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c52d4d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c9961be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55372/0 (socket says 172.21.15.159:55372) 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c52d4d640 1 -- 172.21.15.159:0/3580962845 learned_addr learned my addr 172.21.15.159:0/3580962845 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c51d4b640 1 --2- 172.21.15.159:0/3580962845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fc480 0x564c9961b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c52d4d640 1 -- 172.21.15.159:0/3580962845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 msgr2=0x564c99605a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/3580962845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 0x564c99605a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c52d4d640 1 -- 172.21.15.159:0/3580962845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fc480 msgr2=0x564c9961b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/3580962845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fc480 0x564c9961b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c52d4d640 1 -- 172.21.15.159:0/3580962845 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c995f9280 con 0x564c99606d40 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/3580962845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c9961be10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9c4402b080 tx=0x7f9c44004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2670277880d455a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.446+0000 7f9c37fff640 1 -- 172.21.15.159:0/3580962845 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4404f020 con 0x564c99606d40 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c37fff640 1 -- 172.21.15.159:0/3580962845 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c44003d70 con 0x564c99606d40 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c37fff640 1 -- 172.21.15.159:0/3580962845 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44034040 con 0x564c99606d40 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 -- 172.21.15.159:0/3580962845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 msgr2=0x564c9961be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 --2- 172.21.15.159:0/3580962845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c9961be10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9c4402b080 tx=0x7f9c44004ab0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 -- 172.21.15.159:0/3580962845 shutdown_connections 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 --2- 172.21.15.159:0/3580962845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c9961be10 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 --2- 172.21.15.159:0/3580962845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fc480 0x564c9961b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 --2- 172.21.15.159:0/3580962845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fbb60 0x564c99605a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 -- 172.21.15.159:0/3580962845 >> 172.21.15.159:0/3580962845 conn(0x564c995f80f0 msgr2=0x564c99605380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 -- 172.21.15.159:0/3580962845 shutdown_connections 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 -- 172.21.15.159:0/3580962845 wait complete. 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 -- start start 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.447+0000 7f9c56b89740 1 Processor -- start 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fbb60 0x564c99619ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 0x564c9961a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c56b89740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c996801e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c56b89740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c1ac7c0 con 0x564c99606d40 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c56b89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c1adc30 con 0x564c995fbb60 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c56b89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c1ace90 con 0x564c995fc480 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c56b89740 10 client.0 _ll_register_callbacks cb 0x7f9c3c00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c52d4d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c996801e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c52d4d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c996801e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55374/0 (socket says 172.21.15.159:55374) 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c52d4d640 1 -- 172.21.15.159:0/4242204858 learned_addr learned my addr 172.21.15.159:0/4242204858 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c5254c640 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fbb60 0x564c99619ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c51d4b640 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 0x564c9961a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c52d4d640 1 -- 172.21.15.159:0/4242204858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 msgr2=0x564c9961a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 0x564c9961a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c52d4d640 1 -- 172.21.15.159:0/4242204858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fbb60 msgr2=0x564c99619ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fbb60 0x564c99619ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c52d4d640 1 -- 172.21.15.159:0/4242204858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c99680720 con 0x564c99606d40 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c51d4b640 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 0x564c9961a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c52d4d640 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c996801e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009ca0 tx=0x7f9c4404b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7f0a637f0dc065 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c35ffb640 1 -- 172.21.15.159:0/4242204858 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4405a020 con 0x564c99606d40 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c56b89740 1 -- 172.21.15.159:0/4242204858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c44003d70 con 0x564c99606d40 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.448+0000 7f9c35ffb640 1 -- 172.21.15.159:0/4242204858 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7f9c44004250 con 0x564c99606d40 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c35ffb640 1 -- 172.21.15.159:0/4242204858 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9c44065050 con 0x564c99606d40 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c56b89740 10 client.17397 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c56b89740 1 -- 172.21.15.159:0/4242204858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564c996819a0 con 0x564c99606d40 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c35ffb640 1 -- 172.21.15.159:0/4242204858 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c44003d70 con 0x564c99606d40 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c35ffb640 1 -- 172.21.15.159:0/4242204858 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f9c44048050 con 0x564c99606d40 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c56b89740 10 client.17397 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c56b89740 10 client.17397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c56b89740 20 client.17397 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c56b89740 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564c996820f0 0x564c99684510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c56b89740 4 client.17397 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c56b89740 1 -- 172.21.15.159:0/4242204858 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564c99568d00 con 0x564c996820f0 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.449+0000 7f9c5254c640 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564c996820f0 0x564c99684510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.450+0000 7f9c35ffb640 10 client.17397 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.450+0000 7f9c5254c640 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564c996820f0 0x564c99684510 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccfee7ed3260b445 server_cookie=92ce767a9651510a in_seq=0 out_seq=0 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c35ffb640 1 -- 172.21.15.159:0/4242204858 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564c99568d00 con 0x564c996820f0 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c35ffb640 10 client.17397 handle_command_reply: tid=0 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 client.17397 shutdown 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 -- 172.21.15.159:0/4242204858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 msgr2=0x564c996801e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c996801e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009ca0 tx=0x7f9c4404b600 comp rx=0 tx=0).stop 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 -- 172.21.15.159:0/4242204858 shutdown_connections 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "return_code": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_tag": "24c56765-043e-421e-9562-211047e251d0", 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": "asynchronous" 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564c996820f0 0x564c99684510 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564c99606d40 0x564c996801e0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c995fc480 0x564c9961a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 --2- 172.21.15.159:0/4242204858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c995fbb60 0x564c99619ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c35ffb640 0 client.17397 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 -- 172.21.15.159:0/4242204858 >> 172.21.15.159:0/4242204858 conn(0x564c995f80f0 msgr2=0x564c995f7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 -- 172.21.15.159:0/4242204858 shutdown_connections 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 1 -- 172.21.15.159:0/4242204858 wait complete. 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.451+0000 7f9c56b89740 20 client.17397 trim_cache size 0 max 16384 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 -- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c380a33b0 msgr2=0x7f9c380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c380a33b0 0x7f9c380a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009430 tx=0x7f9c4402a950 comp rx=0 tx=0).stop 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 -- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c102da0 msgr2=0x7f9c4c1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c102da0 0x7f9c4c1983b0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800d950 tx=0x7f9c4800de10 comp rx=0 tx=0).stop 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 -- 172.21.15.159:0/2900715070 shutdown_connections 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f9c380a33b0 0x7f9c380a5870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4c10c180 0x7f9c4c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c4c1036c0 0x7f9c4c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 --2- 172.21.15.159:0/2900715070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c4c102da0 0x7f9c4c1983b0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 -- 172.21.15.159:0/2900715070 >> 172.21.15.159:0/2900715070 conn(0x7f9c4c0fc7a0 msgr2=0x7f9c4c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 -- 172.21.15.159:0/2900715070 shutdown_connections 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:55.452+0000 7f9c547b0640 1 -- 172.21.15.159:0/2900715070 wait complete. 2024-09-19T06:56:56.085 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:55 smithi159 ceph-mon[30935]: pgmap v308: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:56.085 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:55 smithi159 ceph-mon[30935]: scrub queued for path: / 2024-09-19T06:56:56.086 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:55 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:56.086 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:55 smithi159 ceph-mon[30935]: scrub summary: active paths [/] 2024-09-19T06:56:56.086 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:55 smithi159 ceph-mon[30935]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:56.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:55 smithi203 ceph-mon[35473]: pgmap v308: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:56.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:55 smithi203 ceph-mon[35473]: scrub queued for path: / 2024-09-19T06:56:56.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:55 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:56.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:55 smithi203 ceph-mon[35473]: scrub summary: active paths [/] 2024-09-19T06:56:56.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:55 smithi203 ceph-mon[35473]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:56.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:55 smithi189 ceph-mon[34880]: pgmap v308: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:56:56.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:55 smithi189 ceph-mon[34880]: scrub queued for path: / 2024-09-19T06:56:56.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:55 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:56.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:55 smithi189 ceph-mon[34880]: scrub summary: active paths [/] 2024-09-19T06:56:56.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:55 smithi189 ceph-mon[34880]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:56.153 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:56:56.398 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:56.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 -- 172.21.15.159:0/3771408785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102570 msgr2=0x7fbec41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/3771408785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102570 0x7fbec41029b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009900 tx=0x7fbeac02a480 comp rx=0 tx=0).stop 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 -- 172.21.15.159:0/3771408785 shutdown_connections 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/3771408785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbec4102ef0 0x7fbec410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/3771408785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102570 0x7fbec41029b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/3771408785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec4100e20 0x7fbec4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 -- 172.21.15.159:0/3771408785 >> 172.21.15.159:0/3771408785 conn(0x7fbec40fc7d0 msgr2=0x7fbec40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 -- 172.21.15.159:0/3771408785 shutdown_connections 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 -- 172.21.15.159:0/3771408785 wait complete. 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 Processor -- start 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.893+0000 7fbec8b4a640 1 -- start start 2024-09-19T06:56:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec8b4a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec4100e20 0x7fbec4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec8b4a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbec4102570 0x7fbec4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec8b4a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102ef0 0x7fbec419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec8b4a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbec4110fa0 con 0x7fbec4102ef0 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec8b4a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbec4110e20 con 0x7fbec4102570 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec8b4a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbec4111120 con 0x7fbec4100e20 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec2d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102ef0 0x7fbec419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec2d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102ef0 0x7fbec419ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55388/0 (socket says 172.21.15.159:55388) 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec2d9d640 1 -- 172.21.15.159:0/2014627327 learned_addr learned my addr 172.21.15.159:0/2014627327 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbebbfff640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbec4102570 0x7fbec4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec259c640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec4100e20 0x7fbec4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec2d9d640 1 -- 172.21.15.159:0/2014627327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec4100e20 msgr2=0x7fbec4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec2d9d640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec4100e20 0x7fbec4198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec2d9d640 1 -- 172.21.15.159:0/2014627327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbec4102570 msgr2=0x7fbec4198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec2d9d640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbec4102570 0x7fbec4198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec2d9d640 1 -- 172.21.15.159:0/2014627327 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec419d510 con 0x7fbec4102ef0 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbec2d9d640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102ef0 0x7fbec419ce30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00eaa0 tx=0x7fbebc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.894+0000 7fbebb7fe640 1 -- 172.21.15.159:0/2014627327 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc004d20 con 0x7fbec4102ef0 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.895+0000 7fbebb7fe640 1 -- 172.21.15.159:0/2014627327 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbebc005020 con 0x7fbec4102ef0 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.895+0000 7fbec8b4a640 1 -- 172.21.15.159:0/2014627327 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec419d800 con 0x7fbec4102ef0 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.895+0000 7fbebb7fe640 1 -- 172.21.15.159:0/2014627327 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0116d0 con 0x7fbec4102ef0 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.895+0000 7fbec8b4a640 1 -- 172.21.15.159:0/2014627327 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec41a50e0 con 0x7fbec4102ef0 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.897+0000 7fbebb7fe640 1 -- 172.21.15.159:0/2014627327 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fbebc0051d0 con 0x7fbec4102ef0 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.897+0000 7fbecaf23740 1 Processor -- start 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.897+0000 7fbecaf23740 1 -- start start 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadf94880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadf9f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadfa1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbecaf23740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564fadefa2e0 con 0x564fadf944a0 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbecaf23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564fadea1ce0 con 0x564fadf94dc0 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbecaf23740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564fadef62a0 con 0x564fadf9f680 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadf94880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadf94880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55402/0 (socket says 172.21.15.159:55402) 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebbfff640 1 -- 172.21.15.159:0/2333862509 learned_addr learned my addr 172.21.15.159:0/2333862509 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbec259c640 1 --2- 172.21.15.159:0/2333862509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadf9f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebb7fe640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbeb00a33b0 0x7fbeb00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebbfff640 1 -- 172.21.15.159:0/2333862509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 msgr2=0x564fadfa1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebbfff640 1 --2- 172.21.15.159:0/2333862509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadfa1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebbfff640 1 -- 172.21.15.159:0/2333862509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 msgr2=0x564fadf9f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:56.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebbfff640 1 --2- 172.21.15.159:0/2333862509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadf9f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebbfff640 1 -- 172.21.15.159:0/2333862509 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fade86440 con 0x564fadf944a0 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbec259c640 1 --2- 172.21.15.159:0/2333862509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadf9f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbec2d9d640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbeb00a33b0 0x7fbeb00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebbfff640 1 --2- 172.21.15.159:0/2333862509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadf94880 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fbeac02a9a0 tx=0x7fbeac004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee18aec4f4951a4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.898+0000 7fbebb7fe640 1 -- 172.21.15.159:0/2014627327 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7fbebc0cffc0 con 0x7fbec4102ef0 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbeb8ff9640 1 -- 172.21.15.159:0/2333862509 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac035070 con 0x564fadf944a0 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbeb8ff9640 1 -- 172.21.15.159:0/2333862509 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbeac041030 con 0x564fadf944a0 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbeb8ff9640 1 -- 172.21.15.159:0/2333862509 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac031a00 con 0x564fadf944a0 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbecaf23740 1 -- 172.21.15.159:0/2333862509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 msgr2=0x564fadf94880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbecaf23740 1 --2- 172.21.15.159:0/2333862509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadf94880 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fbeac02a9a0 tx=0x7fbeac004180 comp rx=0 tx=0).stop 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbec2d9d640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbeb00a33b0 0x7fbeb00a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbebc098bb0 tx=0x7fbebc066bd0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbecaf23740 1 -- 172.21.15.159:0/2333862509 shutdown_connections 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbecaf23740 1 --2- 172.21.15.159:0/2333862509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadfa1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbecaf23740 1 --2- 172.21.15.159:0/2333862509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadf9f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbecaf23740 1 --2- 172.21.15.159:0/2333862509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadf94880 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.899+0000 7fbecaf23740 1 -- 172.21.15.159:0/2333862509 >> 172.21.15.159:0/2333862509 conn(0x564fadf90a30 msgr2=0x564fadf90e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 -- 172.21.15.159:0/2333862509 shutdown_connections 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 -- 172.21.15.159:0/2333862509 wait complete. 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 -- start start 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 Processor -- start 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf944a0 0x564fadf9efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf94dc0 0x564fadf9c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadf9c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564fadfa2250 con 0x564fadf94dc0 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564fadeb5050 con 0x564fadf944a0 2024-09-19T06:56:56.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564fadfa23d0 con 0x564fadf9f680 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbecaf23740 10 client.0 _ll_register_callbacks cb 0x564fadef5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbec259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf94dc0 0x564fadf9c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbec259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf94dc0 0x564fadf9c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55408/0 (socket says 172.21.15.159:55408) 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbec259c640 1 -- 172.21.15.159:0/3779990177 learned_addr learned my addr 172.21.15.159:0/3779990177 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbebbfff640 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf944a0 0x564fadf9efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.900+0000 7fbebbfff640 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadf9c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbec259c640 1 -- 172.21.15.159:0/3779990177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 msgr2=0x564fadf9c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbec259c640 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadf9c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbec259c640 1 -- 172.21.15.159:0/3779990177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf944a0 msgr2=0x564fadf9efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbec259c640 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf944a0 0x564fadf9efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbec259c640 1 -- 172.21.15.159:0/3779990177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fadc6b3c0 con 0x564fadf94dc0 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbebbfff640 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf944a0 0x564fadf9efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbec259c640 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf94dc0 0x564fadf9c270 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009ee0 tx=0x7fbeb4011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44e73be43eab6b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbea9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbea9ffb640 1 -- 172.21.15.159:0/3779990177 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4019070 con 0x564fadf94dc0 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbea9ffb640 1 -- 172.21.15.159:0/3779990177 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7fbeb4015660 con 0x564fadf94dc0 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbecaf23740 1 -- 172.21.15.159:0/3779990177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbeac041030 con 0x564fadf94dc0 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbea9ffb640 1 -- 172.21.15.159:0/3779990177 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbeb4025050 con 0x564fadf94dc0 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbecaf23740 10 client.17409 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbecaf23740 1 -- 172.21.15.159:0/3779990177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564fadfadc60 con 0x564fadf94dc0 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbea9ffb640 1 -- 172.21.15.159:0/3779990177 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbeac041030 con 0x564fadf94dc0 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbea9ffb640 1 -- 172.21.15.159:0/3779990177 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fbeb4014b60 con 0x564fadf94dc0 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbecaf23740 10 client.17409 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:56.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.901+0000 7fbecaf23740 10 client.17409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.902+0000 7fbecaf23740 20 client.17409 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.902+0000 7fbecaf23740 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564fadfaf110 0x564fadfb1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.902+0000 7fbecaf23740 4 client.17409 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.902+0000 7fbecaf23740 1 -- 172.21.15.159:0/3779990177 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fadf07850 con 0x564fadfaf110 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.902+0000 7fbebbfff640 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564fadfaf110 0x564fadfb1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.902+0000 7fbea9ffb640 10 client.17409 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.902+0000 7fbebbfff640 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564fadfaf110 0x564fadfb1530 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf05e388bb25b1bc server_cookie=97e0f26c83160032 in_seq=0 out_seq=0 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbea9ffb640 1 -- 172.21.15.159:0/3779990177 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fadf07850 con 0x564fadfaf110 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbea9ffb640 10 client.17409 handle_command_reply: tid=0 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbecaf23740 1 client.17409 shutdown 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbecaf23740 1 -- 172.21.15.159:0/3779990177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf94dc0 msgr2=0x564fadf9c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbecaf23740 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf94dc0 0x564fadf9c270 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009ee0 tx=0x7fbeb4011630 comp rx=0 tx=0).stop 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbecaf23740 1 -- 172.21.15.159:0/3779990177 shutdown_connections 2024-09-19T06:56:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbecaf23740 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564fadfaf110 0x564fadfb1530 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbecaf23740 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadf9c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbecaf23740 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf94dc0 0x564fadf9c270 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbecaf23740 1 --2- 172.21.15.159:0/3779990177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf944a0 0x564fadf9efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbea9ffb640 0 client.17409 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.903+0000 7fbecaf23740 1 -- 172.21.15.159:0/3779990177 >> 172.21.15.159:0/3779990177 conn(0x564fadf90a30 msgr2=0x564fadf96760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.904+0000 7fbecaf23740 1 -- 172.21.15.159:0/3779990177 shutdown_connections 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.904+0000 7fbecaf23740 1 -- 172.21.15.159:0/3779990177 wait complete. 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.904+0000 7fbecaf23740 20 client.17409 trim_cache size 0 max 16384 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.920+0000 7fbecaf23740 1 Processor -- start 2024-09-19T06:56:56.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.920+0000 7fbecaf23740 1 -- start start 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.920+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf94dc0 0x564fadfb6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf9f680 0x564fadfb7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbecaf23740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbec41ab940 con 0x564fadf944a0 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbecaf23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbec41ae1a0 con 0x564fadf9f680 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbecaf23740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbec41abf90 con 0x564fadf94dc0 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfab4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55412/0 (socket says 172.21.15.159:55412) 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbebbfff640 1 -- 172.21.15.159:0/1210588918 learned_addr learned my addr 172.21.15.159:0/1210588918 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbebbfff640 1 -- 172.21.15.159:0/1210588918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf94dc0 msgr2=0x564fadfb6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:56.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbebbfff640 1 --2- 172.21.15.159:0/1210588918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf94dc0 0x564fadfb6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbebbfff640 1 -- 172.21.15.159:0/1210588918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf9f680 msgr2=0x564fadfb7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:56.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbebbfff640 1 --2- 172.21.15.159:0/1210588918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf9f680 0x564fadfb7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbebbfff640 1 -- 172.21.15.159:0/1210588918 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fadf942d0 con 0x564fadf944a0 2024-09-19T06:56:56.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbebbfff640 1 --2- 172.21.15.159:0/1210588918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfab4b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0315b0 tx=0x7fbeac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab815cb145d61b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:56.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbeabfff640 1 -- 172.21.15.159:0/1210588918 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac035040 con 0x564fadf944a0 2024-09-19T06:56:56.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbeabfff640 1 -- 172.21.15.159:0/1210588918 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbeac04e030 con 0x564fadf944a0 2024-09-19T06:56:56.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.921+0000 7fbeabfff640 1 -- 172.21.15.159:0/1210588918 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac004990 con 0x564fadf944a0 2024-09-19T06:56:56.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 -- 172.21.15.159:0/1210588918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 msgr2=0x564fadfab4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1210588918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfab4b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0315b0 tx=0x7fbeac000bc0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 -- 172.21.15.159:0/1210588918 shutdown_connections 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1210588918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf9f680 0x564fadfb7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1210588918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf94dc0 0x564fadfb6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1210588918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfab4b0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 -- 172.21.15.159:0/1210588918 >> 172.21.15.159:0/1210588918 conn(0x564fadf90a30 msgr2=0x564fadf9b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 -- 172.21.15.159:0/1210588918 shutdown_connections 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 -- 172.21.15.159:0/1210588918 wait complete. 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 -- start start 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.922+0000 7fbecaf23740 1 Processor -- start 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfa7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadfa3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadfa3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbec41ac660 con 0x564fadf944a0 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbec41adad0 con 0x564fadf94dc0 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbec41acd30 con 0x564fadf9f680 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 10 client.0 _ll_register_callbacks cb 0x7fbeb4009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfa7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfa7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55424/0 (socket says 172.21.15.159:55424) 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbebbfff640 1 -- 172.21.15.159:0/1199741069 learned_addr learned my addr 172.21.15.159:0/1199741069 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbec259c640 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadfa3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbebbfff640 1 -- 172.21.15.159:0/1199741069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 msgr2=0x564fadfa3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbebbfff640 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadfa3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbebbfff640 1 -- 172.21.15.159:0/1199741069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 msgr2=0x564fadfa3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbebbfff640 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadfa3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbebbfff640 1 -- 172.21.15.159:0/1199741069 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fadfa3ea0 con 0x564fadf944a0 2024-09-19T06:56:56.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbec259c640 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadfa3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbebbfff640 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfa7d90 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009a20 tx=0x7fbeac0058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f325b2ae93e859 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbea9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbea9ffb640 1 -- 172.21.15.159:0/1199741069 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac035070 con 0x564fadf944a0 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbea9ffb640 1 -- 172.21.15.159:0/1199741069 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8614+0+0 (secure 0 0 0) 0x7fbeac031be0 con 0x564fadf944a0 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 1 -- 172.21.15.159:0/1199741069 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbeac04e030 con 0x564fadf944a0 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbea9ffb640 1 -- 172.21.15.159:0/1199741069 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbeac031de0 con 0x564fadf944a0 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 10 client.17415 fetch_fsmap learned FSMap version 24 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.923+0000 7fbecaf23740 1 -- 172.21.15.159:0/1199741069 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564fae01e220 con 0x564fadf944a0 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.924+0000 7fbea9ffb640 1 -- 172.21.15.159:0/1199741069 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbeac04e030 con 0x564fadf944a0 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.924+0000 7fbea9ffb640 1 -- 172.21.15.159:0/1199741069 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fbeac051030 con 0x564fadf944a0 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.924+0000 7fbecaf23740 10 client.17415 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.924+0000 7fbecaf23740 10 client.17415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.924+0000 7fbecaf23740 20 client.17415 populate_metadata read hostname 'smithi159' 2024-09-19T06:56:56.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.924+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564fae01e450 0x564fae020840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.924+0000 7fbecaf23740 4 client.17415 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.924+0000 7fbecaf23740 1 -- 172.21.15.159:0/1199741069 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564fadf01d60 con 0x564fae01e450 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.924+0000 7fbec259c640 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564fae01e450 0x564fae020840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbea9ffb640 10 client.17415 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbec259c640 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564fae01e450 0x564fae020840 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48de055eacedf89 server_cookie=e163677004adefb4 in_seq=0 out_seq=0 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbea9ffb640 1 -- 172.21.15.159:0/1199741069 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564fadf01d60 con 0x564fae01e450 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbea9ffb640 10 client.17415 handle_command_reply: tid=0 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 client.17415 shutdown 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 -- 172.21.15.159:0/1199741069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 msgr2=0x564fadfa7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfa7d90 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009a20 tx=0x7fbeac0058c0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 -- 172.21.15.159:0/1199741069 shutdown_connections 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x564fae01e450 0x564fae020840 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564fadf9f680 0x564fadfa3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564fadf94dc0 0x564fadfa3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 --2- 172.21.15.159:0/1199741069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564fadf944a0 0x564fadfa7d90 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbea9ffb640 0 client.17415 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 -- 172.21.15.159:0/1199741069 >> 172.21.15.159:0/1199741069 conn(0x564fadf90a30 msgr2=0x564fadf9dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 -- 172.21.15.159:0/1199741069 shutdown_connections 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 1 -- 172.21.15.159:0/1199741069 wait complete. 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.925+0000 7fbecaf23740 20 client.17415 trim_cache size 0 max 16384 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:56:56.942 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": { 2024-09-19T06:56:56.943 INFO:teuthology.orchestra.run.smithi159.stdout: "24c56765-043e-421e-9562-211047e251d0": { 2024-09-19T06:56:56.943 INFO:teuthology.orchestra.run.smithi159.stdout: "path": "/", 2024-09-19T06:56:56.943 INFO:teuthology.orchestra.run.smithi159.stdout: "tag": "24c56765-043e-421e-9562-211047e251d0", 2024-09-19T06:56:56.943 INFO:teuthology.orchestra.run.smithi159.stdout: "options": "recursive,force" 2024-09-19T06:56:56.943 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:56:56.943 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:56:56.943 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:56:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 -- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbeb00a33b0 msgr2=0x7fbeb00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:56.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbeb00a33b0 0x7fbeb00a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbebc098bb0 tx=0x7fbebc066bd0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 -- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102ef0 msgr2=0x7fbec419ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102ef0 0x7fbec419ce30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00eaa0 tx=0x7fbebc00eea0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 -- 172.21.15.159:0/2014627327 shutdown_connections 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbeb00a33b0 0x7fbeb00a5870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbec4102ef0 0x7fbec419ce30 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbec4102570 0x7fbec4198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 --2- 172.21.15.159:0/2014627327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec4100e20 0x7fbec4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 -- 172.21.15.159:0/2014627327 >> 172.21.15.159:0/2014627327 conn(0x7fbec40fc7d0 msgr2=0x7fbec406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 -- 172.21.15.159:0/2014627327 shutdown_connections 2024-09-19T06:56:56.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:56:56.926+0000 7fbec8b4a640 1 -- 172.21.15.159:0/2014627327 wait complete. 2024-09-19T06:56:57.647 INFO:tasks.cephfs.filesystem:scrub status for tag:24c56765-043e-421e-9562-211047e251d0 - {'path': '/', 'tag': '24c56765-043e-421e-9562-211047e251d0', 'options': 'recursive,force'} 2024-09-19T06:56:57.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:57 smithi159 ceph-mon[30935]: pgmap v309: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:56:58.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:57 smithi203 ceph-mon[35473]: pgmap v309: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:56:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:57 smithi189 ceph-mon[34880]: pgmap v309: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-19T06:57:00.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:56:59 smithi203 ceph-mon[35473]: pgmap v310: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:57:00.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:56:59 smithi189 ceph-mon[34880]: pgmap v310: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:57:00.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:56:59 smithi159 ceph-mon[30935]: pgmap v310: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:57:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:00 smithi203 ceph-mon[35473]: scrub summary: idle 2024-09-19T06:57:01.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:00 smithi189 ceph-mon[34880]: scrub summary: idle 2024-09-19T06:57:01.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:00 smithi159 ceph-mon[30935]: scrub summary: idle 2024-09-19T06:57:02.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:01 smithi203 ceph-mon[35473]: pgmap v311: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:57:02.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:01 smithi189 ceph-mon[34880]: pgmap v311: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:57:02.723 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:01 smithi159 ceph-mon[30935]: pgmap v311: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-19T06:57:04.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:03 smithi203 ceph-mon[35473]: pgmap v312: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-09-19T06:57:04.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:03 smithi189 ceph-mon[34880]: pgmap v312: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-09-19T06:57:04.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:03 smithi159 ceph-mon[30935]: pgmap v312: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-09-19T06:57:06.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:05 smithi203 ceph-mon[35473]: pgmap v313: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:57:06.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:05 smithi189 ceph-mon[34880]: pgmap v313: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:57:06.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:05 smithi159 ceph-mon[30935]: pgmap v313: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T06:57:08.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:07 smithi203 ceph-mon[35473]: pgmap v314: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-09-19T06:57:08.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:07 smithi189 ceph-mon[34880]: pgmap v314: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-09-19T06:57:08.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:07 smithi159 ceph-mon[30935]: pgmap v314: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-09-19T06:57:10.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:09 smithi203 ceph-mon[35473]: pgmap v315: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:57:10.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:09 smithi189 ceph-mon[34880]: pgmap v315: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:57:10.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:09 smithi159 ceph-mon[30935]: pgmap v315: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T06:57:11.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:10 smithi203 ceph-mon[35473]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:57:11.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:10 smithi189 ceph-mon[34880]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:57:11.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:10 smithi159 ceph-mon[30935]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:57:11.561 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:57:11.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.672+0000 7f237a674640 1 -- 172.21.15.159:0/462004457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2374101350 msgr2=0x7f237410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:11.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.672+0000 7f237a674640 1 --2- 172.21.15.159:0/462004457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2374101350 0x7f237410d880 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f236c009cd0 tx=0x7f236c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.672+0000 7f237a674640 1 -- 172.21.15.159:0/462004457 shutdown_connections 2024-09-19T06:57:11.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.672+0000 7f237a674640 1 --2- 172.21.15.159:0/462004457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2374101350 0x7f237410d880 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.672+0000 7f237a674640 1 --2- 172.21.15.159:0/462004457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23741009b0 0x7f2374100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.672+0000 7f237a674640 1 --2- 172.21.15.159:0/462004457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23741069c0 0x7f2374106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.672+0000 7f237a674640 1 -- 172.21.15.159:0/462004457 >> 172.21.15.159:0/462004457 conn(0x7f2374077990 msgr2=0x7f23740fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:11.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.672+0000 7f237a674640 1 -- 172.21.15.159:0/462004457 shutdown_connections 2024-09-19T06:57:11.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.672+0000 7f237a674640 1 -- 172.21.15.159:0/462004457 wait complete. 2024-09-19T06:57:11.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f237a674640 1 Processor -- start 2024-09-19T06:57:11.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f237a674640 1 -- start start 2024-09-19T06:57:11.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f237a674640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23741009b0 0x7f23741982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:11.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f237a674640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2374101350 0x7f2374198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:11.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f237a674640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23741069c0 0x7f237419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:11.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f237a674640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2374110e00 con 0x7f23741069c0 2024-09-19T06:57:11.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f237a674640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2374110c80 con 0x7f23741009b0 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f237a674640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2374110f80 con 0x7f2374101350 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f2378c11640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23741069c0 0x7f237419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f2378c11640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23741069c0 0x7f237419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56234/0 (socket says 172.21.15.159:56234) 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f2378c11640 1 -- 172.21.15.159:0/162813051 learned_addr learned my addr 172.21.15.159:0/162813051 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.673+0000 7f23737fe640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2374101350 0x7f2374198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f2373fff640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23741009b0 0x7f23741982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f2378c11640 1 -- 172.21.15.159:0/162813051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2374101350 msgr2=0x7f2374198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f2378c11640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2374101350 0x7f2374198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f2378c11640 1 -- 172.21.15.159:0/162813051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23741009b0 msgr2=0x7f23741982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f2378c11640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23741009b0 0x7f23741982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f2378c11640 1 -- 172.21.15.159:0/162813051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237419d2c0 con 0x7f23741069c0 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f2378c11640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23741069c0 0x7f237419cb90 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f236c005cc0 tx=0x7f236c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f23717fa640 1 -- 172.21.15.159:0/162813051 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c004040 con 0x7f23741069c0 2024-09-19T06:57:11.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f23717fa640 1 -- 172.21.15.159:0/162813051 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f236c0046c0 con 0x7f23741069c0 2024-09-19T06:57:11.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237419d550 con 0x7f23741069c0 2024-09-19T06:57:11.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f23717fa640 1 -- 172.21.15.159:0/162813051 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c046480 con 0x7f23741069c0 2024-09-19T06:57:11.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.674+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23741a4e40 con 0x7f23741069c0 2024-09-19T06:57:11.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.675+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2374100e10 con 0x7f23741069c0 2024-09-19T06:57:11.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.676+0000 7f23717fa640 1 -- 172.21.15.159:0/162813051 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f236c0305a0 con 0x7f23741069c0 2024-09-19T06:57:11.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.677+0000 7f23717fa640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f235c0a3460 0x7f235c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:11.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.677+0000 7f2373fff640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f235c0a3460 0x7f235c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:11.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.677+0000 7f23717fa640 1 -- 172.21.15.159:0/162813051 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f236c02e030 con 0x7f23741069c0 2024-09-19T06:57:11.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.677+0000 7f2373fff640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f235c0a3460 0x7f235c0a5920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2364005d90 tx=0x7f2364005d20 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:11.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.681+0000 7f23717fa640 1 -- 172.21.15.159:0/162813051 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f236c04b060 con 0x7f23741069c0 2024-09-19T06:57:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.869+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2374062630 con 0x7f235c0a3460 2024-09-19T06:57:11.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.877+0000 7f23717fa640 1 -- 172.21.15.159:0/162813051 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f2374062630 con 0x7f235c0a3460 2024-09-19T06:57:11.878 INFO:teuthology.orchestra.run.smithi159.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:47:09", "first": "2024-09-19T06:48:00", "last": "2024-09-19T06:57:01", "last_pruned": "2024-09-19T06:57:01", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-19T06:57:11.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f235c0a3460 msgr2=0x7f235c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:11.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f235c0a3460 0x7f235c0a5920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2364005d90 tx=0x7f2364005d20 comp rx=0 tx=0).stop 2024-09-19T06:57:11.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23741069c0 msgr2=0x7f237419cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:11.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23741069c0 0x7f237419cb90 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f236c005cc0 tx=0x7f236c003970 comp rx=0 tx=0).stop 2024-09-19T06:57:11.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 shutdown_connections 2024-09-19T06:57:11.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f235c0a3460 0x7f235c0a5920 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23741069c0 0x7f237419cb90 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2374101350 0x7f2374198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 --2- 172.21.15.159:0/162813051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23741009b0 0x7f23741982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 >> 172.21.15.159:0/162813051 conn(0x7f2374077990 msgr2=0x7f2374069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:11.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 shutdown_connections 2024-09-19T06:57:11.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.879+0000 7f237a674640 1 -- 172.21.15.159:0/162813051 wait complete. 2024-09-19T06:57:11.891 DEBUG:teuthology.orchestra.run.smithi159:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:57:11.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.990+0000 7ff839c30640 1 -- 172.21.15.159:0/2801991512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 msgr2=0x7ff8341030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:11.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.990+0000 7ff839c30640 1 --2- 172.21.15.159:0/2801991512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 0x7ff8341030e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff824009900 tx=0x7ff82402a480 comp rx=0 tx=0).stop 2024-09-19T06:57:11.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.990+0000 7ff839c30640 1 -- 172.21.15.159:0/2801991512 shutdown_connections 2024-09-19T06:57:11.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.990+0000 7ff839c30640 1 --2- 172.21.15.159:0/2801991512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff83410c0d0 0x7ff83410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.990+0000 7ff839c30640 1 --2- 172.21.15.159:0/2801991512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834103620 0x7ff83410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.990+0000 7ff839c30640 1 --2- 172.21.15.159:0/2801991512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 0x7ff8341030e0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.990+0000 7ff839c30640 1 -- 172.21.15.159:0/2801991512 >> 172.21.15.159:0/2801991512 conn(0x7ff8340fc6f0 msgr2=0x7ff8340feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:11.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.990+0000 7ff839c30640 1 -- 172.21.15.159:0/2801991512 shutdown_connections 2024-09-19T06:57:11.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.990+0000 7ff839c30640 1 -- 172.21.15.159:0/2801991512 wait complete. 2024-09-19T06:57:11.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff839c30640 1 Processor -- start 2024-09-19T06:57:11.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff839c30640 1 -- start start 2024-09-19T06:57:11.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff839c30640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 0x7ff83419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:11.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff839c30640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff834103620 0x7ff83419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:11.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff839c30640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff83410c0d0 0x7ff83419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:11.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff839c30640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff834111f10 con 0x7ff834102d00 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff839c30640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff834111d90 con 0x7ff83410c0d0 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff839c30640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff834112090 con 0x7ff834103620 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 0x7ff83419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff8337fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 0x7ff83419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56248/0 (socket says 172.21.15.159:56248) 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff8337fe640 1 -- 172.21.15.159:0/2082024169 learned_addr learned my addr 172.21.15.159:0/2082024169 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff832ffd640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff834103620 0x7ff83419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff833fff640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff83410c0d0 0x7ff83419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff8337fe640 1 -- 172.21.15.159:0/2082024169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff834103620 msgr2=0x7ff83419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff8337fe640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff834103620 0x7ff83419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff8337fe640 1 -- 172.21.15.159:0/2082024169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff83410c0d0 msgr2=0x7ff83419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff8337fe640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff83410c0d0 0x7ff83419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:11.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff8337fe640 1 -- 172.21.15.159:0/2082024169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83419f570 con 0x7ff834102d00 2024-09-19T06:57:11.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff832ffd640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff834103620 0x7ff83419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:57:11.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.991+0000 7ff833fff640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff83410c0d0 0x7ff83419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:57:11.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.992+0000 7ff8337fe640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 0x7ff83419a580 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff824005ab0 tx=0x7ff824004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:11.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.992+0000 7ff830ff9640 1 -- 172.21.15.159:0/2082024169 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82403f030 con 0x7ff834102d00 2024-09-19T06:57:11.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.992+0000 7ff830ff9640 1 -- 172.21.15.159:0/2082024169 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff824003ce0 con 0x7ff834102d00 2024-09-19T06:57:11.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.992+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83419f800 con 0x7ff834102d00 2024-09-19T06:57:11.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.992+0000 7ff830ff9640 1 -- 172.21.15.159:0/2082024169 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff824035070 con 0x7ff834102d00 2024-09-19T06:57:11.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.992+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8341a70f0 con 0x7ff834102d00 2024-09-19T06:57:11.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.993+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff83406ab80 con 0x7ff834102d00 2024-09-19T06:57:11.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.994+0000 7ff830ff9640 1 -- 172.21.15.159:0/2082024169 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ff824042030 con 0x7ff834102d00 2024-09-19T06:57:11.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.995+0000 7ff830ff9640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff81c0a3460 0x7ff81c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:11.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.995+0000 7ff830ff9640 1 -- 172.21.15.159:0/2082024169 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7ff8240f0770 con 0x7ff834102d00 2024-09-19T06:57:11.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.995+0000 7ff832ffd640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff81c0a3460 0x7ff81c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:11.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.995+0000 7ff832ffd640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff81c0a3460 0x7ff81c0a5920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff83410ea00 tx=0x7ff828005d30 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:11.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:11.999+0000 7ff830ff9640 1 -- 172.21.15.159:0/2082024169 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff8240bd0c0 con 0x7ff834102d00 2024-09-19T06:57:12.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:11 smithi203 ceph-mon[35473]: pgmap v317: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:57:12.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:11 smithi189 ceph-mon[34880]: pgmap v317: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:57:12.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:11 smithi159 ceph-mon[30935]: pgmap v317: 97 pgs: 97 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T06:57:12.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.185+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 --> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7ff8341020b0 con 0x7ff81c0a3460 2024-09-19T06:57:12.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.192+0000 7ff830ff9640 1 -- 172.21.15.159:0/2082024169 <== mgr.15078 v2:172.21.15.159:6800/1835940314 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7ff8341020b0 con 0x7ff81c0a3460 2024-09-19T06:57:12.193 INFO:teuthology.orchestra.run.smithi159.stdout:/ 1m 6m3h 2024-09-19T06:57:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.194+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff81c0a3460 msgr2=0x7ff81c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.194+0000 7ff839c30640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff81c0a3460 0x7ff81c0a5920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff83410ea00 tx=0x7ff828005d30 comp rx=0 tx=0).stop 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.194+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 msgr2=0x7ff83419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.194+0000 7ff839c30640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 0x7ff83419a580 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff824005ab0 tx=0x7ff824004360 comp rx=0 tx=0).stop 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.195+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 shutdown_connections 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.195+0000 7ff839c30640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff81c0a3460 0x7ff81c0a5920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.195+0000 7ff839c30640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff83410c0d0 0x7ff83419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.195+0000 7ff839c30640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff834103620 0x7ff83419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.195+0000 7ff839c30640 1 --2- 172.21.15.159:0/2082024169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834102d00 0x7ff83419a580 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.195+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 >> 172.21.15.159:0/2082024169 conn(0x7ff8340fc6f0 msgr2=0x7ff83410d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.195+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 shutdown_connections 2024-09-19T06:57:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:12.195+0000 7ff839c30640 1 -- 172.21.15.159:0/2082024169 wait complete. 2024-09-19T06:57:12.206 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T06:57:12.217 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T06:57:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:12 smithi203 ceph-mon[35473]: from='client.17421 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:13.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:12 smithi203 ceph-mon[35473]: from='client.17427 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:13.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:12 smithi189 ceph-mon[34880]: from='client.17421 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:13.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:12 smithi189 ceph-mon[34880]: from='client.17427 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:13.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:12 smithi159 ceph-mon[30935]: from='client.17421 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:13.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:12 smithi159 ceph-mon[30935]: from='client.17427 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:14 smithi189 ceph-mon[34880]: pgmap v318: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:57:14.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:14 smithi189 ceph-mon[34880]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:57:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:14 smithi159 ceph-mon[30935]: pgmap v318: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:57:14.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:14 smithi159 ceph-mon[30935]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:57:15.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:14 smithi203 ceph-mon[35473]: pgmap v318: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T06:57:15.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:14 smithi203 ceph-mon[35473]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:57:15.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:15 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:57:15.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:15 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:57:15.992 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:15 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:57:16.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:16 smithi189 ceph-mon[34880]: pgmap v320: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T06:57:16.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:16 smithi159 ceph-mon[30935]: pgmap v320: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T06:57:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:16 smithi203 ceph-mon[35473]: pgmap v320: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-19T06:57:18.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: pgmap v321: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:57:18.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: Unable to set osd_memory_target on smithi189 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-19T06:57:18.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: Unable to set osd_memory_target on smithi159 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T06:57:18.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T06:57:18.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T06:57:18.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:57:18.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:57:18.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:17 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: pgmap v321: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:57:18.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: Unable to set osd_memory_target on smithi189 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: Unable to set osd_memory_target on smithi159 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.139 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.140 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.140 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T06:57:18.140 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T06:57:18.140 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:57:18.140 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:57:18.140 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:17 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: pgmap v321: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.148 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: Unable to set osd_memory_target on smithi189 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: Unable to set osd_memory_target on smithi159 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:57:18.149 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T06:57:18.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: Unable to set osd_memory_target on smithi203 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-19T06:57:18.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:57:18.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:57:18.150 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:17 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' 2024-09-19T06:57:20.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:19 smithi203 ceph-mon[35473]: pgmap v322: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 230 B/s wr, 6 op/s 2024-09-19T06:57:20.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:19 smithi189 ceph-mon[34880]: pgmap v322: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 230 B/s wr, 6 op/s 2024-09-19T06:57:20.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:19 smithi159 ceph-mon[30935]: pgmap v322: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 230 B/s wr, 6 op/s 2024-09-19T06:57:22.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:21 smithi203 ceph-mon[35473]: pgmap v323: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T06:57:22.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:21 smithi189 ceph-mon[34880]: pgmap v323: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T06:57:22.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:21 smithi159 ceph-mon[30935]: pgmap v323: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-19T06:57:24.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:23 smithi203 ceph-mon[35473]: pgmap v324: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T06:57:24.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:23 smithi189 ceph-mon[34880]: pgmap v324: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T06:57:24.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:23 smithi159 ceph-mon[30935]: pgmap v324: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T06:57:26.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:25 smithi203 ceph-mon[35473]: pgmap v325: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 4 op/s 2024-09-19T06:57:26.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:25 smithi189 ceph-mon[34880]: pgmap v325: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 4 op/s 2024-09-19T06:57:26.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:25 smithi159 ceph-mon[30935]: pgmap v325: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 92 B/s wr, 4 op/s 2024-09-19T06:57:27.648 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:57:27.911 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:28.032 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:27 smithi159 ceph-mon[30935]: pgmap v326: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T06:57:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:27 smithi203 ceph-mon[35473]: pgmap v326: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T06:57:28.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:27 smithi189 ceph-mon[34880]: pgmap v326: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T06:57:28.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 -- 172.21.15.159:0/3920029104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0101450 msgr2=0x7f2cf0105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:28.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/3920029104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0101450 0x7f2cf0105920 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009900 tx=0x7f2ce002a470 comp rx=0 tx=0).stop 2024-09-19T06:57:28.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 -- 172.21.15.159:0/3920029104 shutdown_connections 2024-09-19T06:57:28.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/3920029104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cf0105f40 0x7f2cf01063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/3920029104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0101450 0x7f2cf0105920 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/3920029104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cf0100b30 0x7f2cf0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 -- 172.21.15.159:0/3920029104 >> 172.21.15.159:0/3920029104 conn(0x7f2cf00fc7a0 msgr2=0x7f2cf00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:28.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 -- 172.21.15.159:0/3920029104 shutdown_connections 2024-09-19T06:57:28.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 -- 172.21.15.159:0/3920029104 wait complete. 2024-09-19T06:57:28.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.401+0000 7f2cf7d82640 1 Processor -- start 2024-09-19T06:57:28.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf7d82640 1 -- start start 2024-09-19T06:57:28.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf7d82640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cf0100b30 0x7f2cf01a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf7d82640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cf0101450 0x7f2cf01a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf7d82640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0105f40 0x7f2cf019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf7d82640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0118540 con 0x7f2cf0105f40 2024-09-19T06:57:28.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf7d82640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01183c0 con 0x7f2cf0100b30 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf7d82640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01186c0 con 0x7f2cf0101450 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf631f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0105f40 0x7f2cf019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf631f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0105f40 0x7f2cf019e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60732/0 (socket says 172.21.15.159:60732) 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf631f640 1 -- 172.21.15.159:0/2135848714 learned_addr learned my addr 172.21.15.159:0/2135848714 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cf0100b30 0x7f2cf01a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cf0101450 0x7f2cf01a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf631f640 1 -- 172.21.15.159:0/2135848714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cf0101450 msgr2=0x7f2cf01a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf631f640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cf0101450 0x7f2cf01a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf631f640 1 -- 172.21.15.159:0/2135848714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cf0100b30 msgr2=0x7f2cf01a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:28.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf631f640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cf0100b30 0x7f2cf01a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf631f640 1 -- 172.21.15.159:0/2135848714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf019f020 con 0x7f2cf0105f40 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cf0101450 0x7f2cf01a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.402+0000 7f2cf631f640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0105f40 0x7f2cf019e8f0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800eaa0 tx=0x7f2ce800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.403+0000 7f2ce6ffd640 1 -- 172.21.15.159:0/2135848714 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800cdb0 con 0x7f2cf0105f40 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.403+0000 7f2ce6ffd640 1 -- 172.21.15.159:0/2135848714 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ce8005020 con 0x7f2cf0105f40 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.403+0000 7f2ce6ffd640 1 -- 172.21.15.159:0/2135848714 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80116b0 con 0x7f2cf0105f40 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.403+0000 7f2cf7d82640 1 -- 172.21.15.159:0/2135848714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf019f310 con 0x7f2cf0105f40 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.403+0000 7f2cf7d82640 1 -- 172.21.15.159:0/2135848714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf01ab600 con 0x7f2cf0105f40 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2ce6ffd640 1 -- 172.21.15.159:0/2135848714 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2ce8005560 con 0x7f2cf0105f40 2024-09-19T06:57:28.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cfa15b740 1 Processor -- start 2024-09-19T06:57:28.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cfa15b740 1 -- start start 2024-09-19T06:57:28.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3be3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 0x5595b3bee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3bf0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5595b3b492e0 con 0x5595b3bee680 2024-09-19T06:57:28.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595b3af0ce0 con 0x5595b3be34a0 2024-09-19T06:57:28.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5595b3b452a0 con 0x5595b3be3dc0 2024-09-19T06:57:28.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cf531d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3bf0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cf531d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3bf0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60734/0 (socket says 172.21.15.159:60734) 2024-09-19T06:57:28.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cf531d640 1 -- 172.21.15.159:0/2371883326 learned_addr learned my addr 172.21.15.159:0/2371883326 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:28.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2371883326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3be3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.406+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/2371883326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 0x5595b3bee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2ce6ffd640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2cdc0a33b0 0x7f2cdc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cf631f640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2cdc0a33b0 0x7f2cdc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cf531d640 1 -- 172.21.15.159:0/2371883326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 msgr2=0x5595b3bee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:28.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2371883326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 0x5595b3bee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cf531d640 1 -- 172.21.15.159:0/2371883326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 msgr2=0x5595b3be3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:28.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2371883326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3be3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cf531d640 1 -- 172.21.15.159:0/2371883326 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b3ad5440 con 0x5595b3bee680 2024-09-19T06:57:28.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2ce6ffd640 1 -- 172.21.15.159:0/2135848714 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f2ce80cff70 con 0x7f2cf0105f40 2024-09-19T06:57:28.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2371883326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3bf0a70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00057c0 tx=0x7f2ce0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b253175e90fce0ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:28.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cdbfff640 1 -- 172.21.15.159:0/2371883326 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0045070 con 0x5595b3bee680 2024-09-19T06:57:28.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cf631f640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2cdc0a33b0 0x7f2cdc0a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2ce809c180 tx=0x7f2ce80054d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:28.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cdbfff640 1 -- 172.21.15.159:0/2371883326 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ce0031880 con 0x5595b3bee680 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.407+0000 7f2cdbfff640 1 -- 172.21.15.159:0/2371883326 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0035040 con 0x5595b3bee680 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2371883326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 msgr2=0x5595b3bf0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2371883326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3bf0a70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00057c0 tx=0x7f2ce0000bc0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2371883326 shutdown_connections 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2371883326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3bf0a70 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2371883326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 0x5595b3bee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2371883326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3be3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2371883326 >> 172.21.15.159:0/2371883326 conn(0x5595b3bdfa30 msgr2=0x5595b3bdfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2371883326 shutdown_connections 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2371883326 wait complete. 2024-09-19T06:57:28.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 -- start start 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.408+0000 7f2cfa15b740 1 Processor -- start 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3bee010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 0x5595b3beb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3beb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5595b3bf1250 con 0x5595b3bee680 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595b3b04050 con 0x5595b3be34a0 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5595b3bf13d0 con 0x5595b3be3dc0 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cfa15b740 10 client.0 _ll_register_callbacks cb 0x5595b3b44160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3beb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3beb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60750/0 (socket says 172.21.15.159:60750) 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 -- 172.21.15.159:0/2662979340 learned_addr learned my addr 172.21.15.159:0/2662979340 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:28.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 0x5595b3beb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3bee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 -- 172.21.15.159:0/2662979340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 msgr2=0x5595b3beb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:28.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 0x5595b3beb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 -- 172.21.15.159:0/2662979340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 msgr2=0x5595b3bee010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:28.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3bee010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 -- 172.21.15.159:0/2662979340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b38ba3c0 con 0x5595b3bee680 2024-09-19T06:57:28.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cf531d640 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3beb840 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0001eb0 tx=0x7f2ce00038d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556f1483099c5519 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:28.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.409+0000 7f2cd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:57:28.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cd97fa640 1 -- 172.21.15.159:0/2662979340 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce004e020 con 0x5595b3bee680 2024-09-19T06:57:28.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2662979340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce0031880 con 0x5595b3bee680 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cd97fa640 1 -- 172.21.15.159:0/2662979340 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f2ce003e400 con 0x5595b3bee680 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cd97fa640 1 -- 172.21.15.159:0/2662979340 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2ce0035070 con 0x5595b3bee680 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cfa15b740 10 client.17439 fetch_fsmap learned FSMap version 24 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2662979340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5595b3bfcc40 con 0x5595b3bee680 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cd97fa640 1 -- 172.21.15.159:0/2662979340 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ce0031880 con 0x5595b3bee680 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cd97fa640 1 -- 172.21.15.159:0/2662979340 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f2ce003a040 con 0x5595b3bee680 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cfa15b740 10 client.17439 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cfa15b740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cfa15b740 20 client.17439 populate_metadata read hostname 'smithi159' 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5595b3bfdf90 0x5595b3c00380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cfa15b740 4 client.17439 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.410+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2662979340 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595b3b56850 con 0x5595b3bfdf90 2024-09-19T06:57:28.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.411+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5595b3bfdf90 0x5595b3c00380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.411+0000 7f2cd97fa640 10 client.17439 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:57:28.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.411+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5595b3bfdf90 0x5595b3c00380 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eab128627ee3d6d8 server_cookie=86121ea806ef29a1 in_seq=0 out_seq=0 2024-09-19T06:57:28.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cd97fa640 1 -- 172.21.15.159:0/2662979340 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595b3b56850 con 0x5595b3bfdf90 2024-09-19T06:57:28.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cd97fa640 10 client.17439 handle_command_reply: tid=0 2024-09-19T06:57:28.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 client.17439 shutdown 2024-09-19T06:57:28.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2662979340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 msgr2=0x5595b3beb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:28.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3beb840 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0001eb0 tx=0x7f2ce00038d0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2662979340 shutdown_connections 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5595b3bfdf90 0x5595b3c00380 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3bee680 0x5595b3beb840 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be3dc0 0x5595b3beb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/2662979340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3bee010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cd97fa640 0 client.17439 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2662979340 >> 172.21.15.159:0/2662979340 conn(0x5595b3bdfa30 msgr2=0x5595b3be5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2662979340 shutdown_connections 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 1 -- 172.21.15.159:0/2662979340 wait complete. 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.412+0000 7f2cfa15b740 20 client.17439 trim_cache size 0 max 16384 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cfa15b740 1 Processor -- start 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cfa15b740 1 -- start start 2024-09-19T06:57:28.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be34a0 0x5595b3bdfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3be8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3bee680 0x5595b3be8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01b20c0 con 0x5595b3be3dc0 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01b4920 con 0x5595b3bee680 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01b2710 con 0x5595b3be34a0 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cf5b1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3be8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cf5b1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3be8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60760/0 (socket says 172.21.15.159:60760) 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cf5b1e640 1 -- 172.21.15.159:0/3625395416 learned_addr learned my addr 172.21.15.159:0/3625395416 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cf531d640 1 --2- 172.21.15.159:0/3625395416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be34a0 0x5595b3bdfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cf5b1e640 1 -- 172.21.15.159:0/3625395416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be34a0 msgr2=0x5595b3bdfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/3625395416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be34a0 0x5595b3bdfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cf5b1e640 1 -- 172.21.15.159:0/3625395416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3bee680 msgr2=0x5595b3be8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/3625395416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3bee680 0x5595b3be8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.429+0000 7f2cf5b1e640 1 -- 172.21.15.159:0/3625395416 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b3bee380 con 0x5595b3be3dc0 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/3625395416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3be8540 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00bdd0 tx=0x7f2cec00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8cb9990fa8444b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cdb7fe640 1 -- 172.21.15.159:0/3625395416 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec004220 con 0x5595b3be3dc0 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cdb7fe640 1 -- 172.21.15.159:0/3625395416 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cec0043c0 con 0x5595b3be3dc0 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cdb7fe640 1 -- 172.21.15.159:0/3625395416 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0035f0 con 0x5595b3be3dc0 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cfa15b740 1 -- 172.21.15.159:0/3625395416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 msgr2=0x5595b3be8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/3625395416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3be8540 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00bdd0 tx=0x7f2cec00b410 comp rx=0 tx=0).stop 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cfa15b740 1 -- 172.21.15.159:0/3625395416 shutdown_connections 2024-09-19T06:57:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/3625395416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3bee680 0x5595b3be8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/3625395416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3be8540 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/3625395416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3be34a0 0x5595b3bdfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cfa15b740 1 -- 172.21.15.159:0/3625395416 >> 172.21.15.159:0/3625395416 conn(0x5595b3bdfa30 msgr2=0x5595b3be68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cfa15b740 1 -- 172.21.15.159:0/3625395416 shutdown_connections 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.430+0000 7f2cfa15b740 1 -- 172.21.15.159:0/3625395416 wait complete. 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cfa15b740 1 -- start start 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cfa15b740 1 Processor -- start 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3c5fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3c60160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cfa15b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3bee680 0x5595b3c00980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01b2de0 con 0x5595b3be3dc0 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01b4250 con 0x5595b3be34a0 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cfa15b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01b34b0 con 0x5595b3bee680 2024-09-19T06:57:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cfa15b740 10 client.0 _ll_register_callbacks cb 0x7f2ce0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:57:28.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cf5b1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3c60160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cf5b1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3c60160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60774/0 (socket says 172.21.15.159:60774) 2024-09-19T06:57:28.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.431+0000 7f2cf5b1e640 1 -- 172.21.15.159:0/122399467 learned_addr learned my addr 172.21.15.159:0/122399467 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:28.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cf531d640 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3bee680 0x5595b3c00980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cf5b1e640 1 -- 172.21.15.159:0/122399467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3bee680 msgr2=0x5595b3c00980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:28.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3bee680 0x5595b3c00980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cf5b1e640 1 -- 172.21.15.159:0/122399467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 msgr2=0x5595b3c5fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3c5fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cf5b1e640 1 -- 172.21.15.159:0/122399467 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b3c01160 con 0x5595b3be3dc0 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cf5b1e640 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3c60160 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00b6c0 tx=0x7f2cec004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f3c5b3aea3bd84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cd97fa640 1 -- 172.21.15.159:0/122399467 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec031020 con 0x5595b3be3dc0 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cd97fa640 1 -- 172.21.15.159:0/122399467 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f2cec0035f0 con 0x5595b3be3dc0 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cfa15b740 1 -- 172.21.15.159:0/122399467 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cec0043c0 con 0x5595b3be3dc0 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cd97fa640 1 -- 172.21.15.159:0/122399467 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2cec029040 con 0x5595b3be3dc0 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cfa15b740 10 client.17445 fetch_fsmap learned FSMap version 24 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cfa15b740 1 -- 172.21.15.159:0/122399467 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5595b3c683d0 con 0x5595b3be3dc0 2024-09-19T06:57:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cd97fa640 1 -- 172.21.15.159:0/122399467 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cec0043c0 con 0x5595b3be3dc0 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cd97fa640 1 -- 172.21.15.159:0/122399467 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7f2cec02c050 con 0x5595b3be3dc0 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cfa15b740 10 client.17445 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cfa15b740 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cfa15b740 20 client.17445 populate_metadata read hostname 'smithi159' 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5595b3c68b70 0x5595b3c6af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cfa15b740 4 client.17445 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.432+0000 7f2cfa15b740 1 -- 172.21.15.159:0/122399467 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5595b3b50d60 con 0x5595b3c68b70 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.433+0000 7f2cf531d640 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5595b3c68b70 0x5595b3c6af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.433+0000 7f2cf531d640 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5595b3c68b70 0x5595b3c6af90 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9892a849a684eb70 server_cookie=bd615f0291c6cf51 in_seq=0 out_seq=0 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.433+0000 7f2cd97fa640 10 client.17445 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.433+0000 7f2cd97fa640 1 -- 172.21.15.159:0/122399467 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5595b3b50d60 con 0x5595b3c68b70 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.433+0000 7f2cd97fa640 10 client.17445 handle_command_reply: tid=0 2024-09-19T06:57:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.433+0000 7f2cfa15b740 1 client.17445 shutdown 2024-09-19T06:57:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.433+0000 7f2cfa15b740 1 -- 172.21.15.159:0/122399467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 msgr2=0x5595b3c60160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.433+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3c60160 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00b6c0 tx=0x7f2cec004180 comp rx=0 tx=0).stop 2024-09-19T06:57:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cfa15b740 1 -- 172.21.15.159:0/122399467 shutdown_connections 2024-09-19T06:57:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5595b3c68b70 0x5595b3c6af90 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5595b3bee680 0x5595b3c00980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5595b3be3dc0 0x5595b3c60160 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cd97fa640 0 client.17445 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:57:28.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cfa15b740 1 --2- 172.21.15.159:0/122399467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595b3be34a0 0x5595b3c5fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cfa15b740 1 -- 172.21.15.159:0/122399467 >> 172.21.15.159:0/122399467 conn(0x5595b3bdfa30 msgr2=0x5595b3bde350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:28.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cfa15b740 1 -- 172.21.15.159:0/122399467 shutdown_connections 2024-09-19T06:57:28.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cfa15b740 1 -- 172.21.15.159:0/122399467 wait complete. 2024-09-19T06:57:28.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cfa15b740 20 client.17445 trim_cache size 0 max 16384 2024-09-19T06:57:28.468 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:57:28.468 INFO:teuthology.orchestra.run.smithi159.stdout: "status": "no active scrubs running", 2024-09-19T06:57:28.468 INFO:teuthology.orchestra.run.smithi159.stdout: "scrubs": {} 2024-09-19T06:57:28.468 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:57:28.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 -- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2cdc0a33b0 msgr2=0x7f2cdc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:28.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2cdc0a33b0 0x7f2cdc0a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2ce809c180 tx=0x7f2ce80054d0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 -- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0105f40 msgr2=0x7f2cf019e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:28.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0105f40 0x7f2cf019e8f0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800eaa0 tx=0x7f2ce800ef60 comp rx=0 tx=0).stop 2024-09-19T06:57:28.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 -- 172.21.15.159:0/2135848714 shutdown_connections 2024-09-19T06:57:28.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f2cdc0a33b0 0x7f2cdc0a5870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2cf0105f40 0x7f2cf019e8f0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2cf0101450 0x7f2cf01a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 --2- 172.21.15.159:0/2135848714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cf0100b30 0x7f2cf01a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:28.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 -- 172.21.15.159:0/2135848714 >> 172.21.15.159:0/2135848714 conn(0x7f2cf00fc7a0 msgr2=0x7f2cf00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:28.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 -- 172.21.15.159:0/2135848714 shutdown_connections 2024-09-19T06:57:28.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:28.434+0000 7f2cf7d82640 1 -- 172.21.15.159:0/2135848714 wait complete. 2024-09-19T06:57:29.221 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:57:29.222 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:57:29.475 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:29.864 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:29 smithi159 ceph-mon[30935]: pgmap v327: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:29.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.942+0000 7ff550273640 1 -- 172.21.15.159:0/1771795502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548100a80 msgr2=0x7ff548100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.942+0000 7ff550273640 1 --2- 172.21.15.159:0/1771795502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548100a80 0x7ff548100ee0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff538009930 tx=0x7ff53802a420 comp rx=0 tx=0).stop 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.942+0000 7ff550273640 1 -- 172.21.15.159:0/1771795502 shutdown_connections 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.942+0000 7ff550273640 1 --2- 172.21.15.159:0/1771795502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff548101420 0x7ff54810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.942+0000 7ff550273640 1 --2- 172.21.15.159:0/1771795502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548100a80 0x7ff548100ee0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.942+0000 7ff550273640 1 --2- 172.21.15.159:0/1771795502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff548106a80 0x7ff548106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.942+0000 7ff550273640 1 -- 172.21.15.159:0/1771795502 >> 172.21.15.159:0/1771795502 conn(0x7ff5480fc7a0 msgr2=0x7ff5480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.942+0000 7ff550273640 1 -- 172.21.15.159:0/1771795502 shutdown_connections 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.942+0000 7ff550273640 1 -- 172.21.15.159:0/1771795502 wait complete. 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.943+0000 7ff550273640 1 Processor -- start 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.943+0000 7ff550273640 1 -- start start 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.943+0000 7ff550273640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff548100a80 0x7ff548197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.943+0000 7ff550273640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff548101420 0x7ff548197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff550273640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548106a80 0x7ff54819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff550273640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff548110ea0 con 0x7ff548106a80 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff550273640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff548110d20 con 0x7ff548101420 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff550273640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff548111020 con 0x7ff548100a80 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e810640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548106a80 0x7ff54819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e810640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548106a80 0x7ff54819bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34922/0 (socket says 172.21.15.159:34922) 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e810640 1 -- 172.21.15.159:0/3953006499 learned_addr learned my addr 172.21.15.159:0/3953006499 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e00f640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff548100a80 0x7ff548197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54d80e640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff548101420 0x7ff548197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e810640 1 -- 172.21.15.159:0/3953006499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff548100a80 msgr2=0x7ff548197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e810640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff548100a80 0x7ff548197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e810640 1 -- 172.21.15.159:0/3953006499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff548101420 msgr2=0x7ff548197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e810640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff548101420 0x7ff548197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e810640 1 -- 172.21.15.159:0/3953006499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54819c2f0 con 0x7ff548106a80 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54d80e640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff548101420 0x7ff548197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff54e810640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548106a80 0x7ff54819bc10 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff54000b970 tx=0x7ff54000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff53f7fe640 1 -- 172.21.15.159:0/3953006499 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540019070 con 0x7ff548106a80 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff53f7fe640 1 -- 172.21.15.159:0/3953006499 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff540014440 con 0x7ff548106a80 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff54819c5e0 con 0x7ff548106a80 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff53f7fe640 1 -- 172.21.15.159:0/3953006499 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5400075d0 con 0x7ff548106a80 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.944+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5481a3ec0 con 0x7ff548106a80 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.945+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff548100ee0 con 0x7ff548106a80 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.946+0000 7ff53f7fe640 1 -- 172.21.15.159:0/3953006499 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ff54001c070 con 0x7ff548106a80 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.947+0000 7ff53f7fe640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff5340a3430 0x7ff5340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.947+0000 7ff54e00f640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff5340a3430 0x7ff5340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:29.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.947+0000 7ff53f7fe640 1 -- 172.21.15.159:0/3953006499 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7ff5400cf630 con 0x7ff548106a80 2024-09-19T06:57:29.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.948+0000 7ff54e00f640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff5340a3430 0x7ff5340a58f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff54400abe0 tx=0x7ff54400a2d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:29.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:29.950+0000 7ff53f7fe640 1 -- 172.21.15.159:0/3953006499 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff54009c0c0 con 0x7ff548106a80 2024-09-19T06:57:30.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:29 smithi203 ceph-mon[35473]: pgmap v327: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:30.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:29 smithi189 ceph-mon[34880]: pgmap v327: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:30.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.150+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5481986a0 con 0x7ff548106a80 2024-09-19T06:57:30.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.151+0000 7ff53f7fe640 1 -- 172.21.15.159:0/3953006499 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7ff5481986a0 con 0x7ff548106a80 2024-09-19T06:57:30.152 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:57:30.152 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:57:30.153 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:57:30.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff5340a3430 msgr2=0x7ff5340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:30.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff5340a3430 0x7ff5340a58f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff54400abe0 tx=0x7ff54400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:57:30.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548106a80 msgr2=0x7ff54819bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:30.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548106a80 0x7ff54819bc10 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff54000b970 tx=0x7ff54000bd70 comp rx=0 tx=0).stop 2024-09-19T06:57:30.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 shutdown_connections 2024-09-19T06:57:30.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7ff5340a3430 0x7ff5340a58f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:30.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff548106a80 0x7ff54819bc10 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:30.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff548101420 0x7ff548197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:30.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 --2- 172.21.15.159:0/3953006499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff548100a80 0x7ff548197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:30.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 >> 172.21.15.159:0/3953006499 conn(0x7ff5480fc7a0 msgr2=0x7ff5480fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:30.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 shutdown_connections 2024-09-19T06:57:30.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:30.153+0000 7ff550273640 1 -- 172.21.15.159:0/3953006499 wait complete. 2024-09-19T06:57:30.812 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:57:31.060 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:30 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3953006499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:31.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:30 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3953006499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:31.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:30 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3953006499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:31.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 -- 172.21.15.159:0/3257145888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274101420 msgr2=0x7fd27410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:31.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 --2- 172.21.15.159:0/3257145888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274101420 0x7fd27410d950 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009cd0 tx=0x7fd26c02a8f0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 -- 172.21.15.159:0/3257145888 shutdown_connections 2024-09-19T06:57:31.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 --2- 172.21.15.159:0/3257145888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274101420 0x7fd27410d950 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 --2- 172.21.15.159:0/3257145888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd274100a80 0x7fd274100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 --2- 172.21.15.159:0/3257145888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd274106a80 0x7fd274106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 -- 172.21.15.159:0/3257145888 >> 172.21.15.159:0/3257145888 conn(0x7fd2740fc7a0 msgr2=0x7fd2740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:31.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 -- 172.21.15.159:0/3257145888 shutdown_connections 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 -- 172.21.15.159:0/3257145888 wait complete. 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.529+0000 7fd27a649640 1 Processor -- start 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd27a649640 1 -- start start 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd27a649640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd274100a80 0x7fd2741972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd27a649640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd274101420 0x7fd274197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd27a649640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274106a80 0x7fd27419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd27a649640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd274110ea0 con 0x7fd274106a80 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd27a649640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd274110d20 con 0x7fd274101420 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd27a649640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd274111020 con 0x7fd274100a80 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd278be6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274106a80 0x7fd27419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd278be6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274106a80 0x7fd27419bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34940/0 (socket says 172.21.15.159:34940) 2024-09-19T06:57:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd278be6640 1 -- 172.21.15.159:0/3874893247 learned_addr learned my addr 172.21.15.159:0/3874893247 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd273fff640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd274100a80 0x7fd2741972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd2737fe640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd274101420 0x7fd274197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd278be6640 1 -- 172.21.15.159:0/3874893247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd274100a80 msgr2=0x7fd2741972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd278be6640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd274100a80 0x7fd2741972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd278be6640 1 -- 172.21.15.159:0/3874893247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd274101420 msgr2=0x7fd274197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd278be6640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd274101420 0x7fd274197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.530+0000 7fd278be6640 1 -- 172.21.15.159:0/3874893247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27419c290 con 0x7fd274106a80 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.531+0000 7fd278be6640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274106a80 0x7fd27419bbb0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009ca0 tx=0x7fd26c0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.531+0000 7fd2717fa640 1 -- 172.21.15.159:0/3874893247 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c004040 con 0x7fd274106a80 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.531+0000 7fd27a649640 1 -- 172.21.15.159:0/3874893247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27419c520 con 0x7fd274106a80 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.531+0000 7fd2717fa640 1 -- 172.21.15.159:0/3874893247 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd26c040070 con 0x7fd274106a80 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.531+0000 7fd2717fa640 1 -- 172.21.15.159:0/3874893247 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c045da0 con 0x7fd274106a80 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.531+0000 7fd27a649640 1 -- 172.21.15.159:0/3874893247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2741a3e60 con 0x7fd274106a80 2024-09-19T06:57:31.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.533+0000 7fd2717fa640 1 -- 172.21.15.159:0/3874893247 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd26c0041e0 con 0x7fd274106a80 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.533+0000 7fd27ca22740 1 Processor -- start 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.533+0000 7fd27ca22740 1 -- start start 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd2717fa640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd2600a33b0 0x7fd2600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 0x5621318382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 0x562131838c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131847d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd27ca22740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56213179c2f0 con 0x562131845970 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd27ca22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562131743cf0 con 0x562131839c30 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd27ca22740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5621317982b0 con 0x5621318387e0 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd2717fa640 1 -- 172.21.15.159:0/3874893247 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7fd26c0f10b0 con 0x7fd274106a80 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd2737fe640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd2600a33b0 0x7fd2600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd278be6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131847d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd273fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 0x5621318382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd273fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 0x5621318382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.159:60664/0 (socket says 172.21.15.159:60664) 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd278be6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131847d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34952/0 (socket says 172.21.15.159:34952) 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd2737fe640 1 --2- 172.21.15.159:0/3369598889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 0x562131838c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd273fff640 1 -- 172.21.15.159:0/3369598889 learned_addr learned my addr 172.21.15.159:0/3369598889 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd278be6640 1 -- 172.21.15.159:0/3369598889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 msgr2=0x562131838c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd278be6640 1 --2- 172.21.15.159:0/3369598889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 0x562131838c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd278be6640 1 -- 172.21.15.159:0/3369598889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 msgr2=0x5621318382a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd278be6640 1 --2- 172.21.15.159:0/3369598889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 0x5621318382a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd278be6640 1 -- 172.21.15.159:0/3369598889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621317283a0 con 0x562131845970 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd2737fe640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd2600a33b0 0x7fd2600a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd25c006fd0 tx=0x7fd25c014660 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.534+0000 7fd278be6640 1 --2- 172.21.15.159:0/3369598889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131847d60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0ee8b0 tx=0x7fd26c0bd2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6485a50df2198f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:31.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd26a7fc640 1 -- 172.21.15.159:0/3369598889 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0bd440 con 0x562131845970 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd26a7fc640 1 -- 172.21.15.159:0/3369598889 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd26c036040 con 0x562131845970 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd26a7fc640 1 -- 172.21.15.159:0/3369598889 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0b9ab0 con 0x562131845970 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd27ca22740 1 -- 172.21.15.159:0/3369598889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 msgr2=0x562131847d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd27ca22740 1 --2- 172.21.15.159:0/3369598889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131847d60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0ee8b0 tx=0x7fd26c0bd2d0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd27ca22740 1 -- 172.21.15.159:0/3369598889 shutdown_connections 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd27ca22740 1 --2- 172.21.15.159:0/3369598889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131847d60 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd27ca22740 1 --2- 172.21.15.159:0/3369598889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 0x562131838c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd27ca22740 1 --2- 172.21.15.159:0/3369598889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 0x5621318382a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd27ca22740 1 -- 172.21.15.159:0/3369598889 >> 172.21.15.159:0/3369598889 conn(0x5621317ff310 msgr2=0x562131834e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd27ca22740 1 -- 172.21.15.159:0/3369598889 shutdown_connections 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.535+0000 7fd27ca22740 1 -- 172.21.15.159:0/3369598889 wait complete. 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.536+0000 7fd27ca22740 1 -- start start 2024-09-19T06:57:31.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.536+0000 7fd27ca22740 1 Processor -- start 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.536+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 0x562131845340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.536+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 0x5621318425f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.536+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131842be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.536+0000 7fd27ca22740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x562131848300 con 0x562131845970 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.536+0000 7fd27ca22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562131757060 con 0x562131839c30 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.536+0000 7fd27ca22740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562131848480 con 0x5621318387e0 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.536+0000 7fd27ca22740 10 client.0 _ll_register_callbacks cb 0x5621314aa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd278be6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131842be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd278be6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131842be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34968/0 (socket says 172.21.15.159:34968) 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd278be6640 1 -- 172.21.15.159:0/1984393096 learned_addr learned my addr 172.21.15.159:0/1984393096 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd2737fe640 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 0x5621318425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd273fff640 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 0x562131845340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd278be6640 1 -- 172.21.15.159:0/1984393096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 msgr2=0x562131845340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:31.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd278be6640 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 0x562131845340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd278be6640 1 -- 172.21.15.159:0/1984393096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 msgr2=0x5621318425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd278be6640 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 0x5621318425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd278be6640 1 -- 172.21.15.159:0/1984393096 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56213150d3c0 con 0x562131845970 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd273fff640 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 0x562131845340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd278be6640 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131842be0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0eeda0 tx=0x7fd26c02a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666784b592d6ee40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd2537fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd2537fe640 1 -- 172.21.15.159:0/1984393096 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0c60b0 con 0x562131845970 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd27ca22740 1 -- 172.21.15.159:0/1984393096 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd26c036040 con 0x562131845970 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd2537fe640 1 -- 172.21.15.159:0/1984393096 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7fd26c0b9ab0 con 0x562131845970 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd2537fe640 1 -- 172.21.15.159:0/1984393096 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd26c0bd440 con 0x562131845970 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd27ca22740 10 client.17463 fetch_fsmap learned FSMap version 24 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd27ca22740 1 -- 172.21.15.159:0/1984393096 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562131848300 con 0x562131845970 2024-09-19T06:57:31.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.537+0000 7fd2537fe640 1 -- 172.21.15.159:0/1984393096 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd26c036040 con 0x562131845970 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd2537fe640 1 -- 172.21.15.159:0/1984393096 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd26c04d030 con 0x562131845970 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd27ca22740 10 client.17463 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd27ca22740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd27ca22740 20 client.17463 populate_metadata read hostname 'smithi159' 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd27ca22740 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562131854fc0 0x5621318573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd27ca22740 4 client.17463 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd27ca22740 1 -- 172.21.15.159:0/1984393096 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621317a9860 con 0x562131854fc0 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd273fff640 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562131854fc0 0x5621318573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd273fff640 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562131854fc0 0x5621318573e0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2d67eb154d8ecfa server_cookie=507c0924bc89ab34 in_seq=0 out_seq=0 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.538+0000 7fd2537fe640 10 client.17463 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd2537fe640 1 -- 172.21.15.159:0/1984393096 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621317a9860 con 0x562131854fc0 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd2537fe640 10 client.17463 handle_command_reply: tid=0 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 client.17463 shutdown 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 -- 172.21.15.159:0/1984393096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 msgr2=0x562131842be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:31.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131842be0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0eeda0 tx=0x7fd26c02a8f0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 -- 172.21.15.159:0/1984393096 shutdown_connections 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x562131854fc0 0x5621318573e0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131845970 0x562131842be0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd2537fe640 0 client.17463 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562131839c30 0x5621318425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 --2- 172.21.15.159:0/1984393096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621318387e0 0x562131845340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 -- 172.21.15.159:0/1984393096 >> 172.21.15.159:0/1984393096 conn(0x5621317ff310 msgr2=0x56213183abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 -- 172.21.15.159:0/1984393096 shutdown_connections 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.539+0000 7fd27ca22740 1 -- 172.21.15.159:0/1984393096 wait complete. 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.540+0000 7fd27ca22740 20 client.17463 trim_cache size 0 max 16384 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd27ca22740 1 Processor -- start 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd27ca22740 1 -- start start 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 0x5621318514d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131840040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562131845970 0x562131832320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd27ca22740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741a9610 con 0x562131839c30 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd27ca22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741abe70 con 0x5621318387e0 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd27ca22740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741a9c60 con 0x562131845970 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd2737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131840040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd2737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131840040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34974/0 (socket says 172.21.15.159:34974) 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.553+0000 7fd2737fe640 1 -- 172.21.15.159:0/709957385 learned_addr learned my addr 172.21.15.159:0/709957385 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd273fff640 1 --2- 172.21.15.159:0/709957385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 0x5621318514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd2737fe640 1 -- 172.21.15.159:0/709957385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562131845970 msgr2=0x562131832320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd2737fe640 1 --2- 172.21.15.159:0/709957385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562131845970 0x562131832320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd2737fe640 1 -- 172.21.15.159:0/709957385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 msgr2=0x5621318514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd2737fe640 1 --2- 172.21.15.159:0/709957385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 0x5621318514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd2737fe640 1 -- 172.21.15.159:0/709957385 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621318415c0 con 0x562131839c30 2024-09-19T06:57:31.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd273fff640 1 --2- 172.21.15.159:0/709957385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 0x5621318514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:57:31.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd2737fe640 1 --2- 172.21.15.159:0/709957385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131840040 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x562131835cd0 tx=0x7fd25c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf70b874a4fc5472 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:31.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd269ffb640 1 -- 172.21.15.159:0/709957385 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c022850 con 0x562131839c30 2024-09-19T06:57:31.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd269ffb640 1 -- 172.21.15.159:0/709957385 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd25c027070 con 0x562131839c30 2024-09-19T06:57:31.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.554+0000 7fd269ffb640 1 -- 172.21.15.159:0/709957385 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c016c10 con 0x562131839c30 2024-09-19T06:57:31.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 -- 172.21.15.159:0/709957385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 msgr2=0x562131840040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:31.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 --2- 172.21.15.159:0/709957385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131840040 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x562131835cd0 tx=0x7fd25c01a000 comp rx=0 tx=0).stop 2024-09-19T06:57:31.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 -- 172.21.15.159:0/709957385 shutdown_connections 2024-09-19T06:57:31.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 --2- 172.21.15.159:0/709957385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562131845970 0x562131832320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 --2- 172.21.15.159:0/709957385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131840040 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 --2- 172.21.15.159:0/709957385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 0x5621318514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 -- 172.21.15.159:0/709957385 >> 172.21.15.159:0/709957385 conn(0x5621317ff310 msgr2=0x56213183f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 -- 172.21.15.159:0/709957385 shutdown_connections 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 -- 172.21.15.159:0/709957385 wait complete. 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 -- start start 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 Processor -- start 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 0x5621318320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131832600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562131845970 0x562131832b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.555+0000 7fd27ca22740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741aa330 con 0x562131839c30 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd27ca22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741ab7a0 con 0x5621318387e0 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd27ca22740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741aaa00 con 0x562131845970 2024-09-19T06:57:31.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd27ca22740 10 client.0 _ll_register_callbacks cb 0x7fd26400c3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd2737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131832600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd2737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131832600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34976/0 (socket says 172.21.15.159:34976) 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd2737fe640 1 -- 172.21.15.159:0/2943882864 learned_addr learned my addr 172.21.15.159:0/2943882864 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd273fff640 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 0x5621318320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd278be6640 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562131845970 0x562131832b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd2737fe640 1 -- 172.21.15.159:0/2943882864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562131845970 msgr2=0x562131832b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd2737fe640 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562131845970 0x562131832b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd2737fe640 1 -- 172.21.15.159:0/2943882864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 msgr2=0x5621318320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd2737fe640 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 0x5621318320c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd2737fe640 1 -- 172.21.15.159:0/2943882864 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562131857750 con 0x562131839c30 2024-09-19T06:57:31.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.556+0000 7fd2737fe640 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131832600 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd25c000c00 tx=0x7fd25c009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad5b9da3fe2f640 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd2537fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd2537fe640 1 -- 172.21.15.159:0/2943882864 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c031070 con 0x562131839c30 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd2537fe640 1 -- 172.21.15.159:0/2943882864 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7fd25c016e20 con 0x562131839c30 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd27ca22740 1 -- 172.21.15.159:0/2943882864 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd25c027070 con 0x562131839c30 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd2537fe640 1 -- 172.21.15.159:0/2943882864 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd25c0059c0 con 0x562131839c30 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd27ca22740 10 client.17469 fetch_fsmap learned FSMap version 24 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd27ca22740 1 -- 172.21.15.159:0/2943882864 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5621318bfdf0 con 0x562131839c30 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd2537fe640 1 -- 172.21.15.159:0/2943882864 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd25c027070 con 0x562131839c30 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd2537fe640 1 -- 172.21.15.159:0/2943882864 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 8330+0+0 (secure 0 0 0) 0x7fd25c006140 con 0x562131839c30 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd27ca22740 10 client.17469 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd27ca22740 10 client.17469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd27ca22740 20 client.17469 populate_metadata read hostname 'smithi159' 2024-09-19T06:57:31.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd27ca22740 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5621318c0540 0x5621318c2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:31.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd27ca22740 4 client.17469 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:57:31.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.557+0000 7fd27ca22740 1 -- 172.21.15.159:0/2943882864 --> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5621317a3d70 con 0x5621318c0540 2024-09-19T06:57:31.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd273fff640 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5621318c0540 0x5621318c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:31.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd2537fe640 10 client.17469 ms_handle_connect on v2:172.21.15.203:6838/3762709136 2024-09-19T06:57:31.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd273fff640 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5621318c0540 0x5621318c2960 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54cfe6b3e72829a0 server_cookie=aec6d2c3435575d5 in_seq=0 out_seq=0 2024-09-19T06:57:31.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd2537fe640 1 -- 172.21.15.159:0/2943882864 <== mds.0 v2:172.21.15.203:6838/3762709136 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621317a3d70 con 0x5621318c0540 2024-09-19T06:57:31.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd2537fe640 10 client.17469 handle_command_reply: tid=0 2024-09-19T06:57:31.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 client.17469 shutdown 2024-09-19T06:57:31.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 -- 172.21.15.159:0/2943882864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 msgr2=0x562131832600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:31.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131832600 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd25c000c00 tx=0x7fd25c009e50 comp rx=0 tx=0).stop 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 -- 172.21.15.159:0/2943882864 shutdown_connections 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.203:6838/3762709136,v1:172.21.15.203:6839/3762709136] conn(0x5621318c0540 0x5621318c2960 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562131845970 0x562131832b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562131839c30 0x562131832600 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd2537fe640 0 client.17469 ms_handle_reset on v2:172.21.15.203:6838/3762709136 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 --2- 172.21.15.159:0/2943882864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621318387e0 0x5621318320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 -- 172.21.15.159:0/2943882864 >> 172.21.15.159:0/2943882864 conn(0x5621317ff310 msgr2=0x562131840150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 -- 172.21.15.159:0/2943882864 shutdown_connections 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.558+0000 7fd27ca22740 1 -- 172.21.15.159:0/2943882864 wait complete. 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27ca22740 20 client.17469 trim_cache size 0 max 16384 2024-09-19T06:57:31.576 INFO:teuthology.orchestra.run.smithi159.stdout:[] 2024-09-19T06:57:31.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 -- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd2600a33b0 msgr2=0x7fd2600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:31.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd2600a33b0 0x7fd2600a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd25c006fd0 tx=0x7fd25c014660 comp rx=0 tx=0).stop 2024-09-19T06:57:31.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 -- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274106a80 msgr2=0x7fd27419bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:31.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274106a80 0x7fd27419bbb0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009ca0 tx=0x7fd26c0039f0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 -- 172.21.15.159:0/3874893247 shutdown_connections 2024-09-19T06:57:31.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fd2600a33b0 0x7fd2600a5870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd274106a80 0x7fd27419bbb0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd274101420 0x7fd274197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 --2- 172.21.15.159:0/3874893247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd274100a80 0x7fd2741972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:31.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 -- 172.21.15.159:0/3874893247 >> 172.21.15.159:0/3874893247 conn(0x7fd2740fc7a0 msgr2=0x7fd2740fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:31.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 -- 172.21.15.159:0/3874893247 shutdown_connections 2024-09-19T06:57:31.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:31.559+0000 7fd27a649640 1 -- 172.21.15.159:0/3874893247 wait complete. 2024-09-19T06:57:32.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:31 smithi203 ceph-mon[35473]: pgmap v328: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:32.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:31 smithi189 ceph-mon[34880]: pgmap v328: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:32.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:31 smithi159 ceph-mon[30935]: pgmap v328: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:32.300 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T06:57:32.301 INFO:tasks.fwd_scrub:done joining 2024-09-19T06:57:32.301 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T06:57:32.315 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:57:32.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 -- 172.21.15.159:0/2488753957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 msgr2=0x7fc4541004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 --2- 172.21.15.159:0/2488753957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 0x7fc4541004a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009900 tx=0x7fc43c02a410 comp rx=0 tx=0).stop 2024-09-19T06:57:32.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 -- 172.21.15.159:0/2488753957 shutdown_connections 2024-09-19T06:57:32.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 --2- 172.21.15.159:0/2488753957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4541009e0 0x7fc45410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 --2- 172.21.15.159:0/2488753957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 0x7fc4541004a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 --2- 172.21.15.159:0/2488753957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc454107c50 0x7fc454108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 -- 172.21.15.159:0/2488753957 >> 172.21.15.159:0/2488753957 conn(0x7fc4540771e0 msgr2=0x7fc4540fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 -- 172.21.15.159:0/2488753957 shutdown_connections 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 -- 172.21.15.159:0/2488753957 wait complete. 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.416+0000 7fc45b0af640 1 Processor -- start 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc45b0af640 1 -- start start 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc45b0af640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 0x7fc454101220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc45b0af640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4541009e0 0x7fc454101760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc45b0af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc454107c50 0x7fc454101ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc45b0af640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc454111fb0 con 0x7fc454100040 2024-09-19T06:57:32.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc45b0af640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc454111e30 con 0x7fc4541009e0 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc45b0af640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc454112130 con 0x7fc454107c50 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc458e4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 0x7fc454101220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc458e4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 0x7fc454101220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34986/0 (socket says 172.21.15.159:34986) 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc458e4b640 1 -- 172.21.15.159:0/545271053 learned_addr learned my addr 172.21.15.159:0/545271053 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc453fff640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4541009e0 0x7fc454101760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc458e4b640 1 -- 172.21.15.159:0/545271053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc454107c50 msgr2=0x7fc454101ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc458e4b640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc454107c50 0x7fc454101ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc458e4b640 1 -- 172.21.15.159:0/545271053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4541009e0 msgr2=0x7fc454101760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc458e4b640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4541009e0 0x7fc454101760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc458e4b640 1 -- 172.21.15.159:0/545271053 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4541a6940 con 0x7fc454100040 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc458e4b640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 0x7fc454101220 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c920 tx=0x7fc44400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc451ffb640 1 -- 172.21.15.159:0/545271053 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444007c70 con 0x7fc454100040 2024-09-19T06:57:32.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc451ffb640 1 -- 172.21.15.159:0/545271053 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc444007e10 con 0x7fc454100040 2024-09-19T06:57:32.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc451ffb640 1 -- 172.21.15.159:0/545271053 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444018890 con 0x7fc454100040 2024-09-19T06:57:32.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.417+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4541a6c30 con 0x7fc454100040 2024-09-19T06:57:32.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.418+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4541a71d0 con 0x7fc454100040 2024-09-19T06:57:32.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.419+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4541004a0 con 0x7fc454100040 2024-09-19T06:57:32.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.419+0000 7fc451ffb640 1 -- 172.21.15.159:0/545271053 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc444018a70 con 0x7fc454100040 2024-09-19T06:57:32.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.420+0000 7fc451ffb640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4400a3440 0x7fc4400a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:32.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.421+0000 7fc453fff640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4400a3440 0x7fc4400a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:32.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.421+0000 7fc451ffb640 1 -- 172.21.15.159:0/545271053 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7fc4440cfe80 con 0x7fc454100040 2024-09-19T06:57:32.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.421+0000 7fc453fff640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4400a3440 0x7fc4400a5900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc454102cb0 tx=0x7fc43c031490 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:32.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.425+0000 7fc451ffb640 1 -- 172.21.15.159:0/545271053 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc444014030 con 0x7fc454100040 2024-09-19T06:57:32.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.592+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4541a7400 con 0x7fc454100040 2024-09-19T06:57:32.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.593+0000 7fc451ffb640 1 -- 172.21.15.159:0/545271053 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23402 (secure 0 0 0) 0x7fc44400de20 con 0x7fc454100040 2024-09-19T06:57:32.594 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:57:32.595 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":92,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:57:13.623013+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:6800/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2156136647":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2526477703":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3276076186":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3424652308":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3763048477":"2024-09-20T06:47:00.531421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:57:32.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4400a3440 msgr2=0x7fc4400a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4400a3440 0x7fc4400a5900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc454102cb0 tx=0x7fc43c031490 comp rx=0 tx=0).stop 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 msgr2=0x7fc454101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 0x7fc454101220 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c920 tx=0x7fc44400cde0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 shutdown_connections 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fc4400a3440 0x7fc4400a5900 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc454107c50 0x7fc454101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4541009e0 0x7fc454101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 --2- 172.21.15.159:0/545271053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454100040 0x7fc454101220 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.595+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 >> 172.21.15.159:0/545271053 conn(0x7fc4540771e0 msgr2=0x7fc4541049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.596+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 shutdown_connections 2024-09-19T06:57:32.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.596+0000 7fc45b0af640 1 -- 172.21.15.159:0/545271053 wait complete. 2024-09-19T06:57:32.608 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:40:47.637521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:45:19.566504+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:45:21.598793+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:57:32.609 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:57:32.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.711+0000 7f4285277640 1 -- 172.21.15.159:0/1955248031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280106990 msgr2=0x7f4280106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.711+0000 7f4285277640 1 --2- 172.21.15.159:0/1955248031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280106990 0x7f4280106d70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4270009930 tx=0x7f427002a420 comp rx=0 tx=0).stop 2024-09-19T06:57:32.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.711+0000 7f4285277640 1 -- 172.21.15.159:0/1955248031 shutdown_connections 2024-09-19T06:57:32.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.712+0000 7f4285277640 1 --2- 172.21.15.159:0/1955248031 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4280101320 0x7f428010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.712+0000 7f4285277640 1 --2- 172.21.15.159:0/1955248031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4280100980 0x7f4280100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.712+0000 7f4285277640 1 --2- 172.21.15.159:0/1955248031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280106990 0x7f4280106d70 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.712+0000 7f4285277640 1 -- 172.21.15.159:0/1955248031 >> 172.21.15.159:0/1955248031 conn(0x7f42800779d0 msgr2=0x7f42800fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:32.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.712+0000 7f4285277640 1 -- 172.21.15.159:0/1955248031 shutdown_connections 2024-09-19T06:57:32.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.712+0000 7f4285277640 1 -- 172.21.15.159:0/1955248031 wait complete. 2024-09-19T06:57:32.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.712+0000 7f4285277640 1 Processor -- start 2024-09-19T06:57:32.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.712+0000 7f4285277640 1 -- start start 2024-09-19T06:57:32.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.712+0000 7f4285277640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4280100980 0x7f4280198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:32.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f4285277640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280101320 0x7f4280198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:32.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f4285277640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4280106990 0x7f428019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:32.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f4285277640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4280110dd0 con 0x7f4280101320 2024-09-19T06:57:32.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f4285277640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4280110c50 con 0x7f4280100980 2024-09-19T06:57:32.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f4285277640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4280110f50 con 0x7f4280106990 2024-09-19T06:57:32.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f42767fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280101320 0x7f4280198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f42767fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280101320 0x7f4280198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35010/0 (socket says 172.21.15.159:35010) 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f42767fc640 1 -- 172.21.15.159:0/1887436474 learned_addr learned my addr 172.21.15.159:0/1887436474 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f427effd640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4280100980 0x7f4280198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f427f7fe640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4280106990 0x7f428019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f42767fc640 1 -- 172.21.15.159:0/1887436474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4280106990 msgr2=0x7f428019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f42767fc640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4280106990 0x7f428019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f42767fc640 1 -- 172.21.15.159:0/1887436474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4280100980 msgr2=0x7f4280198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f42767fc640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4280100980 0x7f4280198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f42767fc640 1 -- 172.21.15.159:0/1887436474 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428019d410 con 0x7f4280101320 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f42767fc640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280101320 0x7f4280198960 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f426800d770 tx=0x7f426800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f427cff9640 1 -- 172.21.15.159:0/1887436474 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268017070 con 0x7f4280101320 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f427cff9640 1 -- 172.21.15.159:0/1887436474 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4268005500 con 0x7f4280101320 2024-09-19T06:57:32.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f427cff9640 1 -- 172.21.15.159:0/1887436474 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268004e00 con 0x7f4280101320 2024-09-19T06:57:32.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428019d700 con 0x7f4280101320 2024-09-19T06:57:32.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.713+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42801a4f90 con 0x7f4280101320 2024-09-19T06:57:32.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.714+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4280100de0 con 0x7f4280101320 2024-09-19T06:57:32.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.716+0000 7f427cff9640 1 -- 172.21.15.159:0/1887436474 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4268004fa0 con 0x7f4280101320 2024-09-19T06:57:32.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.716+0000 7f427cff9640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f426c0a33c0 0x7f426c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:32.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.717+0000 7f427effd640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f426c0a33c0 0x7f426c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:32.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.717+0000 7f427cff9640 1 -- 172.21.15.159:0/1887436474 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f42680cfc10 con 0x7f4280101320 2024-09-19T06:57:32.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.717+0000 7f427effd640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f426c0a33c0 0x7f426c0a5880 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4270009900 tx=0x7f42700058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:32.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.720+0000 7f427cff9640 1 -- 172.21.15.159:0/1887436474 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f426809c530 con 0x7f4280101320 2024-09-19T06:57:32.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.888+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f42801a51f0 con 0x7f4280101320 2024-09-19T06:57:32.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.888+0000 7f427cff9640 1 -- 172.21.15.159:0/1887436474 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f426809be30 con 0x7f4280101320 2024-09-19T06:57:32.889 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-09-19T06:57:32.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f426c0a33c0 msgr2=0x7f426c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f426c0a33c0 0x7f426c0a5880 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4270009900 tx=0x7f42700058d0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280101320 msgr2=0x7f4280198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:32.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280101320 0x7f4280198960 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f426800d770 tx=0x7f426800dc30 comp rx=0 tx=0).stop 2024-09-19T06:57:32.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 shutdown_connections 2024-09-19T06:57:32.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f426c0a33c0 0x7f426c0a5880 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4280106990 0x7f428019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4280101320 0x7f4280198960 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 --2- 172.21.15.159:0/1887436474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4280100980 0x7f4280198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:32.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 >> 172.21.15.159:0/1887436474 conn(0x7f42800779d0 msgr2=0x7f42800ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:32.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 shutdown_connections 2024-09-19T06:57:32.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:32.890+0000 7f4285277640 1 -- 172.21.15.159:0/1887436474 wait complete. 2024-09-19T06:57:32.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:32 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/545271053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:57:32.902 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:57:33.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 -- 172.21.15.159:0/4214030291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 msgr2=0x7fe7dc10d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 --2- 172.21.15.159:0/4214030291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 0x7fe7dc10d860 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009cd0 tx=0x7fe7d402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 -- 172.21.15.159:0/4214030291 shutdown_connections 2024-09-19T06:57:33.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 --2- 172.21.15.159:0/4214030291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 0x7fe7dc10d860 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 --2- 172.21.15.159:0/4214030291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7dc100990 0x7fe7dc100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 --2- 172.21.15.159:0/4214030291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7dc1069a0 0x7fe7dc106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 -- 172.21.15.159:0/4214030291 >> 172.21.15.159:0/4214030291 conn(0x7fe7dc0fc6b0 msgr2=0x7fe7dc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:33.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 -- 172.21.15.159:0/4214030291 shutdown_connections 2024-09-19T06:57:33.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 -- 172.21.15.159:0/4214030291 wait complete. 2024-09-19T06:57:33.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.004+0000 7fe7e122e640 1 Processor -- start 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7e122e640 1 -- start start 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7e122e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7dc100990 0x7fe7dc199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7e122e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 0x7fe7dc199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7e122e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7dc1069a0 0x7fe7dc1a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7e122e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc110e40 con 0x7fe7dc101330 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7e122e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc110cc0 con 0x7fe7dc100990 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7e122e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc110fc0 con 0x7fe7dc1069a0 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7da59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 0x7fe7dc199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7da59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 0x7fe7dc199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35028/0 (socket says 172.21.15.159:35028) 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7da59c640 1 -- 172.21.15.159:0/1558733939 learned_addr learned my addr 172.21.15.159:0/1558733939 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:33.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7db59e640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7dc1069a0 0x7fe7dc1a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7dad9d640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7dc100990 0x7fe7dc199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7da59c640 1 -- 172.21.15.159:0/1558733939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7dc1069a0 msgr2=0x7fe7dc1a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7da59c640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7dc1069a0 0x7fe7dc1a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7da59c640 1 -- 172.21.15.159:0/1558733939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7dc100990 msgr2=0x7fe7dc199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7da59c640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7dc100990 0x7fe7dc199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7da59c640 1 -- 172.21.15.159:0/1558733939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7dc1a48f0 con 0x7fe7dc101330 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.005+0000 7fe7dad9d640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7dc100990 0x7fe7dc199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.006+0000 7fe7da59c640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 0x7fe7dc199870 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400b4a0 tx=0x7fe7c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.006+0000 7fe7d3fff640 1 -- 172.21.15.159:0/1558733939 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4014070 con 0x7fe7dc101330 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.006+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7dc1a4ac0 con 0x7fe7dc101330 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.006+0000 7fe7d3fff640 1 -- 172.21.15.159:0/1558733939 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7c4010af0 con 0x7fe7dc101330 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.006+0000 7fe7d3fff640 1 -- 172.21.15.159:0/1558733939 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4017d10 con 0x7fe7dc101330 2024-09-19T06:57:33.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.006+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7dc1a4fe0 con 0x7fe7dc101330 2024-09-19T06:57:33.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.007+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7dc100e70 con 0x7fe7dc101330 2024-09-19T06:57:33.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.008+0000 7fe7d3fff640 1 -- 172.21.15.159:0/1558733939 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe7c4017070 con 0x7fe7dc101330 2024-09-19T06:57:33.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.009+0000 7fe7d3fff640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe7c80a33c0 0x7fe7c80a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.009+0000 7fe7dad9d640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe7c80a33c0 0x7fe7c80a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.009+0000 7fe7d3fff640 1 -- 172.21.15.159:0/1558733939 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7fe7c40cf090 con 0x7fe7dc101330 2024-09-19T06:57:33.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.010+0000 7fe7dad9d640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe7c80a33c0 0x7fe7c80a5880 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc006fd0 tx=0x7fe7cc008040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:33.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.013+0000 7fe7d3fff640 1 -- 172.21.15.159:0/1558733939 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe7c409bb20 con 0x7fe7dc101330 2024-09-19T06:57:33.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:32 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/545271053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:57:33.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:32 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/545271053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:57:33.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.181+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe7dc108f20 con 0x7fe7dc101330 2024-09-19T06:57:33.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.181+0000 7fe7d3fff640 1 -- 172.21.15.159:0/1558733939 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7fe7c409b420 con 0x7fe7dc101330 2024-09-19T06:57:33.183 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-09-19T06:57:33.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.183+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe7c80a33c0 msgr2=0x7fe7c80a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.183+0000 7fe7e122e640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe7c80a33c0 0x7fe7c80a5880 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc006fd0 tx=0x7fe7cc008040 comp rx=0 tx=0).stop 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.183+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 msgr2=0x7fe7dc199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.183+0000 7fe7e122e640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 0x7fe7dc199870 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400b4a0 tx=0x7fe7c400b960 comp rx=0 tx=0).stop 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.183+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 shutdown_connections 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.183+0000 7fe7e122e640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fe7c80a33c0 0x7fe7c80a5880 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.184+0000 7fe7e122e640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7dc1069a0 0x7fe7dc1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.184+0000 7fe7e122e640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7dc101330 0x7fe7dc199870 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.184+0000 7fe7e122e640 1 --2- 172.21.15.159:0/1558733939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7dc100990 0x7fe7dc199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.184+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 >> 172.21.15.159:0/1558733939 conn(0x7fe7dc0fc6b0 msgr2=0x7fe7dc0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:33.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.184+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 shutdown_connections 2024-09-19T06:57:33.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.184+0000 7fe7e122e640 1 -- 172.21.15.159:0/1558733939 wait complete. 2024-09-19T06:57:33.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:57:33.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 -- 172.21.15.159:0/2282669434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c101a80 msgr2=0x7f7f5c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 --2- 172.21.15.159:0/2282669434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c101a80 0x7f7f5c101ee0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009930 tx=0x7f7f5002a420 comp rx=0 tx=0).stop 2024-09-19T06:57:33.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 -- 172.21.15.159:0/2282669434 shutdown_connections 2024-09-19T06:57:33.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 --2- 172.21.15.159:0/2282669434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f5c102420 0x7f7f5c10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 --2- 172.21.15.159:0/2282669434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c101a80 0x7f7f5c101ee0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 --2- 172.21.15.159:0/2282669434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f5c107a90 0x7f7f5c107e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 -- 172.21.15.159:0/2282669434 >> 172.21.15.159:0/2282669434 conn(0x7f7f5c0fd7c0 msgr2=0x7f7f5c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 -- 172.21.15.159:0/2282669434 shutdown_connections 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 -- 172.21.15.159:0/2282669434 wait complete. 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 Processor -- start 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.297+0000 7f7f642e4640 1 -- start start 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f642e4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f5c101a80 0x7f7f5c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f642e4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c102420 0x7f7f5c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f642e4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f5c107a90 0x7f7f5c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f642e4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c111ed0 con 0x7f7f5c102420 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f642e4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c111d50 con 0x7f7f5c107a90 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f642e4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c112050 con 0x7f7f5c101a80 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f6187f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c102420 0x7f7f5c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f6187f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c102420 0x7f7f5c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35040/0 (socket says 172.21.15.159:35040) 2024-09-19T06:57:33.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f6187f640 1 -- 172.21.15.159:0/3979473773 learned_addr learned my addr 172.21.15.159:0/3979473773 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f62881640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f5c107a90 0x7f7f5c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f62080640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f5c101a80 0x7f7f5c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f6187f640 1 -- 172.21.15.159:0/3979473773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f5c101a80 msgr2=0x7f7f5c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f6187f640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f5c101a80 0x7f7f5c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f6187f640 1 -- 172.21.15.159:0/3979473773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f5c107a90 msgr2=0x7f7f5c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f6187f640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f5c107a90 0x7f7f5c19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f6187f640 1 -- 172.21.15.159:0/3979473773 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c19d450 con 0x7f7f5c102420 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f6187f640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c102420 0x7f7f5c1989a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009230 tx=0x7f7f50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f4f7fe640 1 -- 172.21.15.159:0/3979473773 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5003f030 con 0x7f7f5c102420 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f4f7fe640 1 -- 172.21.15.159:0/3979473773 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f50003ad0 con 0x7f7f5c102420 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c19d6e0 con 0x7f7f5c102420 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f4f7fe640 1 -- 172.21.15.159:0/3979473773 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50035070 con 0x7f7f5c102420 2024-09-19T06:57:33.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.298+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c1a4fd0 con 0x7f7f5c102420 2024-09-19T06:57:33.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.299+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5c101ee0 con 0x7f7f5c102420 2024-09-19T06:57:33.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.301+0000 7f7f4f7fe640 1 -- 172.21.15.159:0/3979473773 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7f50042030 con 0x7f7f5c102420 2024-09-19T06:57:33.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.301+0000 7f7f4f7fe640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7f480a33c0 0x7f7f480a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.301+0000 7f7f62080640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7f480a33c0 0x7f7f480a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.301+0000 7f7f4f7fe640 1 -- 172.21.15.159:0/3979473773 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f7f500f0630 con 0x7f7f5c102420 2024-09-19T06:57:33.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.302+0000 7f7f62080640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7f480a33c0 0x7f7f480a5880 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7f58005fd0 tx=0x7f7f5800b510 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:33.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.305+0000 7f7f4f7fe640 1 -- 172.21.15.159:0/3979473773 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f500bcfb0 con 0x7f7f5c102420 2024-09-19T06:57:33.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.471+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7f5c10a010 con 0x7f7f5c102420 2024-09-19T06:57:33.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.471+0000 7f7f4f7fe640 1 -- 172.21.15.159:0/3979473773 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7f7f500bc8b0 con 0x7f7f5c102420 2024-09-19T06:57:33.473 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 64 2024-09-19T06:57:33.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7f480a33c0 msgr2=0x7f7f480a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7f480a33c0 0x7f7f480a5880 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7f58005fd0 tx=0x7f7f5800b510 comp rx=0 tx=0).stop 2024-09-19T06:57:33.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c102420 msgr2=0x7f7f5c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c102420 0x7f7f5c1989a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009230 tx=0x7f7f50004270 comp rx=0 tx=0).stop 2024-09-19T06:57:33.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 shutdown_connections 2024-09-19T06:57:33.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7f480a33c0 0x7f7f480a5880 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f5c107a90 0x7f7f5c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f5c102420 0x7f7f5c1989a0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 --2- 172.21.15.159:0/3979473773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f5c101a80 0x7f7f5c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 >> 172.21.15.159:0/3979473773 conn(0x7f7f5c0fd7c0 msgr2=0x7f7f5c0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:33.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 shutdown_connections 2024-09-19T06:57:33.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.473+0000 7f7f642e4640 1 -- 172.21.15.159:0/3979473773 wait complete. 2024-09-19T06:57:33.486 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T06:57:33.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.585+0000 7fbfb57f1640 1 -- 172.21.15.159:0/714471380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb01069d0 msgr2=0x7fbfb0106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.585+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/714471380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb01069d0 0x7fbfb0106db0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009930 tx=0x7fbfa002a420 comp rx=0 tx=0).stop 2024-09-19T06:57:33.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.585+0000 7fbfb57f1640 1 -- 172.21.15.159:0/714471380 shutdown_connections 2024-09-19T06:57:33.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.585+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/714471380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfb0101360 0x7fbfb010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.585+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/714471380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb01009c0 0x7fbfb0100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.585+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/714471380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb01069d0 0x7fbfb0106db0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.585+0000 7fbfb57f1640 1 -- 172.21.15.159:0/714471380 >> 172.21.15.159:0/714471380 conn(0x7fbfb00fc6a0 msgr2=0x7fbfb00feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.585+0000 7fbfb57f1640 1 -- 172.21.15.159:0/714471380 shutdown_connections 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.585+0000 7fbfb57f1640 1 -- 172.21.15.159:0/714471380 wait complete. 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfb57f1640 1 Processor -- start 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfb57f1640 1 -- start start 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfb57f1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfb01009c0 0x7fbfb010e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfb57f1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb0101360 0x7fbfb010e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfb57f1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb01069d0 0x7fbfb010eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfb57f1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0111f00 con 0x7fbfb0101360 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfb57f1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0111d80 con 0x7fbfb01009c0 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfb57f1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0112080 con 0x7fbfb01069d0 2024-09-19T06:57:33.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfa7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb0101360 0x7fbfb010e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfa7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb0101360 0x7fbfb010e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35058/0 (socket says 172.21.15.159:35058) 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfa7fff640 1 -- 172.21.15.159:0/1563318273 learned_addr learned my addr 172.21.15.159:0/1563318273 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfaeffd640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfb01009c0 0x7fbfb010e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfaf7fe640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb01069d0 0x7fbfb010eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfa7fff640 1 -- 172.21.15.159:0/1563318273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb01069d0 msgr2=0x7fbfb010eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfa7fff640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb01069d0 0x7fbfb010eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfa7fff640 1 -- 172.21.15.159:0/1563318273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfb01009c0 msgr2=0x7fbfb010e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfa7fff640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfb01009c0 0x7fbfb010e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfa7fff640 1 -- 172.21.15.159:0/1563318273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb01a6990 con 0x7fbfb0101360 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.586+0000 7fbfa7fff640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb0101360 0x7fbfb010e860 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800d770 tx=0x7fbf9800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.587+0000 7fbfacff9640 1 -- 172.21.15.159:0/1563318273 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf98017070 con 0x7fbfb0101360 2024-09-19T06:57:33.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.587+0000 7fbfacff9640 1 -- 172.21.15.159:0/1563318273 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf98005500 con 0x7fbfb0101360 2024-09-19T06:57:33.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.587+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb01a6c80 con 0x7fbfb0101360 2024-09-19T06:57:33.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.587+0000 7fbfacff9640 1 -- 172.21.15.159:0/1563318273 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf98004e00 con 0x7fbfb0101360 2024-09-19T06:57:33.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.587+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb01a71d0 con 0x7fbfb0101360 2024-09-19T06:57:33.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.588+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb0100e20 con 0x7fbfb0101360 2024-09-19T06:57:33.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.589+0000 7fbfacff9640 1 -- 172.21.15.159:0/1563318273 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fbf98004fa0 con 0x7fbfb0101360 2024-09-19T06:57:33.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.590+0000 7fbfacff9640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf9c0a3440 0x7fbf9c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:33.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.590+0000 7fbfaeffd640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf9c0a3440 0x7fbf9c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:33.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.590+0000 7fbfacff9640 1 -- 172.21.15.159:0/1563318273 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7fbf980cf790 con 0x7fbfb0101360 2024-09-19T06:57:33.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.590+0000 7fbfaeffd640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf9c0a3440 0x7fbf9c0a5900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009900 tx=0x7fbfa00058d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:33.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.594+0000 7fbfacff9640 1 -- 172.21.15.159:0/1563318273 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf9809c110 con 0x7fbfb0101360 2024-09-19T06:57:33.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.813+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fbfb0108f30 con 0x7fbfb0101360 2024-09-19T06:57:33.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.820+0000 7fbfacff9640 1 -- 172.21.15.159:0/1563318273 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742882 (secure 0 0 0) 0x7fbf9809ba10 con 0x7fbfb0101360 2024-09-19T06:57:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "epoch": 25, 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "active_gid": 15078, 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "active_name": "x", 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "active_addrs": { 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "addrvec": [ 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v2", 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:6800", 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 1835940314 2024-09-19T06:57:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v1", 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:6801", 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 1835940314 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "active_addr": "172.21.15.159:6801/1835940314", 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "active_change": "2024-09-19T06:47:00.531636+0000", 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "available": true, 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "standbys": [ 2024-09-19T06:57:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "gid": 15075, 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "y", 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "available_modules": [ 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "alerts", 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_destination": { 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_destination", 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_from_name": { 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_from_name", 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "Ceph", 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Email From: name", 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_host": { 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_host", 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SMTP server", 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_password": { 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_password", 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Password to authenticate with", 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_port": { 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_port", 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "465", 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SMTP port", 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_sender": { 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_sender", 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_ssl": { 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_ssl", 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:57:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_user": { 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_user", 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "User to authenticate as", 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "balancer", 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "active": { 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "active", 2024-09-19T06:57:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "begin_time": { 2024-09-19T06:57:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "begin_time", 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0000", 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "begin_weekday": { 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "begin_weekday", 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "0", 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "6", 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "crush_compat_max_iterations": { 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "25", 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "250", 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "crush_compat_metrics": { 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crush_compat_metrics", 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:57:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "crush_compat_step": { 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crush_compat_step", 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0.5", 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "0.001", 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "0.999", 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:57:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "end_time": { 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "end_time", 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "2359", 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "end_weekday": { 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "end_weekday", 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "0", 2024-09-19T06:57:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "6", 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "min_score": { 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "min_score", 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": { 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mode", 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "upmap", 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "crush-compat", 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "none", 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "read", 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap", 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap-read" 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Balancer mode", 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "pool_ids": { 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pool_ids", 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap_max_deviation": { 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "upmap_max_deviation", 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:57:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap_max_optimizations": { 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:57:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cephadm", 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "agent_down_multiplier": { 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "agent_down_multiplier", 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "3.0", 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "agent_refresh_rate": { 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "agent_refresh_rate", 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "20", 2024-09-19T06:57:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "agent_starting_port": { 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "agent_starting_port", 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "4721", 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "allow_ptrace": { 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "allow_ptrace", 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "autotune_interval": { 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "autotune_interval", 2024-09-19T06:57:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:57:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0.7", 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm_log_destination": { 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cephadm_log_destination", 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "file", 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "file,syslog", 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "syslog" 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "cgroups_split": { 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cgroups_split", 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "config_checks_enabled": { 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "config_checks_enabled", 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "config_dashboard": { 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "config_dashboard", 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_alertmanager": { 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_alertmanager", 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_base": { 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_base", 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_elasticsearch": { 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "elasticsearch container image", 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_grafana": { 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_grafana", 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_haproxy": { 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_haproxy", 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "HAproxy container image", 2024-09-19T06:57:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_jaeger_agent": { 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_jaeger_collector": { 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_jaeger_query": { 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Jaeger query container image", 2024-09-19T06:57:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_keepalived": { 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_keepalived", 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Keepalived container image", 2024-09-19T06:57:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_loki": { 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_loki", 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Loki container image", 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_node_exporter": { 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_node_exporter", 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_nvmeof": { 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_nvmeof", 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Nvme-of container image", 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_prometheus": { 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_prometheus", 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_promtail": { 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_promtail", 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Promtail container image", 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_samba": { 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_samba", 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_snmp_gateway": { 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "container_init": { 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_init", 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "daemon_cache_timeout": { 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "900", 2024-09-19T06:57:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "default_registry": { 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "default_registry", 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io", 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "device_cache_timeout": { 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "device_cache_timeout", 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "1800", 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "device_enhanced_scan": { 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "device_enhanced_scan", 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "facts_cache_timeout": { 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "facts_cache_timeout", 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "grafana_dashboards_path": { 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "host_check_interval": { 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "host_check_interval", 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "hw_monitoring": { 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "hw_monitoring", 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "inventory_list_all": { 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "inventory_list_all", 2024-09-19T06:57:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "log_refresh_metadata": { 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_refresh_metadata", 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "*", 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:57:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "max_count_per_host": { 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_count_per_host", 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:57:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "max_osd_draining_count": { 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_osd_draining_count", 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "migration_current": { 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "migration_current", 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "internal - do not modify", 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": { 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mode", 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "root", 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm-package", 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "root" 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "oob_default_addr": { 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "oob_default_addr", 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "169.254.1.1", 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "prometheus_alerts_path": { 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:57:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_insecure": { 2024-09-19T06:57:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_insecure", 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.926 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_password": { 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_password", 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.927 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_url": { 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_url", 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.928 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_username": { 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_username", 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.929 INFO:teuthology.orchestra.run.smithi159.stdout: "secure_monitoring_stack": { 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "service_discovery_port": { 2024-09-19T06:57:33.930 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "service_discovery_port", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8765", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "ssh_config_file": { 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssh_config_file", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.931 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "use_agent": { 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "use_agent", 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.932 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "use_repo_digest": { 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "use_repo_digest", 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.933 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_on_failed_host_check": { 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.934 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_on_stray_daemons": { 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.935 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_on_stray_hosts": { 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.936 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crash", 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:33.937 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.938 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.939 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.940 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.941 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.941 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.941 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.941 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.941 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.941 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.941 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.941 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.942 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "retain_interval": { 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "retain_interval", 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "31536000", 2024-09-19T06:57:33.943 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_recent_interval": { 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_recent_interval", 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "1209600", 2024-09-19T06:57:33.944 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "dashboard", 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:33.945 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.946 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.947 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.948 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.949 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.950 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.951 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.952 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.953 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.954 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.955 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.956 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.957 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:57:33.958 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:57:33.959 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:57:33.960 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "admin", 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:57:33.961 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_URL": { 2024-09-19T06:57:33.962 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:57:33.963 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "admin", 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:57:33.964 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.966 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.967 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.968 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.969 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.970 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.971 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.972 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.973 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.976 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.977 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.978 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.979 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:33.980 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.981 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8", 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.982 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "45", 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.983 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.984 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "admin", 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.985 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.987 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.988 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.989 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.990 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "cross_origin_url": { 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cross_origin_url", 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.991 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "crt_file": { 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crt_file", 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.992 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "debug": { 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "debug", 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.993 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "jwt_token_ttl": { 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "jwt_token_ttl", 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "28800", 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.994 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "key_file": { 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "key_file", 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.995 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.996 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:33.997 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:33.998 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:33.999 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.000 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "motd": { 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "motd", 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.001 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "The message of the day", 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.002 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "server_addr": { 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_addr", 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "::", 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.003 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "server_port": { 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_port", 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8080", 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "ssl": { 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssl", 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.005 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "ssl_server_port": { 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssl_server_port", 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8443", 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_behaviour": { 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_behaviour", 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "redirect", 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "redirect" 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_error_status_code": { 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_error_status_code", 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "500", 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "400", 2024-09-19T06:57:34.008 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "599", 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "url_prefix": { 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "url_prefix", 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "devicehealth", 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "enable_monitoring": { 2024-09-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enable_monitoring", 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "monitor device health metrics", 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.011 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.015 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "mark_out_threshold": { 2024-09-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mark_out_threshold", 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "2419200", 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "pool_name": { 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pool_name", 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "device_health_metrics", 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.018 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "retention_period": { 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "retention_period", 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "15552000", 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.019 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "scrape_frequency": { 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "scrape_frequency", 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "86400", 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.020 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "self_heal": { 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "self_heal", 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.021 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:57:34.022 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_threshold": { 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_threshold", 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "7257600", 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.023 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "diskprediction_local", 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.024 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.025 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.026 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.027 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.028 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.029 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "predict_interval": { 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "predict_interval", 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "86400", 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.030 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "predictor_model": { 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "predictor_model", 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "prophetstor", 2024-09-19T06:57:34.031 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.032 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "influx", 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": false, 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "batch_size": { 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "batch_size", 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5000", 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.034 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "database": { 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "database", 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "ceph", 2024-09-19T06:57:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "hostname": { 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "hostname", 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.036 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "30", 2024-09-19T06:57:34.037 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "5", 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.038 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.039 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.040 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "password": { 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "password", 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "port": { 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "port", 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.044 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.045 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8086", 2024-09-19T06:57:34.045 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.045 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.045 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.045 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "InfluxDB server port", 2024-09-19T06:57:34.045 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.045 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.045 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "ssl": { 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssl", 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "false", 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "threads": { 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "threads", 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "32", 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:57:34.047 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "username": { 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "username", 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.048 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: "verify_ssl": { 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "verify_ssl", 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.049 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "true", 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "insights", 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.051 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.052 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.053 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.054 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.055 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.056 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "iostat", 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.057 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.058 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.059 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.060 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.061 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "k8sevents", 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.062 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_event_retention_days": { 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "7", 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:57:34.063 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "config_check_secs": { 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "config_check_secs", 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "10", 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.065 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.066 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.067 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.068 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.069 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.070 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "localpool", 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "failure_domain": { 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "failure_domain", 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "host", 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.071 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.072 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.073 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.074 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.075 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.076 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "min_size": { 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "min_size", 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.077 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "num_rep": { 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "num_rep", 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.078 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "3", 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "pg_num": { 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pg_num", 2024-09-19T06:57:34.079 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "128", 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.080 INFO:teuthology.orchestra.run.smithi159.stdout: "prefix": { 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "prefix", 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "subtree": { 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "subtree", 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "rack", 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.082 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mds_autoscaler", 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.083 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.084 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.085 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.085 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.085 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.085 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.085 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.085 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.085 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.085 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.086 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.087 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.088 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.089 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.089 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.089 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.089 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.089 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.089 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.089 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.089 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.089 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mirroring", 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.090 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.091 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.092 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.093 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.095 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "nfs", 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.096 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.097 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.099 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.101 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "orchestrator", 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: "fail_fs": { 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "fail_fs", 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.102 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.103 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.105 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "orchestrator": { 2024-09-19T06:57:34.108 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "orchestrator", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "rook", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "test_orchestrator" 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Orchestrator backend", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.109 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "osd_perf_query", 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.110 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.112 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.113 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.114 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "osd_support", 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.115 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.116 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.117 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.118 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.119 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.120 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pg_autoscaler", 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.121 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.122 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.123 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.124 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.125 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.126 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "threshold": { 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "threshold", 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "3.0", 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1.0", 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.127 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "scaling threshold", 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "progress", 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: "allow_pg_recovery_event": { 2024-09-19T06:57:34.128 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "enabled": { 2024-09-19T06:57:34.129 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enabled", 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.130 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.131 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.133 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.134 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "max_completed_events": { 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_completed_events", 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "50", 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.135 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.136 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "prometheus", 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "cache": { 2024-09-19T06:57:34.137 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cache", 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "exclude_perf_counters": { 2024-09-19T06:57:34.138 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "exclude_perf_counters", 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.139 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.142 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.144 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_stats_pools": { 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_stats_pools", 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.145 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "300", 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.146 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "scrape_interval": { 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "scrape_interval", 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "15.0", 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.147 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "server_addr": { 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_addr", 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "::", 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.148 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "server_port": { 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_port", 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "9283", 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.149 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "stale_cache_strategy": { 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "stale_cache_strategy", 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "log", 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.150 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_behaviour": { 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_behaviour", 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.151 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "default", 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: "default", 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: "error" 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_error_status_code": { 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_error_status_code", 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "500", 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "400", 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "599", 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.153 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_support", 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.154 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.155 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.156 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.157 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.158 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "max_concurrent_snap_create": { 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.159 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.160 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "trash_purge_schedule": { 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "trash_purge_schedule", 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.161 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "restful", 2024-09-19T06:57:34.162 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "enable_auth": { 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enable_auth", 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.163 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "key_file": { 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "key_file", 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.164 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.165 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.168 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.169 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "server_addr": { 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_addr", 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.170 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "server_port": { 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_port", 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.171 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rgw", 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.172 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.173 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.174 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.175 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.176 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.177 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.178 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rook", 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.179 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.180 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.181 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.182 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.183 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.184 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "storage_class": { 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "storage_class", 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "local", 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "selftest", 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.187 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.188 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.189 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.190 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "roption1": { 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "roption1", 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.191 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "roption2": { 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "roption2", 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.192 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "xyz", 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption1": { 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption1", 2024-09-19T06:57:34.193 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption2": { 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption2", 2024-09-19T06:57:34.194 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption3": { 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption3", 2024-09-19T06:57:34.195 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption4": { 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption4", 2024-09-19T06:57:34.196 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption5": { 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption5", 2024-09-19T06:57:34.197 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption6": { 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption6", 2024-09-19T06:57:34.198 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption7": { 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption7", 2024-09-19T06:57:34.199 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "42", 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "testkey": { 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "testkey", 2024-09-19T06:57:34.200 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "testlkey": { 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "testlkey", 2024-09-19T06:57:34.201 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "testnewline": { 2024-09-19T06:57:34.202 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "testnewline", 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snap_schedule", 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "allow_m_granularity": { 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "allow_m_granularity", 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.204 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "dump_on_update": { 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "dump_on_update", 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.205 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.206 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.207 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.208 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.209 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.210 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "stats", 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.211 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.212 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.213 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.214 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.215 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.216 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "status", 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.217 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.218 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.219 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.220 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.221 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.222 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "telegraf", 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "address": { 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "address", 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.223 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "15", 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.224 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.225 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.226 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.227 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.228 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.229 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "telemetry", 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.230 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_basic": { 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_basic", 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_crash": { 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_crash", 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_device": { 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_device", 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_ident": { 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_ident", 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_perf": { 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_perf", 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "contact": { 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "contact", 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.236 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "description": { 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "description", 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "device_url": { 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "device_url", 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.238 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "enabled": { 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enabled", 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.239 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "24", 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "8", 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.240 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "last_opt_revision": { 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "last_opt_revision", 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "1", 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.241 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "leaderboard": { 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "leaderboard", 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.242 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "leaderboard_description": { 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "leaderboard_description", 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.243 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.244 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.245 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.246 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.247 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.248 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "organization": { 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "organization", 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.249 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "proxy": { 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "proxy", 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.250 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "url": { 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "url", 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.251 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "test_orchestrator", 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.252 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.253 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.254 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.255 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.257 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "volumes", 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.258 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.261 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.262 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "max_concurrent_clones": { 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_concurrent_clones", 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "4", 2024-09-19T06:57:34.263 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "periodic_async_work": { 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "periodic_async_work", 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.264 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Periodically check for async work", 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "snapshot_clone_delay": { 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.265 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.266 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix", 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.267 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "discovery_interval": { 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "discovery_interval", 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "100", 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.268 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "identifier": { 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "identifier", 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.269 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.270 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.271 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.272 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.273 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.274 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.275 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "zabbix_host": { 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix_host", 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.276 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "zabbix_port": { 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix_port", 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10051", 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "zabbix_sender": { 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix_sender", 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.278 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: "gid": 24751, 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "z", 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:57:34.279 INFO:teuthology.orchestra.run.smithi159.stdout: "available_modules": [ 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "alerts", 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.280 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.282 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.283 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.284 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.285 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_destination": { 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_destination", 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.286 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_from_name": { 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_from_name", 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "Ceph", 2024-09-19T06:57:34.287 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Email From: name", 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_host": { 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_host", 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.288 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SMTP server", 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_password": { 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_password", 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.289 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Password to authenticate with", 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_port": { 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_port", 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.290 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "465", 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SMTP port", 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_sender": { 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_sender", 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.291 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_ssl": { 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_ssl", 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_user": { 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_user", 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "User to authenticate as", 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.294 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "balancer", 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "active": { 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "active", 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:57:34.295 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "begin_time": { 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "begin_time", 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0000", 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:57:34.296 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "begin_weekday": { 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "begin_weekday", 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "0", 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "6", 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:57:34.297 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "crush_compat_max_iterations": { 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "25", 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "250", 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:57:34.298 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "crush_compat_metrics": { 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crush_compat_metrics", 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:57:34.299 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "crush_compat_step": { 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crush_compat_step", 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0.5", 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "0.001", 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "0.999", 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:57:34.300 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "end_time": { 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "end_time", 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "2359", 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.301 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "end_weekday": { 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "end_weekday", 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "0", 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "6", 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.302 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.303 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.304 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.305 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.306 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.307 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "min_score": { 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "min_score", 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.308 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": { 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mode", 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.309 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "upmap", 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "crush-compat", 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "none", 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "read", 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap", 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap-read" 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Balancer mode", 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.310 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "pool_ids": { 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pool_ids", 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.311 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.312 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap_max_deviation": { 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "upmap_max_deviation", 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.313 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap_max_optimizations": { 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.314 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cephadm", 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "agent_down_multiplier": { 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "agent_down_multiplier", 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.315 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "3.0", 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "agent_refresh_rate": { 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "agent_refresh_rate", 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.316 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "20", 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "agent_starting_port": { 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "agent_starting_port", 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.317 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "4721", 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "allow_ptrace": { 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "allow_ptrace", 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.318 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "autotune_interval": { 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "autotune_interval", 2024-09-19T06:57:34.319 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:57:34.320 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0.7", 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm_log_destination": { 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cephadm_log_destination", 2024-09-19T06:57:34.321 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "file", 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "file,syslog", 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "syslog" 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.322 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "cgroups_split": { 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cgroups_split", 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.323 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "config_checks_enabled": { 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "config_checks_enabled", 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:57:34.324 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "config_dashboard": { 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "config_dashboard", 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:57:34.325 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_alertmanager": { 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_alertmanager", 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:34.326 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_base": { 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_base", 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.327 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_elasticsearch": { 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "elasticsearch container image", 2024-09-19T06:57:34.328 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_grafana": { 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_grafana", 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:34.329 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_haproxy": { 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_haproxy", 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "HAproxy container image", 2024-09-19T06:57:34.330 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_jaeger_agent": { 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:57:34.331 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_jaeger_collector": { 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.332 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_jaeger_query": { 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.333 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Jaeger query container image", 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_keepalived": { 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_keepalived", 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.334 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Keepalived container image", 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_loki": { 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_loki", 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.335 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Loki container image", 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_node_exporter": { 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_node_exporter", 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.336 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_nvmeof": { 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_nvmeof", 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Nvme-of container image", 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_prometheus": { 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_prometheus", 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.338 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_promtail": { 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_promtail", 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.339 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Promtail container image", 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_samba": { 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_samba", 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.340 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_snmp_gateway": { 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.341 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "container_init": { 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_init", 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.342 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "daemon_cache_timeout": { 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.343 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.344 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "900", 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "default_registry": { 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "default_registry", 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.345 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io", 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "device_cache_timeout": { 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "device_cache_timeout", 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.346 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "1800", 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "device_enhanced_scan": { 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "device_enhanced_scan", 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.347 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "facts_cache_timeout": { 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "facts_cache_timeout", 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.348 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "grafana_dashboards_path": { 2024-09-19T06:57:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:57:34.351 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "host_check_interval": { 2024-09-19T06:57:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "host_check_interval", 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "hw_monitoring": { 2024-09-19T06:57:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "hw_monitoring", 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: "inventory_list_all": { 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "inventory_list_all", 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "log_refresh_metadata": { 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_refresh_metadata", 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.360 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.361 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:57:34.362 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "*", 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:57:34.363 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "max_count_per_host": { 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_count_per_host", 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.364 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "max_osd_draining_count": { 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_osd_draining_count", 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.365 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "migration_current": { 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "migration_current", 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.366 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "internal - do not modify", 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": { 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mode", 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "root", 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm-package", 2024-09-19T06:57:34.367 INFO:teuthology.orchestra.run.smithi159.stdout: "root" 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "oob_default_addr": { 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "oob_default_addr", 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "169.254.1.1", 2024-09-19T06:57:34.368 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "prometheus_alerts_path": { 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:57:34.369 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_insecure": { 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_insecure", 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.370 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_password": { 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_password", 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.371 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_url": { 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_url", 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.372 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_username": { 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_username", 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.373 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "secure_monitoring_stack": { 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.374 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "service_discovery_port": { 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "service_discovery_port", 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.375 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8765", 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "ssh_config_file": { 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssh_config_file", 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.376 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "use_agent": { 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "use_agent", 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.377 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "use_repo_digest": { 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "use_repo_digest", 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.378 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_on_failed_host_check": { 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_on_stray_daemons": { 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.380 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_on_stray_hosts": { 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.381 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.382 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crash", 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.383 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.384 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.385 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.386 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.387 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "retain_interval": { 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "retain_interval", 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "31536000", 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.388 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_recent_interval": { 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_recent_interval", 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "1209600", 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.389 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "dashboard", 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:57:34.390 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:57:34.391 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.392 INFO:teuthology.orchestra.run.smithi159.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.393 INFO:teuthology.orchestra.run.smithi159.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:57:34.394 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.395 INFO:teuthology.orchestra.run.smithi159.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.398 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.400 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.401 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "admin", 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.405 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.406 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_URL": { 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "admin", 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.416 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.417 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.419 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.420 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.421 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.422 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.423 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.424 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8", 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "45", 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.427 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "admin", 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.428 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.429 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.430 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.431 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.432 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.433 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "cross_origin_url": { 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cross_origin_url", 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.434 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "crt_file": { 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crt_file", 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.435 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "debug": { 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "debug", 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.436 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "jwt_token_ttl": { 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "jwt_token_ttl", 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.437 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "28800", 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "key_file": { 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "key_file", 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.438 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.439 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.440 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.441 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.442 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.443 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "motd": { 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "motd", 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.444 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "The message of the day", 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.445 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "server_addr": { 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_addr", 2024-09-19T06:57:34.446 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "::", 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "server_port": { 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_port", 2024-09-19T06:57:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8080", 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "ssl": { 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssl", 2024-09-19T06:57:34.448 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "ssl_server_port": { 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssl_server_port", 2024-09-19T06:57:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8443", 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_behaviour": { 2024-09-19T06:57:34.450 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_behaviour", 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "redirect", 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "redirect" 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.451 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_error_status_code": { 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_error_status_code", 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "500", 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "400", 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "599", 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.452 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "url_prefix": { 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "url_prefix", 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.453 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "devicehealth", 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "enable_monitoring": { 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enable_monitoring", 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "monitor device health metrics", 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.455 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.456 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.457 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.458 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.459 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.460 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "mark_out_threshold": { 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mark_out_threshold", 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "2419200", 2024-09-19T06:57:34.461 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "pool_name": { 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pool_name", 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.462 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "device_health_metrics", 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "retention_period": { 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "retention_period", 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.463 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "15552000", 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "scrape_frequency": { 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "scrape_frequency", 2024-09-19T06:57:34.464 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "86400", 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "self_heal": { 2024-09-19T06:57:34.465 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "self_heal", 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.466 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.467 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_threshold": { 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_threshold", 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "7257600", 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.468 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "diskprediction_local", 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "predict_interval": { 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "predict_interval", 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "86400", 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "predictor_model": { 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "predictor_model", 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "prophetstor", 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "influx", 2024-09-19T06:57:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": false, 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "batch_size": { 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "batch_size", 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5000", 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "database": { 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "database", 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "ceph", 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:57:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "hostname": { 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "hostname", 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:57:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "30", 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "5", 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:57:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "password": { 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "password", 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:57:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "port": { 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "port", 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8086", 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "InfluxDB server port", 2024-09-19T06:57:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "ssl": { 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssl", 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "false", 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:57:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "threads": { 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "threads", 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "32", 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:57:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "username": { 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "username", 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:57:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "verify_ssl": { 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "verify_ssl", 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "true", 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:57:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "insights", 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "iostat", 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "k8sevents", 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_event_retention_days": { 2024-09-19T06:57:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "7", 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "config_check_secs": { 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "config_check_secs", 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "10", 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.507 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "localpool", 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "failure_domain": { 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "failure_domain", 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "host", 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "min_size": { 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "min_size", 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "num_rep": { 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "num_rep", 2024-09-19T06:57:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "3", 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "pg_num": { 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pg_num", 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "128", 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "prefix": { 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "prefix", 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "subtree": { 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "subtree", 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "rack", 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mds_autoscaler", 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mirroring", 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "nfs", 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "orchestrator", 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "fail_fs": { 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "fail_fs", 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "orchestrator": { 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "orchestrator", 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm", 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "rook", 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "test_orchestrator" 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Orchestrator backend", 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "osd_perf_query", 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "osd_support", 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pg_autoscaler", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "threshold": { 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "threshold", 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "3.0", 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1.0", 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "scaling threshold", 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "progress", 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "allow_pg_recovery_event": { 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:57:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "enabled": { 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enabled", 2024-09-19T06:57:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "max_completed_events": { 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_completed_events", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "50", 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "prometheus", 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "cache": { 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cache", 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "exclude_perf_counters": { 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "exclude_perf_counters", 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_stats_pools": { 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_stats_pools", 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "300", 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "scrape_interval": { 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "scrape_interval", 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "15.0", 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "server_addr": { 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_addr", 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "::", 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "server_port": { 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_port", 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "9283", 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "stale_cache_strategy": { 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "stale_cache_strategy", 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "log", 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.591 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_behaviour": { 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_behaviour", 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "default", 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.592 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "default", 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "error" 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_error_status_code": { 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_error_status_code", 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.593 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "500", 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "400", 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "599", 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.594 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_support", 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.595 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.596 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.597 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.598 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.599 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "max_concurrent_snap_create": { 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.600 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.601 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "trash_purge_schedule": { 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "trash_purge_schedule", 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.602 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "restful", 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.603 INFO:teuthology.orchestra.run.smithi159.stdout: "enable_auth": { 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enable_auth", 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.604 INFO:teuthology.orchestra.run.smithi159.stdout: "key_file": { 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "key_file", 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.606 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.607 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.608 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.609 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.610 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "server_addr": { 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_addr", 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.611 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "server_port": { 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_port", 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.612 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rgw", 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.613 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.616 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.617 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.618 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rook", 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.619 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.620 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.621 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.622 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.623 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.624 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "storage_class": { 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "storage_class", 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "local", 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.625 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "selftest", 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.626 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.627 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.628 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.629 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.630 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "roption1": { 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "roption1", 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.631 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "roption2": { 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "roption2", 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.632 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "xyz", 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption1": { 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption1", 2024-09-19T06:57:34.633 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption2": { 2024-09-19T06:57:34.634 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption2", 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption3": { 2024-09-19T06:57:34.635 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption3", 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.636 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption4": { 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption4", 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.637 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption5": { 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption5", 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption6": { 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption6", 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption7": { 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption7", 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "42", 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "testkey": { 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "testkey", 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "testlkey": { 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "testlkey", 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.642 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "testnewline": { 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "testnewline", 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.643 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snap_schedule", 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: "allow_m_granularity": { 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "allow_m_granularity", 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.644 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "dump_on_update": { 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "dump_on_update", 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.645 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.646 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.648 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.649 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.650 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.651 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "stats", 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.652 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.653 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.654 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.655 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.656 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.657 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "status", 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.658 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.661 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.662 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.663 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "telegraf", 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "address": { 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "address", 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.664 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "15", 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.665 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.666 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.667 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.668 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.669 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.670 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "telemetry", 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.671 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_basic": { 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_basic", 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_crash": { 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_crash", 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.673 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_device": { 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_device", 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.674 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_ident": { 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_ident", 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.675 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_perf": { 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_perf", 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.676 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "contact": { 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "contact", 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.677 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "description": { 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "description", 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.678 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "device_url": { 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "device_url", 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.679 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "enabled": { 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enabled", 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.680 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "24", 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "8", 2024-09-19T06:57:34.681 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "last_opt_revision": { 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "last_opt_revision", 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "1", 2024-09-19T06:57:34.682 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "leaderboard": { 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "leaderboard", 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.683 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "leaderboard_description": { 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "leaderboard_description", 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.684 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.685 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.688 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.689 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "organization": { 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "organization", 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.690 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "proxy": { 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "proxy", 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.691 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "url": { 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "url", 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.692 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "test_orchestrator", 2024-09-19T06:57:34.693 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.694 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.695 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.696 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.697 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.698 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "volumes", 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.699 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.700 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.701 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.702 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.703 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.704 INFO:teuthology.orchestra.run.smithi159.stdout: "max_concurrent_clones": { 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_concurrent_clones", 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "4", 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "periodic_async_work": { 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "periodic_async_work", 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Periodically check for async work", 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.706 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "snapshot_clone_delay": { 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.707 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.708 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix", 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: "discovery_interval": { 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "discovery_interval", 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.709 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "100", 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "identifier": { 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "identifier", 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.710 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.711 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.712 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.713 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.714 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.715 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.716 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.717 INFO:teuthology.orchestra.run.smithi159.stdout: "zabbix_host": { 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix_host", 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.718 INFO:teuthology.orchestra.run.smithi159.stdout: "zabbix_port": { 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix_port", 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10051", 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.719 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "zabbix_sender": { 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix_sender", 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.720 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: "modules": [ 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm", 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: "dashboard", 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: "iostat", 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: "nfs", 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: "restful", 2024-09-19T06:57:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: "snap_schedule" 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "available_modules": [ 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "alerts", 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.722 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.723 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.724 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.725 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.726 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.727 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_destination": { 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_destination", 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.728 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_from_name": { 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_from_name", 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.729 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "Ceph", 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Email From: name", 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_host": { 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_host", 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.730 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SMTP server", 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_password": { 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_password", 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.731 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Password to authenticate with", 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_port": { 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_port", 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.732 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "465", 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SMTP port", 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_sender": { 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_sender", 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.733 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_ssl": { 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_ssl", 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.734 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "smtp_user": { 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "smtp_user", 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.735 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "User to authenticate as", 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "balancer", 2024-09-19T06:57:34.736 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "active": { 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "active", 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:57:34.737 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "begin_time": { 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "begin_time", 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0000", 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:57:34.738 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "begin_weekday": { 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "begin_weekday", 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "0", 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "6", 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.739 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "crush_compat_max_iterations": { 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "25", 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "250", 2024-09-19T06:57:34.740 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "crush_compat_metrics": { 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crush_compat_metrics", 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.741 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "crush_compat_step": { 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crush_compat_step", 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0.5", 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "0.001", 2024-09-19T06:57:34.742 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "0.999", 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "end_time": { 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "end_time", 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "2359", 2024-09-19T06:57:34.743 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "end_weekday": { 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "end_weekday", 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "0", 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "6", 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.745 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.746 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.747 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.748 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.749 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "min_score": { 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "min_score", 2024-09-19T06:57:34.750 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": { 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mode", 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.751 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "upmap", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "crush-compat", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "none", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "read", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap-read" 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Balancer mode", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.752 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "pool_ids": { 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pool_ids", 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.753 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:57:34.754 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap_max_deviation": { 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "upmap_max_deviation", 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:57:34.755 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "upmap_max_optimizations": { 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:57:34.756 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cephadm", 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: "agent_down_multiplier": { 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "agent_down_multiplier", 2024-09-19T06:57:34.757 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "3.0", 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "agent_refresh_rate": { 2024-09-19T06:57:34.758 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "agent_refresh_rate", 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "20", 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.759 INFO:teuthology.orchestra.run.smithi159.stdout: "agent_starting_port": { 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "agent_starting_port", 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "4721", 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.760 INFO:teuthology.orchestra.run.smithi159.stdout: "allow_ptrace": { 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "allow_ptrace", 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.761 INFO:teuthology.orchestra.run.smithi159.stdout: "autotune_interval": { 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "autotune_interval", 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.762 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0.7", 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.763 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm_log_destination": { 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cephadm_log_destination", 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "file", 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "file,syslog", 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "syslog" 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.764 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "cgroups_split": { 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cgroups_split", 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.765 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "config_checks_enabled": { 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "config_checks_enabled", 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.766 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "config_dashboard": { 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "config_dashboard", 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.767 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_alertmanager": { 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_alertmanager", 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.768 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_base": { 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_base", 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.769 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_elasticsearch": { 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.770 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "elasticsearch container image", 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_grafana": { 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_grafana", 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.771 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_haproxy": { 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_haproxy", 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.772 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "HAproxy container image", 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_jaeger_agent": { 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.773 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_jaeger_collector": { 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.774 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_jaeger_query": { 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.775 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Jaeger query container image", 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_keepalived": { 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_keepalived", 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.776 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Keepalived container image", 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_loki": { 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_loki", 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.777 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Loki container image", 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_node_exporter": { 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_node_exporter", 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:57:34.778 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_nvmeof": { 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_nvmeof", 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:57:34.779 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Nvme-of container image", 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_prometheus": { 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_prometheus", 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.780 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Prometheus container image", 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_promtail": { 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_promtail", 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.781 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Promtail container image", 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_samba": { 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_samba", 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.782 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "container_image_snmp_gateway": { 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:57:34.783 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "container_init": { 2024-09-19T06:57:34.784 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "container_init", 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "daemon_cache_timeout": { 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.786 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "900", 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.787 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "default_registry": { 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "default_registry", 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "docker.io", 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:57:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "device_cache_timeout": { 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "device_cache_timeout", 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "1800", 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:57:34.789 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "device_enhanced_scan": { 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "device_enhanced_scan", 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.790 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "facts_cache_timeout": { 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "facts_cache_timeout", 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.791 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "grafana_dashboards_path": { 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.792 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "host_check_interval": { 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "host_check_interval", 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:57:34.793 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "hw_monitoring": { 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "hw_monitoring", 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:57:34.794 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "inventory_list_all": { 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "inventory_list_all", 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.795 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.796 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.797 INFO:teuthology.orchestra.run.smithi159.stdout: "log_refresh_metadata": { 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_refresh_metadata", 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.798 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.799 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.800 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.801 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.802 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "*", 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.803 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "max_count_per_host": { 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_count_per_host", 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.804 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "max_osd_draining_count": { 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_osd_draining_count", 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.805 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "migration_current": { 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "migration_current", 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.806 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "internal - do not modify", 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "mode": { 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mode", 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.807 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "root", 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm-package", 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "root" 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "oob_default_addr": { 2024-09-19T06:57:34.808 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "oob_default_addr", 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "169.254.1.1", 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "prometheus_alerts_path": { 2024-09-19T06:57:34.809 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.810 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_insecure": { 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_insecure", 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_password": { 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_password", 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.812 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_url": { 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_url", 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.813 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "registry_username": { 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "registry_username", 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:57:34.814 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "secure_monitoring_stack": { 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:57:34.815 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "service_discovery_port": { 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "service_discovery_port", 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8765", 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:57:34.816 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "ssh_config_file": { 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssh_config_file", 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.817 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "use_agent": { 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "use_agent", 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.818 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "use_repo_digest": { 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "use_repo_digest", 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_on_failed_host_check": { 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.820 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_on_stray_daemons": { 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.821 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_on_stray_hosts": { 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.822 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crash", 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.823 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.824 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.825 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.826 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.827 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.828 INFO:teuthology.orchestra.run.smithi159.stdout: "retain_interval": { 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "retain_interval", 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "31536000", 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.829 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_recent_interval": { 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_recent_interval", 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "1209600", 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.830 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "dashboard", 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.831 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.832 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.833 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.834 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.835 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.836 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.837 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.838 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.839 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.840 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.841 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.842 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:57:34.843 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:57:34.844 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.845 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "admin", 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:57:34.846 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_URL": { 2024-09-19T06:57:34.847 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:57:34.848 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "admin", 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:57:34.849 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:57:34.850 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:57:34.851 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:57:34.852 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.853 INFO:teuthology.orchestra.run.smithi159.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.855 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.856 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.857 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.858 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.859 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.860 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.861 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.862 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.863 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:57:34.864 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.865 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8", 2024-09-19T06:57:34.866 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "45", 2024-09-19T06:57:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.868 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "admin", 2024-09-19T06:57:34.869 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.870 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.871 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.872 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.873 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.874 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "cross_origin_url": { 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cross_origin_url", 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.875 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "crt_file": { 2024-09-19T06:57:34.876 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "crt_file", 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "debug": { 2024-09-19T06:57:34.877 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "debug", 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.878 INFO:teuthology.orchestra.run.smithi159.stdout: "jwt_token_ttl": { 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "jwt_token_ttl", 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "28800", 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.879 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "key_file": { 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "key_file", 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.880 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.881 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.882 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.883 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.884 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.886 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "motd": { 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "motd", 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "The message of the day", 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "server_addr": { 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_addr", 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "::", 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.889 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "server_port": { 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_port", 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8080", 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.890 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "ssl": { 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssl", 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.891 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "ssl_server_port": { 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssl_server_port", 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.892 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8443", 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_behaviour": { 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_behaviour", 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.893 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "redirect", 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "redirect" 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.894 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_error_status_code": { 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_error_status_code", 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "500", 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "400", 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "599", 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.895 INFO:teuthology.orchestra.run.smithi159.stdout: "url_prefix": { 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "url_prefix", 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.896 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "devicehealth", 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: "enable_monitoring": { 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enable_monitoring", 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.897 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "monitor device health metrics", 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.898 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.899 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.900 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.901 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.903 INFO:teuthology.orchestra.run.smithi159.stdout: "mark_out_threshold": { 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mark_out_threshold", 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "2419200", 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.904 INFO:teuthology.orchestra.run.smithi159.stdout: "pool_name": { 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pool_name", 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "device_health_metrics", 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "retention_period": { 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "retention_period", 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "15552000", 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.906 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "scrape_frequency": { 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "scrape_frequency", 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "86400", 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:57:34.907 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "self_heal": { 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "self_heal", 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.908 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.909 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "warn_threshold": { 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "warn_threshold", 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.910 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "7257600", 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "diskprediction_local", 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.912 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.913 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.915 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.915 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.915 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.915 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.915 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.915 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.915 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.915 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.915 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.916 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "predict_interval": { 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "predict_interval", 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "86400", 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "predictor_model": { 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "predictor_model", 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "prophetstor", 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "600", 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.920 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "influx", 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": false, 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.921 INFO:teuthology.orchestra.run.smithi159.stdout: "batch_size": { 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "batch_size", 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5000", 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.922 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "database": { 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "database", 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "ceph", 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.923 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "hostname": { 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "hostname", 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.924 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "30", 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "5", 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:57:34.925 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.926 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.927 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.928 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.929 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.930 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "password": { 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "password", 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:57:34.931 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "port": { 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "port", 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "8086", 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.932 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "InfluxDB server port", 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "ssl": { 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ssl", 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "false", 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.933 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "threads": { 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "threads", 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "32", 2024-09-19T06:57:34.934 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "username": { 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "username", 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.935 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "verify_ssl": { 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "verify_ssl", 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "true", 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.936 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.937 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "insights", 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.938 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.939 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.940 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.941 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.942 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.943 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "iostat", 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.944 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.945 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.946 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.947 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.948 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "k8sevents", 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.949 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_event_retention_days": { 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "7", 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.950 INFO:teuthology.orchestra.run.smithi159.stdout: "config_check_secs": { 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "config_check_secs", 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "10", 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.952 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.953 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.954 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.956 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "localpool", 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: "failure_domain": { 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "failure_domain", 2024-09-19T06:57:34.957 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "host", 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.958 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.959 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.960 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.961 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.962 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.963 INFO:teuthology.orchestra.run.smithi159.stdout: "min_size": { 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "min_size", 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "num_rep": { 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "num_rep", 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "3", 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "pg_num": { 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pg_num", 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "128", 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: "prefix": { 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "prefix", 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.967 INFO:teuthology.orchestra.run.smithi159.stdout: "subtree": { 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "subtree", 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "rack", 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.968 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mds_autoscaler", 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.969 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.972 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.973 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mirroring", 2024-09-19T06:57:34.974 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.975 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.976 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.977 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.978 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.979 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "nfs", 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.980 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.981 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.982 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.983 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.984 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.985 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "orchestrator", 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "fail_fs": { 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "fail_fs", 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:57:34.986 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.987 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.988 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.989 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.990 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.991 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "orchestrator": { 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "orchestrator", 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.992 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: "cephadm", 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: "rook", 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: "test_orchestrator" 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Orchestrator backend", 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.993 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "osd_perf_query", 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.994 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.995 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:34.996 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:34.997 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:34.998 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "osd_support", 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:34.999 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.000 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.001 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.002 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.003 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "pg_autoscaler", 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.005 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.007 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.008 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.009 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.010 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "threshold": { 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "threshold", 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "3.0", 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1.0", 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.011 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "scaling threshold", 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "progress", 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "allow_pg_recovery_event": { 2024-09-19T06:57:35.012 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "enabled": { 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enabled", 2024-09-19T06:57:35.013 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.014 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.015 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.016 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.017 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.018 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "max_completed_events": { 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_completed_events", 2024-09-19T06:57:35.019 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "50", 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "sleep_interval": { 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "sleep_interval", 2024-09-19T06:57:35.020 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "prometheus", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "cache": { 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cache", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.022 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "exclude_perf_counters": { 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "exclude_perf_counters", 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:57:35.023 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.024 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.025 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.026 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.028 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_stats_pools": { 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_stats_pools", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.029 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "300", 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.030 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "scrape_interval": { 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "scrape_interval", 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "15.0", 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.031 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "server_addr": { 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_addr", 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "::", 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:57:35.032 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "server_port": { 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_port", 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "9283", 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:57:35.033 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "stale_cache_strategy": { 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "stale_cache_strategy", 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "log", 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.034 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_behaviour": { 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_behaviour", 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "default", 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "default", 2024-09-19T06:57:35.035 INFO:teuthology.orchestra.run.smithi159.stdout: "error" 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "standby_error_status_code": { 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "standby_error_status_code", 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "500", 2024-09-19T06:57:35.036 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "400", 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "599", 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_support", 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.038 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.039 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.040 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.041 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.042 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "max_concurrent_snap_create": { 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10", 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.043 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.044 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "trash_purge_schedule": { 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "trash_purge_schedule", 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.045 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "restful", 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "enable_auth": { 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enable_auth", 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.046 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "key_file": { 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "key_file", 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.047 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.048 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.049 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.050 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.051 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.052 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "server_addr": { 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_addr", 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.053 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "server_port": { 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "server_port", 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.054 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.055 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rgw", 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.056 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.057 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.058 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.059 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.060 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "5", 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.061 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rook", 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.062 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.063 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.064 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.065 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.066 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.067 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "storage_class": { 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "storage_class", 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "local", 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:57:35.068 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "selftest", 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.069 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.070 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.071 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.072 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "roption1": { 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "roption1", 2024-09-19T06:57:35.074 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "roption2": { 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "roption2", 2024-09-19T06:57:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "xyz", 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption1": { 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption1", 2024-09-19T06:57:35.076 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption2": { 2024-09-19T06:57:35.077 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption2", 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption3": { 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption3", 2024-09-19T06:57:35.078 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "float", 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption4": { 2024-09-19T06:57:35.079 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption4", 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.080 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption5": { 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption5", 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.081 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption6": { 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption6", 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "rwoption7": { 2024-09-19T06:57:35.082 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rwoption7", 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "1", 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "42", 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "testkey": { 2024-09-19T06:57:35.083 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "testkey", 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.084 INFO:teuthology.orchestra.run.smithi159.stdout: "testlkey": { 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "testlkey", 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.085 INFO:teuthology.orchestra.run.smithi159.stdout: "testnewline": { 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "testnewline", 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.086 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snap_schedule", 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "allow_m_granularity": { 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "allow_m_granularity", 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.087 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "dump_on_update": { 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "dump_on_update", 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.088 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "stats", 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "status", 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "telegraf", 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "address": { 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "address", 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "15", 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "telemetry", 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_basic": { 2024-09-19T06:57:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_basic", 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_crash": { 2024-09-19T06:57:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_crash", 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_device": { 2024-09-19T06:57:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_device", 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_ident": { 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_ident", 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "channel_perf": { 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "channel_perf", 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "contact": { 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "contact", 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "description": { 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "description", 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "device_url": { 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "device_url", 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "enabled": { 2024-09-19T06:57:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "enabled", 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "24", 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "8", 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "last_opt_revision": { 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "last_opt_revision", 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "1", 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "leaderboard": { 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "leaderboard", 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "leaderboard_description": { 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "leaderboard_description", 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "organization": { 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "organization", 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "proxy": { 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "proxy", 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "url": { 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "url", 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "test_orchestrator", 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "volumes", 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "max_concurrent_clones": { 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "max_concurrent_clones", 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "4", 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "periodic_async_work": { 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "periodic_async_work", 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Periodically check for async work", 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "snapshot_clone_delay": { 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "0", 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:57:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "True", 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:57:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix", 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "can_run": true, 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "error_string": "", 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "module_options": { 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "discovery_interval": { 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "discovery_interval", 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "uint", 2024-09-19T06:57:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "100", 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "identifier": { 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "identifier", 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "interval": { 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "interval", 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "secs", 2024-09-19T06:57:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "60", 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "log_level": { 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_level", 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster": { 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster", 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_cluster_level": { 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_cluster_level", 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "info", 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [ 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "", 2024-09-19T06:57:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "critical", 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "debug", 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "error", 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "info", 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "warning" 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "log_to_file": { 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "log_to_file", 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "bool", 2024-09-19T06:57:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 1, 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "False", 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "zabbix_host": { 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix_host", 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "", 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "zabbix_port": { 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix_port", 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "int", 2024-09-19T06:57:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "10051", 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "zabbix_sender": { 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "zabbix_sender", 2024-09-19T06:57:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "str", 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "level": "advanced", 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "flags": 0, 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "min": "", 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "max": "", 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "enum_allowed": [], 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "desc": "", 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "long_desc": "", 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "tags": [], 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "see_also": [] 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "services": { 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "dashboard": "https://172.21.15.159:8443/" 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "always_on_modules": { 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "octopus": [ 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "balancer", 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "devicehealth", 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "orchestrator", 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "pg_autoscaler", 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "progress", 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_support", 2024-09-19T06:57:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "status", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "telemetry", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "volumes" 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "pacific": [ 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "balancer", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "devicehealth", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "orchestrator", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "pg_autoscaler", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "progress", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_support", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "status", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "telemetry", 2024-09-19T06:57:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "volumes" 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "quincy": [ 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "balancer", 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "devicehealth", 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "orchestrator", 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "pg_autoscaler", 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "progress", 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_support", 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "status", 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "telemetry", 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "volumes" 2024-09-19T06:57:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "reef": [ 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "balancer", 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "devicehealth", 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "orchestrator", 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "pg_autoscaler", 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "progress", 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_support", 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "status", 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "telemetry", 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "volumes" 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "squid": [ 2024-09-19T06:57:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "balancer", 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "devicehealth", 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "orchestrator", 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "pg_autoscaler", 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "progress", 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "rbd_support", 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "status", 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "telemetry", 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "volumes" 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "last_failure_osd_epoch": 82, 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "active_clients": [ 2024-09-19T06:57:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "devicehealth", 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "addrvec": [ 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v2", 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:0", 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 358537194 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "libcephsqlite", 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "addrvec": [ 2024-09-19T06:57:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v2", 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:0", 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 2181823860 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "rbd_support", 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "addrvec": [ 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v2", 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:0", 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 4163645703 2024-09-19T06:57:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snap_schedule", 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "addrvec": [ 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v2", 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:0", 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 1881560931 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "snap_schedule", 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "addrvec": [ 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v2", 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:0", 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 3712902885 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "volumes", 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "addrvec": [ 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-19T06:57:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v2", 2024-09-19T06:57:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:0", 2024-09-19T06:57:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 3480249181 2024-09-19T06:57:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-19T06:57:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:57:35.172 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:33 smithi189 ceph-mon[34880]: pgmap v329: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:35.172 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:33 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1887436474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:57:35.172 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:33 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1558733939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:57:35.172 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:33 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3979473773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:57:35.173 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:33 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1563318273' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:57:35.173 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:33 smithi203 ceph-mon[35473]: pgmap v329: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:35.173 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:33 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1887436474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:57:35.173 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:33 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1558733939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:57:35.173 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:33 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3979473773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:57:35.173 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:33 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1563318273' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf9c0a3440 msgr2=0x7fbf9c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf9c0a3440 0x7fbf9c0a5900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009900 tx=0x7fbfa00058d0 comp rx=0 tx=0).stop 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb0101360 msgr2=0x7fbfb010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb0101360 0x7fbfb010e860 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800d770 tx=0x7fbf9800dc30 comp rx=0 tx=0).stop 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 shutdown_connections 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7fbf9c0a3440 0x7fbf9c0a5900 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb01069d0 0x7fbfb010eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfb0101360 0x7fbfb010e860 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 --2- 172.21.15.159:0/1563318273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfb01009c0 0x7fbfb010e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 >> 172.21.15.159:0/1563318273 conn(0x7fbfb00fc6a0 msgr2=0x7fbfb00fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:35.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.826+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 shutdown_connections 2024-09-19T06:57:35.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:33.827+0000 7fbfb57f1640 1 -- 172.21.15.159:0/1563318273 wait complete. 2024-09-19T06:57:35.235 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T06:57:35.235 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T06:57:35.235 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:33 smithi159 ceph-mon[30935]: pgmap v329: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:35.236 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:33 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1887436474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:57:35.236 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:33 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1558733939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:57:35.236 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:33 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3979473773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:57:35.236 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:33 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1563318273' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:57:35.494 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:35.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:35 smithi159 ceph-mon[30935]: pgmap v330: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:36.027 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:57:36.027 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:36.027 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 0, 2024-09-19T06:57:36.027 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 2, 2024-09-19T06:57:36.027 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:57:36.027 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 0, 2024-09-19T06:57:36.027 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.001202049, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.000233518, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:36.028 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 215, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 203, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 1448400, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 123872, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:36.029 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.037401550, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.013422529, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.035791649, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 203, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.014022448, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000069076 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.030 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 1448400, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 123872 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 2, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 153, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 184064, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.012590324, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.008381699, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.002115691, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:36.031 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 150, 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.011407459, 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000076049 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 184064 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.032 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:36.033 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:36.034 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:36.035 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 149017, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 31, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:36.036 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 2, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-19T06:57:36.037 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 213, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 1415653, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 213, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 213, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 1415653, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:36.038 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:36.039 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:36.039 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:57:36.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:35 smithi203 ceph-mon[35473]: pgmap v330: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:36.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:35 smithi189 ceph-mon[34880]: pgmap v330: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:36.721 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T06:57:36.722 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T06:57:36.722 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T06:57:36.722 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-19T06:57:36.722 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T06:57:36.722 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T06:57:36.973 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:37.480 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:57:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 220, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 208, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 1449760, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 127072, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.042599689, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.015153906, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.037836277, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 208, 2024-09-19T06:57:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.014851889, 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000071403 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 1449760, 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 127072 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 2, 2024-09-19T06:57:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 158, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 184944, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.013051983, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.008800418, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.001980676, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 155, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.017027164, 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000109852 2024-09-19T06:57:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 184944 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 0, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 2, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 0, 2024-09-19T06:57:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.000358893, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.000272316, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 0, 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 148977, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 30, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 0, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 2, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 218, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 1416303, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 218, 2024-09-19T06:57:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 218, 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 1416303, 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:37.492 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:57:38.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:37 smithi203 ceph-mon[35473]: pgmap v331: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:38.103 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:37 smithi159 ceph-mon[30935]: pgmap v331: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:38.132 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T06:57:38.132 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:57:38.132 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:57:38.132 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-19T06:57:38.132 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T06:57:38.132 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T06:57:38.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:37 smithi189 ceph-mon[34880]: pgmap v331: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:38.383 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:38.886 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:57:38.886 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:38.886 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 4, 2024-09-19T06:57:38.886 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 4, 2024-09-19T06:57:38.886 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 2992, 2024-09-19T06:57:38.886 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 448, 2024-09-19T06:57:38.886 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:38.886 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.003035078, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.000034086, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.002116406, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 3, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.004016908, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001338969 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:38.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 212, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 202, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 1445680, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 124064, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.037136428, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.013685887, 2024-09-19T06:57:38.888 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.035252344, 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 201, 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.010817884, 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000053820 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 1445680, 2024-09-19T06:57:38.889 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 2, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 155, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 184416, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.014500372, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.009874308, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.002359579, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:38.890 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 152, 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.009902771, 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000065149 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:57:38.891 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 184416 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 0, 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:38.892 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:38.893 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-19T06:57:38.894 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 148995, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 31, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:38.895 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:38.896 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 0, 2024-09-19T06:57:38.896 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:38.896 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:38.896 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:38.896 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-19T06:57:38.896 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:38.896 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 2, 2024-09-19T06:57:38.896 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:38.896 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 214, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 1415783, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 214, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-19T06:57:38.897 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-19T06:57:38.898 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 214, 2024-09-19T06:57:38.898 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 1415783, 2024-09-19T06:57:38.898 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-19T06:57:38.898 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:38.898 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:38.898 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:38.898 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:38.898 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:38.898 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:57:39.822 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T06:57:39.822 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T06:57:39.823 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T06:57:39.823 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-19T06:57:39.823 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T06:57:39.823 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T06:57:40.070 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:40.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:39 smithi203 ceph-mon[35473]: pgmap v332: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:40.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:39 smithi189 ceph-mon[34880]: pgmap v332: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:40.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:39 smithi159 ceph-mon[30935]: pgmap v332: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:40.577 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-19T06:57:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 0, 2024-09-19T06:57:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 2, 2024-09-19T06:57:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:57:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 0, 2024-09-19T06:57:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.001135099, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.000257150, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 218, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 208, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 1447312, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 127904, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.039358524, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.013440297, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.038154601, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 207, 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.010803119, 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000052188 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 1447312, 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 127904 2024-09-19T06:57:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 6, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 161, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 3312, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 185568, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.013858395, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.007936409, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.003769277, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 159, 2024-09-19T06:57:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.016899803, 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000106288 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 185568 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 0, 2024-09-19T06:57:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 149011, 2024-09-19T06:57:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 32, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 2, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 220, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 1416563, 2024-09-19T06:57:40.587 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 220, 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 220, 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 1416563, 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-19T06:57:40.588 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-19T06:57:41.295 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T06:57:41.295 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:57:41.295 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:57:41.295 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-19T06:57:41.295 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T06:57:41.295 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T06:57:41.555 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:57:41.929 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:41 smithi189 ceph-mon[34880]: pgmap v333: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:42.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:41 smithi203 ceph-mon[35473]: pgmap v333: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:42.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:41 smithi159 ceph-mon[30935]: pgmap v333: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:42.202 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-19T06:57:42.202 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:42.202 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 952, 2024-09-19T06:57:42.202 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 954, 2024-09-19T06:57:42.202 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 38025869, 2024-09-19T06:57:42.202 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 302746, 2024-09-19T06:57:42.202 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 8, 2024-09-19T06:57:42.202 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.103075491, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.029984723, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.036955990, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.027675292, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 952, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.036088728, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000037908 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.203 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 449, 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 446, 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 54808420, 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 176914, 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-19T06:57:42.204 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.066005250, 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.014174672, 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.046003048, 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.006884192, 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 446, 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.021960627, 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000049239 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 196496, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 80176 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 432, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 528, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 31653236, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 393795, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.054433646, 2024-09-19T06:57:42.206 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.013285062, 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.026972797, 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.010277064, 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 526, 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.017738550, 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000033723 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.207 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T06:57:42.208 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 256736 2024-09-19T06:57:42.208 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.208 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-19T06:57:42.208 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-19T06:57:42.208 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-19T06:57:42.208 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.208 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-19T06:57:42.208 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-19T06:57:42.208 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-19T06:57:42.209 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2724, 2024-09-19T06:57:42.209 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.107318226, 2024-09-19T06:57:42.209 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000039397 2024-09-19T06:57:42.209 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:42.209 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.209 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-19T06:57:42.209 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-19T06:57:42.209 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-19T06:57:42.209 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.210 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 14370, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 8435, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 5935, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 2320, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-19T06:57:42.211 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 2, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-19T06:57:42.212 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 4, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 234, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 6, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:57:42.213 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:57:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-19T06:57:42.215 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:57:42.216 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 35655, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-19T06:57:42.217 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 3, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 17, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 174403597, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 178342029, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 178341917, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 35655 2024-09-19T06:57:42.218 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 4708, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 9274, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 4566, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 223, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 223, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 0, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 14370, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 14370, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 0, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-19T06:57:42.219 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 75724, 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 215328 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.220 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.221 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-19T06:57:42.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.223 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.224 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.225 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-19T06:57:42.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.225 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.225 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.225 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-19T06:57:42.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.226 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.227 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-19T06:57:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.229 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.230 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.231 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.232 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 2, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 0, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 0, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 1890, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:42.233 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:42.234 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:42.234 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:42.234 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:42.234 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:42.234 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:42.234 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:42.234 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:42.234 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:42.234 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:42.235 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 417304, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 4880, 2024-09-19T06:57:42.236 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8384, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 184, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:42.237 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 21245126, 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 174939, 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-19T06:57:42.238 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 1687, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 26, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 4, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 1687, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1687, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 1.201975706, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000712493 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-19T06:57:42.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1687, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 1688 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 1687, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 1687, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 1012, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 672, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-19T06:57:42.240 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 2, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-19T06:57:42.241 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-19T06:57:42.242 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 92, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 8, 2024-09-19T06:57:42.243 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 11, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 11, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-19T06:57:42.244 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-19T06:57:42.245 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 1829, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 124312702, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 1829, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1829, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 124312702, 2024-09-19T06:57:42.246 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:42.247 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 1687, 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 123819706, 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1687, 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 123819706, 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.248 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 1687, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 1687, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1687, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1687, 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-19T06:57:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-19T06:57:42.250 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x55cb223586e0": { 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-19T06:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:42.252 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-19T06:57:43.216 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T06:57:43.216 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:57:43.216 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:57:43.216 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-09-19T06:57:43.216 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T06:57:43.217 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T06:57:43.471 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:57:44.014 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-19T06:57:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 0, 2024-09-19T06:57:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 2, 2024-09-19T06:57:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:57:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 0, 2024-09-19T06:57:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.001147941, 2024-09-19T06:57:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000251464, 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:57:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:57:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 2, 2024-09-19T06:57:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 159, 2024-09-19T06:57:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 185120, 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.011288817, 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.007312328, 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001873688, 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 156, 2024-09-19T06:57:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.016733198, 2024-09-19T06:57:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000107264 2024-09-19T06:57:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:57:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 185120 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 221, 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 209, 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1450032, 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 127712, 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.039684773, 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.013677086, 2024-09-19T06:57:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.038807260, 2024-09-19T06:57:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 209, 2024-09-19T06:57:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.015412799, 2024-09-19T06:57:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000073745 2024-09-19T06:57:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 1450032, 2024-09-19T06:57:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 127712 2024-09-19T06:57:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-19T06:57:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-19T06:57:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-19T06:57:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 148977, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 30, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-19T06:57:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 219, 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1416433, 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 219, 2024-09-19T06:57:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-19T06:57:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-19T06:57:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 219, 2024-09-19T06:57:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1416433, 2024-09-19T06:57:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-19T06:57:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:44.031 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-19T06:57:44.764 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:44 smithi189 ceph-mon[34880]: pgmap v334: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:44.792 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-19T06:57:44.793 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-19T06:57:44.793 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-19T06:57:44.793 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-19T06:57:44.793 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T06:57:44.793 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T06:57:44.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:44 smithi159 ceph-mon[30935]: pgmap v334: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:45.040 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:57:45.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:44 smithi203 ceph-mon[35473]: pgmap v334: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:45.594 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-19T06:57:45.594 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:45.594 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 0, 2024-09-19T06:57:45.594 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 2, 2024-09-19T06:57:45.594 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:57:45.594 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 0, 2024-09-19T06:57:45.594 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:45.594 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.001157578, 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000252868, 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.595 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 219, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 207, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1449488, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 126432, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:45.596 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.038058833, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.013380788, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.036398109, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 207, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.015972442, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000077161 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:45.597 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 1449488, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 126432 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 2, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 157, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 184768, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.011541522, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.007523841, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001945952, 2024-09-19T06:57:45.598 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 154, 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.014877455, 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000096606 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.599 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 184768 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:45.600 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:45.601 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:45.601 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:45.601 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:45.601 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:45.601 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:45.601 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:45.601 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:45.601 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:45.601 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:45.602 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:45.603 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 148994, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 31, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-19T06:57:45.604 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:45.605 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:45.605 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:45.605 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-19T06:57:45.605 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:45.605 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-19T06:57:45.605 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:45.605 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-19T06:57:45.605 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:45.605 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 217, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1416173, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 217, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 217, 2024-09-19T06:57:45.606 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1416173, 2024-09-19T06:57:45.607 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-19T06:57:45.607 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:45.607 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:45.607 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:45.607 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:45.607 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:45.607 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-19T06:57:46.335 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-19T06:57:46.335 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-19T06:57:46.335 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-19T06:57:46.335 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.h 2024-09-19T06:57:46.335 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T06:57:46.335 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T06:57:46.582 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:57:46.888 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:46 smithi189 ceph-mon[34880]: pgmap v335: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:46.893 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:46 smithi203 ceph-mon[35473]: pgmap v335: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:46.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:46 smithi159 ceph-mon[30935]: pgmap v335: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:47.139 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 220, 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 210, 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1447856, 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 129184, 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.040608124, 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.013810632, 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.039675748, 2024-09-19T06:57:47.140 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 209, 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.012793638, 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000061213 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 1447856, 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 129184 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.141 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 6, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 164, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 3312, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 186096, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.013698706, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.007969822, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.003716659, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 162, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.021043210, 2024-09-19T06:57:47.142 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000129896 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 186096 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 0, 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 2, 2024-09-19T06:57:47.143 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 0, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.000378508, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000313607, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:47.144 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:47.146 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:47.147 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 150008, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 31, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-19T06:57:47.148 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-19T06:57:47.149 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 222, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1416823, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 222, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-19T06:57:47.150 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-19T06:57:47.151 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 222, 2024-09-19T06:57:47.151 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1416823, 2024-09-19T06:57:47.151 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-19T06:57:47.151 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-19T06:57:47.151 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-19T06:57:47.151 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-19T06:57:47.151 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:47.151 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-19T06:57:47.151 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-19T06:57:47.837 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T06:57:47.837 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T06:57:47.837 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T06:57:47.837 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-19T06:57:47.837 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T06:57:47.838 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T06:57:48.096 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:57:48.601 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T06:57:48.601 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:48.601 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 4, 2024-09-19T06:57:48.601 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 4, 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 2992, 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 448, 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.003093580, 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.000031987, 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.002203991, 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:48.602 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 3, 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.003970771, 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001323590 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:48.603 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 2, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 159, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 185120, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.010329606, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.006685446, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.001797623, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 156, 2024-09-19T06:57:48.604 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.014026819, 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000089915 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 185120 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:48.605 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 217, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 207, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 1447040, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 127264, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.039069251, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.014095550, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.038833527, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 206, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.011399320, 2024-09-19T06:57:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000055336 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 1447040, 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 0, 2024-09-19T06:57:48.607 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:48.608 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:48.609 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:48.610 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 148977, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 30, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:48.611 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 0, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 2, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:48.612 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 219, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 1416433, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 219, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 219, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1416433, 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T06:57:48.613 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:48.614 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:48.614 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:48.614 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:48.614 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:48.614 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T06:57:48.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:48 smithi203 ceph-mon[35473]: pgmap v336: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:48.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:48 smithi159 ceph-mon[30935]: pgmap v336: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:49.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:48 smithi189 ceph-mon[34880]: pgmap v336: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:49.423 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-19T06:57:49.423 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-19T06:57:49.423 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-19T06:57:49.423 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.c 2024-09-19T06:57:49.423 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T06:57:49.423 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T06:57:49.689 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:57:50.241 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T06:57:50.241 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:50.241 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 4, 2024-09-19T06:57:50.241 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 4, 2024-09-19T06:57:50.241 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 2992, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 448, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.003184490, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.000031234, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.002310804, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 3, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.004179639, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001393213 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.242 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 218, 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 208, 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 1447312, 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 127904, 2024-09-19T06:57:50.243 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.039093784, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.013753646, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.037725550, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 207, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.012071642, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000058317 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:50.244 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 1447312, 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 127904 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 2, 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 159, 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 185120, 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:50.245 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.010598208, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.006909669, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.001663361, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 156, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.016198499, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000103836 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:50.246 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 185120 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 0, 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:50.247 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:50.248 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:50.249 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 148984, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 30, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T06:57:50.250 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 2, 2024-09-19T06:57:50.251 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 220, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 1416563, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:50.252 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 220, 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 220, 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1416563, 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:50.253 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T06:57:50.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:50 smithi159 ceph-mon[30935]: pgmap v337: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:50.904 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:50 smithi203 ceph-mon[35473]: pgmap v337: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:50.931 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-19T06:57:50.931 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-19T06:57:50.931 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-19T06:57:50.931 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-09-19T06:57:50.931 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T06:57:50.931 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T06:57:51.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:50 smithi189 ceph-mon[34880]: pgmap v337: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:57:51.717 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T06:57:51.717 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:51.717 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 80922, 2024-09-19T06:57:51.717 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 139675, 2024-09-19T06:57:51.717 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 31257517, 2024-09-19T06:57:51.717 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 103563300, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 37, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 5, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 5.776074495, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 2.561847438, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 3.582545597, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.720643584, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 139675, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 7.771893580, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000055642 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.718 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 131899, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.020037932, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000151 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 20898848, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 52416304 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 52995, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 52934, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 19960975, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 111287842, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 200, 2024-09-19T06:57:51.719 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 7, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 3.314082615, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 1.151649236, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.732094561, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 1.217160964, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 52931, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 17.136811713, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000323757 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 298, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000034537, 2024-09-19T06:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000115 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 44112, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 127008 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 26819, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 26796, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 9529418, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 46344803, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 17, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 5, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 1.678907593, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.538001995, 2024-09-19T06:57:51.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.370019711, 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.647994970, 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 26793, 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 5.798979420, 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000216436 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 301, 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000054418, 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000180 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 98272, 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 359248 2024-09-19T06:57:51.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 109561, 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 38.376565025, 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000350275 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.723 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 7184, 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 3.453980937, 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000480787 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 25367, 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 25367, 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 25367, 2024-09-19T06:57:51.724 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 175.650993245, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.006924389 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 0, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 0, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 1299, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 25, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 3, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 10416, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 6011, 2024-09-19T06:57:51.725 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 4405, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 0, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 1828, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 0, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 3, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 4, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 2, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 27013, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 26347, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 0, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 0, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-09-19T06:57:51.726 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 2, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 0, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 0, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 0, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 0, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 0, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 28098, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 4, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 234, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 6, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 28098, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-09-19T06:57:51.727 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 525, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 18, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 507, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 27573, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 13504, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 24211, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 7863, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 23334, 2024-09-19T06:57:51.728 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 14523, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 626, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 16931 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 0, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 0, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 0, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 0, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 0, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 61, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:57:51.729 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 7279, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 7215, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 3, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 0, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 6, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 14322, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 18, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 0, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 30, 2024-09-19T06:57:51.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 58117, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 56282, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 56282, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 1835, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 8084, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 96, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 93, 2024-09-19T06:57:51.731 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 93, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 3, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 1, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 11, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 174403597, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 178342029, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 0, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 26782, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 83.636298152, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.003122854 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 0 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.732 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 4756, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 11989, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 7233, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 233, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 288, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 55, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 10416, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 17273, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 6857, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 4, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 12196, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 12192, 2024-09-19T06:57:51.733 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 132948, 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 231712 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 43505, 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 0, 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 25367, 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 32, 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 0, 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 7208, 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 33.882111124, 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.004700625 2024-09-19T06:57:51.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 107, 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 2.648102347, 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.024748620 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 3, 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.008404334, 2024-09-19T06:57:51.735 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.002801444 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 730, 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 4.207335792, 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.005763473 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2, 2024-09-19T06:57:51.736 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000476060, 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000238030 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-09-19T06:57:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 10, 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.001640409, 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000164040 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 73, 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 16.668715637, 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.228338570 2024-09-19T06:57:51.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 10, 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.054741627, 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.005474162 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-09-19T06:57:51.739 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 429, 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.088791095, 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000206972 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 479, 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.824267608, 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001720809 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 94, 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.373637558, 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.003974867 2024-09-19T06:57:51.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 73, 2024-09-19T06:57:51.741 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 2.975729465, 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.040763417 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4, 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.019110531, 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.004777632 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.742 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 8973, 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 103.552939569, 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.011540503 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 8, 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.002479272, 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000309909 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 7, 2024-09-19T06:57:51.744 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.019492836, 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.002784690 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 6, 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.003756596, 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000626099 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 7151, 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 10.319261385, 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001443051 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.745 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 2, 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 5, 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 3, 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 2, 2024-09-19T06:57:51.746 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 713, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 356, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 620, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:51.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:51.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T06:57:51.749 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 956612, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 4889, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:51.750 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 8384, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 184, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 18882282, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 197533, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.751 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 109593, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 193211139, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 32, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 109593, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 109593, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 1364.634923410, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.012451843 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-09-19T06:57:51.752 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 109593, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 128902 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 109593, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 28198, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 81395, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 1017, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 8329, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 82, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 26846, 2024-09-19T06:57:51.753 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 143, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 0, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 9, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 7878, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 28116, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 16659, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:57:51.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 36717, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-09-19T06:57:51.755 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 92, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 13, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 12, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 12, 2024-09-19T06:57:51.756 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 0, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 2764, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 0, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 342 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 1, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 14333 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.757 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 56, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 32, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 7245, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 7215, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 160732, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 43830370, 2024-09-19T06:57:51.758 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 160732, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 160732, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 43830370, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T06:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 109593, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 194088662, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 109593, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 194088662, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.760 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 109593, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 109593, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 109593, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 109593, 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T06:57:51.761 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 7215, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 877523, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 7215, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T06:57:51.762 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 64, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 877523, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x557690416960": { 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 58117, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 174147725, 2024-09-19T06:57:51.763 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 58117, 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 26782, 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 174147725, 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:51.764 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T06:57:52.586 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T06:57:52.586 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=10 2024-09-19T06:57:52.587 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=4 2024-09-19T06:57:52.587 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=25 2024-09-19T06:57:52.587 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T06:57:52.587 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T06:57:52.834 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:57:52.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:52 smithi203 ceph-mon[35473]: pgmap v338: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:52.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:52 smithi159 ceph-mon[30935]: pgmap v338: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:53.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:52 smithi189 ceph-mon[34880]: pgmap v338: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:53.355 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 0, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 2, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 0, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 4, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 0, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.001079901, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.000272307, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:53.356 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.357 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 6, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 165, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 3312, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 186272, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 5, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.012479399, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.006953423, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.003588977, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 163, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.019619686, 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000120366 2024-09-19T06:57:53.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 186272 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 222, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 212, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 1448400, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 130464, 2024-09-19T06:57:53.359 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 2, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 1, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.038763935, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.014110303, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.037750504, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 211, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.012470092, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000059099 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:53.360 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 1448400, 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 130464 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 0, 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:53.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:53.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:53.363 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 149034, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 32, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:53.364 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 928, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 2, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T06:57:53.365 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 224, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 1417083, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 224, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 224, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1417083, 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T06:57:53.366 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T06:57:53.367 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T06:57:53.367 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T06:57:53.367 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:53.367 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T06:57:53.367 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T06:57:54.061 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-19T06:57:54.061 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-19T06:57:54.061 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-19T06:57:54.061 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-19T06:57:54.061 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T06:57:54.073 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T06:57:54.073 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:57:54.073 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:57:54.094 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-19T06:57:54.095 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:57:54.154 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:57:54.448 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:54.845 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:54 smithi159 ceph-mon[30935]: pgmap v339: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:54.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.923+0000 7f3b4c842640 1 -- 172.21.15.159:0/2592771038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48100a80 msgr2=0x7f3b48100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.923+0000 7f3b4c842640 1 --2- 172.21.15.159:0/2592771038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48100a80 0x7f3b48100ee0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009930 tx=0x7f3b3002a420 comp rx=0 tx=0).stop 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.923+0000 7f3b4c842640 1 -- 172.21.15.159:0/2592771038 shutdown_connections 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.923+0000 7f3b4c842640 1 --2- 172.21.15.159:0/2592771038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48101420 0x7f3b4810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.923+0000 7f3b4c842640 1 --2- 172.21.15.159:0/2592771038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48100a80 0x7f3b48100ee0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.923+0000 7f3b4c842640 1 --2- 172.21.15.159:0/2592771038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b48106a80 0x7f3b48106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.923+0000 7f3b4c842640 1 -- 172.21.15.159:0/2592771038 >> 172.21.15.159:0/2592771038 conn(0x7f3b480fc7a0 msgr2=0x7f3b480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.923+0000 7f3b4c842640 1 -- 172.21.15.159:0/2592771038 shutdown_connections 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.923+0000 7f3b4c842640 1 -- 172.21.15.159:0/2592771038 wait complete. 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.924+0000 7f3b4c842640 1 Processor -- start 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.924+0000 7f3b4c842640 1 -- start start 2024-09-19T06:57:54.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.924+0000 7f3b4c842640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b48100a80 0x7f3b481983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.924+0000 7f3b4c842640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48101420 0x7f3b481988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.924+0000 7f3b4c842640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48106a80 0x7f3b4819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.924+0000 7f3b4c842640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3b48110e80 con 0x7f3b48106a80 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.924+0000 7f3b4c842640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b48110d00 con 0x7f3b48101420 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.924+0000 7f3b4c842640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3b48111000 con 0x7f3b48100a80 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b46d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48106a80 0x7f3b4819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b46d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48106a80 0x7f3b4819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45492/0 (socket says 172.21.15.159:45492) 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b46d9d640 1 -- 172.21.15.159:0/599415893 learned_addr learned my addr 172.21.15.159:0/599415893 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b3ffff640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48101420 0x7f3b481988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b4659c640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b48100a80 0x7f3b481983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b46d9d640 1 -- 172.21.15.159:0/599415893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b48100a80 msgr2=0x7f3b481983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b46d9d640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b48100a80 0x7f3b481983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:54.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b46d9d640 1 -- 172.21.15.159:0/599415893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48101420 msgr2=0x7f3b481988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b46d9d640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48101420 0x7f3b481988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b46d9d640 1 -- 172.21.15.159:0/599415893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4819d360 con 0x7f3b48106a80 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b46d9d640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48106a80 0x7f3b4819cc80 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000cce0 tx=0x7f3b4000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b3f7fe640 1 -- 172.21.15.159:0/599415893 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4000f450 con 0x7f3b48106a80 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b3f7fe640 1 -- 172.21.15.159:0/599415893 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b4000fad0 con 0x7f3b48106a80 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4819d650 con 0x7f3b48106a80 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b3f7fe640 1 -- 172.21.15.159:0/599415893 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b40018c10 con 0x7f3b48106a80 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.925+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b481a4f30 con 0x7f3b48106a80 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.926+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b48100ee0 con 0x7f3b48106a80 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.927+0000 7f3b3f7fe640 1 -- 172.21.15.159:0/599415893 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3b4000f5f0 con 0x7f3b48106a80 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.928+0000 7f3b3f7fe640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3b340a3430 0x7f3b340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.928+0000 7f3b4659c640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3b340a3430 0x7f3b340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.928+0000 7f3b3f7fe640 1 -- 172.21.15.159:0/599415893 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f3b400d0320 con 0x7f3b48106a80 2024-09-19T06:57:54.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.929+0000 7f3b4659c640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3b340a3430 0x7f3b340a58f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009b50 tx=0x7f3b38005f90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:54.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:54.933+0000 7f3b3f7fe640 1 -- 172.21.15.159:0/599415893 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b40014030 con 0x7f3b48106a80 2024-09-19T06:57:55.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:54 smithi203 ceph-mon[35473]: pgmap v339: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:55.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.112+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3b4802d7c0 con 0x7f3b48106a80 2024-09-19T06:57:55.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.112+0000 7f3b3f7fe640 1 -- 172.21.15.159:0/599415893 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v92) ==== 81+0+1019 (secure 0 0 0) 0x7f3b4009cca0 con 0x7f3b48106a80 2024-09-19T06:57:55.113 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/2390667146 2024-09-20T06:47:00.531421+0000 2024-09-19T06:57:55.113 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3688060506 2024-09-20T06:38:10.187881+0000 2024-09-19T06:57:55.113 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2156136647 2024-09-20T06:47:00.531421+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2881238143 2024-09-20T06:38:10.187881+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/1858964097 2024-09-20T06:38:10.187881+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2526477703 2024-09-20T06:47:00.531421+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/141750176 2024-09-20T06:38:10.187881+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3276076186 2024-09-20T06:47:00.531421+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3917454568 2024-09-20T06:38:33.329792+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3612735042 2024-09-20T06:38:33.329792+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/3687310237 2024-09-20T06:38:33.329792+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/3687310237 2024-09-20T06:38:33.329792+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/4146600912 2024-09-20T06:38:33.329792+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/141750176 2024-09-20T06:38:10.187881+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3424652308 2024-09-20T06:47:00.531421+0000 2024-09-19T06:57:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/2390667146 2024-09-20T06:47:00.531421+0000 2024-09-19T06:57:55.115 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3763048477 2024-09-20T06:47:00.531421+0000 2024-09-19T06:57:55.115 INFO:teuthology.orchestra.run.smithi159.stderr:listed 17 entries 2024-09-19T06:57:55.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3b340a3430 msgr2=0x7f3b340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:55.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3b340a3430 0x7f3b340a58f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009b50 tx=0x7f3b38005f90 comp rx=0 tx=0).stop 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48106a80 msgr2=0x7f3b4819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48106a80 0x7f3b4819cc80 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000cce0 tx=0x7f3b4000a620 comp rx=0 tx=0).stop 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 shutdown_connections 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f3b340a3430 0x7f3b340a58f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b48106a80 0x7f3b4819cc80 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48101420 0x7f3b481988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 --2- 172.21.15.159:0/599415893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b48100a80 0x7f3b481983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.114+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 >> 172.21.15.159:0/599415893 conn(0x7f3b480fc7a0 msgr2=0x7f3b4806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.115+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 shutdown_connections 2024-09-19T06:57:55.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:55.115+0000 7f3b4c842640 1 -- 172.21.15.159:0/599415893 wait complete. 2024-09-19T06:57:55.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:54 smithi189 ceph-mon[34880]: pgmap v339: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:57:55.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:55 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/599415893' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:57:55.932 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T06:57:55.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:55.932 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T06:57:55.975 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T06:57:55.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:55.975 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T06:57:56.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:56.041 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-09-19T06:57:56.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:55 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/599415893' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:57:56.097 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T06:57:56.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:56.097 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:57:56.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:55 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/599415893' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:57:56.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:56.163 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2024-09-19T06:57:56.253 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T06:57:56.264 INFO:tasks.cephadm:Teardown begin 2024-09-19T06:57:56.264 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T06:57:56.264 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:57:56.515 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:56.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:56 smithi159 ceph-mon[30935]: pgmap v340: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:56.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 -- 172.21.15.159:0/1452985147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 msgr2=0x7f4d8010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:56.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/1452985147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 0x7f4d8010d930 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009cd0 tx=0x7f4d7802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:57:56.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 -- 172.21.15.159:0/1452985147 shutdown_connections 2024-09-19T06:57:56.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/1452985147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 0x7f4d8010d930 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:56.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/1452985147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80100a60 0x7f4d80100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:56.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/1452985147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d80106a60 0x7f4d80106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:56.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 -- 172.21.15.159:0/1452985147 >> 172.21.15.159:0/1452985147 conn(0x7f4d800fc780 msgr2=0x7f4d800feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 -- 172.21.15.159:0/1452985147 shutdown_connections 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 -- 172.21.15.159:0/1452985147 wait complete. 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 Processor -- start 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.995+0000 7f4d86cf1640 1 -- start start 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d86cf1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80100a60 0x7f4d8010e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d86cf1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 0x7f4d8010e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d86cf1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d80106a60 0x7f4d8010ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d86cf1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80111f80 con 0x7f4d80101400 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d86cf1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80111e00 con 0x7f4d80100a60 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d86cf1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80112100 con 0x7f4d80106a60 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 0x7f4d8010e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:57.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 0x7f4d8010e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45520/0 (socket says 172.21.15.159:45520) 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7ffff640 1 -- 172.21.15.159:0/3360936919 learned_addr learned my addr 172.21.15.159:0/3360936919 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7ffff640 1 -- 172.21.15.159:0/3360936919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d80106a60 msgr2=0x7f4d8010ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7ffff640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d80106a60 0x7f4d8010ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d84a8d640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80100a60 0x7f4d8010e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7ffff640 1 -- 172.21.15.159:0/3360936919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80100a60 msgr2=0x7f4d8010e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7ffff640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80100a60 0x7f4d8010e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7ffff640 1 -- 172.21.15.159:0/3360936919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d801a68d0 con 0x7f4d80101400 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d84a8d640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80100a60 0x7f4d8010e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7ffff640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 0x7f4d8010e900 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00c920 tx=0x7f4d6c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7dffb640 1 -- 172.21.15.159:0/3360936919 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c007c70 con 0x7f4d80101400 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d801a6bc0 con 0x7f4d80101400 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7dffb640 1 -- 172.21.15.159:0/3360936919 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d6c007e10 con 0x7f4d80101400 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.996+0000 7f4d7dffb640 1 -- 172.21.15.159:0/3360936919 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c018890 con 0x7f4d80101400 2024-09-19T06:57:57.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.997+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d801a7150 con 0x7f4d80101400 2024-09-19T06:57:57.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.998+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d80100ec0 con 0x7f4d80101400 2024-09-19T06:57:57.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.999+0000 7f4d7dffb640 1 -- 172.21.15.159:0/3360936919 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4d6c018a70 con 0x7f4d80101400 2024-09-19T06:57:57.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.999+0000 7f4d7dffb640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4d700a33b0 0x7f4d700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:57.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.999+0000 7f4d84a8d640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4d700a33b0 0x7f4d700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:57.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:56.999+0000 7f4d7dffb640 1 -- 172.21.15.159:0/3360936919 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f4d6c0cff80 con 0x7f4d80101400 2024-09-19T06:57:57.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.000+0000 7f4d84a8d640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4d700a33b0 0x7f4d700a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4d74006fd0 tx=0x7f4d74008040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:57.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.003+0000 7f4d7dffb640 1 -- 172.21.15.159:0/3360936919 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4d6c014030 con 0x7f4d80101400 2024-09-19T06:57:57.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:56 smithi203 ceph-mon[35473]: pgmap v340: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:57.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:56 smithi189 ceph-mon[34880]: pgmap v340: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:57:57.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.202+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d801a7380 con 0x7f4d80101400 2024-09-19T06:57:57.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.203+0000 7f4d7dffb640 1 -- 172.21.15.159:0/3360936919 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f4d6c00de20 con 0x7f4d80101400 2024-09-19T06:57:57.204 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:57:57.205 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:57:57.205 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4d700a33b0 msgr2=0x7f4d700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4d700a33b0 0x7f4d700a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4d74006fd0 tx=0x7f4d74008040 comp rx=0 tx=0).stop 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 msgr2=0x7f4d8010e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 0x7f4d8010e900 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00c920 tx=0x7f4d6c00cde0 comp rx=0 tx=0).stop 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 shutdown_connections 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f4d700a33b0 0x7f4d700a5870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d80106a60 0x7f4d8010ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80101400 0x7f4d8010e900 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 --2- 172.21.15.159:0/3360936919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80100a60 0x7f4d8010e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.205+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 >> 172.21.15.159:0/3360936919 conn(0x7f4d800fc780 msgr2=0x7f4d800fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.206+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 shutdown_connections 2024-09-19T06:57:57.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:57.206+0000 7f4d86cf1640 1 -- 172.21.15.159:0/3360936919 wait complete. 2024-09-19T06:57:57.843 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:57:58.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:57 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/3360936919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:58.092 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:58.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:57 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/3360936919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:58.147 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:57 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/3360936919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:58.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.560+0000 7f0079e10640 1 -- 172.21.15.159:0/1994900850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 msgr2=0x7f00741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:58.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.560+0000 7f0079e10640 1 --2- 172.21.15.159:0/1994900850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 0x7f00741021c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f0064009900 tx=0x7f006402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.560+0000 7f0079e10640 1 -- 172.21.15.159:0/1994900850 shutdown_connections 2024-09-19T06:57:58.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.560+0000 7f0079e10640 1 --2- 172.21.15.159:0/1994900850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074106f10 0x7f007410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.560+0000 7f0079e10640 1 --2- 172.21.15.159:0/1994900850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074102790 0x7f00741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.560+0000 7f0079e10640 1 --2- 172.21.15.159:0/1994900850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 0x7f00741021c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.560+0000 7f0079e10640 1 -- 172.21.15.159:0/1994900850 >> 172.21.15.159:0/1994900850 conn(0x7f00740fd8c0 msgr2=0x7f00740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:58.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.560+0000 7f0079e10640 1 -- 172.21.15.159:0/1994900850 shutdown_connections 2024-09-19T06:57:58.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.560+0000 7f0079e10640 1 -- 172.21.15.159:0/1994900850 wait complete. 2024-09-19T06:57:58.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f0079e10640 1 Processor -- start 2024-09-19T06:57:58.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f0079e10640 1 -- start start 2024-09-19T06:57:58.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f0079e10640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 0x7f00740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:58.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f0079e10640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074102790 0x7f0074074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:58.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f0079e10640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074106f10 0x7f0074074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:58.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f0079e10640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0074111f90 con 0x7f0074101de0 2024-09-19T06:57:58.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f0079e10640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0074111e10 con 0x7f0074106f10 2024-09-19T06:57:58.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f0079e10640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0074112110 con 0x7f0074102790 2024-09-19T06:57:58.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f00737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 0x7f00740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:58.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f00737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 0x7f00740744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45540/0 (socket says 172.21.15.159:45540) 2024-09-19T06:57:58.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.561+0000 7f00737fe640 1 -- 172.21.15.159:0/2003432902 learned_addr learned my addr 172.21.15.159:0/2003432902 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:57:58.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f006bfff640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074102790 0x7f0074074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:58.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f0073fff640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074106f10 0x7f0074074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:58.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f00737fe640 1 -- 172.21.15.159:0/2003432902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074102790 msgr2=0x7f0074074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:58.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f00737fe640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074102790 0x7f0074074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f00737fe640 1 -- 172.21.15.159:0/2003432902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074106f10 msgr2=0x7f0074074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:58.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f00737fe640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074106f10 0x7f0074074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f00737fe640 1 -- 172.21.15.159:0/2003432902 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00741a6890 con 0x7f0074101de0 2024-09-19T06:57:58.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f006bfff640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074102790 0x7f0074074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:57:58.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f0073fff640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074106f10 0x7f0074074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:57:58.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f00737fe640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 0x7f00740744f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f0064005ab0 tx=0x7f00640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:58.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f00717fa640 1 -- 172.21.15.159:0/2003432902 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006403f030 con 0x7f0074101de0 2024-09-19T06:57:58.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f00717fa640 1 -- 172.21.15.159:0/2003432902 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0064003ce0 con 0x7f0074101de0 2024-09-19T06:57:58.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00741a6b20 con 0x7f0074101de0 2024-09-19T06:57:58.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f00717fa640 1 -- 172.21.15.159:0/2003432902 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064035070 con 0x7f0074101de0 2024-09-19T06:57:58.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.562+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00741a7050 con 0x7f0074101de0 2024-09-19T06:57:58.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.563+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00741021c0 con 0x7f0074101de0 2024-09-19T06:57:58.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.564+0000 7f00717fa640 1 -- 172.21.15.159:0/2003432902 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0064042030 con 0x7f0074101de0 2024-09-19T06:57:58.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.565+0000 7f00717fa640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f00600a3430 0x7f00600a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:58.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.565+0000 7f006bfff640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f00600a3430 0x7f00600a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:58.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.565+0000 7f00717fa640 1 -- 172.21.15.159:0/2003432902 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f00640f06c0 con 0x7f0074101de0 2024-09-19T06:57:58.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.565+0000 7f006bfff640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f00600a3430 0x7f00600a58f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0074075f80 tx=0x7f005c005d90 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:58.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.569+0000 7f00717fa640 1 -- 172.21.15.159:0/2003432902 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00640bd040 con 0x7f0074101de0 2024-09-19T06:57:58.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.770+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0074075a20 con 0x7f0074101de0 2024-09-19T06:57:58.773 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:58 smithi159 ceph-mon[30935]: pgmap v341: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:57:58.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.771+0000 7f00717fa640 1 -- 172.21.15.159:0/2003432902 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11873 (secure 0 0 0) 0x7f00640bc940 con 0x7f0074101de0 2024-09-19T06:57:58.774 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:57:58.774 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-09-19T06:49:54:298403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2983935292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2983935292},{"type":"v1","addr":"172.21.15.159:6835","nonce":2983935292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1806152492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1806152492},{"type":"v1","addr":"172.21.15.159:6837","nonce":1806152492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3807456889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3807456889},{"type":"v1","addr":"172.21.15.159:6839","nonce":3807456889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6841/2821417176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6840","nonce":2821417176},{"type":"v1","addr":"172.21.15.159:6841","nonce":2821417176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2134153159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2134153159},{"type":"v1","addr":"172.21.15.189:6833","nonce":2134153159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/4124611480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4124611480},{"type":"v1","addr":"172.21.15.203:6833","nonce":4124611480}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3575906757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3575906757},{"type":"v1","addr":"172.21.15.189:6835","nonce":3575906757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1888227213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1888227213},{"type":"v1","addr":"172.21.15.189:6837","nonce":1888227213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/818128260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":818128260},{"type":"v1","addr":"172.21.15.203:6835","nonce":818128260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1596598644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1596598644},{"type":"v1","addr":"172.21.15.203:6837","nonce":1596598644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:45:23.401782+0000","modified":"2024-09-19T06:49:54.298391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6839/3762709136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3762709136},{"type":"v1","addr":"172.21.15.203:6839","nonce":3762709136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25424":{"gid":25424,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/2326501898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2326501898},{"type":"v1","addr":"172.21.15.189:6839","nonce":2326501898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487]},"id":1}]} 2024-09-19T06:57:58.774 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-09-19T06:57:58.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.773+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f00600a3430 msgr2=0x7f00600a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:58.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.773+0000 7f0079e10640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f00600a3430 0x7f00600a58f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0074075f80 tx=0x7f005c005d90 comp rx=0 tx=0).stop 2024-09-19T06:57:58.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.773+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 msgr2=0x7f00740744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:58.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.773+0000 7f0079e10640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 0x7f00740744f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f0064005ab0 tx=0x7f00640042f0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.774+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 shutdown_connections 2024-09-19T06:57:58.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.774+0000 7f0079e10640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f00600a3430 0x7f00600a58f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.774+0000 7f0079e10640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074106f10 0x7f0074074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.774+0000 7f0079e10640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074102790 0x7f0074074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.774+0000 7f0079e10640 1 --2- 172.21.15.159:0/2003432902 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0074101de0 0x7f00740744f0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:58.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.774+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 >> 172.21.15.159:0/2003432902 conn(0x7f00740fd8c0 msgr2=0x7f00740fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:58.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.774+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 shutdown_connections 2024-09-19T06:57:58.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:57:58.774+0000 7f0079e10640 1 -- 172.21.15.159:0/2003432902 wait complete. 2024-09-19T06:57:59.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:58 smithi203 ceph-mon[35473]: pgmap v341: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:57:59.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:58 smithi189 ceph-mon[34880]: pgmap v341: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T06:57:59.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:57:59.701 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:59.926 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:57:59 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2003432902' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:59.933 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:57:59 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2003432902' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:59.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:57:59 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2003432902' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:58:00.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 -- 172.21.15.159:0/2038708755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 msgr2=0x7f7d2c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:00.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2038708755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 0x7f7d2c103110 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009930 tx=0x7f7d1c02a420 comp rx=0 tx=0).stop 2024-09-19T06:58:00.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 -- 172.21.15.159:0/2038708755 shutdown_connections 2024-09-19T06:58:00.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2038708755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d2c1082a0 0x7f7d2c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2038708755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d2c1036e0 0x7f7d2c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2038708755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 0x7f7d2c103110 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 -- 172.21.15.159:0/2038708755 >> 172.21.15.159:0/2038708755 conn(0x7f7d2c0fc7d0 msgr2=0x7f7d2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 -- 172.21.15.159:0/2038708755 shutdown_connections 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 -- 172.21.15.159:0/2038708755 wait complete. 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 Processor -- start 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.200+0000 7f7d32a50640 1 -- start start 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d32a50640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 0x7f7d2c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d32a50640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d2c1036e0 0x7f7d2c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d32a50640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d2c1082a0 0x7f7d2c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d32a50640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c1120a0 con 0x7f7d2c102d30 2024-09-19T06:58:00.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d32a50640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c111f20 con 0x7f7d2c1036e0 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d32a50640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c112220 con 0x7f7d2c1082a0 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 0x7f7d2c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 0x7f7d2c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49900/0 (socket says 172.21.15.159:49900) 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d2bfff640 1 -- 172.21.15.159:0/2994392797 learned_addr learned my addr 172.21.15.159:0/2994392797 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d2b7fe640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d2c1036e0 0x7f7d2c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d30fed640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d2c1082a0 0x7f7d2c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d2bfff640 1 -- 172.21.15.159:0/2994392797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d2c1082a0 msgr2=0x7f7d2c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d2bfff640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d2c1082a0 0x7f7d2c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d2bfff640 1 -- 172.21.15.159:0/2994392797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d2c1036e0 msgr2=0x7f7d2c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d2bfff640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d2c1036e0 0x7f7d2c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.201+0000 7f7d2bfff640 1 -- 172.21.15.159:0/2994392797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c1a6a00 con 0x7f7d2c102d30 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.202+0000 7f7d2bfff640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 0x7f7d2c100990 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009a50 tx=0x7f7d1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.202+0000 7f7d297fa640 1 -- 172.21.15.159:0/2994392797 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c03f030 con 0x7f7d2c102d30 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.202+0000 7f7d297fa640 1 -- 172.21.15.159:0/2994392797 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d1c003ad0 con 0x7f7d2c102d30 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.202+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2c1a6c90 con 0x7f7d2c102d30 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.202+0000 7f7d297fa640 1 -- 172.21.15.159:0/2994392797 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c035070 con 0x7f7d2c102d30 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.202+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d2c1a7170 con 0x7f7d2c102d30 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.203+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d2c103110 con 0x7f7d2c102d30 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.204+0000 7f7d297fa640 1 -- 172.21.15.159:0/2994392797 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7d1c042030 con 0x7f7d2c102d30 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.205+0000 7f7d297fa640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d140a33b0 0x7f7d140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.205+0000 7f7d2b7fe640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d140a33b0 0x7f7d140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.205+0000 7f7d297fa640 1 -- 172.21.15.159:0/2994392797 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f7d1c0f0840 con 0x7f7d2c102d30 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.205+0000 7f7d2b7fe640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d140a33b0 0x7f7d140a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c102420 tx=0x7f7d2000a2d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:00.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.208+0000 7f7d297fa640 1 -- 172.21.15.159:0/2994392797 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d1c0bd1c0 con 0x7f7d2c102d30 2024-09-19T06:58:00.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.379+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d2c10a2b0 con 0x7f7d2c102d30 2024-09-19T06:58:00.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.381+0000 7f7d297fa640 1 -- 172.21.15.159:0/2994392797 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23402 (secure 0 0 0) 0x7f7d1c0bcac0 con 0x7f7d2c102d30 2024-09-19T06:58:00.383 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-19T06:58:00.384 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":92,"fsid":"82c73dba-7651-11ef-bceb-c7b262605968","created":"2024-09-19T06:37:38.556116+0000","modified":"2024-09-19T06:57:13.623013+0000","last_up_change":"2024-09-19T06:44:33.484423+0000","last_in_change":"2024-09-19T06:44:11.155885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:40:47.637521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:45:19.566504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:45:21.598793+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2486cf57-4865-4e17-9c7f-77f87827299c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6803","nonce":2998326151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6805","nonce":2998326151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6809","nonce":2998326151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2998326151},{"type":"v1","addr":"172.21.15.159:6807","nonce":2998326151}]},"public_addr":"172.21.15.159:6803/2998326151","cluster_addr":"172.21.15.159:6805/2998326151","heartbeat_back_addr":"172.21.15.159:6809/2998326151","heartbeat_front_addr":"172.21.15.159:6807/2998326151","state":["exists","up"]},{"osd":1,"uuid":"84853b71-3763-46a8-bd4d-56bf68801c09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6801","nonce":2297013449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6803","nonce":2297013449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6807","nonce":2297013449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2297013449},{"type":"v1","addr":"172.21.15.189:6805","nonce":2297013449}]},"public_addr":"172.21.15.189:6801/2297013449","cluster_addr":"172.21.15.189:6803/2297013449","heartbeat_back_addr":"172.21.15.189:6807/2297013449","heartbeat_front_addr":"172.21.15.189:6805/2297013449","state":["exists","up"]},{"osd":2,"uuid":"49aa2a29-471b-48e6-97f0-04f58c824dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6801","nonce":3236164718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6803","nonce":3236164718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6807","nonce":3236164718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3236164718},{"type":"v1","addr":"172.21.15.203:6805","nonce":3236164718}]},"public_addr":"172.21.15.203:6801/3236164718","cluster_addr":"172.21.15.203:6803/3236164718","heartbeat_back_addr":"172.21.15.203:6807/3236164718","heartbeat_front_addr":"172.21.15.203:6805/3236164718","state":["exists","up"]},{"osd":3,"uuid":"446be896-916b-4fca-80f9-132c9786a9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6811","nonce":1022245465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6813","nonce":1022245465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6817","nonce":1022245465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1022245465},{"type":"v1","addr":"172.21.15.159:6815","nonce":1022245465}]},"public_addr":"172.21.15.159:6811/1022245465","cluster_addr":"172.21.15.159:6813/1022245465","heartbeat_back_addr":"172.21.15.159:6817/1022245465","heartbeat_front_addr":"172.21.15.159:6815/1022245465","state":["exists","up"]},{"osd":4,"uuid":"88500d1e-e298-47a6-a704-07c09f025773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6809","nonce":3807984659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6811","nonce":3807984659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6815","nonce":3807984659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3807984659},{"type":"v1","addr":"172.21.15.189:6813","nonce":3807984659}]},"public_addr":"172.21.15.189:6809/3807984659","cluster_addr":"172.21.15.189:6811/3807984659","heartbeat_back_addr":"172.21.15.189:6815/3807984659","heartbeat_front_addr":"172.21.15.189:6813/3807984659","state":["exists","up"]},{"osd":5,"uuid":"0a156a5d-e640-45d6-bb29-c50a3b827351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6809","nonce":2510785256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6811","nonce":2510785256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6815","nonce":2510785256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":2510785256},{"type":"v1","addr":"172.21.15.203:6813","nonce":2510785256}]},"public_addr":"172.21.15.203:6809/2510785256","cluster_addr":"172.21.15.203:6811/2510785256","heartbeat_back_addr":"172.21.15.203:6815/2510785256","heartbeat_front_addr":"172.21.15.203:6813/2510785256","state":["exists","up"]},{"osd":6,"uuid":"cda5238c-fc5d-4c45-b495-781bc5de8142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6819","nonce":46949645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6821","nonce":46949645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6825","nonce":46949645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":46949645},{"type":"v1","addr":"172.21.15.159:6823","nonce":46949645}]},"public_addr":"172.21.15.159:6819/46949645","cluster_addr":"172.21.15.159:6821/46949645","heartbeat_back_addr":"172.21.15.159:6825/46949645","heartbeat_front_addr":"172.21.15.159:6823/46949645","state":["exists","up"]},{"osd":7,"uuid":"8fac82c9-01ac-4b8a-bfd9-1f9e18d142d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6817","nonce":3813484683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6819","nonce":3813484683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6823","nonce":3813484683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3813484683},{"type":"v1","addr":"172.21.15.189:6821","nonce":3813484683}]},"public_addr":"172.21.15.189:6817/3813484683","cluster_addr":"172.21.15.189:6819/3813484683","heartbeat_back_addr":"172.21.15.189:6823/3813484683","heartbeat_front_addr":"172.21.15.189:6821/3813484683","state":["exists","up"]},{"osd":8,"uuid":"351b6b47-cfc7-4274-9cc5-a11b341f8695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6817","nonce":3706643135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6819","nonce":3706643135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6823","nonce":3706643135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3706643135},{"type":"v1","addr":"172.21.15.203:6821","nonce":3706643135}]},"public_addr":"172.21.15.203:6817/3706643135","cluster_addr":"172.21.15.203:6819/3706643135","heartbeat_back_addr":"172.21.15.203:6823/3706643135","heartbeat_front_addr":"172.21.15.203:6821/3706643135","state":["exists","up"]},{"osd":9,"uuid":"76ab4227-85ea-40eb-b916-b897d8496768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6827","nonce":623154511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6829","nonce":623154511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6833","nonce":623154511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":623154511},{"type":"v1","addr":"172.21.15.159:6831","nonce":623154511}]},"public_addr":"172.21.15.159:6827/623154511","cluster_addr":"172.21.15.159:6829/623154511","heartbeat_back_addr":"172.21.15.159:6833/623154511","heartbeat_front_addr":"172.21.15.159:6831/623154511","state":["exists","up"]},{"osd":10,"uuid":"72665ec5-c275-4e11-a0a2-2326c4a08be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6825","nonce":274384931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6827","nonce":274384931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6831","nonce":274384931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":274384931},{"type":"v1","addr":"172.21.15.189:6829","nonce":274384931}]},"public_addr":"172.21.15.189:6825/274384931","cluster_addr":"172.21.15.189:6827/274384931","heartbeat_back_addr":"172.21.15.189:6831/274384931","heartbeat_front_addr":"172.21.15.189:6829/274384931","state":["exists","up"]},{"osd":11,"uuid":"2bef0c50-64ad-4014-a6ad-db56a89ad139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6825","nonce":4150435701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6827","nonce":4150435701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6831","nonce":4150435701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4150435701},{"type":"v1","addr":"172.21.15.203:6829","nonce":4150435701}]},"public_addr":"172.21.15.203:6825/4150435701","cluster_addr":"172.21.15.203:6827/4150435701","heartbeat_back_addr":"172.21.15.203:6831/4150435701","heartbeat_front_addr":"172.21.15.203:6829/4150435701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:39:54.579226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:18.824131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:40:43.932877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:09.238536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:41:35.597606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:00.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:25.685925+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:42:51.088525+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:16.049518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:43:42.500429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:07.502465+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:44:32.382427+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:6800/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3688060506":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2156136647":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/2881238143":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/1858964097":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/2526477703":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3276076186":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3917454568":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/3612735042":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6801/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/3687310237":"2024-09-20T06:38:33.329792+0000","172.21.15.159:0/4146600912":"2024-09-20T06:38:33.329792+0000","172.21.15.159:6800/141750176":"2024-09-20T06:38:10.187881+0000","172.21.15.159:0/3424652308":"2024-09-20T06:47:00.531421+0000","172.21.15.159:6801/2390667146":"2024-09-20T06:47:00.531421+0000","172.21.15.159:0/3763048477":"2024-09-20T06:47:00.531421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:58:00.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d140a33b0 msgr2=0x7f7d140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:00.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d140a33b0 0x7f7d140a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c102420 tx=0x7f7d2000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 msgr2=0x7f7d2c100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:00.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 0x7f7d2c100990 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009a50 tx=0x7f7d1c004270 comp rx=0 tx=0).stop 2024-09-19T06:58:00.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 shutdown_connections 2024-09-19T06:58:00.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f7d140a33b0 0x7f7d140a5870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d2c1082a0 0x7f7d2c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d2c1036e0 0x7f7d2c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 --2- 172.21.15.159:0/2994392797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d2c102d30 0x7f7d2c100990 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:00.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 >> 172.21.15.159:0/2994392797 conn(0x7f7d2c0fc7d0 msgr2=0x7f7d2c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:00.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 shutdown_connections 2024-09-19T06:58:00.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:00.384+0000 7f7d32a50640 1 -- 172.21.15.159:0/2994392797 wait complete. 2024-09-19T06:58:01.075 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:00 smithi159 ceph-mon[30935]: pgmap v342: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:58:01.075 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:00 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2994392797' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:58:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:00 smithi203 ceph-mon[35473]: pgmap v342: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:58:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:00 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2994392797' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:58:01.103 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T06:58:01.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:00 smithi189 ceph-mon[34880]: pgmap v342: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:58:01.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:00 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2994392797' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:58:01.353 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:58:01.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 -- 172.21.15.159:0/805388615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da410c170 msgr2=0x7f1da410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:01.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 --2- 172.21.15.159:0/805388615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da410c170 0x7f1da410e610 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009ca0 tx=0x7f1d9c02a950 comp rx=0 tx=0).stop 2024-09-19T06:58:01.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 -- 172.21.15.159:0/805388615 shutdown_connections 2024-09-19T06:58:01.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 --2- 172.21.15.159:0/805388615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da410c170 0x7f1da410e610 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:01.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 --2- 172.21.15.159:0/805388615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1da4103660 0x7f1da410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:01.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 --2- 172.21.15.159:0/805388615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1da4102d40 0x7f1da4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:01.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 -- 172.21.15.159:0/805388615 >> 172.21.15.159:0/805388615 conn(0x7f1da40fc7a0 msgr2=0x7f1da40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:01.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 -- 172.21.15.159:0/805388615 shutdown_connections 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 -- 172.21.15.159:0/805388615 wait complete. 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.851+0000 7f1da9096640 1 Processor -- start 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da9096640 1 -- start start 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da9096640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1da4102d40 0x7f1da4198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da9096640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da4103660 0x7f1da4198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da9096640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1da410c170 0x7f1da419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da9096640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4111f30 con 0x7f1da4103660 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da9096640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4111db0 con 0x7f1da4102d40 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da9096640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41120b0 con 0x7f1da410c170 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da4103660 0x7f1da4198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:01.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da4103660 0x7f1da4198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49914/0 (socket says 172.21.15.159:49914) 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da259c640 1 -- 172.21.15.159:0/2424703985 learned_addr learned my addr 172.21.15.159:0/2424703985 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da359e640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1da410c170 0x7f1da419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da2d9d640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1da4102d40 0x7f1da4198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da259c640 1 -- 172.21.15.159:0/2424703985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1da410c170 msgr2=0x7f1da419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da259c640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1da410c170 0x7f1da419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da259c640 1 -- 172.21.15.159:0/2424703985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1da4102d40 msgr2=0x7f1da4198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da259c640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1da4102d40 0x7f1da4198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.852+0000 7f1da259c640 1 -- 172.21.15.159:0/2424703985 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da419d300 con 0x7f1da4103660 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.853+0000 7f1da259c640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da4103660 0x7f1da4198890 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800d950 tx=0x7f1d9800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.853+0000 7f1d8bfff640 1 -- 172.21.15.159:0/2424703985 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98017030 con 0x7f1da4103660 2024-09-19T06:58:01.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.853+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da419d5f0 con 0x7f1da4103660 2024-09-19T06:58:01.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.853+0000 7f1d8bfff640 1 -- 172.21.15.159:0/2424703985 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d9800be10 con 0x7f1da4103660 2024-09-19T06:58:01.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.853+0000 7f1d8bfff640 1 -- 172.21.15.159:0/2424703985 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d980055f0 con 0x7f1da4103660 2024-09-19T06:58:01.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.853+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da41a4ed0 con 0x7f1da4103660 2024-09-19T06:58:01.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.854+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da4103120 con 0x7f1da4103660 2024-09-19T06:58:01.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.855+0000 7f1d8bfff640 1 -- 172.21.15.159:0/2424703985 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1d98009a30 con 0x7f1da4103660 2024-09-19T06:58:01.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.856+0000 7f1d8bfff640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1d8c0a33b0 0x7f1d8c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:01.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.856+0000 7f1da2d9d640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1d8c0a33b0 0x7f1d8c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:01.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.856+0000 7f1d8bfff640 1 -- 172.21.15.159:0/2424703985 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8614+0+0 (secure 0 0 0) 0x7f1d980cf550 con 0x7f1da4103660 2024-09-19T06:58:01.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.856+0000 7f1da2d9d640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1d8c0a33b0 0x7f1d8c0a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400abe0 tx=0x7f1d9400a2d0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:01.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:01.860+0000 7f1d8bfff640 1 -- 172.21.15.159:0/2424703985 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d9809bed0 con 0x7f1da4103660 2024-09-19T06:58:02.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.059+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1da41a5210 con 0x7f1da4103660 2024-09-19T06:58:02.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.062+0000 7f1d8bfff640 1 -- 172.21.15.159:0/2424703985 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 161+0+0 (secure 0 0 0) 0x7f1d9809b7d0 con 0x7f1da4103660 2024-09-19T06:58:02.063 INFO:teuthology.orchestra.run.smithi159.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T06:58:02.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1d8c0a33b0 msgr2=0x7f1d8c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:02.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1d8c0a33b0 0x7f1d8c0a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400abe0 tx=0x7f1d9400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da4103660 msgr2=0x7f1da4198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da4103660 0x7f1da4198890 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800d950 tx=0x7f1d9800dd50 comp rx=0 tx=0).stop 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 shutdown_connections 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f1d8c0a33b0 0x7f1d8c0a5870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1da410c170 0x7f1da419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1da4103660 0x7f1da4198890 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 --2- 172.21.15.159:0/2424703985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1da4102d40 0x7f1da4198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 >> 172.21.15.159:0/2424703985 conn(0x7f1da40fc7a0 msgr2=0x7f1da40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 shutdown_connections 2024-09-19T06:58:02.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:02.065+0000 7f1da9096640 1 -- 172.21.15.159:0/2424703985 wait complete. 2024-09-19T06:58:02.388 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[68480]: ignoring --setuser ceph since I am not root 2024-09-19T06:58:02.388 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[68480]: ignoring --setgroup ceph since I am not root 2024-09-19T06:58:02.388 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-mds[68484]: -- 172.21.15.189:0/3018148486 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a5cae9860 con 0x556a5cac7000 2024-09-19T06:58:02.389 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[68480]: starting mds.b at 2024-09-19T06:58:02.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:02 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a[30931]: 2024-09-19T06:58:02.060+0000 7feca2ba5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:58:02.592 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i[65616]: ignoring --setuser ceph since I am not root 2024-09-19T06:58:02.592 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i[65616]: ignoring --setgroup ceph since I am not root 2024-09-19T06:58:02.592 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-mds[65620]: -- 172.21.15.203:0/1167708468 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccbca7dc20 con 0x55ccbca5b000 2024-09-19T06:58:02.592 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i[65616]: starting mds.i at 2024-09-19T06:58:02.704 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T06:58:02.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:02 smithi159 ceph-mon[30935]: pgmap v343: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:58:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:02 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2424703985' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:58:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:02 smithi159 ceph-mon[30935]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:58:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:02 smithi159 ceph-mon[30935]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:58:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:02 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2424703985' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:58:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:02 smithi159 ceph-mon[30935]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:58:02.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:02 smithi159 ceph-mon[30935]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T06:58:02.956 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:58:03.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-mon[35473]: pgmap v343: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:58:03.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2424703985' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:58:03.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-mon[35473]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:58:03.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-mon[35473]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:58:03.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2424703985' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:58:03.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-mon[35473]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:58:03.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:02 smithi203 ceph-mon[35473]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T06:58:03.137 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-mon[34880]: pgmap v343: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-19T06:58:03.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2424703985' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:58:03.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-mon[34880]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:58:03.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-mon[34880]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:58:03.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2424703985' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:58:03.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-mon[34880]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:58:03.138 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:02 smithi189 ceph-mon[34880]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T06:58:03.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.452+0000 7f843be1f640 1 -- 172.21.15.159:0/2259402041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 msgr2=0x7f843410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:03.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.452+0000 7f843be1f640 1 --2- 172.21.15.159:0/2259402041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 0x7f843410da40 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f8424009900 tx=0x7f842402a480 comp rx=0 tx=0).stop 2024-09-19T06:58:03.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.452+0000 7f843be1f640 1 -- 172.21.15.159:0/2259402041 shutdown_connections 2024-09-19T06:58:03.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.452+0000 7f843be1f640 1 --2- 172.21.15.159:0/2259402041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 0x7f843410da40 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:03.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.452+0000 7f843be1f640 1 --2- 172.21.15.159:0/2259402041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8434102570 0x7f84341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:03.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.452+0000 7f843be1f640 1 --2- 172.21.15.159:0/2259402041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8434100e20 0x7f8434101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:03.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.452+0000 7f843be1f640 1 -- 172.21.15.159:0/2259402041 >> 172.21.15.159:0/2259402041 conn(0x7f84340fc7d0 msgr2=0x7f84340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:03.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 -- 172.21.15.159:0/2259402041 shutdown_connections 2024-09-19T06:58:03.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 -- 172.21.15.159:0/2259402041 wait complete. 2024-09-19T06:58:03.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 Processor -- start 2024-09-19T06:58:03.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 -- start start 2024-09-19T06:58:03.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8434100e20 0x7f84340fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:03.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8434102570 0x7f84340fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:03.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 0x7f84340fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:03.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8434110fa0 con 0x7f8434102ef0 2024-09-19T06:58:03.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8434110e20 con 0x7f8434100e20 2024-09-19T06:58:03.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.453+0000 7f843be1f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8434111120 con 0x7f8434102570 2024-09-19T06:58:03.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843a3bc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 0x7f84340fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:03.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843a3bc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 0x7f84340fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49932/0 (socket says 172.21.15.159:49932) 2024-09-19T06:58:03.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843a3bc640 1 -- 172.21.15.159:0/556873277 learned_addr learned my addr 172.21.15.159:0/556873277 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:58:03.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f8439bbb640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8434100e20 0x7f84340fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:03.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f84393ba640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8434102570 0x7f84340fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843a3bc640 1 -- 172.21.15.159:0/556873277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8434102570 msgr2=0x7f84340fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843a3bc640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8434102570 0x7f84340fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843a3bc640 1 -- 172.21.15.159:0/556873277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8434100e20 msgr2=0x7f84340fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843a3bc640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8434100e20 0x7f84340fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843a3bc640 1 -- 172.21.15.159:0/556873277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84341a6a40 con 0x7f8434102ef0 2024-09-19T06:58:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843a3bc640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 0x7f84340fd700 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f8424005ab0 tx=0x7f8424003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:03.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f8432ffd640 1 -- 172.21.15.159:0/556873277 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842403f070 con 0x7f8434102ef0 2024-09-19T06:58:03.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f8432ffd640 1 -- 172.21.15.159:0/556873277 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8424031e30 con 0x7f8434102ef0 2024-09-19T06:58:03.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84341a6cd0 con 0x7f8434102ef0 2024-09-19T06:58:03.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f8432ffd640 1 -- 172.21.15.159:0/556873277 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424035030 con 0x7f8434102ef0 2024-09-19T06:58:03.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.454+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84341a7200 con 0x7f8434102ef0 2024-09-19T06:58:03.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.455+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8434101200 con 0x7f8434102ef0 2024-09-19T06:58:03.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.456+0000 7f8432ffd640 1 -- 172.21.15.159:0/556873277 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f8424042070 con 0x7f8434102ef0 2024-09-19T06:58:03.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.457+0000 7f8432ffd640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f841c0a3430 0x7f841c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:03.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.458+0000 7f8439bbb640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f841c0a3430 0x7f841c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:03.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.458+0000 7f8432ffd640 1 -- 172.21.15.159:0/556873277 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8656+0+0 (secure 0 0 0) 0x7f84240f0d50 con 0x7f8434102ef0 2024-09-19T06:58:03.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.458+0000 7f8439bbb640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f841c0a3430 0x7f841c0a58f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f842c00a400 tx=0x7f842c00d040 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:03.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.461+0000 7f8432ffd640 1 -- 172.21.15.159:0/556873277 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84240bd670 con 0x7f8434102ef0 2024-09-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:03.661+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f843410a0a0 con 0x7f8434102ef0 2024-09-19T06:58:04.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.065+0000 7f8432ffd640 1 -- 172.21.15.159:0/556873277 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f8424003e20 con 0x7f8434102ef0 2024-09-19T06:58:04.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f841c0a3430 msgr2=0x7f841c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:04.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f841c0a3430 0x7f841c0a58f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f842c00a400 tx=0x7f842c00d040 comp rx=0 tx=0).stop 2024-09-19T06:58:04.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 msgr2=0x7f84340fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:04.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 0x7f84340fd700 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f8424005ab0 tx=0x7f8424003c30 comp rx=0 tx=0).stop 2024-09-19T06:58:04.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 shutdown_connections 2024-09-19T06:58:04.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f841c0a3430 0x7f841c0a58f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:04.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8434102ef0 0x7f84340fd700 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:04.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8434102570 0x7f84340fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:04.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 --2- 172.21.15.159:0/556873277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8434100e20 0x7f84340fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:04.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 >> 172.21.15.159:0/556873277 conn(0x7f84340fc7d0 msgr2=0x7f843406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:04.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 shutdown_connections 2024-09-19T06:58:04.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:04.067+0000 7f843be1f640 1 -- 172.21.15.159:0/556873277 wait complete. 2024-09-19T06:58:04.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:04 smithi203 ceph-mon[35473]: pgmap v345: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T06:58:04.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:04 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.189:6838/1272887105,v1:172.21.15.189:6839/1272887105] up:boot 2024-09-19T06:58:04.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:04 smithi203 ceph-mon[35473]: mds.? [v2:172.21.15.203:6838/1464150062,v1:172.21.15.203:6839/1464150062] up:boot 2024-09-19T06:58:04.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:04 smithi203 ceph-mon[35473]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T06:58:04.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:58:04.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:04 smithi203 ceph-mon[35473]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:58:04.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:04 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/556873277' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:58:04.377 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:04 smithi159 ceph-mon[30935]: pgmap v345: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T06:58:04.377 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:04 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.189:6838/1272887105,v1:172.21.15.189:6839/1272887105] up:boot 2024-09-19T06:58:04.377 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:04 smithi159 ceph-mon[30935]: mds.? [v2:172.21.15.203:6838/1464150062,v1:172.21.15.203:6839/1464150062] up:boot 2024-09-19T06:58:04.377 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:04 smithi159 ceph-mon[30935]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T06:58:04.377 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:58:04.377 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:04 smithi159 ceph-mon[30935]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:58:04.377 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:04 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/556873277' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:58:04.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:04 smithi189 ceph-mon[34880]: pgmap v345: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T06:58:04.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:04 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.189:6838/1272887105,v1:172.21.15.189:6839/1272887105] up:boot 2024-09-19T06:58:04.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:04 smithi189 ceph-mon[34880]: mds.? [v2:172.21.15.203:6838/1464150062,v1:172.21.15.203:6839/1464150062] up:boot 2024-09-19T06:58:04.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:04 smithi189 ceph-mon[34880]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T06:58:04.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:58:04.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:04 smithi189 ceph-mon[34880]: from='mgr.15078 172.21.15.159:0/263439720' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:58:04.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:04 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/556873277' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:58:04.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T06:58:04.948 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:58:05.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:05 smithi203 ceph-mon[35473]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:58:05.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:05 smithi203 ceph-mon[35473]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:58:05.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:05 smithi203 ceph-mon[35473]: Cluster is now healthy 2024-09-19T06:58:05.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:05 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/556873277' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:58:05.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:05 smithi203 ceph-mon[35473]: fsmap 12 up:standby 2024-09-19T06:58:05.374 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:05 smithi159 ceph-mon[30935]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:58:05.374 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:05 smithi159 ceph-mon[30935]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:58:05.374 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:05 smithi159 ceph-mon[30935]: Cluster is now healthy 2024-09-19T06:58:05.374 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:05 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/556873277' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:58:05.374 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:05 smithi159 ceph-mon[30935]: fsmap 12 up:standby 2024-09-19T06:58:05.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:05 smithi189 ceph-mon[34880]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:58:05.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:05 smithi189 ceph-mon[34880]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:58:05.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:05 smithi189 ceph-mon[34880]: Cluster is now healthy 2024-09-19T06:58:05.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:05 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/556873277' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:58:05.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:05 smithi189 ceph-mon[34880]: fsmap 12 up:standby 2024-09-19T06:58:05.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.457+0000 7f5ebc97e640 1 -- 172.21.15.159:0/103021083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8106f10 msgr2=0x7f5eb810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:05.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.457+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/103021083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8106f10 0x7f5eb810ea90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009ca0 tx=0x7f5eb002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:58:05.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.457+0000 7f5ebc97e640 1 -- 172.21.15.159:0/103021083 shutdown_connections 2024-09-19T06:58:05.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.457+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/103021083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8106f10 0x7f5eb810ea90 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.457+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/103021083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5eb8102790 0x7f5eb81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.457+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/103021083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5eb8101de0 0x7f5eb81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.457+0000 7f5ebc97e640 1 -- 172.21.15.159:0/103021083 >> 172.21.15.159:0/103021083 conn(0x7f5eb80fd8c0 msgr2=0x7f5eb80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.457+0000 7f5ebc97e640 1 -- 172.21.15.159:0/103021083 shutdown_connections 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.457+0000 7f5ebc97e640 1 -- 172.21.15.159:0/103021083 wait complete. 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.458+0000 7f5ebc97e640 1 Processor -- start 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.458+0000 7f5ebc97e640 1 -- start start 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.458+0000 7f5ebc97e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5eb8101de0 0x7f5eb81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.458+0000 7f5ebc97e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8102790 0x7f5eb8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.458+0000 7f5ebc97e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5eb8106f10 0x7f5eb819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.458+0000 7f5ebc97e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8111f70 con 0x7f5eb8102790 2024-09-19T06:58:05.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.458+0000 7f5ebc97e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8111df0 con 0x7f5eb8101de0 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.458+0000 7f5ebc97e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81120f0 con 0x7f5eb8106f10 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.458+0000 7f5eaffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8102790 0x7f5eb8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8102790 0x7f5eb8198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49952/0 (socket says 172.21.15.159:49952) 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaffff640 1 -- 172.21.15.159:0/1503572941 learned_addr learned my addr 172.21.15.159:0/1503572941 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eb6d9d640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5eb8106f10 0x7f5eb819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eb659c640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5eb8101de0 0x7f5eb81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaffff640 1 -- 172.21.15.159:0/1503572941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5eb8106f10 msgr2=0x7f5eb819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaffff640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5eb8106f10 0x7f5eb819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaffff640 1 -- 172.21.15.159:0/1503572941 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5eb8101de0 msgr2=0x7f5eb81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaffff640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5eb8101de0 0x7f5eb81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaffff640 1 -- 172.21.15.159:0/1503572941 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb819d3a0 con 0x7f5eb8102790 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaffff640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8102790 0x7f5eb8198930 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000e9f0 tx=0x7f5ea000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaf7fe640 1 -- 172.21.15.159:0/1503572941 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000cd80 con 0x7f5eb8102790 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb819d690 con 0x7f5eb8102790 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaf7fe640 1 -- 172.21.15.159:0/1503572941 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea0005500 con 0x7f5eb8102790 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5eaf7fe640 1 -- 172.21.15.159:0/1503572941 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0010690 con 0x7f5eb8102790 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.459+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb81a4f70 con 0x7f5eb8102790 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.460+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb81021c0 con 0x7f5eb8102790 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.461+0000 7f5eaf7fe640 1 -- 172.21.15.159:0/1503572941 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5ea00046c0 con 0x7f5eb8102790 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.462+0000 7f5eaf7fe640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ea40a33b0 0x7f5ea40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.462+0000 7f5eb659c640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ea40a33b0 0x7f5ea40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.462+0000 7f5eaf7fe640 1 -- 172.21.15.159:0/1503572941 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8656+0+0 (secure 0 0 0) 0x7f5ea00d0140 con 0x7f5eb8102790 2024-09-19T06:58:05.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.462+0000 7f5eb659c640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ea40a33b0 0x7f5ea40a5870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800bbe0 tx=0x7f5ea800b390 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:05.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.466+0000 7f5eaf7fe640 1 -- 172.21.15.159:0/1503572941 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ea009caa0 con 0x7f5eb8102790 2024-09-19T06:58:05.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:05.632+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5eb802d7c0 con 0x7f5eb8102790 2024-09-19T06:58:06.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.081+0000 7f5eaf7fe640 1 -- 172.21.15.159:0/1503572941 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7f5ea009c3a0 con 0x7f5eb8102790 2024-09-19T06:58:06.083 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_metadata' removed 2024-09-19T06:58:06.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ea40a33b0 msgr2=0x7f5ea40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:06.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ea40a33b0 0x7f5ea40a5870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800bbe0 tx=0x7f5ea800b390 comp rx=0 tx=0).stop 2024-09-19T06:58:06.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8102790 msgr2=0x7f5eb8198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:06.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8102790 0x7f5eb8198930 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000e9f0 tx=0x7f5ea000edf0 comp rx=0 tx=0).stop 2024-09-19T06:58:06.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 shutdown_connections 2024-09-19T06:58:06.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5ea40a33b0 0x7f5ea40a5870 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:06.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5eb8106f10 0x7f5eb819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:06.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb8102790 0x7f5eb8198930 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:06.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 --2- 172.21.15.159:0/1503572941 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5eb8101de0 0x7f5eb81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:06.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 >> 172.21.15.159:0/1503572941 conn(0x7f5eb80fd8c0 msgr2=0x7f5eb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:06.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.085+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 shutdown_connections 2024-09-19T06:58:06.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:06.086+0000 7f5ebc97e640 1 -- 172.21.15.159:0/1503572941 wait complete. 2024-09-19T06:58:06.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:06 smithi203 ceph-mon[35473]: pgmap v346: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T06:58:06.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:06 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1503572941' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:58:06.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:06 smithi189 ceph-mon[34880]: pgmap v346: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T06:58:06.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:06 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1503572941' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:58:06.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:06 smithi159 ceph-mon[30935]: pgmap v346: 97 pgs: 97 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T06:58:06.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:06 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1503572941' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:58:06.800 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 82c73dba-7651-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T06:58:07.047 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:58:07.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:07 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/1503572941' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:58:07.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:07 smithi203 ceph-mon[35473]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:58:07.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:07 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/1503572941' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:58:07.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:07 smithi189 ceph-mon[34880]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:58:07.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:07 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/1503572941' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:58:07.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:07 smithi159 ceph-mon[30935]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:58:07.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.506+0000 7f5ca481e640 1 -- 172.21.15.159:0/3537315432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca0103760 msgr2=0x7f5ca0107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.506+0000 7f5ca481e640 1 --2- 172.21.15.159:0/3537315432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca0103760 0x7f5ca0107ba0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009930 tx=0x7f5c8802a420 comp rx=0 tx=0).stop 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.506+0000 7f5ca481e640 1 -- 172.21.15.159:0/3537315432 shutdown_connections 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.506+0000 7f5ca481e640 1 --2- 172.21.15.159:0/3537315432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca01082e0 0x7f5ca010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.506+0000 7f5ca481e640 1 --2- 172.21.15.159:0/3537315432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca0103760 0x7f5ca0107ba0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.506+0000 7f5ca481e640 1 --2- 172.21.15.159:0/3537315432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ca0102db0 0x7f5ca0103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.506+0000 7f5ca481e640 1 -- 172.21.15.159:0/3537315432 >> 172.21.15.159:0/3537315432 conn(0x7f5ca00fc7d0 msgr2=0x7f5ca00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.506+0000 7f5ca481e640 1 -- 172.21.15.159:0/3537315432 shutdown_connections 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.506+0000 7f5ca481e640 1 -- 172.21.15.159:0/3537315432 wait complete. 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5ca481e640 1 Processor -- start 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5ca481e640 1 -- start start 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5ca481e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ca0102db0 0x7f5ca0100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:07.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5ca481e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0103760 0x7f5ca0100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5ca481e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca01082e0 0x7f5ca0101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5ca481e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01120d0 con 0x7f5ca01082e0 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5ca481e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0111f50 con 0x7f5ca0102db0 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5ca481e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0112250 con 0x7f5ca0103760 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca01082e0 0x7f5ca0101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca01082e0 0x7f5ca0101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49976/0 (socket says 172.21.15.159:49976) 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9ed9d640 1 -- 172.21.15.159:0/2228654528 learned_addr learned my addr 172.21.15.159:0/2228654528 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9dd9b640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0103760 0x7f5ca0100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9e59c640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ca0102db0 0x7f5ca0100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9ed9d640 1 -- 172.21.15.159:0/2228654528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0103760 msgr2=0x7f5ca0100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9ed9d640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0103760 0x7f5ca0100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9ed9d640 1 -- 172.21.15.159:0/2228654528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ca0102db0 msgr2=0x7f5ca0100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:07.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9ed9d640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ca0102db0 0x7f5ca0100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9ed9d640 1 -- 172.21.15.159:0/2228654528 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca01a6af0 con 0x7f5ca01082e0 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.507+0000 7f5c9e59c640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ca0102db0 0x7f5ca0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.508+0000 7f5c9ed9d640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca01082e0 0x7f5ca0101490 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800d750 tx=0x7f5c9800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.508+0000 7f5c977fe640 1 -- 172.21.15.159:0/2228654528 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98017070 con 0x7f5ca01082e0 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.508+0000 7f5c977fe640 1 -- 172.21.15.159:0/2228654528 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c98005500 con 0x7f5ca01082e0 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.508+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca01a6de0 con 0x7f5ca01082e0 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.508+0000 7f5c977fe640 1 -- 172.21.15.159:0/2228654528 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98004d90 con 0x7f5ca01082e0 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.508+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca01a72a0 con 0x7f5ca01082e0 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.509+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca0103190 con 0x7f5ca01082e0 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.510+0000 7f5c977fe640 1 -- 172.21.15.159:0/2228654528 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5c98004f30 con 0x7f5ca01082e0 2024-09-19T06:58:07.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.511+0000 7f5c977fe640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5c8c0a33b0 0x7f5c8c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:07.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.511+0000 7f5c9e59c640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5c8c0a33b0 0x7f5c8c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:07.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.511+0000 7f5c977fe640 1 -- 172.21.15.159:0/2228654528 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8131+0+0 (secure 0 0 0) 0x7f5c980cf5d0 con 0x7f5ca01082e0 2024-09-19T06:58:07.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.511+0000 7f5c9e59c640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5c8c0a33b0 0x7f5c8c0a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5c90007eb0 tx=0x7f5c900073c0 comp rx=0 tx=0).ready entity=mgr.15078 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:07.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.515+0000 7f5c977fe640 1 -- 172.21.15.159:0/2228654528 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c9809c180 con 0x7f5ca01082e0 2024-09-19T06:58:07.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:07.682+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5ca010a2c0 con 0x7f5ca01082e0 2024-09-19T06:58:08.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.099+0000 7f5c977fe640 1 -- 172.21.15.159:0/2228654528 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f5c9809ba80 con 0x7f5ca01082e0 2024-09-19T06:58:08.100 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_data' removed 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5c8c0a33b0 msgr2=0x7f5c8c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5c8c0a33b0 0x7f5c8c0a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5c90007eb0 tx=0x7f5c900073c0 comp rx=0 tx=0).stop 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca01082e0 msgr2=0x7f5ca0101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca01082e0 0x7f5ca0101490 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800d750 tx=0x7f5c9800dc10 comp rx=0 tx=0).stop 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 shutdown_connections 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:6800/1835940314,v1:172.21.15.159:6801/1835940314] conn(0x7f5c8c0a33b0 0x7f5c8c0a5870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ca01082e0 0x7f5ca0101490 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0103760 0x7f5ca0100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 --2- 172.21.15.159:0/2228654528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ca0102db0 0x7f5ca0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.101+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 >> 172.21.15.159:0/2228654528 conn(0x7f5ca00fc7d0 msgr2=0x7f5ca0105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:08.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.102+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 shutdown_connections 2024-09-19T06:58:08.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-19T06:58:08.102+0000 7f5ca481e640 1 -- 172.21.15.159:0/2228654528 wait complete. 2024-09-19T06:58:08.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:08 smithi189 ceph-mon[34880]: pgmap v348: 65 pgs: 65 active+clean; 60 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:58:08.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:08 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2228654528' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:58:08.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:08 smithi159 ceph-mon[30935]: pgmap v348: 65 pgs: 65 active+clean; 60 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:58:08.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:08 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2228654528' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:58:08.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:08 smithi203 ceph-mon[35473]: pgmap v348: 65 pgs: 65 active+clean; 60 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:58:08.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:08 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2228654528' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:58:08.751 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:58:08.779 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:58:08.806 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:58:08.835 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T06:58:08.836 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:58:08.851 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:58:08.866 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:58:08.891 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T06:58:08.892 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T06:58:08.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:58:09.105 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:08 smithi159 systemd[1]: Stopping Ceph mon.a for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:09.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:09 smithi189 ceph-mon[34880]: from='client.? 172.21.15.159:0/2228654528' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:58:09.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:09 smithi189 ceph-mon[34880]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:58:09.397 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:09 smithi159 ceph-mon[30935]: from='client.? 172.21.15.159:0/2228654528' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:58:09.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:09 smithi159 ceph-mon[30935]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:58:09.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a[30931]: 2024-09-19T06:58:09.202+0000 7feca83b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:09.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a[30931]: 2024-09-19T06:58:09.202+0000 7feca83b0640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T06:58:09.398 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:09 smithi159 podman[124612]: 2024-09-19 06:58:09.34546593 +0000 UTC m=+0.268246680 container died 2bf001ca4d2128d1d1a4b070a94cad4fc4d9f7e5b0d2d94218d0c5c3b79d9884 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T06:58:09.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:09 smithi203 ceph-mon[35473]: from='client.? 172.21.15.159:0/2228654528' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:58:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:09 smithi203 ceph-mon[35473]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:58:09.897 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:09 smithi159 podman[124612]: 2024-09-19 06:58:09.727752125 +0000 UTC m=+0.650532869 container cleanup 2bf001ca4d2128d1d1a4b070a94cad4fc4d9f7e5b0d2d94218d0c5c3b79d9884 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:58:09.898 INFO:journalctl@ceph.mon.a.smithi159.stdout:Sep 19 06:58:09 smithi159 bash[124612]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:58:10.156 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T06:58:10.202 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:10.202 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T06:58:10.203 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T06:58:10.203 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.b 2024-09-19T06:58:10.529 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:10 smithi189 systemd[1]: Stopping Ceph mon.b for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:10.794 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:10 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-b[34876]: 2024-09-19T06:58:10.528+0000 7fb32800f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:10.795 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:10 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-b[34876]: 2024-09-19T06:58:10.528+0000 7fb32800f640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:58:11.130 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:10 smithi189 podman[70621]: 2024-09-19 06:58:10.794201683 +0000 UTC m=+0.384727198 container died 23f295b00c42a35484c4a114f37706cb10eb5d88974323e0ef83a22dddaef27b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T06:58:11.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:11 smithi189 podman[70621]: 2024-09-19 06:58:11.246967579 +0000 UTC m=+0.837493104 container cleanup 23f295b00c42a35484c4a114f37706cb10eb5d88974323e0ef83a22dddaef27b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:58:11.388 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 19 06:58:11 smithi189 bash[70621]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-b 2024-09-19T06:58:11.725 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T06:58:11.773 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:11.773 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T06:58:11.773 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T06:58:11.773 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.c 2024-09-19T06:58:12.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:11 smithi203 systemd[1]: Stopping Ceph mon.c for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:12.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:12 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-c[35469]: 2024-09-19T06:58:12.085+0000 7fb0666ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:12 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-c[35469]: 2024-09-19T06:58:12.085+0000 7fb0666ce640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:58:12.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:12 smithi203 podman[70816]: 2024-09-19 06:58:12.157257898 +0000 UTC m=+0.186478631 container died c5cd3c7c105ade504ab6513b1b24718c492db0829113697b98eabce0bc3090cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T06:58:12.815 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:12 smithi203 podman[70816]: 2024-09-19 06:58:12.536080047 +0000 UTC m=+0.565300793 container cleanup c5cd3c7c105ade504ab6513b1b24718c492db0829113697b98eabce0bc3090cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T06:58:12.816 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 06:58:12 smithi203 bash[70816]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mon-c 2024-09-19T06:58:12.960 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T06:58:13.006 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:13.006 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T06:58:13.006 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T06:58:13.006 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:58:13.346 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:58:13 smithi159 systemd[1]: Stopping Ceph mgr.x for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:13.643 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:58:13 smithi159 podman[124733]: 2024-09-19 06:58:13.347596612 +0000 UTC m=+0.146898173 container died d70b5d613ab8a7cc52e4c3ef41d23c6e69b18f1915fd5c26f4e7648b03593170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T06:58:13.897 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:58:13 smithi159 podman[124733]: 2024-09-19 06:58:13.742740923 +0000 UTC m=+0.542042476 container cleanup d70b5d613ab8a7cc52e4c3ef41d23c6e69b18f1915fd5c26f4e7648b03593170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:58:13.898 INFO:journalctl@ceph.mgr.x.smithi159.stdout:Sep 19 06:58:13 smithi159 bash[124733]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-x 2024-09-19T06:58:14.169 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T06:58:14.205 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:14.205 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T06:58:14.205 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T06:58:14.205 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.y 2024-09-19T06:58:14.574 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:58:14 smithi189 systemd[1]: Stopping Ceph mgr.y for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:14.888 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:58:14 smithi189 podman[70744]: 2024-09-19 06:58:14.573842532 +0000 UTC m=+0.160184071 container died a25f5e01e5272c7c7369871719fba9a068103153ca6aeaf776678f224d33a19c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T06:58:15.341 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:58:15 smithi189 podman[70744]: 2024-09-19 06:58:15.07688592 +0000 UTC m=+0.663227456 container cleanup a25f5e01e5272c7c7369871719fba9a068103153ca6aeaf776678f224d33a19c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T06:58:15.341 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 19 06:58:15 smithi189 bash[70744]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-y 2024-09-19T06:58:15.562 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T06:58:15.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:15.596 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T06:58:15.596 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T06:58:15.596 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.z 2024-09-19T06:58:15.992 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:58:15 smithi203 systemd[1]: Stopping Ceph mgr.z for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:16.278 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:58:15 smithi203 podman[70938]: 2024-09-19 06:58:15.991152649 +0000 UTC m=+0.165098182 container died cd0004496eb1f139ba3db94b22e152517d9df03232ea4c36f9ae60288e654c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T06:58:16.592 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:58:16 smithi203 podman[70938]: 2024-09-19 06:58:16.402940981 +0000 UTC m=+0.576886508 container cleanup cd0004496eb1f139ba3db94b22e152517d9df03232ea4c36f9ae60288e654c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T06:58:16.592 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:58:16 smithi203 bash[70938]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z 2024-09-19T06:58:16.866 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T06:58:16.890 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:58:16 smithi203 podman[70949]: 2024-09-19 06:58:16.639648667 +0000 UTC m=+0.646753676 container remove cd0004496eb1f139ba3db94b22e152517d9df03232ea4c36f9ae60288e654c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mgr-z, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T06:58:16.890 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:58:16 smithi203 systemd[1]: ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-19T06:58:16.890 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:58:16 smithi203 systemd[1]: ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-19T06:58:16.890 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:58:16 smithi203 systemd[1]: Stopped Ceph mgr.z for 82c73dba-7651-11ef-bceb-c7b262605968. 2024-09-19T06:58:16.890 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 06:58:16 smithi203 systemd[1]: ceph-82c73dba-7651-11ef-bceb-c7b262605968@mgr.z.service: Consumed 11.514s CPU time. 2024-09-19T06:58:16.901 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:16.902 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T06:58:16.902 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T06:58:16.902 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.0 2024-09-19T06:58:17.240 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:16 smithi159 systemd[1]: Stopping Ceph osd.0 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:17.648 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:17 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0[45333]: 2024-09-19T06:58:17.239+0000 7fb1a44fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:17.648 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:17 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0[45333]: 2024-09-19T06:58:17.239+0000 7fb1a44fb640 -1 osd.0 95 *** Got signal Terminated *** 2024-09-19T06:58:17.648 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:17 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0[45333]: 2024-09-19T06:58:17.239+0000 7fb1a44fb640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:22.898 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:22 smithi159 podman[124855]: 2024-09-19 06:58:22.637558121 +0000 UTC m=+5.547278532 container died 8ccc064a662de7fd310aac834962aeb67b180dca48822c438f0bff5bf9309ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:58:23.397 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:23 smithi159 podman[124855]: 2024-09-19 06:58:23.153899551 +0000 UTC m=+6.063619970 container cleanup 8ccc064a662de7fd310aac834962aeb67b180dca48822c438f0bff5bf9309ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:58:23.398 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:23 smithi159 bash[124855]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0 2024-09-19T06:58:23.825 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:23 smithi159 podman[124870]: 2024-09-19 06:58:23.400270058 +0000 UTC m=+0.756325499 container remove 8ccc064a662de7fd310aac834962aeb67b180dca48822c438f0bff5bf9309ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T06:58:24.138 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:23 smithi159 podman[124962]: 2024-09-19 06:58:23.727108589 +0000 UTC m=+0.016318820 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:24.139 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:23 smithi159 podman[124962]: 2024-09-19 06:58:23.868797118 +0000 UTC m=+0.158007379 container create 1ebfe1ebf6ea7497f9b3acdbc29ea324f5e79c7f206cedb7290b59eb8322ea57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:58:24.398 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:24 smithi159 podman[124962]: 2024-09-19 06:58:24.137987961 +0000 UTC m=+0.427198190 container init 1ebfe1ebf6ea7497f9b3acdbc29ea324f5e79c7f206cedb7290b59eb8322ea57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:58:24.398 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:24 smithi159 podman[124962]: 2024-09-19 06:58:24.141853622 +0000 UTC m=+0.431063842 container start 1ebfe1ebf6ea7497f9b3acdbc29ea324f5e79c7f206cedb7290b59eb8322ea57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T06:58:24.398 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:24 smithi159 podman[124962]: 2024-09-19 06:58:24.238006088 +0000 UTC m=+0.527216320 container attach 1ebfe1ebf6ea7497f9b3acdbc29ea324f5e79c7f206cedb7290b59eb8322ea57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T06:58:24.398 INFO:journalctl@ceph.osd.0.smithi159.stdout:Sep 19 06:58:24 smithi159 podman[124962]: 2024-09-19 06:58:24.328879994 +0000 UTC m=+0.618090230 container died 1ebfe1ebf6ea7497f9b3acdbc29ea324f5e79c7f206cedb7290b59eb8322ea57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T06:58:25.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T06:58:25.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:25.129 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T06:58:25.129 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T06:58:25.129 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.1 2024-09-19T06:58:25.388 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:25 smithi189 systemd[1]: Stopping Ceph osd.1 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:25.887 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1[39328]: 2024-09-19T06:58:25.547+0000 7fc4f6aa4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:25.888 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1[39328]: 2024-09-19T06:58:25.547+0000 7fc4f6aa4640 -1 osd.1 95 *** Got signal Terminated *** 2024-09-19T06:58:25.888 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1[39328]: 2024-09-19T06:58:25.547+0000 7fc4f6aa4640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:31.284 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:30 smithi189 podman[70884]: 2024-09-19 06:58:30.957288722 +0000 UTC m=+5.644543720 container died 151eac50f629a56a41624c7dc7630c07678b580036421b06a25954336a063d74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T06:58:31.634 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:31 smithi189 podman[70884]: 2024-09-19 06:58:31.374037701 +0000 UTC m=+6.061292698 container cleanup 151eac50f629a56a41624c7dc7630c07678b580036421b06a25954336a063d74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T06:58:31.634 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:31 smithi189 bash[70884]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1 2024-09-19T06:58:31.887 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:31 smithi189 podman[70899]: 2024-09-19 06:58:31.634340824 +0000 UTC m=+0.677867061 container remove 151eac50f629a56a41624c7dc7630c07678b580036421b06a25954336a063d74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:58:32.330 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:32 smithi189 podman[70992]: 2024-09-19 06:58:31.940010921 +0000 UTC m=+0.016661672 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:32.330 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:32 smithi189 podman[70992]: 2024-09-19 06:58:32.043386993 +0000 UTC m=+0.120037740 container create 71f29df74e6bd388b4c10d9e41f692ff406eea6ceb693699f1080c28b68332d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T06:58:32.330 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:32 smithi189 podman[70992]: 2024-09-19 06:58:32.329774081 +0000 UTC m=+0.406424830 container init 71f29df74e6bd388b4c10d9e41f692ff406eea6ceb693699f1080c28b68332d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:58:32.638 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:32 smithi189 podman[70992]: 2024-09-19 06:58:32.333470958 +0000 UTC m=+0.410121705 container start 71f29df74e6bd388b4c10d9e41f692ff406eea6ceb693699f1080c28b68332d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:32.638 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:32 smithi189 podman[70992]: 2024-09-19 06:58:32.455033455 +0000 UTC m=+0.531684205 container attach 71f29df74e6bd388b4c10d9e41f692ff406eea6ceb693699f1080c28b68332d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T06:58:32.638 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 19 06:58:32 smithi189 podman[70992]: 2024-09-19 06:58:32.52085612 +0000 UTC m=+0.597506863 container died 71f29df74e6bd388b4c10d9e41f692ff406eea6ceb693699f1080c28b68332d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T06:58:33.198 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T06:58:33.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:33.239 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T06:58:33.239 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T06:58:33.240 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.2 2024-09-19T06:58:33.591 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:33 smithi203 systemd[1]: Stopping Ceph osd.2 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:34.091 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2[40417]: 2024-09-19T06:58:33.616+0000 7f781ac49640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:34.091 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2[40417]: 2024-09-19T06:58:33.616+0000 7f781ac49640 -1 osd.2 95 *** Got signal Terminated *** 2024-09-19T06:58:34.092 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2[40417]: 2024-09-19T06:58:33.616+0000 7f781ac49640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:39.293 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:38 smithi203 podman[71075]: 2024-09-19 06:58:38.981248813 +0000 UTC m=+5.543844174 container died acb89449b4899b2d741fa5de82e39123e5123165bf1eb991bfc3d100112fcb57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:39.591 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:39 smithi203 podman[71075]: 2024-09-19 06:58:39.400158314 +0000 UTC m=+5.962753662 container cleanup acb89449b4899b2d741fa5de82e39123e5123165bf1eb991bfc3d100112fcb57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T06:58:39.591 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:39 smithi203 bash[71075]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2 2024-09-19T06:58:40.068 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:39 smithi203 podman[71092]: 2024-09-19 06:58:39.63517008 +0000 UTC m=+0.652804786 container remove acb89449b4899b2d741fa5de82e39123e5123165bf1eb991bfc3d100112fcb57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T06:58:40.342 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:40 smithi203 podman[71180]: 2024-09-19 06:58:39.970501069 +0000 UTC m=+0.016060538 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:40.342 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:40 smithi203 podman[71180]: 2024-09-19 06:58:40.094660258 +0000 UTC m=+0.140219715 container create 1f5ecc3527511e8a6b29e70eb487d86dd4d7ad04e048808c7e979529f6e26e6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:58:40.842 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:40 smithi203 podman[71180]: 2024-09-19 06:58:40.382482992 +0000 UTC m=+0.428042454 container init 1f5ecc3527511e8a6b29e70eb487d86dd4d7ad04e048808c7e979529f6e26e6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-19T06:58:40.842 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:40 smithi203 podman[71180]: 2024-09-19 06:58:40.385784293 +0000 UTC m=+0.431343747 container start 1f5ecc3527511e8a6b29e70eb487d86dd4d7ad04e048808c7e979529f6e26e6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:40.842 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:40 smithi203 podman[71180]: 2024-09-19 06:58:40.481210706 +0000 UTC m=+0.526770160 container attach 1f5ecc3527511e8a6b29e70eb487d86dd4d7ad04e048808c7e979529f6e26e6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T06:58:40.842 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 06:58:40 smithi203 podman[71180]: 2024-09-19 06:58:40.5794786 +0000 UTC m=+0.625038056 container died 1f5ecc3527511e8a6b29e70eb487d86dd4d7ad04e048808c7e979529f6e26e6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:41.234 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T06:58:41.275 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:41.275 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T06:58:41.275 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T06:58:41.275 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.3 2024-09-19T06:58:41.579 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:41 smithi159 systemd[1]: Stopping Ceph osd.3 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:41.847 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:41 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3[52213]: 2024-09-19T06:58:41.578+0000 7f481d581640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:41.847 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:41 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3[52213]: 2024-09-19T06:58:41.578+0000 7f481d581640 -1 osd.3 95 *** Got signal Terminated *** 2024-09-19T06:58:41.847 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:41 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3[52213]: 2024-09-19T06:58:41.578+0000 7f481d581640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:43.637 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:43 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:43.385+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:44.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:43 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:43.968+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:44.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:44.051+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:44.614 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:44 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:44.162+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:44.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:44 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:44.366+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:44.897 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:44 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3[52213]: 2024-09-19T06:58:44.613+0000 7f4815b8f640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.127410+0000 front 2024-09-19T06:58:19.127438+0000 (oldest deadline 2024-09-19T06:58:44.427566+0000) 2024-09-19T06:58:45.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:44.943+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:45.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:45.066+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:45.534 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:45 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:45.175+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:45.637 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:45 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:45.377+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:45.898 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:45 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3[52213]: 2024-09-19T06:58:45.606+0000 7f4815b8f640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.127410+0000 front 2024-09-19T06:58:19.127438+0000 (oldest deadline 2024-09-19T06:58:44.427566+0000) 2024-09-19T06:58:45.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:45 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:45.533+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:46.091 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:46.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:46.092 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:45.810+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:46.092 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:45.960+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:46.573 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:46 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:46.190+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:46.887 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:46 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:46.424+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:46.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:46 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:46.573+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:47.091 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:47.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:47.092 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:46.795+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:47.092 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:46.989+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:47.272 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:47 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:47.201+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:47.272 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:46 smithi159 podman[125065]: 2024-09-19 06:58:46.979619438 +0000 UTC m=+5.511014019 container died abf2c8f582fb5ae3cb43e4e6db04eb5a9e0dc8b36edcdfbbb3f592273ef370c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T06:58:47.560 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:47 smithi159 podman[125065]: 2024-09-19 06:58:47.471154477 +0000 UTC m=+6.002549094 container cleanup abf2c8f582fb5ae3cb43e4e6db04eb5a9e0dc8b36edcdfbbb3f592273ef370c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T06:58:47.561 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:47 smithi159 bash[125065]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3 2024-09-19T06:58:47.887 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:47 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:47.443+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:47.897 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:47 smithi159 podman[125092]: 2024-09-19 06:58:47.697804501 +0000 UTC m=+0.713479927 container remove abf2c8f582fb5ae3cb43e4e6db04eb5a9e0dc8b36edcdfbbb3f592273ef370c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T06:58:47.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:47 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:47.559+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:48.092 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:47.805+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:48.092 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:48.032+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:48.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:47.992+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:48.310 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:48 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:48.183+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:48.310 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:48 smithi159 podman[125183]: 2024-09-19 06:58:47.916078223 +0000 UTC m=+0.015793501 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:48.310 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:48 smithi159 podman[125183]: 2024-09-19 06:58:48.040486291 +0000 UTC m=+0.140201551 container create 0532602aad84ca904d2ce68b1ca65cdf6df3c971a6a4a1ea0da447bc02293abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T06:58:48.570 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:48 smithi159 podman[125183]: 2024-09-19 06:58:48.309826436 +0000 UTC m=+0.409541697 container init 0532602aad84ca904d2ce68b1ca65cdf6df3c971a6a4a1ea0da447bc02293abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:58:48.571 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:48 smithi159 podman[125183]: 2024-09-19 06:58:48.314261219 +0000 UTC m=+0.413976487 container start 0532602aad84ca904d2ce68b1ca65cdf6df3c971a6a4a1ea0da447bc02293abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T06:58:48.571 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:48 smithi159 podman[125183]: 2024-09-19 06:58:48.401764623 +0000 UTC m=+0.501479900 container attach 0532602aad84ca904d2ce68b1ca65cdf6df3c971a6a4a1ea0da447bc02293abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:48.571 INFO:journalctl@ceph.osd.3.smithi159.stdout:Sep 19 06:58:48 smithi159 podman[125183]: 2024-09-19 06:58:48.502304071 +0000 UTC m=+0.602019342 container died 0532602aad84ca904d2ce68b1ca65cdf6df3c971a6a4a1ea0da447bc02293abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T06:58:48.855 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:48 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:48.569+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:48.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:48 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:48.480+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:49.091 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:48.807+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:49.092 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:49.044+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:49.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:48.954+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:49.156 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T06:58:49.199 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:49.199 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T06:58:49.199 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T06:58:49.199 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.4 2024-09-19T06:58:49.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:49 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:49.167+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:49.490 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:49 smithi189 systemd[1]: Stopping Ceph osd.4 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:49.830 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:49 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:49.489+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:49.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:49 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:49.556+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:50.090 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:49.929+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:50.091 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:49.794+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:50.137 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:49 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4[46230]: 2024-09-19T06:58:49.829+0000 7fb863135640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:50.138 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:49 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4[46230]: 2024-09-19T06:58:49.829+0000 7fb863135640 -1 osd.4 95 *** Got signal Terminated *** 2024-09-19T06:58:50.138 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:49 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4[46230]: 2024-09-19T06:58:49.829+0000 7fb863135640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:50.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:50.090+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:50.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:50 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:50.130+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:50.887 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:50 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:50.519+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:50.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:50 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:50.553+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:51.068 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:50.754+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:51.068 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:50.960+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:51.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:51 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:51.068+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:51.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:51 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:51.141+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:51.867 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:58:51 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:58:51.673+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:58:51.867 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:51 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:51.557+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:51.867 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:51 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:51.557+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:58:51.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:51 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:51.581+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:51.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:51 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:51.581+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:58:52.055 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:51 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:51.719+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:52.055 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:51 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:51.946+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:52.137 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:51 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4[46230]: 2024-09-19T06:58:51.866+0000 7fb85f74b640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:27.999057+0000 front 2024-09-19T06:58:27.999082+0000 (oldest deadline 2024-09-19T06:58:51.499184+0000) 2024-09-19T06:58:52.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:52 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:52.054+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:52.552 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:52 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:52.165+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:52.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:58:52 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:58:52.680+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:58:52.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:52 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:52.528+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:52.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:52 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:52.528+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:58:52.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:52 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:52.551+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:52.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:52 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:52.551+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:58:53.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:52 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:52.915+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:53.092 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:52 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:52.763+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:53.092 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:52 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:52.763+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:58:53.388 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:52 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4[46230]: 2024-09-19T06:58:52.906+0000 7fb85f74b640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:27.999057+0000 front 2024-09-19T06:58:27.999082+0000 (oldest deadline 2024-09-19T06:58:51.499184+0000) 2024-09-19T06:58:53.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:53 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:53.142+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:53.591 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:53 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:53.092+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:53.869 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:58:53 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:58:53.634+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:58:53.869 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:53 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:53.504+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:53.869 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:53 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:53.504+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:58:53.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:53 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:53.593+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:53.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:53 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:53.593+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:58:54.061 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:53 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:53.760+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:54.061 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:53 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:53.760+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:58:54.061 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:53 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:53.938+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:54.061 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:53 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:53.938+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:58:54.137 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:53 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4[46230]: 2024-09-19T06:58:53.868+0000 7fb85f74b640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:27.999057+0000 front 2024-09-19T06:58:27.999082+0000 (oldest deadline 2024-09-19T06:58:51.499184+0000) 2024-09-19T06:58:54.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:54 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:54.059+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:54.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:54 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:54.120+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:54.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:58:54 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:58:54.616+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:58:54.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:54 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:54.479+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:54.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:54 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:54.479+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:58:54.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:54 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:54.567+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:54.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:54 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:54.567+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:58:54.982 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:54 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:54.719+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:54.982 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:54 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:54.719+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:58:55.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:55.106+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:55.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:54 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:54.981+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:55.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:54 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:54.981+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:58:55.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:55.146+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:55.493 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:55 smithi189 podman[71094]: 2024-09-19 06:58:55.223480177 +0000 UTC m=+5.828201364 container died 7b96d71479364177072015186efd1270c8813a774fc36f72466c180c4432c52c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T06:58:55.881 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:58:55 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:58:55.630+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:58:55.881 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:55 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:55.491+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:55.882 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:55 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:55.491+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:58:55.882 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:55 smithi189 podman[71094]: 2024-09-19 06:58:55.62120233 +0000 UTC m=+6.225923511 container cleanup 7b96d71479364177072015186efd1270c8813a774fc36f72466c180c4432c52c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:58:55.882 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:55 smithi189 bash[71094]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4 2024-09-19T06:58:55.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:55.586+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:55.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:55.586+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:58:55.945 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:55.693+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:55.945 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:55.693+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:58:56.137 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:55 smithi189 podman[71110]: 2024-09-19 06:58:55.880929037 +0000 UTC m=+0.648001843 container remove 7b96d71479364177072015186efd1270c8813a774fc36f72466c180c4432c52c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T06:58:56.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:56.123+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:56.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:55.944+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:56.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:55 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:55.944+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:58:56.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:56.127+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:56.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:56.127+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:58:56.501 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:56 smithi189 podman[71198]: 2024-09-19 06:58:56.140712681 +0000 UTC m=+0.016055349 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:56.501 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:56 smithi189 podman[71198]: 2024-09-19 06:58:56.273618069 +0000 UTC m=+0.148960719 container create b2221ba0bbd9688fca51a1e6cfbe5a2bcfec3e4875c5a2ffb8fc0377049d4905 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-19T06:58:56.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:58:56 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:58:56.669+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:58:56.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:56 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:56.507+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:56.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:56 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:56.507+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:58:56.889 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:56 smithi189 podman[71198]: 2024-09-19 06:58:56.501337405 +0000 UTC m=+0.376680061 container init b2221ba0bbd9688fca51a1e6cfbe5a2bcfec3e4875c5a2ffb8fc0377049d4905 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:56.889 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:56 smithi189 podman[71198]: 2024-09-19 06:58:56.504729871 +0000 UTC m=+0.380072521 container start b2221ba0bbd9688fca51a1e6cfbe5a2bcfec3e4875c5a2ffb8fc0377049d4905 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T06:58:56.889 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:56 smithi189 podman[71198]: 2024-09-19 06:58:56.628049132 +0000 UTC m=+0.503391796 container attach b2221ba0bbd9688fca51a1e6cfbe5a2bcfec3e4875c5a2ffb8fc0377049d4905 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:58:56.889 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 19 06:58:56 smithi189 podman[71198]: 2024-09-19 06:58:56.690359116 +0000 UTC m=+0.565701770 container died b2221ba0bbd9688fca51a1e6cfbe5a2bcfec3e4875c5a2ffb8fc0377049d4905 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:58:56.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:56.555+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:56.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:56 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:56.555+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:58:57.090 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:56.743+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:57.090 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:56.743+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:58:57.090 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:56.991+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:57.090 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:56 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:56.991+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:58:57.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:57 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:57.088+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:57.383 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T06:58:57.421 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:57.421 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T06:58:57.421 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T06:58:57.421 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.5 2024-09-19T06:58:57.517 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:57 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:57.158+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:57.518 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:57 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:57.158+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:58:57.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:57 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:57.509+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:57.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:57 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:57.509+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:58:57.713 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:57 smithi203 systemd[1]: Stopping Ceph osd.5 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:58:57.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:57 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:57.516+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:57.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:57 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:57.516+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:58:58.041 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:57 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:57.711+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:58.041 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:57 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:57.711+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:58:58.041 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:57 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:57.738+0000 7fa3d4d97640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:58.041 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:57 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:57.738+0000 7fa3d4d97640 -1 osd.5 95 *** Got signal Terminated *** 2024-09-19T06:58:58.041 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:57 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:57.738+0000 7fa3d4d97640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:58.138 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:58:57 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:58:57.672+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:58:58.343 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:58.138+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:58.406 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:58.040+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:58.407 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:58.040+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:58:58.499 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:58.171+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:58.499 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:58.171+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:58:58.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:58:58 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:58:58.662+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:58:58.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:58 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:58.469+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:58.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:58 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:58.469+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:58:58.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:58.497+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:58.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:58 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:58.497+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:58:59.017 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:58.747+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:58:59.018 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:58 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:58.747+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:58:59.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:58:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:58:59.161+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:58:59.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:59.015+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:58:59.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:59.015+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:58:59.509 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:59.169+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:58:59.510 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:58:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:58:59.169+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:58:59.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:58:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:58:59.634+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:58:59.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:59.445+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:58:59.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:58:59 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:58:59.445+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:58:59.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:59.508+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:58:59.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:58:59 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:58:59.508+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:00.091 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:59.752+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:59:00.091 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:58:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:58:59.752+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:59:00.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:59.984+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:00.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:58:59 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:58:59.984+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:00.482 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:00.212+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:00.482 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:00.212+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:00.591 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:00 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:00.147+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:00.887 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:00 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:00.663+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:00.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:00 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:00.483+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:00.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:00 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:00.483+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:00.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:00.480+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:00.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:00.480+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:00.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:00.480+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:01.091 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:00 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:59:00.745+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:59:01.092 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:00 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:59:00.745+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:59:01.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:00 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:00.980+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:01.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:00 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:00.980+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:01.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:00 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:00.980+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:01.509 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:01.257+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:01.509 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:01.257+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:01.591 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:01 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:01.155+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:01.893 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:01 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:01.466+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:01.893 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:01 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:01.466+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:01.893 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:01 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:01.625+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:01.893 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:01 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:01.625+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:01.899 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:01.507+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:01.899 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:01.507+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:01.899 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:01 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:01.507+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:02.000 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:01 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:59:01.706+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:59:02.000 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:01 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:59:01.706+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:59:02.000 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:01 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:59:01.706+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:35.632971+0000 front 2024-09-19T06:58:35.632856+0000 (oldest deadline 2024-09-19T06:59:01.533033+0000) 2024-09-19T06:59:02.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:02.151+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:02.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:01 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:01.997+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:02.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:01 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:01.997+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:02.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:01 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:01.997+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:02.483 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:02 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:02.229+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:02.483 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:02 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:02.229+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:02.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:02 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:02.589+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:02.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:02 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:02.589+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:02.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:02 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:02.494+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:02.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:02 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:02.494+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:02.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:02 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:02.481+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:02.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:02 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:02.481+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:02.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:02 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:02.481+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:03.092 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:59:02.739+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.829669+0000 front 2024-09-19T06:58:18.829749+0000 (oldest deadline 2024-09-19T06:58:45.230477+0000) 2024-09-19T06:59:03.092 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:59:02.739+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:29.931788+0000 front 2024-09-19T06:58:29.931550+0000 (oldest deadline 2024-09-19T06:58:52.231491+0000) 2024-09-19T06:59:03.092 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5[47157]: 2024-09-19T06:59:02.739+0000 7fa3cd3a5640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:35.632971+0000 front 2024-09-19T06:58:35.632856+0000 (oldest deadline 2024-09-19T06:59:01.533033+0000) 2024-09-19T06:59:03.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:02.949+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:03.093 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:02.949+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:03.093 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:02 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:02.949+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:03.499 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:03 smithi203 podman[71297]: 2024-09-19 06:59:03.201852904 +0000 UTC m=+5.583225170 container died 37ba70723139697337c3532b6fa3615df90dbb08be006aad7556e8db833f97c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:59:03.499 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:03 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:03.114+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:03.500 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:03 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:03.114+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:03.526 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:03 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:03.218+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:03.526 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:03 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:03.218+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:03.526 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:03 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:03.218+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:03.842 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:03 smithi203 podman[71297]: 2024-09-19 06:59:03.598108516 +0000 UTC m=+5.979480776 container cleanup 37ba70723139697337c3532b6fa3615df90dbb08be006aad7556e8db833f97c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T06:59:03.842 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:03 smithi203 bash[71297]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5 2024-09-19T06:59:03.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:03 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:03.586+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:03.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:03 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:03.586+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:03.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:03 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:03.470+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:03.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:03 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:03.470+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:03.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:03 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:03.525+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:03.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:03 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:03.525+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:03.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:03 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:03.525+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:04.133 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:03 smithi203 podman[71311]: 2024-09-19 06:59:03.87013369 +0000 UTC m=+0.665235546 container remove 37ba70723139697337c3532b6fa3615df90dbb08be006aad7556e8db833f97c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T06:59:04.134 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:03 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:03.960+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:04.134 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:03 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:03.960+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:04.134 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:03 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:03.960+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:04.471 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:04 smithi203 podman[71405]: 2024-09-19 06:59:04.115498743 +0000 UTC m=+0.016090725 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:59:04.471 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:04 smithi203 podman[71405]: 2024-09-19 06:59:04.225978885 +0000 UTC m=+0.126570861 container create fc4238929c24856bc7c7e8063a78a2cd63b8dee24e5a78539dce5e41c12c4bb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:59:04.471 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:04 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:04.132+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:04.471 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:04 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:04.132+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:04.503 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:04 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:04.192+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:04.503 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:04 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:04.193+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:04.503 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:04 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:04.193+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:04.842 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:04 smithi203 podman[71405]: 2024-09-19 06:59:04.470675103 +0000 UTC m=+0.371267080 container init fc4238929c24856bc7c7e8063a78a2cd63b8dee24e5a78539dce5e41c12c4bb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:59:04.842 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:04 smithi203 podman[71405]: 2024-09-19 06:59:04.474084159 +0000 UTC m=+0.374676136 container start fc4238929c24856bc7c7e8063a78a2cd63b8dee24e5a78539dce5e41c12c4bb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:04.842 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:04 smithi203 podman[71405]: 2024-09-19 06:59:04.56222217 +0000 UTC m=+0.462814159 container attach fc4238929c24856bc7c7e8063a78a2cd63b8dee24e5a78539dce5e41c12c4bb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T06:59:04.842 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 06:59:04 smithi203 podman[71405]: 2024-09-19 06:59:04.658952368 +0000 UTC m=+0.559544353 container died fc4238929c24856bc7c7e8063a78a2cd63b8dee24e5a78539dce5e41c12c4bb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:59:04.887 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:04 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:04.593+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:04.887 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:04 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:04.593+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:04.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:04 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:04.467+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:04.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:04 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:04.467+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:04.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:04 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:04.502+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:04.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:04 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:04.502+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:04.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:04 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:04.502+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:05.283 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:05 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:05.131+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:05.284 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:05 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:05.131+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:05.284 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:04 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:04.921+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:05.284 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:04 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:04.921+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:05.284 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:04 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:04.921+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:05.305 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T06:59:05.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:05.346 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T06:59:05.346 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T06:59:05.346 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.6 2024-09-19T06:59:05.520 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:05 smithi159 systemd[1]: Stopping Ceph osd.6 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:59:05.521 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:05.179+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:05.521 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:05.179+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:05.521 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:05.179+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:05.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:05 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:05.561+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:05.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:05 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:05.561+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:05.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:05 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:05.499+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:05.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:05 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:05.499+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:05.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:05 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:05.499+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:05.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:05.518+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:05.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:05.518+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:05.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:05.518+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:05.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:05.666+0000 7f514965c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:05.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:05.666+0000 7f514965c640 -1 osd.6 95 *** Got signal Terminated *** 2024-09-19T06:59:05.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:05 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:05.666+0000 7f514965c640 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:59:06.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:06 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:06.143+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:06.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:06 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:06.143+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:06.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:05 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:05.946+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:06.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:05 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:05.946+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:06.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:05 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:05.946+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:06.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:06.140+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:06.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:06.140+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:06.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:06.140+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:06.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:06 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:06.537+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:06.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:06 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:06.537+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:06.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:06 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:06.466+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:06.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:06 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:06.466+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:06.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:06 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:06.466+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:06.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:06.514+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:06.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:06.514+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:06.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:06 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:06.514+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:07.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:07 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:07.135+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:07.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:07 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:07.135+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:07.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:06 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:06.961+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:07.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:06 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:06.961+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:07.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:06 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:06.961+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:07.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:07 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:07.145+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:07.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:07 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:07.145+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:07.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:07 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:07.145+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:07.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:07 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:07.527+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:07.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:07 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:07.527+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:07.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:07 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:07.462+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:07.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:07 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:07.462+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:07.889 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:07 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:07.462+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:07.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:07 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:07.486+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:07.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:07 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:07.486+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:07.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:07 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:07.486+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:08.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:08 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:08.139+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:08.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:08 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:08.139+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:08.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:08 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:08.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:08.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:08 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:08.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:08.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:08 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:08.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:08.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:08 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:08.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:08.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:08.143+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:08.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:08.143+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:08.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:08.143+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:08.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:08.575+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:08.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:08.575+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:08.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:08.575+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:08.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:08.464+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:08.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:08.464+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:08.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:08.464+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:08.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:08.464+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:08.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:08.487+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:08.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:08.487+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:08.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:08 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:08.487+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:09.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:09 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:09.100+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:09.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:09 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:09.100+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:09.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:09 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:09.028+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:09.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:09 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:09.028+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:09.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:09 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:09.028+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:09.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:09 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:09.028+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:09.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:09.124+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:09.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:09.124+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:09.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:09.124+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:09.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:09 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:09.530+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:09.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:09 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:09.530+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:09.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:09 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:09.530+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:09.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:09 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:09.495+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:09.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:09 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:09.495+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:09.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:09 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:09.495+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:09.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:09 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:09.495+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:09.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:09.461+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:09.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:09.461+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:09.898 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:09 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:09.461+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:10.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:10 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:10.082+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:10.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:10 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:10.082+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:10.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:10 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:10.082+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:10.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:10 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:10.028+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:10.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:10 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:10.028+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:10.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:10 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:10.028+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:10.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:10 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:10.028+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:10.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:10 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:10.092+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:10.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:10 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:10.092+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:10.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:10 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:10.092+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:10.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:10 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:10.092+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:10.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:10 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:10.482+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:10.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:10 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:10.482+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:10.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:10 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:10.482+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:10.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:10 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:10.476+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:10.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:10 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:10.476+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:10.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:10 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:10.476+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:10.889 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:10 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:10.476+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:10.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:10 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:10.456+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.464099+0000 front 2024-09-19T06:58:20.464147+0000 (oldest deadline 2024-09-19T06:58:44.564215+0000) 2024-09-19T06:59:10.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:10 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:10.456+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:25.665029+0000 front 2024-09-19T06:58:25.665079+0000 (oldest deadline 2024-09-19T06:58:51.565037+0000) 2024-09-19T06:59:10.897 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:10 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6[58830]: 2024-09-19T06:59:10.456+0000 7f5141c6a640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.366702+0000 front 2024-09-19T06:58:34.366742+0000 (oldest deadline 2024-09-19T06:58:59.666865+0000) 2024-09-19T06:59:11.310 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:11 smithi159 podman[125286]: 2024-09-19 06:59:11.04344164 +0000 UTC m=+5.499663858 container died 62c94f49c2a9127fe1ef3e0d2961de823ba65a58df9ae613b2ee690f17834ac6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T06:59:11.311 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:11 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:11.129+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:11.311 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:11 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:11.129+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:11.311 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:11 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:11.129+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:11.311 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:11 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:11.129+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:11.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:11 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:11.082+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:11.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:11 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:11.082+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:11.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:11 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:11.082+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:11.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:11 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:11.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:11.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:11 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:11.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:11.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:11 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:11.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:11.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:11 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:11.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:11.647 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:11 smithi159 podman[125286]: 2024-09-19 06:59:11.534281148 +0000 UTC m=+5.990503371 container cleanup 62c94f49c2a9127fe1ef3e0d2961de823ba65a58df9ae613b2ee690f17834ac6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:59:11.648 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:11 smithi159 bash[125286]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6 2024-09-19T06:59:11.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:11 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:11.489+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:11.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:11 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:11.489+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:11.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:11 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:11.489+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:11.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:11 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:11.444+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:11.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:11 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:11.444+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:11.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:11 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:11.444+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:11.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:11 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:11.444+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:12.021 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:12 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:12.019+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:12.021 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:12 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:12.019+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:12.022 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:12 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:12.019+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:12.105 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:11 smithi159 podman[125304]: 2024-09-19 06:59:11.786125321 +0000 UTC m=+0.737848424 container remove 62c94f49c2a9127fe1ef3e0d2961de823ba65a58df9ae613b2ee690f17834ac6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T06:59:12.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:12 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:12.019+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:12.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:12 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:12.056+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:12.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:12 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:12.056+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:12.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:12 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:12.056+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:12.381 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:12.157+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:12.382 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:12.157+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:12.382 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:12.157+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:12.382 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:12 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:12.157+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:12.382 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:12 smithi159 podman[125389]: 2024-09-19 06:59:12.007642694 +0000 UTC m=+0.016044433 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:59:12.382 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:12 smithi159 podman[125389]: 2024-09-19 06:59:12.137015719 +0000 UTC m=+0.145417453 container create 55ae0d8e784848cde6aaa2e4c230bf1dc95862dbecfd3e4f740ad4870997f8d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:59:12.382 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:12 smithi159 podman[125389]: 2024-09-19 06:59:12.38135124 +0000 UTC m=+0.389752985 container init 55ae0d8e784848cde6aaa2e4c230bf1dc95862dbecfd3e4f740ad4870997f8d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T06:59:12.648 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:12 smithi159 podman[125389]: 2024-09-19 06:59:12.384903959 +0000 UTC m=+0.393305688 container start 55ae0d8e784848cde6aaa2e4c230bf1dc95862dbecfd3e4f740ad4870997f8d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T06:59:12.648 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:12 smithi159 podman[125389]: 2024-09-19 06:59:12.473116094 +0000 UTC m=+0.481517835 container attach 55ae0d8e784848cde6aaa2e4c230bf1dc95862dbecfd3e4f740ad4870997f8d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:59:12.648 INFO:journalctl@ceph.osd.6.smithi159.stdout:Sep 19 06:59:12 smithi159 podman[125389]: 2024-09-19 06:59:12.581353413 +0000 UTC m=+0.589755153 container died 55ae0d8e784848cde6aaa2e4c230bf1dc95862dbecfd3e4f740ad4870997f8d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T06:59:12.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:12 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:12.447+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:12.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:12 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:12.447+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:12.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:12 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:12.447+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:12.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:12 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:12.431+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:12.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:12 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:12.431+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:12.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:12 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:12.431+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:12.889 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:12 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:12.431+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:13.329 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T06:59:13.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:13 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:13.089+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:13.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:13 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:13.089+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:13.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:13 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:13.089+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:13.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:13 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:13.036+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:13.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:13 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:13.036+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:13.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:13 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:13.036+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:13.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:13 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:13.036+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:13.376 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:13.377 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T06:59:13.377 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T06:59:13.377 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.7 2024-09-19T06:59:13.591 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:13 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:13.190+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:13.591 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:13 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:13.190+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:13.591 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:13 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:13.190+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:13.591 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:13 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:13.190+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:13.692 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:13.396+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:13.692 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:13.396+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:13.692 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:13.396+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:13.692 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:13.396+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:13.692 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:13 smithi189 systemd[1]: Stopping Ceph osd.7 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:59:13.692 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:13.494+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:13.692 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:13.494+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:13.692 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:13.494+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:13.692 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:13.689+0000 7f192bf69640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:13.693 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:13.689+0000 7f192bf69640 -1 osd.7 95 *** Got signal Terminated *** 2024-09-19T06:59:13.693 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:13 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:13.689+0000 7f192bf69640 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:59:14.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:14 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:14.051+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:14.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:14 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:14.051+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:14.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:14 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:14.051+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:14.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:14 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:14.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:14.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:14 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:14.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:14.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:14 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:14.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:14.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:14 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:14.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:14.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:14.141+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:14.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:14.141+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:14.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:14.141+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:14.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:14 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:14.141+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:14.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:14 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:14.425+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:14.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:14 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:14.425+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:14.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:14 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:14.425+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:14.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:14 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:14.425+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:14.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:14 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:14.516+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:14.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:14 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:14.516+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:14.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:14 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:14.516+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:15.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:15 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:15.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:15.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:15 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:15.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:15.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:15 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:15.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:15.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:15 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:15.034+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:15.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:15 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:15.034+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:15.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:15 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:15.034+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:15.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:15 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:15.034+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:15.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:15 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:15.181+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:15.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:15 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:15.181+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:15.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:15 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:15.181+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:15.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:15 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:15.181+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:15.887 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:15 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:15.532+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:15.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:15 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:15.532+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:15.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:15 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:15.532+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:15.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:15 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:15.411+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:15.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:15 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:15.411+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:15.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:15 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:15.411+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:15.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:15 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:15.411+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:16.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:16.013+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:16.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:16.013+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:16.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:16.013+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:16.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:16.013+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:16.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:16.038+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:16.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:16.038+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:16.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:16.038+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:16.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:16.038+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:16.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:16 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:16.188+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:16.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:16 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:16.188+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:16.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:16 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:16.188+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:16.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:16 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:16.188+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:16.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:16 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:16.188+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:16.887 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:16 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:16.548+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:16.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:16 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:16.548+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:16.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:16 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:16.548+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:16.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:16 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:16.405+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:16.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:16 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:16.405+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:16.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:16 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:16.405+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:16.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:16 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:16.405+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:17.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:17 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:17.027+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:17.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:17 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:17.027+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:17.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:17 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:17.027+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:17.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:17 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:17.027+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:17.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:16.982+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:17.343 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:16.982+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:17.343 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:16.982+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:17.343 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:16 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:16.982+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:17.647 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:17 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:17.163+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:17.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:17 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:17.163+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:17.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:17 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:17.163+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:17.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:17 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:17.163+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:17.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:17 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:17.163+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:17.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:17 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:17.563+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:17.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:17 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:17.563+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:17.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:17 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:17.563+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:17.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:17 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:17.419+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:17.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:17 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:17.419+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:17.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:17 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:17.419+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:17.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:17 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:17.419+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:18.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:18 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:18.039+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:18.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:18 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:18.039+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:18.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:18 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:18.039+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:18.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:18 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:18.039+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:18.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:17 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:17.969+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:18.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:17 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:17.969+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:18.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:17 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:17.969+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:18.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:17 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:17.969+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:18.397 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:18 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:18.125+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:18.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:18 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:18.125+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:18.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:18 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:18.125+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:18.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:18 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:18.125+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:18.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:18 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:18.125+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:18.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:18 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:18.526+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:26.395589+0000 front 2024-09-19T06:58:26.395655+0000 (oldest deadline 2024-09-19T06:58:51.095806+0000) 2024-09-19T06:59:18.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:18 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:18.526+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.497668+0000 front 2024-09-19T06:58:37.497744+0000 (oldest deadline 2024-09-19T06:59:00.997508+0000) 2024-09-19T06:59:18.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:18 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7[52877]: 2024-09-19T06:59:18.526+0000 7f192857f640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.298570+0000 front 2024-09-19T06:58:46.298595+0000 (oldest deadline 2024-09-19T06:59:07.998614+0000) 2024-09-19T06:59:18.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:18 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:18.434+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:18.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:18 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:18.434+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:18.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:18 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:18.434+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:18.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:18 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:18.434+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:19.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:19 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:19.042+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:19.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:19 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:19.042+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:19.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:19 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:19.042+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:19.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:19 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:19.042+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:19.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:18 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:18.925+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:19.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:18 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:18.925+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:19.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:18 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:18.925+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:19.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:18 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:18.925+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:19.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:18 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:18.925+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:19.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:19 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:19.142+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:19.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:19 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:19.142+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:19.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:19 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:19.142+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:19.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:19 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:19.142+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:19.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:19 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:19.142+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:19.534 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:19 smithi189 podman[71300]: 2024-09-19 06:59:19.254246872 +0000 UTC m=+5.680463536 container died ab7dcc580eef853a4e7658a8d8108da76f44d290235c46d5e5c138fa65e7974a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:59:19.534 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:19 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:19.476+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:19.534 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:19 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:19.476+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:19.535 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:19 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:19.476+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:19.535 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:19 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:19.476+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:19.535 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:19 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:19.476+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:19.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:19 smithi189 podman[71300]: 2024-09-19 06:59:19.665950877 +0000 UTC m=+6.092167544 container cleanup ab7dcc580eef853a4e7658a8d8108da76f44d290235c46d5e5c138fa65e7974a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:59:19.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:19 smithi189 bash[71300]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7 2024-09-19T06:59:20.331 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:19 smithi189 podman[71314]: 2024-09-19 06:59:19.900517359 +0000 UTC m=+0.648817464 container remove ab7dcc580eef853a4e7658a8d8108da76f44d290235c46d5e5c138fa65e7974a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:20.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:20 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:20.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:20.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:20 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:20.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:20.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:20 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:20.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:20.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:20 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:20.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:20.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:19 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:19.897+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:20.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:19 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:19.897+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:20.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:19 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:19.897+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:20.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:19 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:19.897+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:20.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:19 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:19.897+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:20.621 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:20 smithi189 podman[71406]: 2024-09-19 06:59:20.234190628 +0000 UTC m=+0.016456713 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:59:20.621 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:20 smithi189 podman[71406]: 2024-09-19 06:59:20.351328016 +0000 UTC m=+0.133594093 container create c44ab468bc73c761ae7c6dd490fa27c9e0fe136cb93b670b3edfd856795fa437 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T06:59:20.621 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:20 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:20.479+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:20.622 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:20 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:20.479+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:20.622 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:20 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:20.479+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:20.622 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:20 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:20.479+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:20.622 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:20 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:20.479+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:20.647 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:20 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:20.169+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:20.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:20 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:20.169+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:20.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:20 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:20.169+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:20.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:20 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:20.169+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:20.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:20 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:20.169+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:20.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:20 smithi189 podman[71406]: 2024-09-19 06:59:20.62118787 +0000 UTC m=+0.403453945 container init c44ab468bc73c761ae7c6dd490fa27c9e0fe136cb93b670b3edfd856795fa437 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:59:20.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:20 smithi189 podman[71406]: 2024-09-19 06:59:20.625166307 +0000 UTC m=+0.407432389 container start c44ab468bc73c761ae7c6dd490fa27c9e0fe136cb93b670b3edfd856795fa437 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T06:59:20.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:20 smithi189 podman[71406]: 2024-09-19 06:59:20.729431205 +0000 UTC m=+0.511697289 container attach c44ab468bc73c761ae7c6dd490fa27c9e0fe136cb93b670b3edfd856795fa437 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T06:59:20.888 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 19 06:59:20 smithi189 podman[71406]: 2024-09-19 06:59:20.815487945 +0000 UTC m=+0.597754023 container died c44ab468bc73c761ae7c6dd490fa27c9e0fe136cb93b670b3edfd856795fa437 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T06:59:21.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:20 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:20.946+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:21.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:20 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:20.946+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:21.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:20 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:20.946+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:21.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:20 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:20.946+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:21.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:20 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:20.946+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:21.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:21.076+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:21.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:21.076+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:21.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:21.076+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:21.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:21.076+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:21.403 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T06:59:21.442 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:21.443 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T06:59:21.443 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T06:59:21.443 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.8 2024-09-19T06:59:21.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:21 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:21.527+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:21.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:21 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:21.527+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:21.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:21 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:21.527+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:21.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:21 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:21.527+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:21.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:21 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:21.527+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:21.647 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:21 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:21.207+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:21.647 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:21 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:21.207+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:21.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:21 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:21.207+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:21.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:21 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:21.207+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:21.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:21 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:21.207+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:21.841 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:21 smithi203 systemd[1]: Stopping Ceph osd.8 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:59:22.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:21.990+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:21.990+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:21.990+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:21.990+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:21.990+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:21.853+0000 7fca6e525640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:21.853+0000 7fca6e525640 -1 osd.8 95 *** Got signal Terminated *** 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:21.853+0000 7fca6e525640 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:22 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:22.066+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:22 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:22.066+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:22.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:22 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:22.066+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:22.343 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:22 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:22.066+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:22.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:22 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:22.216+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:22.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:22 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:22.216+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:22.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:22 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:22.216+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:22.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:22 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:22.216+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:22.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:22 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:22.216+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:22.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:22 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:22.493+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:22.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:22 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:22.493+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:22.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:22 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:22.493+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:22.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:22 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:22.493+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:22.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:22 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:22.493+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:23.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:23 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:23.030+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:23.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:23 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:23.030+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:23.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:23 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:23.030+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:23.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:23 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:23.030+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:23.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:22 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:22.948+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:23.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:22 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:22.948+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:23.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:22 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:22.948+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:23.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:22 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:22.948+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:23.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:22 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:22.948+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:23.647 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:23 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:23.180+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:23.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:23 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:23.180+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:23.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:23 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:23.180+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:23.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:23 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:23.180+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:23.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:23 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:23.180+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:23.790 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:23 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:23.480+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:23.790 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:23 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:23.480+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:23.790 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:23 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:23.480+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:23.790 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:23 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:23.480+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:23.790 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:23 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:23.480+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:24.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:24.073+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:24.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:24.073+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:24.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:24.073+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:24.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:24.073+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:24.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:24.073+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.926708+0000 front 2024-09-19T06:58:59.926740+0000 (oldest deadline 2024-09-19T06:59:23.426829+0000) 2024-09-19T06:59:24.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:23 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:23.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:24.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:23 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:23.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:24.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:23 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:23.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:24.343 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:23 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:23.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:24.343 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:23 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:23.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:24.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:24 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:24.168+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:24.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:24 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:24.168+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:24.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:24 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:24.168+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:24.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:24 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:24.168+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:24.398 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:24 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:24.168+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:24.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:24 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:24.520+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:24.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:24 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:24.520+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:24.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:24 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:24.520+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:24.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:24 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:24.520+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:24.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:24 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:24.520+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:24.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:24 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:24.520+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:25.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:24.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:25.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:24.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:25.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:24.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:25.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:24.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:25.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:24.972+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:25.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:25 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:25.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:25.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:25 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:25.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:25.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:25 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:25.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:25.343 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:25 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:25.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:25.343 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:25 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:25.053+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.926708+0000 front 2024-09-19T06:58:59.926740+0000 (oldest deadline 2024-09-19T06:59:23.426829+0000) 2024-09-19T06:59:25.647 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:25 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:25.210+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:25.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:25 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:25.210+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:25.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:25 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:25.210+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:25.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:25 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:25.210+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:25.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:25 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:25.210+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:25.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:25 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:25.210+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:25.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:25.547+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:25.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:25.547+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:25.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:25.547+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:25.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:25.547+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:25.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:25.547+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:25.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:25 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:25.547+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:26.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:26.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:26.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:26.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:26.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.018+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:26.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:26.042+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:19.720198+0000 front 2024-09-19T06:58:19.720210+0000 (oldest deadline 2024-09-19T06:58:43.820286+0000) 2024-09-19T06:59:26.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:26.042+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.723801+0000 front 2024-09-19T06:58:37.723860+0000 (oldest deadline 2024-09-19T06:59:02.423917+0000) 2024-09-19T06:59:26.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:26.042+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:46.425285+0000 front 2024-09-19T06:58:46.425416+0000 (oldest deadline 2024-09-19T06:59:09.925287+0000) 2024-09-19T06:59:26.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:26.042+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:49.925954+0000 front 2024-09-19T06:58:49.925967+0000 (oldest deadline 2024-09-19T06:59:15.225835+0000) 2024-09-19T06:59:26.342 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8[53938]: 2024-09-19T06:59:26.042+0000 7fca6ab3b640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.926708+0000 front 2024-09-19T06:58:59.926740+0000 (oldest deadline 2024-09-19T06:59:23.426829+0000) 2024-09-19T06:59:26.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:26 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:26.193+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:26.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:26 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:26.193+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:26.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:26 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:26.193+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:26.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:26 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:26.193+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:26.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:26 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:26.193+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:26.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:26 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:26.193+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:26.887 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:26 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:26.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:26.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:26 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:26.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:26.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:26 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:26.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:26.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:26 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:26.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:26.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:26 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:26.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:26.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:26 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:26.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:27.341 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:27 smithi203 podman[71520]: 2024-09-19 06:59:27.194929553 +0000 UTC m=+5.548116413 container died a1ac5de132601e653ca46dbba7ed42e4c777ed1a8a16b2f6940cf1c9007ae70d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:59:27.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.974+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:27.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.974+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:27.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.974+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:27.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.974+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:27.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.974+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:27.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:26 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:26.974+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:27.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:27 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:27.236+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:27.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:27 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:27.236+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:27.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:27 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:27.236+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:27.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:27 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:27.236+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:27.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:27 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:27.236+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:27.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:27 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:27.236+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:27.829 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:27 smithi203 podman[71520]: 2024-09-19 06:59:27.594232765 +0000 UTC m=+5.947419623 container cleanup a1ac5de132601e653ca46dbba7ed42e4c777ed1a8a16b2f6940cf1c9007ae70d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T06:59:27.829 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:27 smithi203 bash[71520]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8 2024-09-19T06:59:27.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:27 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:27.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:27.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:27 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:27.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:27.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:27 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:27.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:27.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:27 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:27.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:27.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:27 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:27.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:27.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:27 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:27.582+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:28.091 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:27 smithi203 podman[71534]: 2024-09-19 06:59:27.828959176 +0000 UTC m=+0.630682473 container remove a1ac5de132601e653ca46dbba7ed42e4c777ed1a8a16b2f6940cf1c9007ae70d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T06:59:28.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.023+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:28.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.023+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:28.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.023+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:28.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.023+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:28.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.023+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:28.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.023+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:28.491 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:28 smithi203 podman[71623]: 2024-09-19 06:59:28.14687217 +0000 UTC m=+0.103562730 container create 7748aee9c11af55cb9a5d953248d2af7f6adac35eb8f85418ba9d2f4b84421cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:28.491 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:28 smithi203 podman[71623]: 2024-09-19 06:59:28.059478175 +0000 UTC m=+0.016168693 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:59:28.492 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:28 smithi203 podman[71623]: 2024-09-19 06:59:28.391027334 +0000 UTC m=+0.347717848 container init 7748aee9c11af55cb9a5d953248d2af7f6adac35eb8f85418ba9d2f4b84421cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T06:59:28.492 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:28 smithi203 podman[71623]: 2024-09-19 06:59:28.394505222 +0000 UTC m=+0.351195737 container start 7748aee9c11af55cb9a5d953248d2af7f6adac35eb8f85418ba9d2f4b84421cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:59:28.492 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:28 smithi203 podman[71623]: 2024-09-19 06:59:28.490981111 +0000 UTC m=+0.447671643 container attach 7748aee9c11af55cb9a5d953248d2af7f6adac35eb8f85418ba9d2f4b84421cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:59:28.647 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:28.253+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:28.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:28.253+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:28.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:28.253+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:28.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:28.253+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:28.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:28.253+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:28.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:28 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:28.253+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:28.841 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 06:59:28 smithi203 podman[71623]: 2024-09-19 06:59:28.587885626 +0000 UTC m=+0.544576141 container died 7748aee9c11af55cb9a5d953248d2af7f6adac35eb8f85418ba9d2f4b84421cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:59:28.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:28 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:28.549+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:28.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:28 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:28.549+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:28.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:28 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:28.549+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:28.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:28 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:28.549+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:28.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:28 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:28.549+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:28.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:28 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:28.549+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:29.203 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.991+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:29.203 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.991+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:29.204 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.991+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:29.204 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.991+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:29.204 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.992+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:29.204 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:28 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:28.992+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:29.228 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T06:59:29.271 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:29.271 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T06:59:29.271 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T06:59:29.271 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.9 2024-09-19T06:59:29.589 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:29.205+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:29.589 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:29.205+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:29.589 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:29.205+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:29.589 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:29.205+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:29.590 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:29.205+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:29.590 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:29.205+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:29.590 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 systemd[1]: Stopping Ceph osd.9 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:59:29.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:29 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:29.509+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:29.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:29 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:29.509+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:29.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:29 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:29.509+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:29.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:29 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:29.509+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:29.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:29 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:29.509+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:29.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:29 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:29.509+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:29.897 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:29.588+0000 7fd85179d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:29.897 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:29.588+0000 7fd85179d640 -1 osd.9 95 *** Got signal Terminated *** 2024-09-19T06:59:29.897 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:29 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:29.588+0000 7fd85179d640 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:59:30.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:29 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:29.959+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:30.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:29 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:29.959+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:30.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:29 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:29.959+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:30.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:29 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:29.959+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:30.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:29 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:29.959+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:30.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:29 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:29.959+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:30.647 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:30 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:30.156+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:30.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:30 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:30.156+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:30.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:30 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:30.156+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:30.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:30 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:30.156+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:30.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:30 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:30.156+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:30.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:30 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:30.156+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:30.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:30 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:30.543+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:30.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:30 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:30.543+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:30.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:30 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:30.543+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:30.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:30 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:30.543+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:30.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:30 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:30.543+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:30.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:30 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:30.543+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:31.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:30.941+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:31.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:30.941+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:31.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:30.941+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:31.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:30.941+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:31.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:30.941+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:31.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:30 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:30.941+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:31.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:31.204+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:31.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:31.204+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:31.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:31.204+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:31.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:31.204+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:31.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:31.204+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:31.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:31 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:31.204+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:31.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:31 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:31.515+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:31.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:31 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:31.515+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:31.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:31 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:31.515+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:31.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:31 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:31.515+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:31.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:31 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:31.515+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:31.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:31 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:31.515+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:32.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:31.979+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:32.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:31.979+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:32.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:31.979+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:32.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:31.979+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:32.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:31.979+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:32.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:31 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:31.979+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:32.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:32.212+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:32.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:32.212+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:32.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:32.212+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:32.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:32.212+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:32.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:32.212+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:32.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:32.212+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:32.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:32 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:32.212+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:07.232619+0000 front 2024-09-19T06:59:07.232590+0000 (oldest deadline 2024-09-19T06:59:31.332706+0000) 2024-09-19T06:59:32.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:32 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:32.550+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:32.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:32 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:32.550+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:32.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:32 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:32.550+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:32.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:32 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:32.550+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:32.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:32 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:32.550+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:32.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:32 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:32.550+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:33.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:32.971+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:33.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:32.971+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:33.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:32.971+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:33.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:32.971+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:33.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:32.971+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:33.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:32 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:32.971+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:33.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:33 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:33.248+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:33.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:33 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:33.248+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:33.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:33 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:33.248+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:33.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:33 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:33.248+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:33.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:33 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:33.248+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:33.649 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:33 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:33.248+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:33.649 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:33 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:33.248+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:07.232619+0000 front 2024-09-19T06:59:07.232590+0000 (oldest deadline 2024-09-19T06:59:31.332706+0000) 2024-09-19T06:59:33.841 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:33.548+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:33.841 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:33.548+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:33.841 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:33.548+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:33.841 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:33.548+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:33.841 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:33.548+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:33.841 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:33.548+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:33.841 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:33 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:33.548+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:09.867688+0000 front 2024-09-19T06:59:09.867749+0000 (oldest deadline 2024-09-19T06:59:32.767574+0000) 2024-09-19T06:59:34.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:33.940+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:34.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:33.940+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:34.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:33.940+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:34.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:33.940+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:34.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:33.940+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:34.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:33 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:33.940+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:34.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:34.244+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:18.722595+0000 front 2024-09-19T06:58:18.722574+0000 (oldest deadline 2024-09-19T06:58:43.422747+0000) 2024-09-19T06:59:34.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:34.244+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:30.424072+0000 front 2024-09-19T06:58:30.424110+0000 (oldest deadline 2024-09-19T06:58:55.724274+0000) 2024-09-19T06:59:34.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:34.244+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:37.926330+0000 front 2024-09-19T06:58:37.926350+0000 (oldest deadline 2024-09-19T06:59:02.626187+0000) 2024-09-19T06:59:34.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:34.244+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.927239+0000 front 2024-09-19T06:58:44.927210+0000 (oldest deadline 2024-09-19T06:59:09.627419+0000) 2024-09-19T06:59:34.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:34.244+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.129469+0000 front 2024-09-19T06:58:54.129614+0000 (oldest deadline 2024-09-19T06:59:15.229253+0000) 2024-09-19T06:59:34.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:34.244+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:00.931158+0000 front 2024-09-19T06:59:00.931201+0000 (oldest deadline 2024-09-19T06:59:25.031241+0000) 2024-09-19T06:59:34.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:34 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9[65671]: 2024-09-19T06:59:34.244+0000 7fd849dab640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:07.232619+0000 front 2024-09-19T06:59:07.232590+0000 (oldest deadline 2024-09-19T06:59:31.332706+0000) 2024-09-19T06:59:34.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:34 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:34.562+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:34.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:34 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:34.562+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:34.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:34 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:34.562+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:34.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:34 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:34.562+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:34.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:34 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:34.562+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:34.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:34 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:34.562+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:34.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:34 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:34.562+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:09.867688+0000 front 2024-09-19T06:59:09.867749+0000 (oldest deadline 2024-09-19T06:59:32.767574+0000) 2024-09-19T06:59:35.305 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:34 smithi159 podman[125504]: 2024-09-19 06:59:34.984632879 +0000 UTC m=+5.515152672 container died 48fee7f13ace6814c087932effbc285b7b56e840c904ea6cf895939c99a5917c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:35.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:34.963+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:35.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:34.963+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:35.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:34.963+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:35.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:34.963+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:35.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:34.963+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:35.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:34.963+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:35.647 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:35 smithi159 podman[125504]: 2024-09-19 06:59:35.304711811 +0000 UTC m=+5.835231602 container cleanup 48fee7f13ace6814c087932effbc285b7b56e840c904ea6cf895939c99a5917c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T06:59:35.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:35 smithi159 bash[125504]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9 2024-09-19T06:59:35.648 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:35 smithi159 podman[125518]: 2024-09-19 06:59:35.522745458 +0000 UTC m=+0.540389075 container remove 48fee7f13ace6814c087932effbc285b7b56e840c904ea6cf895939c99a5917c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:59:35.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:35.607+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:35.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:35.607+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:35.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:35.607+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:35.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:35.607+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:35.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:35.607+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:35.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:35.607+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:35.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:35 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:35.607+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:09.867688+0000 front 2024-09-19T06:59:09.867749+0000 (oldest deadline 2024-09-19T06:59:32.767574+0000) 2024-09-19T06:59:36.209 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:35 smithi159 podman[125608]: 2024-09-19 06:59:35.823057636 +0000 UTC m=+0.016159079 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:59:36.210 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:35 smithi159 podman[125608]: 2024-09-19 06:59:35.940159655 +0000 UTC m=+0.133261087 container create 49651a9d7f882172b4b7e0458b02ae0c7ea2af7045879e6239de836858546616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:59:36.210 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:36 smithi159 podman[125608]: 2024-09-19 06:59:36.134345084 +0000 UTC m=+0.327446513 container init 49651a9d7f882172b4b7e0458b02ae0c7ea2af7045879e6239de836858546616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:36.210 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:36 smithi159 podman[125608]: 2024-09-19 06:59:36.137581129 +0000 UTC m=+0.330682559 container start 49651a9d7f882172b4b7e0458b02ae0c7ea2af7045879e6239de836858546616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T06:59:36.210 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:36 smithi159 podman[125608]: 2024-09-19 06:59:36.209165999 +0000 UTC m=+0.402267428 container attach 49651a9d7f882172b4b7e0458b02ae0c7ea2af7045879e6239de836858546616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:36.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:35 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:35.964+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:36.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:35 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:35.964+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:36.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:35 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:35.964+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:36.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:35 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:35.964+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:36.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:35 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:35.964+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:36.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:35 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:35.964+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:36.613 INFO:journalctl@ceph.osd.9.smithi159.stdout:Sep 19 06:59:36 smithi159 podman[125608]: 2024-09-19 06:59:36.327400263 +0000 UTC m=+0.520501693 container died 49651a9d7f882172b4b7e0458b02ae0c7ea2af7045879e6239de836858546616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T06:59:36.888 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T06:59:36.927 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:36.927 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T06:59:36.927 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T06:59:36.927 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.10 2024-09-19T06:59:36.955 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:36.656+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:36.955 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:36.656+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:36.955 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:36.656+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:36.955 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:36.656+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:36.955 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:36.656+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:36.956 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:36.656+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:36.956 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:36 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:36.656+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:09.867688+0000 front 2024-09-19T06:59:09.867749+0000 (oldest deadline 2024-09-19T06:59:32.767574+0000) 2024-09-19T06:59:37.244 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:36 smithi189 systemd[1]: Stopping Ceph osd.10 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:59:37.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:37 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:37.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:37.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:37 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:37.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:37.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:37 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:37.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:37.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:37 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:37.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:37.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:37 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:37.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:37.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:37 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:37.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:37.637 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.243+0000 7fa95f6e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:37.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.243+0000 7fa95f6e1640 -1 osd.10 95 *** Got signal Terminated *** 2024-09-19T06:59:37.638 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.243+0000 7fa95f6e1640 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:59:38.138 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.657+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:38.138 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.657+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:38.138 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.657+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:38.138 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.657+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:38.138 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.657+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:38.138 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.657+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:38.138 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:37 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:37.657+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:09.867688+0000 front 2024-09-19T06:59:09.867749+0000 (oldest deadline 2024-09-19T06:59:32.767574+0000) 2024-09-19T06:59:38.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.040+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:38.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.040+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:38.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.040+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:38.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.040+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:38.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.040+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:38.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.040+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:38.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:38 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:38.620+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:38.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:38 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:38.620+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:38.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:38 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:38.620+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:38.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:38 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:38.620+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:38.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:38 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:38.620+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:38.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:38 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:38.620+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:38.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:38 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:38.620+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:09.867688+0000 front 2024-09-19T06:59:09.867749+0000 (oldest deadline 2024-09-19T06:59:32.767574+0000) 2024-09-19T06:59:39.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.996+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:39.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.996+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:39.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.996+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:39.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.996+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:39.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.996+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:39.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:38 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:38.996+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:39.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:39 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:39.632+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:39.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:39 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:39.632+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:39.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:39 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:39.632+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:39.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:39 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:39.632+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:39.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:39 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:39.632+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:39.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:39 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:39.632+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:39.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:39 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:39.632+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:09.867688+0000 front 2024-09-19T06:59:09.867749+0000 (oldest deadline 2024-09-19T06:59:32.767574+0000) 2024-09-19T06:59:40.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:40 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:39.999+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:40.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:40 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:39.999+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:40.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:40 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:39.999+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:40.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:40 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:39.999+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:40.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:40 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:39.999+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:40.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:40 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:39.999+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:40.887 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:40 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:40.583+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:40.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:40 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:40.583+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:40.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:40 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:40.583+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:40.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:40 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:40.583+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:40.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:40 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:40.583+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:40.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:40 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:40.583+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:40.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:40 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:40.583+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:09.867688+0000 front 2024-09-19T06:59:09.867749+0000 (oldest deadline 2024-09-19T06:59:32.767574+0000) 2024-09-19T06:59:41.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:41 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:41.022+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:41.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:41 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:41.022+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:41.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:41 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:41.022+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:41.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:41 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:41.022+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:41.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:41 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:41.022+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:41.343 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:41 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:41.022+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:41.343 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:41 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:41.022+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:41.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:41 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:41.602+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:20.960228+0000 front 2024-09-19T06:58:20.959998+0000 (oldest deadline 2024-09-19T06:58:42.660013+0000) 2024-09-19T06:59:41.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:41 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:41.602+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.560993+0000 front 2024-09-19T06:58:28.560961+0000 (oldest deadline 2024-09-19T06:58:51.461164+0000) 2024-09-19T06:59:41.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:41 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:41.602+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.262677+0000 front 2024-09-19T06:58:34.262777+0000 (oldest deadline 2024-09-19T06:59:04.863262+0000) 2024-09-19T06:59:41.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:41 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:41.602+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.864019+0000 front 2024-09-19T06:58:44.863917+0000 (oldest deadline 2024-09-19T06:59:08.363742+0000) 2024-09-19T06:59:41.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:41 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:41.602+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:54.566254+0000 front 2024-09-19T06:58:54.566277+0000 (oldest deadline 2024-09-19T06:59:19.266241+0000) 2024-09-19T06:59:41.888 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:41 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:41.602+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:58:59.266871+0000 front 2024-09-19T06:58:59.266921+0000 (oldest deadline 2024-09-19T06:59:23.966644+0000) 2024-09-19T06:59:41.889 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:41 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10[59611]: 2024-09-19T06:59:41.602+0000 7fa95bcf7640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6822 osd.6 since back 2024-09-19T06:59:09.867688+0000 front 2024-09-19T06:59:09.867749+0000 (oldest deadline 2024-09-19T06:59:32.767574+0000) 2024-09-19T06:59:42.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:42 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:42.030+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:42.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:42 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:42.030+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:42.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:42 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:42.030+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:42.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:42 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:42.030+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:42.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:42 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:42.030+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:42.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:42 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:42.030+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:42.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:42 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:42.030+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:43.069 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:42 smithi189 podman[71523]: 2024-09-19 06:59:42.765672645 +0000 UTC m=+5.639280438 container died 9fff0bdbbff5e4e4aebe6e9e2115d8765b5a91d6e72debc107a623fcdf888173 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T06:59:43.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:43 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:43.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:43.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:43 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:43.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:43.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:43 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:43.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:43.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:43 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:43.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:43.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:43 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:43.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:43.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:43 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:43.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:43.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:43 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:43.041+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:43.387 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:43 smithi189 podman[71523]: 2024-09-19 06:59:43.143176012 +0000 UTC m=+6.016783786 container cleanup 9fff0bdbbff5e4e4aebe6e9e2115d8765b5a91d6e72debc107a623fcdf888173 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T06:59:43.388 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:43 smithi189 bash[71523]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10 2024-09-19T06:59:43.714 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:43 smithi189 podman[71542]: 2024-09-19 06:59:43.394312287 +0000 UTC m=+0.629862518 container remove 9fff0bdbbff5e4e4aebe6e9e2115d8765b5a91d6e72debc107a623fcdf888173 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T06:59:44.006 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:43 smithi189 podman[71629]: 2024-09-19 06:59:43.61675109 +0000 UTC m=+0.015618987 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:59:44.006 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:43 smithi189 podman[71629]: 2024-09-19 06:59:43.720096445 +0000 UTC m=+0.118964331 container create e3a617d2ea7a572c79c6244116a07d6a29f3f60c9c169cec88aabceed2452909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T06:59:44.006 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:43 smithi189 podman[71629]: 2024-09-19 06:59:43.922465687 +0000 UTC m=+0.321333575 container init e3a617d2ea7a572c79c6244116a07d6a29f3f60c9c169cec88aabceed2452909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:59:44.006 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:43 smithi189 podman[71629]: 2024-09-19 06:59:43.925712923 +0000 UTC m=+0.324580810 container start e3a617d2ea7a572c79c6244116a07d6a29f3f60c9c169cec88aabceed2452909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T06:59:44.006 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:44 smithi189 podman[71629]: 2024-09-19 06:59:44.005891694 +0000 UTC m=+0.404759588 container attach e3a617d2ea7a572c79c6244116a07d6a29f3f60c9c169cec88aabceed2452909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T06:59:44.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:44.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:44.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:44.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:44.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:44.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:44.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:44.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:44.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:44.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:44.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:44.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:44.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:44 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:44.001+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:44.388 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 19 06:59:44 smithi189 podman[71629]: 2024-09-19 06:59:44.115130642 +0000 UTC m=+0.513998533 container died e3a617d2ea7a572c79c6244116a07d6a29f3f60c9c169cec88aabceed2452909 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:59:44.768 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T06:59:44.848 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:44.848 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T06:59:44.849 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T06:59:44.852 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.11 2024-09-19T06:59:45.173 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:44 smithi203 systemd[1]: Stopping Ceph osd.11 for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:59:45.173 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.026+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:45.173 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.026+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:45.173 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.026+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:45.174 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.026+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:45.174 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.026+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:45.174 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.026+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:45.174 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.026+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:45.174 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.172+0000 7fcae0985640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:45.174 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.172+0000 7fcae0985640 -1 osd.11 95 *** Got signal Terminated *** 2024-09-19T06:59:45.174 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:45 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:45.172+0000 7fcae0985640 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:59:46.341 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:46.057+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:46.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:46.057+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:46.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:46.057+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:46.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:46.057+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:46.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:46.057+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:46.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:46.057+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:46.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:46 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:46.058+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:47.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:47.076+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:47.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:47.076+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:47.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:47.076+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:47.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:47.076+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:47.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:47.076+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:47.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:47.076+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:47.342 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:47 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:47.076+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:48.563 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:48.107+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:48.564 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:48.107+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:48.564 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:48.107+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:48.564 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:48.107+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:48.564 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:48.107+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:48.564 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:48.107+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:48.564 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:48.107+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:48.564 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:48 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:48.107+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6820 osd.8 since back 2024-09-19T06:59:26.586499+0000 front 2024-09-19T06:59:26.586475+0000 (oldest deadline 2024-09-19T06:59:47.686454+0000) 2024-09-19T06:59:49.592 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:49.140+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:49.592 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:49.140+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:49.592 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:49.140+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:49.592 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:49.140+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:49.592 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:49.140+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:49.592 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:49.140+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:49.592 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:49.140+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:49.592 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:49 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:49.140+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6820 osd.8 since back 2024-09-19T06:59:26.586499+0000 front 2024-09-19T06:59:26.586475+0000 (oldest deadline 2024-09-19T06:59:47.686454+0000) 2024-09-19T06:59:50.556 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:50.144+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-09-19T06:58:17.176865+0000 front 2024-09-19T06:58:17.176891+0000 (oldest deadline 2024-09-19T06:58:43.076797+0000) 2024-09-19T06:59:50.556 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:50.144+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-19T06:58:28.378156+0000 front 2024-09-19T06:58:28.377947+0000 (oldest deadline 2024-09-19T06:58:53.678104+0000) 2024-09-19T06:59:50.556 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:50.144+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T06:58:34.778973+0000 front 2024-09-19T06:58:34.778948+0000 (oldest deadline 2024-09-19T06:59:00.679071+0000) 2024-09-19T06:59:50.556 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:50.144+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6814 osd.3 since back 2024-09-19T06:58:44.680577+0000 front 2024-09-19T06:58:44.680647+0000 (oldest deadline 2024-09-19T06:59:06.980717+0000) 2024-09-19T06:59:50.556 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:50.144+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-19T06:58:53.882882+0000 front 2024-09-19T06:58:53.882959+0000 (oldest deadline 2024-09-19T06:59:17.982794+0000) 2024-09-19T06:59:50.556 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:50.144+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T06:59:02.583976+0000 front 2024-09-19T06:59:02.583995+0000 (oldest deadline 2024-09-19T06:59:26.684039+0000) 2024-09-19T06:59:50.556 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:50.144+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-19T06:59:14.785718+0000 front 2024-09-19T06:59:14.785771+0000 (oldest deadline 2024-09-19T06:59:40.685560+0000) 2024-09-19T06:59:50.557 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11[60493]: 2024-09-19T06:59:50.144+0000 7fcadcf9b640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.203:6820 osd.8 since back 2024-09-19T06:59:26.586499+0000 front 2024-09-19T06:59:26.586475+0000 (oldest deadline 2024-09-19T06:59:47.686454+0000) 2024-09-19T06:59:50.824 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 podman[71738]: 2024-09-19 06:59:50.555345701 +0000 UTC m=+5.507225345 container died a8b45f2d421a665fd0420cf82d2a94775605a9c17d64e85566a74b8a982ce3c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T06:59:51.091 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 podman[71738]: 2024-09-19 06:59:50.922364723 +0000 UTC m=+5.874244366 container cleanup a8b45f2d421a665fd0420cf82d2a94775605a9c17d64e85566a74b8a982ce3c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T06:59:51.092 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:50 smithi203 bash[71738]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11 2024-09-19T06:59:51.541 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:51 smithi203 podman[71767]: 2024-09-19 06:59:51.182072937 +0000 UTC m=+0.624260631 container remove a8b45f2d421a665fd0420cf82d2a94775605a9c17d64e85566a74b8a982ce3c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:51.842 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:51 smithi203 podman[71857]: 2024-09-19 06:59:51.443999482 +0000 UTC m=+0.016175878 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:59:51.842 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:51 smithi203 podman[71857]: 2024-09-19 06:59:51.557816768 +0000 UTC m=+0.129993203 container create 1e4df13e39f30802df93101deaf0d16064baddbe2d81f838f8b87390dee0cb3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:59:51.842 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:51 smithi203 podman[71857]: 2024-09-19 06:59:51.77736627 +0000 UTC m=+0.349542646 container init 1e4df13e39f30802df93101deaf0d16064baddbe2d81f838f8b87390dee0cb3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T06:59:51.842 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:51 smithi203 podman[71857]: 2024-09-19 06:59:51.780656616 +0000 UTC m=+0.352832993 container start 1e4df13e39f30802df93101deaf0d16064baddbe2d81f838f8b87390dee0cb3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:52.264 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:51 smithi203 podman[71857]: 2024-09-19 06:59:51.870621719 +0000 UTC m=+0.442798107 container attach 1e4df13e39f30802df93101deaf0d16064baddbe2d81f838f8b87390dee0cb3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T06:59:52.264 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 06:59:51 smithi203 podman[71857]: 2024-09-19 06:59:51.969019237 +0000 UTC m=+0.541195625 container died 1e4df13e39f30802df93101deaf0d16064baddbe2d81f838f8b87390dee0cb3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:59:52.622 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T06:59:52.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:52.662 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T06:59:52.662 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T06:59:52.663 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.a 2024-09-19T06:59:52.983 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:59:52 smithi159 systemd[1]: Stopping Ceph mds.a for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:59:53.398 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:59:52 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-a[72383]: 2024-09-19T06:59:52.981+0000 7f60bc7c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:53.398 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:59:52 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-a[72383]: 2024-09-19T06:59:52.981+0000 7f60bc7c7640 -1 mds.a *** got signal Terminated *** 2024-09-19T06:59:54.607 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:59:54 smithi159 podman[125726]: 2024-09-19 06:59:54.322775324 +0000 UTC m=+1.458131657 container died 30fab5e7f69be8c0db31e85e44c091d59e4e47ae401074d08ee3c994769fef71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:59:54.897 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:59:54 smithi159 podman[125726]: 2024-09-19 06:59:54.773177235 +0000 UTC m=+1.908533554 container cleanup 30fab5e7f69be8c0db31e85e44c091d59e4e47ae401074d08ee3c994769fef71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T06:59:54.897 INFO:journalctl@ceph.mds.a.smithi159.stdout:Sep 19 06:59:54 smithi159 bash[125726]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-a 2024-09-19T06:59:55.209 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T06:59:55.245 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:55.246 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T06:59:55.246 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T06:59:55.246 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.d 2024-09-19T06:59:55.648 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:59:55 smithi159 systemd[1]: Stopping Ceph mds.d for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T06:59:55.648 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:59:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-d[71177]: 2024-09-19T06:59:55.560+0000 7f793ebcf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:55.648 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:59:55 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-d[71177]: 2024-09-19T06:59:55.560+0000 7f793ebcf640 -1 mds.d *** got signal Terminated *** 2024-09-19T06:59:59.438 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:59:59 smithi159 podman[125849]: 2024-09-19 06:59:59.178609641 +0000 UTC m=+3.708676502 container died 7e716c69227407ba4775b913dc4fe223d3891fce65c6219ba5987f03d074c785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T06:59:59.898 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:59:59 smithi159 podman[125849]: 2024-09-19 06:59:59.644330705 +0000 UTC m=+4.174397561 container cleanup 7e716c69227407ba4775b913dc4fe223d3891fce65c6219ba5987f03d074c785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:59:59.898 INFO:journalctl@ceph.mds.d.smithi159.stdout:Sep 19 06:59:59 smithi159 bash[125849]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-d 2024-09-19T07:00:00.085 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T07:00:00.118 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:00.118 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T07:00:00.118 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T07:00:00.118 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.g 2024-09-19T07:00:00.433 INFO:journalctl@ceph.mds.g.smithi159.stdout:Sep 19 07:00:00 smithi159 systemd[1]: Stopping Ceph mds.g for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:00.897 INFO:journalctl@ceph.mds.g.smithi159.stdout:Sep 19 07:00:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-g[72061]: 2024-09-19T07:00:00.431+0000 7fc6030c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:00.897 INFO:journalctl@ceph.mds.g.smithi159.stdout:Sep 19 07:00:00 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-g[72061]: 2024-09-19T07:00:00.431+0000 7fc6030c4640 -1 mds.g *** got signal Terminated *** 2024-09-19T07:00:03.607 INFO:journalctl@ceph.mds.g.smithi159.stdout:Sep 19 07:00:03 smithi159 podman[125972]: 2024-09-19 07:00:03.346678703 +0000 UTC m=+3.009078381 container died f0f476929a60f86b79a80c9ed66afa23e93404ec826142937aa6e244fcda9fc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:00:03.900 INFO:journalctl@ceph.mds.g.smithi159.stdout:Sep 19 07:00:03 smithi159 podman[125972]: 2024-09-19 07:00:03.69803417 +0000 UTC m=+3.360433854 container cleanup f0f476929a60f86b79a80c9ed66afa23e93404ec826142937aa6e244fcda9fc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T07:00:03.900 INFO:journalctl@ceph.mds.g.smithi159.stdout:Sep 19 07:00:03 smithi159 bash[125972]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-g 2024-09-19T07:00:04.127 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T07:00:04.159 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:04.160 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T07:00:04.160 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T07:00:04.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.j 2024-09-19T07:00:04.648 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 07:00:04 smithi159 systemd[1]: Stopping Ceph mds.j for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:04.648 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 07:00:04 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-j[70777]: 2024-09-19T07:00:04.476+0000 7fd141acc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:04.648 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 07:00:04 smithi159 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-j[70777]: 2024-09-19T07:00:04.476+0000 7fd141acc640 -1 mds.j *** got signal Terminated *** 2024-09-19T07:00:07.877 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 07:00:07 smithi159 podman[126092]: 2024-09-19 07:00:07.621448641 +0000 UTC m=+3.238022033 container died f8ea31394b3d33f19d12f94d41b639917e6145267cdc9848f44773c10f958beb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T07:00:08.147 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 07:00:07 smithi159 podman[126092]: 2024-09-19 07:00:07.977108701 +0000 UTC m=+3.593682097 container cleanup f8ea31394b3d33f19d12f94d41b639917e6145267cdc9848f44773c10f958beb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T07:00:08.147 INFO:journalctl@ceph.mds.j.smithi159.stdout:Sep 19 07:00:07 smithi159 bash[126092]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-j 2024-09-19T07:00:08.394 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T07:00:08.427 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:08.427 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T07:00:08.427 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T07:00:08.427 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.b 2024-09-19T07:00:08.736 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 07:00:08 smithi189 systemd[1]: Stopping Ceph mds.b for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:09.040 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 07:00:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[68480]: 2024-09-19T07:00:08.735+0000 7f8aa420b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:09.040 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 07:00:08 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b[68480]: 2024-09-19T07:00:08.735+0000 7f8aa420b640 -1 mds.b *** got signal Terminated *** 2024-09-19T07:00:10.388 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 07:00:10 smithi189 podman[71732]: 2024-09-19 07:00:10.128929158 +0000 UTC m=+1.505920735 container died 01dd6900350242335a3cd0af9a763fb1e4b2b14dd6faa70a6117321eb4a5f536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T07:00:10.753 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 07:00:10 smithi189 podman[71732]: 2024-09-19 07:00:10.49334911 +0000 UTC m=+1.870340677 container cleanup 01dd6900350242335a3cd0af9a763fb1e4b2b14dd6faa70a6117321eb4a5f536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T07:00:10.753 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 19 07:00:10 smithi189 bash[71732]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-b 2024-09-19T07:00:10.920 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T07:00:10.956 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:10.956 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T07:00:10.956 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T07:00:10.956 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.e 2024-09-19T07:00:11.298 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 07:00:11 smithi189 systemd[1]: Stopping Ceph mds.e for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:11.637 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 07:00:11 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-e[64510]: 2024-09-19T07:00:11.297+0000 7f9439429640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:11.638 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 07:00:11 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-e[64510]: 2024-09-19T07:00:11.297+0000 7f9439429640 -1 mds.e *** got signal Terminated *** 2024-09-19T07:00:14.249 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 07:00:13 smithi189 podman[71866]: 2024-09-19 07:00:13.971238839 +0000 UTC m=+2.795043002 container died 4bdc73a359bf782758659511064ea42efb2e358fb86394f023278e490ab34359 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T07:00:14.623 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 07:00:14 smithi189 podman[71866]: 2024-09-19 07:00:14.347342344 +0000 UTC m=+3.171146493 container cleanup 4bdc73a359bf782758659511064ea42efb2e358fb86394f023278e490ab34359 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:00:14.624 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 19 07:00:14 smithi189 bash[71866]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-e 2024-09-19T07:00:14.780 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T07:00:14.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:14.814 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T07:00:14.814 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T07:00:14.814 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.h 2024-09-19T07:00:15.135 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 07:00:14 smithi189 systemd[1]: Stopping Ceph mds.h for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:15.388 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 07:00:15 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-h[64815]: 2024-09-19T07:00:15.134+0000 7f480571f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:15.388 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 07:00:15 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-h[64815]: 2024-09-19T07:00:15.134+0000 7f480571f640 -1 mds.h *** got signal Terminated *** 2024-09-19T07:00:18.138 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 07:00:17 smithi189 podman[71988]: 2024-09-19 07:00:17.881074737 +0000 UTC m=+2.845226257 container died fae9a2299096db957639135a94bb0538b59c38bfa3dfb8803bc4812ea23f3fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T07:00:18.510 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 07:00:18 smithi189 podman[71988]: 2024-09-19 07:00:18.234130415 +0000 UTC m=+3.198281931 container cleanup fae9a2299096db957639135a94bb0538b59c38bfa3dfb8803bc4812ea23f3fef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True) 2024-09-19T07:00:18.511 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 19 07:00:18 smithi189 bash[71988]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-h 2024-09-19T07:00:18.666 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T07:00:18.701 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:18.701 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T07:00:18.702 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T07:00:18.702 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.k 2024-09-19T07:00:19.096 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 07:00:18 smithi189 systemd[1]: Stopping Ceph mds.k for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:19.387 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 07:00:19 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-k[64210]: 2024-09-19T07:00:19.095+0000 7f0b4c181640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:19.388 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 07:00:19 smithi189 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-k[64210]: 2024-09-19T07:00:19.095+0000 7f0b4c181640 -1 mds.k *** got signal Terminated *** 2024-09-19T07:00:20.780 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 07:00:20 smithi189 podman[72112]: 2024-09-19 07:00:20.487689216 +0000 UTC m=+1.564846039 container died 44ac5cdd8d069f109a8b95888876671e2f7bb0bfd9a1215d19c063287483cc8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-k, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T07:00:21.114 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 07:00:20 smithi189 podman[72112]: 2024-09-19 07:00:20.879771002 +0000 UTC m=+1.956927814 container cleanup 44ac5cdd8d069f109a8b95888876671e2f7bb0bfd9a1215d19c063287483cc8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T07:00:21.114 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 19 07:00:20 smithi189 bash[72112]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-k 2024-09-19T07:00:21.258 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T07:00:21.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:21.292 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T07:00:21.292 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T07:00:21.292 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.c 2024-09-19T07:00:21.591 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 07:00:21 smithi203 systemd[1]: Stopping Ceph mds.c for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:22.091 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 07:00:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-c[65317]: 2024-09-19T07:00:21.598+0000 7f5db82b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:22.091 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 07:00:21 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-c[65317]: 2024-09-19T07:00:21.598+0000 7f5db82b0640 -1 mds.c *** got signal Terminated *** 2024-09-19T07:00:23.415 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 07:00:23 smithi203 podman[71973]: 2024-09-19 07:00:23.151596066 +0000 UTC m=+1.668871390 container died a5d9e09df2d070224c7451677ab965753e65b78746cd1f8aa4578553db32639a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T07:00:23.799 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 07:00:23 smithi203 podman[71973]: 2024-09-19 07:00:23.522983113 +0000 UTC m=+2.040258434 container cleanup a5d9e09df2d070224c7451677ab965753e65b78746cd1f8aa4578553db32639a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T07:00:23.800 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 07:00:23 smithi203 bash[71973]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-c 2024-09-19T07:00:23.955 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T07:00:23.990 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:23.990 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T07:00:23.990 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T07:00:23.991 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.f 2024-09-19T07:00:24.311 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 07:00:24 smithi203 systemd[1]: Stopping Ceph mds.f for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:24.591 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 07:00:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-f[65015]: 2024-09-19T07:00:24.310+0000 7f7ec6151640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:24.592 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 07:00:24 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-f[65015]: 2024-09-19T07:00:24.310+0000 7f7ec6151640 -1 mds.f *** got signal Terminated *** 2024-09-19T07:00:28.592 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 07:00:28 smithi203 podman[72093]: 2024-09-19 07:00:28.32209745 +0000 UTC m=+4.110649053 container died 6e733e568cd8fe321b104d8d426603090e8e17bbf95fb7a3fbd1f5c646137f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-f, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T07:00:28.945 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 07:00:28 smithi203 podman[72093]: 2024-09-19 07:00:28.726813465 +0000 UTC m=+4.515365078 container cleanup 6e733e568cd8fe321b104d8d426603090e8e17bbf95fb7a3fbd1f5c646137f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T07:00:28.945 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 07:00:28 smithi203 bash[72093]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-f 2024-09-19T07:00:29.086 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T07:00:29.119 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:29.119 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T07:00:29.120 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T07:00:29.120 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.i 2024-09-19T07:00:29.456 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 07:00:29 smithi203 systemd[1]: Stopping Ceph mds.i for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:29.841 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 07:00:29 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i[65616]: 2024-09-19T07:00:29.455+0000 7f244d8c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:29.842 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 07:00:29 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i[65616]: 2024-09-19T07:00:29.455+0000 7f244d8c2640 -1 mds.i *** got signal Terminated *** 2024-09-19T07:00:33.740 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 07:00:33 smithi203 podman[72212]: 2024-09-19 07:00:33.460963837 +0000 UTC m=+4.128464657 container died d8bd847cff05b60ead06d529b9d66c5bcaf3709090dd7000043893fea4eff3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:00:34.092 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 07:00:33 smithi203 podman[72212]: 2024-09-19 07:00:33.839088297 +0000 UTC m=+4.506589125 container cleanup d8bd847cff05b60ead06d529b9d66c5bcaf3709090dd7000043893fea4eff3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T07:00:34.092 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 07:00:33 smithi203 bash[72212]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-i 2024-09-19T07:00:34.424 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T07:00:34.456 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:34.457 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T07:00:34.457 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T07:00:34.457 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.l 2024-09-19T07:00:34.841 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 07:00:34 smithi203 systemd[1]: Stopping Ceph mds.l for 82c73dba-7651-11ef-bceb-c7b262605968... 2024-09-19T07:00:34.842 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 07:00:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-l[64711]: 2024-09-19T07:00:34.776+0000 7f5db2494640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:00:34.842 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 07:00:34 smithi203 ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-l[64711]: 2024-09-19T07:00:34.776+0000 7f5db2494640 -1 mds.l *** got signal Terminated *** 2024-09-19T07:00:37.919 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 07:00:37 smithi203 podman[72331]: 2024-09-19 07:00:37.654442445 +0000 UTC m=+2.985139438 container died ecef4d148ff30547809c8f17bab59d7da8ac1c5a7bafa73bd98572ae992995df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T07:00:38.203 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 07:00:38 smithi203 podman[72331]: 2024-09-19 07:00:38.001322384 +0000 UTC m=+3.332019308 container cleanup ecef4d148ff30547809c8f17bab59d7da8ac1c5a7bafa73bd98572ae992995df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T07:00:38.204 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 07:00:38 smithi203 bash[72331]: ceph-82c73dba-7651-11ef-bceb-c7b262605968-mds-l 2024-09-19T07:00:38.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-82c73dba-7651-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T07:00:38.450 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:00:38.450 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T07:00:38.450 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 82c73dba-7651-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:00:38.653 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T07:00:41.206 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 82c73dba-7651-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:00:41.408 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T07:00:43.861 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 82c73dba-7651-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:00:44.064 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T07:00:46.451 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:00:46.485 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:00:46.518 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:00:46.546 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T07:00:46.547 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751/remote/smithi159/crash 2024-09-19T07:00:46.548 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:00:46.588 INFO:teuthology.orchestra.run.smithi159.stderr:tar: /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:00:46.588 INFO:teuthology.orchestra.run.smithi159.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:00:46.590 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751/remote/smithi189/crash 2024-09-19T07:00:46.591 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:00:46.629 INFO:teuthology.orchestra.run.smithi189.stderr:tar: /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:00:46.629 INFO:teuthology.orchestra.run.smithi189.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:00:46.631 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751/remote/smithi203/crash 2024-09-19T07:00:46.632 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:00:46.673 INFO:teuthology.orchestra.run.smithi203.stderr:tar: /var/lib/ceph/82c73dba-7651-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:00:46.673 INFO:teuthology.orchestra.run.smithi203.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:00:46.674 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T07:00:46.674 DEBUG:teuthology.orchestra.run.smithi159:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T07:00:46.714 INFO:tasks.cephadm:Compressing logs... 2024-09-19T07:00:46.714 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:00:46.756 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:00:46.759 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:00:46.781 INFO:teuthology.orchestra.run.smithi159.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T07:00:46.781 INFO:teuthology.orchestra.run.smithi159.stderr:: No such file or directory 2024-09-19T07:00:46.781 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T07:00:46.782 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:00:46.782 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:00:46.782 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T07:00:46.786 INFO:teuthology.orchestra.run.smithi203.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:00:46.786 INFO:teuthology.orchestra.run.smithi203.stderr:: No such file or directory 2024-09-19T07:00:46.786 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:00:46.786 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T07:00:46.786 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T07:00:46.787 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:00:46.787 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T07:00:46.787 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T07:00:46.787 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.i.log: /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.cephadm.log: /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.11.log: /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.2.log: 82.0% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:00:46.787 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T07:00:46.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:00:46.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T07:00:46.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T07:00:46.789 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:00:46.789 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T07:00:46.789 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.g.log: -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:00:46.789 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.4% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:00:46.789 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T07:00:46.789 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log: 94.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T07:00:46.793 INFO:teuthology.orchestra.run.smithi189.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T07:00:46.793 INFO:teuthology.orchestra.run.smithi189.stderr:: No such file or directory 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr: 94.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:00:46.794 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.cephadm.log: /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mgr.y.log: 82.1% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:00:46.795 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T07:00:46.799 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:00:46.799 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.5.log: /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:00:46.799 INFO:teuthology.orchestra.run.smithi203.stderr: 87.3% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:00:46.800 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T07:00:46.800 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T07:00:46.800 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T07:00:46.800 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.7% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T07:00:46.800 INFO:teuthology.orchestra.run.smithi203.stderr: 90.9% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:00:46.800 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T07:00:46.800 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T07:00:46.801 INFO:teuthology.orchestra.run.smithi159.stderr: 94.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T07:00:46.801 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T07:00:46.802 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:00:46.802 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T07:00:46.802 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T07:00:46.802 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T07:00:46.802 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:00:46.802 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.3.log: 94.7% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T07:00:46.802 INFO:teuthology.orchestra.run.smithi159.stderr: 91.1% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:00:46.805 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log: 87.3% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:00:46.805 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T07:00:46.805 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:00:46.805 INFO:teuthology.orchestra.run.smithi189.stderr: 94.5% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T07:00:46.805 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T07:00:46.805 INFO:teuthology.orchestra.run.smithi189.stderr: 91.9% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T07:00:46.805 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:00:46.805 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:00:46.806 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.c.log: 94.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T07:00:46.807 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/cephadm.log: 94.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:00:46.807 INFO:teuthology.orchestra.run.smithi203.stderr: 91.9% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T07:00:46.808 INFO:teuthology.orchestra.run.smithi189.stderr: 94.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T07:00:46.808 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:00:46.809 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:00:46.812 INFO:teuthology.orchestra.run.smithi203.stderr: 94.5% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T07:00:47.086 INFO:teuthology.orchestra.run.smithi203.stderr: 91.7% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T07:00:47.151 INFO:teuthology.orchestra.run.smithi159.stderr: 90.2% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T07:00:47.228 INFO:teuthology.orchestra.run.smithi189.stderr: 91.8% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T07:00:47.965 INFO:teuthology.orchestra.run.smithi159.stderr: 90.4% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T07:00:50.814 INFO:teuthology.orchestra.run.smithi189.stderr: 95.8% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T07:00:53.597 INFO:teuthology.orchestra.run.smithi159.stderr: 91.9% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T07:00:53.691 INFO:teuthology.orchestra.run.smithi159.stderr: 91.9% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T07:00:54.129 INFO:teuthology.orchestra.run.smithi203.stderr: 91.7% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T07:00:55.105 INFO:teuthology.orchestra.run.smithi159.stderr: 92.0% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T07:00:55.829 INFO:teuthology.orchestra.run.smithi189.stderr: 91.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T07:00:56.164 INFO:teuthology.orchestra.run.smithi189.stderr: 91.8% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T07:00:56.317 INFO:teuthology.orchestra.run.smithi189.stderr: 91.8% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T07:00:57.539 INFO:teuthology.orchestra.run.smithi203.stderr: 91.8% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T07:00:57.709 INFO:teuthology.orchestra.run.smithi189.stderr: 91.8% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T07:00:57.711 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-19T07:00:57.711 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m10.938s 2024-09-19T07:00:57.711 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m41.976s 2024-09-19T07:00:57.711 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m1.351s 2024-09-19T07:00:58.142 INFO:teuthology.orchestra.run.smithi159.stderr: 91.9% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T07:00:58.144 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-09-19T07:00:58.144 INFO:teuthology.orchestra.run.smithi159.stderr:real 0m11.374s 2024-09-19T07:00:58.145 INFO:teuthology.orchestra.run.smithi159.stderr:user 0m33.730s 2024-09-19T07:00:58.145 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m1.193s 2024-09-19T07:00:59.055 INFO:teuthology.orchestra.run.smithi203.stderr: 92.4% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T07:00:59.835 INFO:teuthology.orchestra.run.smithi203.stderr: 91.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T07:01:27.446 INFO:teuthology.orchestra.run.smithi203.stderr: 93.6% -- replaced with /var/log/ceph/82c73dba-7651-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T07:01:27.448 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-19T07:01:27.448 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m40.674s 2024-09-19T07:01:27.448 INFO:teuthology.orchestra.run.smithi203.stderr:user 1m21.644s 2024-09-19T07:01:27.448 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m2.640s 2024-09-19T07:01:27.449 INFO:tasks.cephadm:Archiving logs... 2024-09-19T07:01:27.449 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751/remote/smithi159/log 2024-09-19T07:01:27.450 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:01:32.872 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751/remote/smithi189/log 2024-09-19T07:01:32.873 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:01:39.730 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751/remote/smithi203/log 2024-09-19T07:01:39.731 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:01:51.854 INFO:tasks.cephadm:Removing cluster... 2024-09-19T07:01:51.854 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 82c73dba-7651-11ef-bceb-c7b262605968 --force 2024-09-19T07:01:52.057 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T07:01:52.362 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 82c73dba-7651-11ef-bceb-c7b262605968 --force 2024-09-19T07:01:52.570 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T07:01:52.888 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 82c73dba-7651-11ef-bceb-c7b262605968 --force 2024-09-19T07:01:53.091 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: 82c73dba-7651-11ef-bceb-c7b262605968 2024-09-19T07:01:53.458 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T07:01:53.458 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:01:53.478 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:01:53.495 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:01:53.510 INFO:tasks.cephadm:Teardown complete 2024-09-19T07:01:53.511 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T07:01:53.528 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T07:01:53.528 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:01:53.530 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:01:53.537 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:01:53.650 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T07:01:53.662 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T07:01:53.663 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:01:53.665 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:01:53.668 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:01:53.679 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:01:53.680 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:01:53.682 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:01:53.685 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:01:53.685 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-19T07:01:53.685 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +430us[ +431us] +/- 43ms 2024-09-19T07:01:53.685 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 65 -995us[ -994us] +/- 70ms 2024-09-19T07:01:53.685 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 +264us[ +264us] +/- 68ms 2024-09-19T07:01:53.685 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:01:53.686 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:01:53.686 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-19T07:01:53.686 INFO:teuthology.orchestra.run.smithi159.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +431us[ +423us] +/- 44ms 2024-09-19T07:01:53.686 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -1083us[-1091us] +/- 71ms 2024-09-19T07:01:53.686 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 1 +259us[ +251us] +/- 68ms 2024-09-19T07:01:53.686 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:01:53.687 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:01:53.687 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-19T07:01:53.687 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +457us[ +464us] +/- 44ms 2024-09-19T07:01:53.687 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -1048us[-1042us] +/- 71ms 2024-09-19T07:01:53.687 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +273us[ +280us] +/- 68ms 2024-09-19T07:01:53.687 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:01:53.688 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T07:01:53.700 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T07:01:53.701 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T07:01:53.718 DEBUG:teuthology.orchestra.run.smithi159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:01:53.810 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:01:53.878 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:01:53.947 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:01:53.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:01:53.977 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:01:54.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:01:54.006 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:01:54.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:01:54.034 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T07:01:54.048 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T07:01:54.107 INFO:teuthology.task.internal:Duration was 1884.340803 seconds 2024-09-19T07:01:54.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T07:01:54.122 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T07:01:54.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:01:54.125 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:01:54.128 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:01:54.163 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:01:54.164 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:01:54.167 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:01:54.684 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T07:01:54.684 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2024-09-19T07:01:54.685 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:01:54.706 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-19T07:01:54.707 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:01:54.751 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-09-19T07:01:54.751 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:01:54.777 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T07:01:54.778 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:01:54.780 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:01:54.795 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:01:54.845 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T07:01:54.845 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:01:54.848 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:01:54.861 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:01:55.831 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T07:01:55.846 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T07:01:55.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:01:55.870 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:01:55.901 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:01:55.931 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T07:01:55.949 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:01:55.952 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:01:55.955 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:01:55.972 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2024-09-19T07:01:55.980 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-19T07:01:55.998 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-09-19T07:01:56.131 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:01:56.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:01:56.146 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:01:56.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:01:56.162 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:01:56.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:01:56.188 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T07:01:56.201 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T07:01:56.202 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751/remote/smithi159 2024-09-19T07:01:56.203 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:01:56.264 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751/remote/smithi189 2024-09-19T07:01:56.264 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:01:56.303 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911751/remote/smithi203 2024-09-19T07:01:56.303 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:01:56.344 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T07:01:56.344 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:01:56.347 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:01:56.349 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:01:56.396 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T07:01:56.413 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T07:01:56.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T07:01:56.425 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T07:01:56.425 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:01:56.427 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:01:56.430 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:01:56.439 INFO:teuthology.orchestra.run.smithi159.stdout: 265625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:01 /home/ubuntu/cephtest 2024-09-19T07:01:56.444 INFO:teuthology.orchestra.run.smithi189.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:01 /home/ubuntu/cephtest 2024-09-19T07:01:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:01 /home/ubuntu/cephtest 2024-09-19T07:01:56.455 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T07:01:56.467 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T07:01:56.494 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} duration: 1884.3408031463623 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T07:01:56.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T07:01:56.579 INFO:teuthology.run:pass